Design Documents

Links to all the design docs

This page contains links to all the design documents
Name
Authors
Date
​Segment Writer API​
Neha Pawar
Feb 2021
​Kinesis Integration in Pinot 
Neha Pawar
Dec 2020
​JSON Indexing​
Kishore Gopalakrishna
Oct 2020
​Lookup Join​
Dharak Kharod
Oct 2020
​Strict Replica-Group Routing​
Jackie Jiang
Oct 2020
​Cluster Manager UI​
Neha Pawar
Sep 2020
​Pinot Upsert Revisited​
Yupeng Fu
Sep 2020
​Use IdSet for Id Filtering​
Jackie Jiang
Sep 2020
​Pinot managed offline flows​
Neha
Aug 2020
​Server Health Checker​
Chinmay
Aug 2020
​HAVING and Post-Aggregation Support​
Jackie Jiang
July 2020
​Segment Merge and Rollup (Updated)​
Seunghyun
June 2020
​Filtering during ingestion​
Neha
June 2020
​Segment Preprocessing Hadoop Job​
Jialiang Li
May 2020
​Flattening during ingestion​
Neha
May 2020
​Compatibility Regression Testing​
Subbu
May 2020
​Refactor pinot-core and pinot-common​
Kishore
May 2020
​Range Indexing in Pinot​
Kishore
Apr 2020
​Deprecate TimeFieldSpec, make DateTimeFieldSpec mainstream​
Neha
Apr 2020
​Geospatial support in Pinot​
Yupeng Fu
Apr 2020
​Column transformation during ingestion​
Neha
Mar 2020
​Tiered Storage​
Neha
Mar 2020
​Synthetic Data Generator for Pinot​
Alex Pucher
Mar 2020
​Text Search ​
Siddharth Teotia
Nov 2019
​Pinot SQL migration Plan​
Xiang Fu
Nov 2019
​Segment Admin Rest APIs​
Jackie Jiang
Nov 2019
​Order By in aggregations​
Neha
Oct 2019
​Pinot Benchmark as a Service​
Jialiang Li
Sep 2019
​Controller Separation between Helix and Pinot​
Jialiang Li
Jun 2019
​Upsert​
James
Jun 2019
​Pinot Freshness Metric​
Sunitha Beeram
May 2019
​By passing deep-store requirement for Realtime segment completion​
Ting, Chinmay
May 2019
​Project Tuna: Automatic Inverted Index Recommendation​
Jia Guo
May 2019
​Segment Completion Enhancement for deep storage support​
Subbu
Feb 2019
​Segment Merge and Rollup​
Seunghyun Lee
2018
​Pinot-Minion Service​
Jackie Jiang
2017
​Consuming and indexing rows in realtime​
Subbu
2017
​Partition Aware Query Routing​
Subbu
2017
​Query Processing​
Subbu
2016
​Expressions and UDFs​
Subbu
2016

Stream Ingestion Plugin

Next - For Operators

Deployment and Monitoring

Last updated 2 weeks ago

Name	Authors	Date
Segment Writer API	Neha Pawar	Feb 2021
Kinesis Integration in Pinot	Neha Pawar	Dec 2020
JSON Indexing	Kishore Gopalakrishna	Oct 2020
Lookup Join	Dharak Kharod	Oct 2020
Strict Replica-Group Routing	Jackie Jiang	Oct 2020
Cluster Manager UI	Neha Pawar	Sep 2020
Pinot Upsert Revisited	Yupeng Fu	Sep 2020
Use IdSet for Id Filtering	Jackie Jiang	Sep 2020
Pinot managed offline flows	Neha	Aug 2020
Server Health Checker	Chinmay	Aug 2020
HAVING and Post-Aggregation Support	Jackie Jiang	July 2020
Segment Merge and Rollup (Updated)	Seunghyun	June 2020
Filtering during ingestion	Neha	June 2020
Segment Preprocessing Hadoop Job	Jialiang Li	May 2020
Flattening during ingestion	Neha	May 2020
Compatibility Regression Testing	Subbu	May 2020
Refactor pinot-core and pinot-common	Kishore	May 2020
Range Indexing in Pinot	Kishore	Apr 2020
Deprecate TimeFieldSpec, make DateTimeFieldSpec mainstream	Neha	Apr 2020
Geospatial support in Pinot	Yupeng Fu	Apr 2020
Column transformation during ingestion	Neha	Mar 2020
Tiered Storage	Neha	Mar 2020
Synthetic Data Generator for Pinot	Alex Pucher	Mar 2020
Text Search	Siddharth Teotia	Nov 2019
Pinot SQL migration Plan	Xiang Fu	Nov 2019
Segment Admin Rest APIs	Jackie Jiang	Nov 2019
Order By in aggregations	Neha	Oct 2019
Pinot Benchmark as a Service	Jialiang Li	Sep 2019
Controller Separation between Helix and Pinot	Jialiang Li	Jun 2019
Upsert	James	Jun 2019
Pinot Freshness Metric	Sunitha Beeram	May 2019
By passing deep-store requirement for Realtime segment completion	Ting, Chinmay	May 2019
Project Tuna: Automatic Inverted Index Recommendation	Jia Guo	May 2019
Segment Completion Enhancement for deep storage support	Subbu	Feb 2019
Segment Merge and Rollup	Seunghyun Lee	2018
Pinot-Minion Service	Jackie Jiang	2017
Consuming and indexing rows in realtime	Subbu	2017
Partition Aware Query Routing	Subbu	2017
Query Processing	Subbu	2016
Expressions and UDFs	Subbu	2016