Blogs

A curated list of blog posts about Apache Pinot and related systems

Apache Pinot Official Blog

Visit the Apache Pinot Blog for the latest posts from the Pinot community.

2024

• Apache Pinot Year in Review 2024 - Peter Corless (Dec 2024)

• Pinot for Low-Latency Offline Table Analytics - Ankit Sultana, Caner Balci, Uber Data Team (Sep 2024)

• The Power of Apache Pinot: Why I Chose It for Real-Time Analytics - Unais Yousha Siddiqui (Sep 2024)

• Build a real-time analytics solution with Apache Pinot on AWS - Raj Ramasubbu, Francisco Morillo, Ismail Makhlouf (Aug 2024)

2023

• Announcing Apache Pinot 1.0 - Hubert Dulay, Mayank Shrivastava, Neha Pawar (Sep 2023)

• Segment Compaction for Upsert Enabled Tables in Apache Pinot - Robert Zych (Aug 2023)

• Star-Tree Index in Apache Pinot - Part 3 - Understanding the Impact in Real Customer Scenarios - Sandeep Dabade, Kulbir Nijjer (Jul 2023)

• Real-Time Mastodon Usage with Apache Kafka, Apache Pinot, and Streamlit - Mark Needham (Jun 2023)

• How to Ingest Streaming Data from Kafka to Apache Pinot - Barkha Herman (May 2023)

• Change Data Capture with Apache Pinot - How Does It Work? - Hubert Dulay (May 2023)

• Apache Pinot Tutorial for Getting Started - A Step-by-Step Guide - Barkha Herman (May 2023)

• StarTree Indexes in Apache Pinot Part-1 - Understanding the Impact on Query Performance - Sandeep Dabade (May 2023)

• Geospatial Indexing in Apache Pinot - Mark Needham (May 2023)

• Apache Pinot 0.12 - Consumer Record Lag - Mark Needham (Mar 2023)

• Apache Pinot 0.12 - Configurable Time Boundary - Mark Needham (Feb 2023)

• Apache Pinot 0.11 - Deduplication on Real-Time Tables - Mark Needham (Jan 2023)

2022

• Apache Pinot 0.11 - Pausing Real-Time Ingestion - Mark Needham (Nov 2022)

• Apache Pinot 0.11 - Timestamp Indexes - Mark Needham (Nov 2022)

• Apache Pinot 0.11 - Inserts from SQL - Mark Needham (Nov 2022)

• Apache Pinot 0.11 - How do I see my indexes? - Mark Needham (Nov 2022)

• GapFill Function For Time-Series Datasets In Pinot - Weixiang Sun, Lakshmanan Velusamy (Aug 2022)

• Announcing Apache Pinot 0.10 (Apr 2022)

2021

• Text analytics on LinkedIn Talent Insights using Apache Pinot - LinkedIn Engineering (Jun 2021)

• Introduction to Geospatial Queries in Apache Pinot - Hubert Dulay (Jun 2021)

• Automating Merchant Live Monitoring with Real-Time Analytics - Charon - Uber Data Team (Apr 2021)

• Deploying Apache Pinot at a Large Retail Chain (Apr 2021)

• Solving for the cardinality of set intersection at scale with Pinot and Theta Sketches - LinkedIn Engineering (Apr 2021)

• Introduction to Upserts in Apache Pinot - Hubert Dulay (Apr 2021)

• Real-time Analytics with Presto and Apache Pinot (Feb 2021)

• Change Data Analysis with Debezium and Apache Pinot - Hubert Dulay (Jan 2021)

2020

• From Lambda to Lambda-less Lessons learned - LinkedIn Engineering (Dec 2020)

• Operating Apache Pinot at Uber Scale - Uber Data Team (Oct 2020)

• Deep Analysis of Russian Twitter Trolls - Hubert Dulay (Oct 2020)

• Building a Climate Dashboard with Apache Pinot and Superset - Apache Pinot Developer Blog (Sep 2020)

• Leverage Plugins to Ingest Parquet Files from S3 in Pinot (Aug 2020)

• Monitoring Apache Pinot with JMX, Prometheus and Grafana (Aug 2020)

• Achieving 99th percentile latency SLA using Apache Pinot (Aug 2020)

• Utilize UDFs to Supercharge Queries in Apache Pinot (Aug 2020)

• Building a culture around metrics and anomaly detection - Hubert Dulay (Jul 2020)

• Moving developers up the stack with Apache Pinot - Hubert Dulay (Jul 2020)

• Bridging batch and stream processing for the Recruiter usage statistics dashboard - LinkedIn Engineering (Jul 2020)

• Building LinkedIn Talent Insights to democratize data-driven decision making - LinkedIn Engineering (Jun 2020)

• Monitoring business performance data with ThirdEye smart alerts - LinkedIn Engineering (Jun 2020)

• Exploring OLAP on Kubernetes with Apache Pinot - Apache Pinot Developer Blog (Jun 2020)

• Introducing Apache Pinot 0.3.0 - LinkedIn Engineering (Apr 2020)

• Using Apache Pinot and Kafka to Analyze GitHub Events - Apache Pinot Developer Blog (Apr 2020)

• Analyzing anomalies with ThirdEye - LinkedIn Engineering (Feb 2020)

• Engineering SQL Support on Apache Pinot at Uber - Uber Engineering (Jan 2020)

2019

• Auto-Tuning Pinot Real-Time Consumption - LinkedIn Engineering (Jul 2019)

• Star-Tree Index: Powering Fast Aggregations on Pinot - LinkedIn Engineering (Jun 2019)

• Smart Alerts in ThirdEye, LinkedIn's Real-Time Monitoring Platform - LinkedIn Engineering (Jun 2019)

• Pinot Joins Apache Incubator - LinkedIn Engineering (Mar 2019)

• Introducing ThirdEye: LinkedIn's Business-Wide Monitoring Platform - LinkedIn Engineering (Jan 2019)

2017

• Engineering Restaurant Manager, our UberEATS Analytics Dashboard - Uber Engineering (Sep 2017)

2015

• Open Sourcing Pinot: Scaling the Wall of Real-Time Analytics - LinkedIn Engineering (Jun 2015)

• A Brief History of Scaling LinkedIn - LinkedIn Engineering (May 2015)

Engineering Blogs from Adopters

Uber Engineering

• Rebuilding Uber's Apache Pinot Query Architecture (Jan 2025)

• Serving Millions of Apache Pinot Queries with Neutrino (Dec 2024)

• Building Zone Failure Resilience in Apache Pinot at Uber (Nov 2024)

LinkedIn Engineering

• Real-time analytics on network flow data with Apache Pinot (2022)

• Text analytics on LinkedIn Talent Insights using Apache Pinot (2021)

Grab Engineering

• Powering Partner Gateway metrics with Apache Pinot

Third-Party Blogs and Tutorials

Medium / Apache Pinot Developer Blog

• Optimizing Workflow Log Management with Apache Pinot: An Upsert Approach (Sep 2024)

• Apache Pinot 0.11 Released (Sep 2022)

• Real-time Analytics with Presto and Apache Pinot — Part I (Sep 2022)

• CDC-based Upserts with Debezium, Apache Kafka, and Apache Pinot (Jul 2022)

• Moving developers up the stack with Apache Pinot (Dec 2021)

• Announcing Apache Pinot 0.7.1 (Apr 2021)

Industry Analyst Coverage

• Apache Pinot 1.0 Provides a Realtime Distributed OLAP Datastore - InfoQ (Dec 2023)

• Building Latency Sensitive User Facing Analytics via Apache Pinot - InfoQ

Cloud Provider Blogs

• Build a real-time analytics solution with Apache Pinot on AWS - AWS Big Data Blog (Aug 2024)

Confluent

• Real-Time Analytics with Apache Kafka and Pinot - Confluent Blog (2020)

DZone

• How to Stream Sensor Data to Apache Pinot for Real Time Analysis

• Setting up Apache Pinot on Kubernetes in Under 15 Minutes

Other

• Real-Time App Performance Monitoring with Apache Pinot - Analytics Vidhya (Sep 2024)

• Exploring Apache Pinot - Auriga IT (2024)

StarTree Resources

For StarTree-specific blog posts on Apache Pinot features, best practices, and use cases, visit the StarTree Resources page.

Notable posts include:

• Apache Kafka and Apache Pinot – Built together to work together

• Consistent, Scalable Compaction for Real-Time Upserts in Apache Pinot (Mar 2025)

• Inside the flight path of real-time ingestion in Apache Pinot (Part 2) (Mar 2025)

• Apache Pinot – a scalable alternative to ElasticSearch for log analytics (2025)

• Flattening JSON Objects in Pinot for Performance and Efficiency (2025)

• Apache Pinot Year in Review 2024 (Dec 2024)

• Clickstream and Funnel Analysis with Apache Pinot and StarTree (2024)

• Introducing Tiered Storage in Apache Pinot (2023)

• Grape to Glass: Apache Pinot 1.0 Uncorked (2023)

• What Makes Apache Pinot Fast - Part 1

• Capacity Planning in Apache Pinot - Part 1

• Best Practice Table Design In Apache Pinot

• Apache Pinot 2021 Recap and 2022 Roadmap