Stream Ingestion
Choose stream ingestion when Pinot should consume events continuously and expose new rows quickly.
Last updated
Was this helpful?
⌘Ctrlk
Choose stream ingestion when Pinot should consume events continuously and expose new rows quickly.
Stream ingestion keeps Pinot close to the source of truth. Use it when rows should be queryable soon after they are emitted, and when the system needs a steady flow rather than periodic batch loads.
Pick the stream connector and partitioning strategy.
Choose how Pinot should flush, commit, and complete segments.
Decide whether the table should remain purely realtime or later become hybrid.
The stream has to support the consumption mode you choose. The table config has to describe the partitioning, replicas, and segment lifecycle clearly enough that the servers can behave predictably under load.
The existing walk-throughs in Import Data and Data Ingestion Overview still contain the detailed mechanics.
This page covered the stream-ingestion model and the main lifecycle choices behind it.
Read Upsert and Dedup if the stream should collapse duplicate keys or keep only the latest row.
Last updated
Was this helpful?
Was this helpful?