V2 Multi-Stage Query Engine
Last updated
Was this helpful?
Last updated
Was this helpful?
The new multi-stage query engine (a.k.a V2 query engine) is designed to support more complex SQL semantics such as JOIN
, OVER
window, MATCH_RECOGNIZE
and eventually, make Pinot support closer to full ANSI SQL semantics.
It also resolves the bottleneck effect for the broker reduce stage where only a single machine is dedicated to perform heavy lifting such as high cardinality GROUP BY
result merging; ORDER BY
sorting, etc.
To enable the V2 engine,
please make sure to either
Please add the following configurations to your cluster config:
Start the cluster normally, you should see the following window in the controller query page:
The overall PEP design doc and discussion can be found in the following links
using the latest master commit.
Download the latest Apache Pinot docker image using the .
and