Server

Servers host the data segments and serve queries off the data they host. There's two types of servers
Offline
Offline servers are responsible for downloading segments from the segment store, to host and serve queries off. When a new segment is uploaded to the controller, the controller decides the servers (as many as replication) that will host the new segment and notifies them to download the segment from the segment store. On receiving this notification, the servers download the segment file and load the segment onto the server, to server queries off them.
Realtime
Real time servers directly ingest from a real time stream (such as Kafka, EventHubs). Periodically, they make segments of the in-memory ingested data, based on certain thresholds. This segment is then persisted onto the segment store.
Pinot Servers are modeled as Helix Participants, hosting Pinot tables (referred to as resources in helix terminology). Segments of a table are modeled as Helix partitions (of a resource). Thus, a Pinot server hosts one or more helix partitions of one or more helix resources (i.e. one or more segments of one or more tables).
Starting a Server
Make sure you've setup Zookeeper. If you're using docker, make sure to pull the pinot docker image.  To start a server 
1
Usage: StartServer
2
	-serverHost               <String>                      : Host name for controller. (required=false)
3
	-serverPort               <int>                         : Port number to start the server at. (required=false)
4
	-serverAdminPort          <int>                         : Port number to serve the server admin API at. (required=false)
5
	-dataDir                  <string>                      : Path to directory containing data. (required=false)
6
	-segmentDir               <string>                      : Path to directory containing segments. (required=false)
7
	-zkAddress                <http>                        : Http address of Zookeeper. (required=false)
8
	-clusterName              <String>                      : Pinot cluster name. (required=false)
9
	-configFileName           <Config File Name>            : Broker Starter Config file. (required=false)
10
	-help                                                   : Print this message. (required=false)
Copied!
​
​
Docker Image
Launcher Scripts
1
docker run \
2
    --network=pinot-demo \
3
    --name pinot-server \
4
    -d ${PINOT_IMAGE} StartServer \
5
    -zkAddress pinot-zookeeper:2181
Copied!
1
bin/pinot-admin.sh StartServer \
2
    -zkAddress localhost:2181
Copied!
USAGE
1
Usage: StartServer
2
	-serverHost               <String>                      : Host name for controller. (required=false)
3
	-serverPort               <int>                         : Port number to start the server at. (required=false)
4
	-serverAdminPort          <int>                         : Port number to serve the server admin API at. (required=false)
5
	-dataDir                  <string>                      : Path to directory containing data. (required=false)
6
	-segmentDir               <string>                      : Path to directory containing segments. (required=false)
7
	-zkAddress                <http>                        : Http address of Zookeeper. (required=false)
8
	-clusterName              <String>                      : Pinot cluster name. (required=false)
9
	-configFileName           <Config File Name>            : Server Starter Config file. (required=false)
10
	-help                                                   : Print this message. (required=false)
Copied!

Broker

Minion

Last modified 1yr ago

Copy link

Contents

Starting a Server