Please refer to key metrics documented in monitoring pinot.
Pinot uses yammer MetricsRegistry to collect metrics within our application components. These metrics can be published to a metrics server with the help of MetricsRegistryRegistrationListener interface. By default, metrics are published to JMX using the JmxReporterMetricsRegistryRegistrationListener.
You can write a listener to publish metrics to another metrics server by implementing the
MetricsRegistryRegistrationListener interface. This listener can be injected into the controller by setting the fully qualified name of the class in the controller configs for the property
You would have to design your own systems to view and monitor these metrics. A list of all the metrics published for each component can be found in:
Metrics published to JMX could also be exposed to Prometheus through tooling like jmx_reporter.
ALL_JAVA_OPTS="-javaagent:jmx_prometheus_javaagent-0.12.0.jar=8080:pinot.yml -Xms4G -Xmx4G -XX:MaxDirectMemorySize=30g -Dlog4j2.configurationFile=conf/pinot-admin-log4j2.xml -Dplugins.dir=$BASEDIR/plugins"bin/pinot-admin.sh ....
This will expose a port at 8080 to dump metrics as Prometheus format for Prometheus scrapper to fetch.