# Operate Pinot - [Deployment](https://docs.pinot.apache.org/operate-pinot/deployment.md) - [Set Up Cluster](https://docs.pinot.apache.org/operate-pinot/deployment/setup-cluster.md) - [Advanced Pinot Setup](https://docs.pinot.apache.org/operate-pinot/deployment/advanced-pinot-setup.md) - [Server Startup Status Checkers](https://docs.pinot.apache.org/operate-pinot/deployment/server-startup-status-checkers.md) - [Set Up Table](https://docs.pinot.apache.org/operate-pinot/deployment/setup-table.md) - [Set Up Ingestion](https://docs.pinot.apache.org/operate-pinot/deployment/setup-ingestion.md) - [Decoupling Controller from the Data Path](https://docs.pinot.apache.org/operate-pinot/deployment/decoupling-controller-from-the-data-path.md): Decouple the controller from the data path for real-time Pinot tables. - [Command-Line Interface (CLI)](https://docs.pinot.apache.org/operate-pinot/deployment/cli.md) - [Configuration Recommendation Engine](https://docs.pinot.apache.org/operate-pinot/deployment/configuration-recommendation-engine.md): This page describes the automated mechanisms we have for recommending a suitable configuration for your deployment. - [Security](https://docs.pinot.apache.org/operate-pinot/security.md) - [Security Hardening Guide](https://docs.pinot.apache.org/operate-pinot/security/security-hardening.md): Operator-facing guide to hardening an Apache Pinot cluster for production - [Access Control](https://docs.pinot.apache.org/operate-pinot/security/access-control.md) - [Authentication](https://docs.pinot.apache.org/operate-pinot/security/authentication.md): Set up HTTP basic auth and ACLs for access to controller and broker - [Basic Auth Access Control](https://docs.pinot.apache.org/operate-pinot/security/authentication/basic-auth-access-control.md): Set up BasicAuthAccessControl for access to controller and broker - [ZkBasicAuthAccessControl](https://docs.pinot.apache.org/operate-pinot/security/authentication/zkbasicauthaccesscontrol.md): Set up ZkBasicAuthAccessControl for access to controller and broker - [Configuring TLS/SSL](https://docs.pinot.apache.org/operate-pinot/security/configuring-tls-ssl.md): Set up TLS-secured connections inside and outside your cluster - [Audit Logging](https://docs.pinot.apache.org/operate-pinot/security/audit-logging.md) - [Monitoring](https://docs.pinot.apache.org/operate-pinot/monitoring.md) - [Metrics and Monitoring](https://docs.pinot.apache.org/operate-pinot/monitoring/metrics-and-monitoring.md) - [Continuous Java Flight Recorder (JFR)](https://docs.pinot.apache.org/operate-pinot/monitoring/continuous-jfr.md): Continuous JFR runbook for Pinot with dynamic cluster-level on/off control - [Monitor Pinot Using Prometheus and Grafana](https://docs.pinot.apache.org/operate-pinot/monitoring/monitor-pinot-using-prometheus-and-grafana.md) - [Managing Logs](https://docs.pinot.apache.org/operate-pinot/monitoring/managing-logs.md) - [Performance Tuning](https://docs.pinot.apache.org/operate-pinot/tuning.md): Reduce query latency, control resource usage, and scale throughput by tuning routing, scheduling, memory, and real-time ingestion. - [Tuning Default MMAP Advice](https://docs.pinot.apache.org/operate-pinot/tuning/tuning-default-mmap-advice.md): Adding on behalf of Dino Occhialini \[https://github.com/dinoocch] - [Real-Time](https://docs.pinot.apache.org/operate-pinot/tuning/realtime.md): Learn about tuning real-time tables. - [Routing](https://docs.pinot.apache.org/operate-pinot/tuning/routing.md) - [Query Routing Using Adaptive Server Selection](https://docs.pinot.apache.org/operate-pinot/tuning/query-routing-using-adaptive-server-selection.md) - [Query Scheduling](https://docs.pinot.apache.org/operate-pinot/tuning/query-scheduling.md): Schedule queries to prioritize them. - [Workload-Based Query Resource Isolation](https://docs.pinot.apache.org/operate-pinot/tuning/workload-query-isolation.md): Isolate query resources across workloads to prevent noisy-neighbor problems and enforce resource budgets. - [Segment Pruning](https://docs.pinot.apache.org/operate-pinot/tuning/segment-pruning.md): Understand how Pinot prunes irrelevant segments to reduce query latency and resource usage. - [OOM Protection Using Automatic Query Killing](https://docs.pinot.apache.org/operate-pinot/tuning/oom-protection-using-automatic-query-killing.md): Pinot's built in heap usage monitoring and OOM protection - [Pause Ingestion Based on Resource Utilization](https://docs.pinot.apache.org/operate-pinot/tuning/pause-ingestion-based-on-resource-utilization.md): Pause and resume ingestion based on resource utilization. - [Pauseless Consumption](https://docs.pinot.apache.org/operate-pinot/tuning/pauseless-consumption.md): Operate and monitor pauseless consumption for real-time tables in Apache Pinot. - [Performance Optimization Configurations](https://docs.pinot.apache.org/operate-pinot/tuning/performance-optimization-configurations.md) - [Segment Operations Throttling](https://docs.pinot.apache.org/operate-pinot/tuning/segment-operations-throttling.md) - [Segment Management](https://docs.pinot.apache.org/operate-pinot/segment-management.md): Assign, distribute, maintain, compact, and repair segments across your Pinot cluster. - [Segment Assignment](https://docs.pinot.apache.org/operate-pinot/segment-management/segment-assignment.md): This page introduces all the segment assignment strategies, when to use them, and how to configure them. - [Segment Lifecycle and Repair](https://docs.pinot.apache.org/operate-pinot/segment-management/segment-lifecycle-and-repair.md): Operator decision guide for choosing the right segment operation — reset, reload, refresh, rebalance, force commit, or a Minion repair task. - [Instance Assignment](https://docs.pinot.apache.org/operate-pinot/segment-management/instance-assignment.md): This page introduces all the instance assignment strategies, when to use them, and how to configure them. - [Rebalance](https://docs.pinot.apache.org/operate-pinot/segment-management/rebalance.md): This page describes how to rebalance a table - [Rebalance Servers](https://docs.pinot.apache.org/operate-pinot/segment-management/rebalance/rebalance-servers.md) - [Examples and Scenarios](https://docs.pinot.apache.org/operate-pinot/segment-management/rebalance/rebalance-servers/examples-and-scenarios.md): To help understand rebalance and its output better, here are some examples with different scenarios with table rebalance. - [Rebalance Brokers](https://docs.pinot.apache.org/operate-pinot/segment-management/rebalance/rebalance-brokers.md) - [Rebalance Tenant](https://docs.pinot.apache.org/operate-pinot/segment-management/rebalance/rebalance-tenant.md) - [Separating Data Storage by Age](https://docs.pinot.apache.org/operate-pinot/segment-management/separating-data-storage-by-age.md) - [Using Multiple Tenants](https://docs.pinot.apache.org/operate-pinot/segment-management/separating-data-storage-by-age/moving-segments-across-tenants.md) - [Using Multiple Directories](https://docs.pinot.apache.org/operate-pinot/segment-management/separating-data-storage-by-age/using-multiple-directories.md) - [Pinot Managed Offline Flows](https://docs.pinot.apache.org/operate-pinot/segment-management/pinot-managed-offline-flows.md) - [Minion Merge Rollup Task](https://docs.pinot.apache.org/operate-pinot/segment-management/minion-merge-rollup-task.md) - [PurgeTask](https://docs.pinot.apache.org/operate-pinot/segment-management/purge-task.md) - [RefreshSegmentTask](https://docs.pinot.apache.org/operate-pinot/segment-management/refresh-segment-task.md) - [SegmentGenerationAndPushTask](https://docs.pinot.apache.org/operate-pinot/segment-management/segment-generation-and-push-task.md) - [Upsert Compaction Task](https://docs.pinot.apache.org/operate-pinot/segment-management/upsert-compaction-task.md) - [Upsert Compact Merge Task](https://docs.pinot.apache.org/operate-pinot/segment-management/upsert-compact-merge-task.md): Describes the Minion Task that can remove upserted/tombstoned records from Upsert tables, and can also merge compacted segments. - [Upsert Merge Compact Task](https://docs.pinot.apache.org/operate-pinot/segment-management/upsert-merge-compact-task.md) - [Consistent Push and Rollback](https://docs.pinot.apache.org/operate-pinot/segment-management/consistent-push-and-rollback.md) - [Reload a Table Segment](https://docs.pinot.apache.org/operate-pinot/segment-management/segment-reload.md): Reload a table segment in Apache Pinot. - [Production Guides](https://docs.pinot.apache.org/operate-pinot/production-guides.md) - [Running Pinot in Production](https://docs.pinot.apache.org/operate-pinot/production-guides/running-pinot-in-production.md): Production deployment guide covering topology, capacity, health checks, graceful operations, backups, and rollouts. - [Run MSE in Production](https://docs.pinot.apache.org/operate-pinot/production-guides/run-multi-stage-engine-in-production.md): Operational guidance for running the multi-stage engine (MSE) in production, including resource model, guardrails, and known limitations. - [Kubernetes Production](https://docs.pinot.apache.org/operate-pinot/kubernetes-production.md) - [Kubernetes Deployment](https://docs.pinot.apache.org/operate-pinot/kubernetes-production/deployment-pinot-on-kubernetes.md) - [Helm Chart Values Reference](https://docs.pinot.apache.org/operate-pinot/kubernetes-production/helm-chart-reference.md) - [Amazon EKS (Kafka)](https://docs.pinot.apache.org/operate-pinot/kubernetes-production/non-eks-to-eks.md) - [Amazon MSK (Kafka)](https://docs.pinot.apache.org/operate-pinot/kubernetes-production/how-to-connect-pinot-with-amazon-managed-streaming-for-apache-kafka-amazon-msk.md): How to Connect Pinot with Amazon Managed Streaming for Apache Kafka (Amazon MSK) - [Upgrades](https://docs.pinot.apache.org/operate-pinot/upgrades.md) - [Upgrading Pinot](https://docs.pinot.apache.org/operate-pinot/upgrades/upgrading-pinot-cluster.md): This page describes the Pinot cross-release compatibility test suite. - [Upgrade Notes](https://docs.pinot.apache.org/operate-pinot/upgrades/upgrade-notes.md): Operator-facing behavior changes, migration hazards, and required actions for recent Apache Pinot releases. - [Troubleshooting](https://docs.pinot.apache.org/operate-pinot/troubleshooting.md): Diagnose and resolve issues in Apache Pinot by identifying your problem type and following the right troubleshooting path. - [Debugging Pinot](https://docs.pinot.apache.org/operate-pinot/troubleshooting/troubleshooting-pinot.md) - [General FAQ](https://docs.pinot.apache.org/operate-pinot/troubleshooting/troubleshooting-pinot/general-faq.md): This page has a collection of frequently asked questions of a general nature with answers from the community. - [Query FAQ](https://docs.pinot.apache.org/operate-pinot/troubleshooting/query-faq.md): This page has a collection of frequently asked questions about queries with answers from the community. - [Troubleshoot Multi-Stage Engine (MSE)](https://docs.pinot.apache.org/operate-pinot/troubleshooting/query-faq/troubleshoot-multi-stage-query-engine.md): Troubleshoot issues with the multi-stage engine (MSE). - [Ingestion FAQ](https://docs.pinot.apache.org/operate-pinot/troubleshooting/ingestion-faq.md): This page has a collection of frequently asked questions about ingestion with answers from the community. - [Realtime Ingestion Stopped](https://docs.pinot.apache.org/operate-pinot/troubleshooting/ingestion-faq/realtime-ingestion-stopped.md) - [Operations FAQ](https://docs.pinot.apache.org/operate-pinot/troubleshooting/operations-faq.md): This page has a collection of frequently asked questions about operations with answers from the community. - [Pinot on Kubernetes FAQ](https://docs.pinot.apache.org/operate-pinot/troubleshooting/pinot-on-kubernetes-faq.md): This page has a collection of frequently asked questions about Pinot on Kubernetes with answers from the community. - [Troubleshoot ZooKeeper Znodes](https://docs.pinot.apache.org/operate-pinot/troubleshooting/troubleshoot-zookeeper.md): Troubleshoot issues with Zookeeper znodes. --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.pinot.apache.org/operate-pinot.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.