# Basics - [Concepts](https://docs.pinot.apache.org/release-1.1.0/basics/concepts.md): Explore the fundamental concepts of Apache Pinot™ as a distributed OLAP database. - [Architecture](https://docs.pinot.apache.org/release-1.1.0/basics/architecture.md): Understand how the components of Apache Pinot™ work together to create a scalable OLAP database that can deliver low-latency, high-concurrency queries at scale. - [Components](https://docs.pinot.apache.org/release-1.1.0/basics/components.md): Discover the core components of Apache Pinot, enabling efficient data processing and analytics. Unleash the power of Pinot's building blocks for high-performance data-driven applications. - [Cluster](https://docs.pinot.apache.org/release-1.1.0/basics/components/cluster.md): Learn to build and manage Apache Pinot clusters, uncovering key components for efficient data processing and optimized analysis. - [Tenant](https://docs.pinot.apache.org/release-1.1.0/basics/components/cluster/tenant.md): Discover the tenant component of Apache Pinot, which facilitates efficient data isolation and resource management within Pinot clusters. - [Server](https://docs.pinot.apache.org/release-1.1.0/basics/components/cluster/server.md): Uncover the efficient data processing and storage capabilities of Apache Pinot's server component, optimizing performance for data-driven applications. - [Controller](https://docs.pinot.apache.org/release-1.1.0/basics/components/cluster/controller.md): Discover the controller component of Apache Pinot, enabling efficient data and query management. - [Broker](https://docs.pinot.apache.org/release-1.1.0/basics/components/cluster/broker.md): Discover how Apache Pinot's broker component optimizes query processing, data retrieval, and enhances data-driven applications. - [Minion](https://docs.pinot.apache.org/release-1.1.0/basics/components/cluster/minion.md): Explore the minion component in Apache Pinot, empowering efficient data movement and segment generation within Pinot clusters. - [Table](https://docs.pinot.apache.org/release-1.1.0/basics/components/table.md): Explore the table component in Apache Pinot, a fundamental building block for organizing and managing data in Pinot clusters, enabling effective data processing and analysis. - [Segment](https://docs.pinot.apache.org/release-1.1.0/basics/components/table/segment.md): Discover the segment component in Apache Pinot for efficient data storage and querying within Pinot clusters, enabling optimized data processing and analysis. - [Deep Store](https://docs.pinot.apache.org/release-1.1.0/basics/components/table/segment/deep-store.md): Leverage Apache Pinot's deep store component for efficient large-scale data storage and management, enabling impactful data processing and analysis. - [Schema](https://docs.pinot.apache.org/release-1.1.0/basics/components/table/schema.md): Explore the Schema component in Apache Pinot, vital for defining the structure and data types of Pinot tables, enabling efficient data processing and analysis. - [Pinot Data Explorer](https://docs.pinot.apache.org/release-1.1.0/basics/components/exploring-pinot.md): Pinot Data Explorer is a user-friendly interface in Apache Pinot for interactive data exploration, querying, and visualization. - [Getting Started](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started.md): This section contains quick start guides to help you get up and running with Pinot. - [Running Pinot locally](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/running-pinot-locally.md): This quick start guide will help you bootstrap a Pinot standalone instance on your local machine. - [Running Pinot in Docker](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/running-pinot-in-docker.md): This guide will show you to run a Pinot cluster using Docker. - [Quick Start Examples](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/quick-start.md): This section describes quick start commands that launch all Pinot components in a single process. - [Running in Kubernetes](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/kubernetes-quickstart.md): Pinot quick start in Kubernetes - [Running on public clouds](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/public-cloud-examples.md): This page links to multiple quick start guides for deploying Pinot to different public cloud providers. - [Running on Azure](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/public-cloud-examples/azure-quickstart.md): This quickstart guide helps you get started running Pinot on Microsoft Azure. - [Running on GCP](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/public-cloud-examples/gcp-quickstart.md): This quickstart guide helps you get started running Pinot on Google Cloud Platform (GCP). - [Running on AWS](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/public-cloud-examples/aws-quickstart.md): This quickstart guide helps you get started running Pinot on Amazon Web Services (AWS). - [Create and update a table configuration](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/create-and-update-table-config.md): Create and edit a table configuration in the Pinot UI or with the API. - [Batch import example](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/pushing-your-data-to-pinot.md): Step-by-step guide for pushing your own data into the Pinot cluster - [Stream ingestion example](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/pushing-your-streaming-data-to-pinot.md): The Docker instructions on this page are still WIP - [HDFS as Deep Storage](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/hdfs-as-deepstorage.md): This guide shows how to set up HDFS as deep storage for a Pinot segment. - [Troubleshooting Pinot](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/troubleshooting-pinot.md) - [Frequently Asked Questions (FAQs)](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/frequent-questions.md): This page lists pages with frequently asked questions with answers from the community. - [General](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/frequent-questions/general.md): This page has a collection of frequently asked questions of a general nature with answers from the community. - [Pinot On Kubernetes FAQ](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/frequent-questions/pinot-on-kubernetes-faq.md): This page has a collection of frequently asked questions about Pinot on Kubernetes with answers from the community. - [Ingestion FAQ](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/frequent-questions/ingestion-faq.md): This page has a collection of frequently asked questions about ingestion with answers from the community. - [Query FAQ](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/frequent-questions/query-faq.md): This page has a collection of frequently asked questions about queries with answers from the community. - [Operations FAQ](https://docs.pinot.apache.org/release-1.1.0/basics/getting-started/frequent-questions/operations-faq.md): This page has a collection of frequently asked questions about operations with answers from the community. - [Import Data](https://docs.pinot.apache.org/release-1.1.0/basics/data-import.md): This page lists options for importing data into Pinot with links to detailed instructions with examples. - [From Query Console](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/from-query-console.md): Insert a file into Pinot from Query Console - [Batch Ingestion](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/batch-ingestion.md): Batch ingestion of data into Apache Pinot. - [Spark](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/batch-ingestion/spark.md): Batch ingestion of data into Apache Pinot using Apache Spark. - [Flink](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/batch-ingestion/flink.md): Batch ingestion of data into Apache Pinot using Apache Flink. - [Hadoop](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/batch-ingestion/hadoop.md): Batch ingestion of data into Apache Pinot using Apache Hadoop. - [Backfill Data](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/batch-ingestion/backfill-data.md): Batch ingestion of backfill data into Apache Pinot. - [Dimension table](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/batch-ingestion/dim-table.md): Batch ingestion of data into Apache Pinot using dimension tables. - [Stream ingestion](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-stream-ingestion.md): This guide shows you how to ingest a stream of records into a Pinot table. - [Apache Kafka](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-stream-ingestion/import-from-apache-kafka.md): This guide shows you how to ingest a stream of records from an Apache Kafka topic into a Pinot table. - [Amazon Kinesis](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-stream-ingestion/amazon-kinesis.md): This guide shows you how to ingest a stream of records from an Amazon Kinesis topic into a Pinot table. - [Apache Pulsar](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-stream-ingestion/apache-pulsar.md): This guide shows you how to ingest a stream of records from an Apache Pulsar topic into a Pinot table. - [Stream Ingestion with Upsert](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/upsert.md): Upsert support in Apache Pinot. - [Segment compaction on upserts](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/segment-compaction-on-upserts.md): Use segment compaction on upsert-enabled real-time tables. - [Stream Ingestion with Dedup](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/dedup.md): Deduplication support in Apache Pinot. - [Stream Ingestion with CLP](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/clp.md): Support for encoding fields with CLP during ingestion. - [File Systems](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-file-system.md): This section contains a collection of short guides to show you how to import data from a Pinot-supported file system. - [Amazon S3](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-file-system/amazon-s3.md): This guide shows you how to import data from files stored in Amazon S3. - [Azure Data Lake Storage](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-file-system/import-from-adls-azure.md): This guide shows you how to import data from files stored in Azure Data Lake Storage Gen2 (ADLS Gen2) - [HDFS](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-file-system/import-from-hdfs.md): This guide shows you how to import data from HDFS. - [Google Cloud Storage](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-file-system/import-from-gcp.md): This guide shows you how to import data from GCP (Google Cloud Platform). - [Input formats](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-input-formats.md): This section contains a collection of guides that will show you how to import data from a Pinot-supported input format. - [Complex Type (Array, Map) Handling](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-input-formats/complex-type.md): Complex type handling in Apache Pinot. - [Ingest records with dynamic schemas](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/pinot-input-formats/schema-conforming-transformer.md): Storing records with dynamic schemas in a table with a fixed schema. - [Reload a table segment](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/segment-reload.md): Reload a table segment in Apache Pinot. - [Upload a table segment](https://docs.pinot.apache.org/release-1.1.0/basics/data-import/segment-upload.md): Upload a table segment in Apache Pinot. - [Indexing](https://docs.pinot.apache.org/release-1.1.0/basics/indexing.md): This page describes the indexing techniques available in Apache Pinot - [Bloom filter](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/bloom-filter.md): This page describes configuring the Bloom filter for Apache Pinot - [Dictionary index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/dictionary-index.md) - [Forward index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/forward-index.md) - [Geospatial](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/geospatial-support.md): This page talks about geospatial support in Pinot. - [Inverted index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/inverted-index.md): This page describes configuring the inverted index for Apache Pinot - [JSON index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/json-index.md): This page describes configuring the JSON index for Apache Pinot. - [Native text index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/native-text-index.md): This page talks about native text indices and corresponding search functionality in Apache Pinot. - [Range index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/range-index.md): This page describes configuring the range index for Apache Pinot - [Star-tree index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/star-tree-index.md): This page describes the indexing techniques available in Apache Pinot. - [Text search support](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/text-search-support.md): This page talks about support for text search in Pinot. - [Timestamp index](https://docs.pinot.apache.org/release-1.1.0/basics/indexing/timestamp-index.md): Use a timestamp index to speed up your time query with different granularities - [Releases](https://docs.pinot.apache.org/release-1.1.0/basics/releases.md): The following summarizes Pinot's releases, from the latest one to the earliest one. - [1.1.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/1.1.0.md): Release Notes for version 1.1.0 - [Apache Pinot™ 1.0.0 release notes](https://docs.pinot.apache.org/release-1.1.0/basics/releases/1.0.0.md): This page covers the latest changes included in the Apache Pinot™ 1.0.0 release, including new features, enhancements, and bug fixes. - [0.12.1](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.12.1.md) - [0.12.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.12.0.md) - [0.11.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.11.0.md) - [0.10.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.10.0.md) - [0.9.3](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.9.3.md) - [0.9.2](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.9.2.md) - [0.9.1](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.9.1.md) - [0.9.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.9.0.md) - [0.8.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.8.0.md): This release introduced several new features, including compatibility tests, enhanced complex type and Json support, partial upsert support, and new stream ingestion plugins. - [0.7.1](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.7.1.md): This release introduced several awesome new features, including JSON index, lookup-based join support, geospatial support, TLS support for pinot connections, and various performance optimizations. - [0.6.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.6.0.md): This release introduced some excellent new features, including upsert, tiered storage, pinot-spark-connector, support of having clause, more validations on table config and schema, support of ordinals - [0.5.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.5.0.md): This release includes many new features on Pinot ingestion and connectors, query capability and a revamped controller UI. - [0.4.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.4.0.md): 0.4.0 release introduced the theta-sketch based distinct count function, an S3 filesystem plugin, a unified star-tree index implementation, migration from TimeFieldSpec to DateTimeFieldSpec, etc. - [0.3.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.3.0.md): 0.3.0 release of Apache Pinot introduces the concept of plugins that makes it easy to extend and integrate with other systems. - [0.2.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/0.2.0.md): The 0.2.0 release is the first release after the initial one and includes several improvements, reported following. - [0.1.0](https://docs.pinot.apache.org/release-1.1.0/basics/releases/1.0.md): The 0.1.0 is first release of Pinot as an Apache project - [Recipes](https://docs.pinot.apache.org/release-1.1.0/basics/recipes.md): Here you will find a collection of ready-made sample applications and examples for real-world data - [Connect to Streamlit](https://docs.pinot.apache.org/release-1.1.0/basics/recipes/streamlit.md): In this Apache Pinot guide, we'll learn how visualize data using the Streamlit web framework. - [Connect to Dash](https://docs.pinot.apache.org/release-1.1.0/basics/recipes/dash.md): In this Apache Pinot guide, we'll learn how visualize data using the Dash web framework. - [Visualize data with Redash](https://docs.pinot.apache.org/release-1.1.0/basics/recipes/redash.md) - [GitHub Events Stream](https://docs.pinot.apache.org/release-1.1.0/basics/recipes/github-events-stream.md): Steps for setting up a Pinot cluster and a real-time table which consumes from the GitHub events stream. --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.pinot.apache.org/release-1.1.0/basics.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.