Apache Pinot Docs
Search…
latest
Introduction
Basics
Concepts
Architecture
Components
Getting Started
Running Pinot locally
Running Pinot in Docker
Running Pinot in Kubernetes
Public cloud examples
Running on Azure
Running on GCP
Running on AWS
Hdfs as Deep Storage
Manual cluster setup
Batch import example
Stream ingestion example
Troubleshooting Pinot
Frequently Asked Questions (FAQs)
Import Data
Indexing
Releases
Recipes
For Users
Query
APIs
External Clients
Tutorials
For Developers
Basics
Advanced
Plugins
Design Documents
For Operators
Deployment and Monitoring
Command-Line Interface (CLI)
Configuration Recommendation Engine
Tutorials
Configuration Reference
Cluster
Controller
Broker
Server
Table
Schema
Ingestion Job Spec
RESOURCES
Community
Team
Blogs
Presentations
Videos
Integrations
Trino
ThirdEye
Superset
Presto
Powered By GitBook
Running on GCP
This starter provides a quick start for running Pinot on Google Cloud Platform (GCP)
This document provides the basic instruction to set up a Kubernetes Cluster on Google Kubernetes Engine(GKE)​

1. Tooling Installation

1.1 Install Kubectl

Please follow this link (https://kubernetes.io/docs/tasks/tools/install-kubectl) to install kubectl.
For Mac User
1
brew install kubernetes-cli
Copied!
Please check kubectl version after installation.
1
kubectl version
Copied!
QuickStart scripts are tested under kubectl client version v1.16.3 and server version v1.13.12

1.2 Install Helm

Please follow this link (https://helm.sh/docs/using_helm/#installing-helm) to install helm.
For Mac User
1
brew install kubernetes-helm
Copied!
Please check helm version after installation.
1
helm version
Copied!
This QuickStart provides helm supports for helm v3.0.0 and v2.12.1. Please pick the script based on your helm version.

1.3 Install Google Cloud SDK

​
Please follow this link (https://cloud.google.com/sdk/install) to install Google Cloud SDK.

1.3.1 For Mac User

    Install Google Cloud SDK
1
curl https://sdk.cloud.google.com | bash
Copied!
    Restart your shell
1
exec -l $SHELL
Copied!

2. (Optional) Initialize Google Cloud Environment

1
gcloud init
Copied!

3. (Optional) Create a Kubernetes cluster(GKE) in Google Cloud

Below script will create a 3 nodes cluster named pinot-quickstart in us-west1-b with n1-standard-2 machines for demo purposes.
Please modify the parameters in the example command below:
1
GCLOUD_PROJECT=[your gcloud project name]
2
GCLOUD_ZONE=us-west1-b
3
GCLOUD_CLUSTER=pinot-quickstart
4
GCLOUD_MACHINE_TYPE=n1-standard-2
5
GCLOUD_NUM_NODES=3
6
gcloud container clusters create ${GCLOUD_CLUSTER} \
7
--num-nodes=${GCLOUD_NUM_NODES} \
8
--machine-type=${GCLOUD_MACHINE_TYPE} \
9
--zone=${GCLOUD_ZONE} \
10
--project=${GCLOUD_PROJECT}
Copied!
You can monitor cluster status by command:
1
gcloud compute instances list
Copied!
Once the cluster is in RUNNING status, it's ready to be used.

4. Connect to an existing cluster

Simply run below command to get the credential for the cluster pinot-quickstart that you just created or your existing cluster.
1
GCLOUD_PROJECT=[your gcloud project name]
2
GCLOUD_ZONE=us-west1-b
3
GCLOUD_CLUSTER=pinot-quickstart
4
gcloud container clusters get-credentials ${GCLOUD_CLUSTER} --zone ${GCLOUD_ZONE} --project ${GCLOUD_PROJECT}
Copied!
To verify the connection, you can run:
1
kubectl get nodes
Copied!

5. Pinot Quickstart

Please follow this Kubernetes QuickStart to deploy your Pinot Demo.

6. Delete a Kubernetes Cluster

1
GCLOUD_ZONE=us-west1-b
2
gcloud container clusters delete pinot-quickstart --zone=${GCLOUD_ZONE}
Copied!
Previous
Running on Azure
Next
Running on AWS
Last modified 1yr ago
Copy link
Contents
1. Tooling Installation
1.1 Install Kubectl
1.2 Install Helm
1.3 Install Google Cloud SDK
2. (Optional) Initialize Google Cloud Environment
3. (Optional) Create a Kubernetes cluster(GKE) in Google Cloud
4. Connect to an existing cluster
5. Pinot Quickstart
6. Delete a Kubernetes Cluster