Installation#

Now that you satisfied all the requirements you are ready to proceed with installing SEP.

Overview#

Installing charts with Helm on your cluster follows the same steps:

  • Establish access to the Helm chart repository

  • Create a values.yaml file specific to the chart and cluster

  • Configure credentials to access the Docker registry

  • Ensure your Helm/kubectrl configuration points at the correct cluster with kubectl cluster-info

  • Run Helm to install the chart

  • Access the cluster and check for success

Each Helm chart includes a values.yaml file that sets a reasonable set of default values. This default setup does not include catalog definitions and others that are necessary for your cluster.

You have to change your values file to add or update any configuration and run a Helm upgrade to apply the changes to the cluster.

Iterate on the configuration in the values YAML file with minimal setup until you have a working system. Depending on your cluster you have to adjust memory requirements for the worker and coordinator and other settings. Inspect the message with kubectl or Octant to determine details.

After you achieved a running cluster, ensure to store the values YAML file as a reference and then add more details as required for the specific cluster need.

SEP installation#

The SEP installation is managed with the starburst-presto Helm chart. Use a minimal values YAML file with the registry credentials in the current directory to install SEP with the following command:

helm upgrade  my-presto starburstdata/starburst-presto \
  --install \
  --version 338.0.0 \
  --values ./values.yaml

The version value is available from the Helm repo.

The default values result in one coordinator and two worker nodes in the cluster.

Determine the IP address or the DNS hostname of the coordinator and verify the coordinator is running by accessing the Presto Web UI. You can use the same details to connect with the CLI or the JDBC driver.

As a next step, update the configuration with the desired values. The SEP configuration provides details for configuration of catalogs to access data sources, worker and coordinator memory settings and much more.

After the initial installation, proceed to learn about operating your cluster with tips about testing, connecting, updating and more.

Hive metastore installation#

The Hive metastore installation is managed with the starburst-hive Helm chart. Installation follows the same approach as the SEP chart with a minimal values YAML file with the registry credentials in the current directory:

helm upgrade  my-presto starburstdata/starburst-hive \
  --install \
  --version 338.0.0 \
  --values ./values.yaml

As a next step, update the configuration with the desired values. The Hive metastore configuration provides details for the configuration of the Hive metastore.

Ranger installation#

The Ranger installation is managed with the starburst-ranger Helm chart. Installation follows the same approach as the SEP chart with a minimal values YAML file with the registry credentials in the current directory:

helm upgrade  my-presto starburstdata/starburst-ranger\
  --install \
  --version 338.0.0 \
  --values ./values.yaml

As a next step, update the configuration with the desired values. The Ranger configuration provides details for the configuration of Starburst Ranger.

Node assignment#

All charts you to configure criteria to define which node and pod in the cluster is suitable to use for running the relevant container. The following configurations are available, and by default not defined:

nodeSelector: {}
affinity: {}
tolerations: []

Example configurations are available in the k8s documentation. Specific usage and values highly depend on your k8s cluster configuration.

Further resources: