Ceph storage support

The high-performance object storage Ceph is compatible with Amazon S3 using Ceph Object Gateway, and supported for any catalog using one of the following connectors:

• Starburst Delta Lake connector

• Starburst Hive connector

• Starburst Iceberg connector

Requirements

The following requirements apply when using Ceph as storage backend:

• A configured reliable autonomic distributed object store gateway (RADOSGW).

• Network connectivity between the SEP cluster and Ceph storage.

Configuration

Ceph is fully compatible with Amazon S3 and as a result all related S3 configuration information applies. In addition, make sure that path style access is enabled in your catalog properties file:

hive.s3.path-style-access=true