IBM Cloud Object Storage support for the Hive connector

Configure the Hive connector to support IBM Cloud Object Storage COS access.

Note

The IBM Cloud Object Storage support requires a valid Starburst Enterprise license.

Configuration

In order to use COS, you need to configure a catalog file to use the Hive connector. For example, create a file etc/catalog/ibm-cos.properties and specify the path to the COS service config file with the hive.cos.service-config property.

connector.name=hive
hive.cos.service-config=etc/catalog/cos-service.properties

The service configuration file contains the access and secret keys, as well as the endpoints for one or multiple COS services:

service1.access-key=<your-access-key1>
service1.secret-key=<your-secret-key1>
service1.endpoint=<endpoint1>
service2.access-key=<your-access-key2>
service2.secret-key=<your-secret-key2>
service2.endpoint=<endpoint2>

The endpoints property is optional. service1 and service2 are placeholders for unique COS service names. The granularity for providing access credentials is at the COS service level.