Write partitioning properties#

The property described in this page is defined as follows, depending on the deployment type:

  • Kubernetes: In the additionalProperties section of the the top-level coordinator and worker nodes in the values.yaml file.

  • Starburst Admin: In the files/coordinator/config.properties.j2 and files/worker/config.properties.j2 files.

use-preferred-write-partitioning#

  • Type: boolean

  • Default value: true

  • Session property: use_preferred_write_partitioning

Enable preferred write partitioning. When set to true, each partition is written by a separate writer. For some connectors such as the Hive connector, only a single new file is written per partition, instead of multiple files. Partition writer assignments are distributed across worker nodes for parallel processing.