Release 453-e LTS (30 August 2024)

Starburst Enterprise platform (SEP) 453-e LTS is the follow up release to the 451-e STS release and the 443-e LTS release.

This release is a promotion of the original 453-e STS release in August 2024 into a long term support (LTS) release.

It contains all improvements from Starburst Enterprise releases since the 443-e LTS release:

• 446-e STS

• 448-e STS

• 449-e STS

• 451-e STS

It includes all improvements from the following Trino releases:

• Trino 444

• Trino 445

• Trino 446

• Trino 447

• Trino 448

• Trino 449

• Trino 450

• Trino 451

• Trino 452

• Trino 453

Highlights since 443-e

• Added native filesystem support for object storage.

• Added Query result caching.

• Promoted Schema discovery to general availability with added UI support.

• Added support for location grants with built-in access control.

Breaking Changes

• SEP now requires JDK 22 to run.

• The following configuration properties and catalog configuration properties have been removed. These properties must be removed from all configurations or the cluster fails to start:

  • delta.max-initial-splits

  • delta.max-initial-split-size

  • legacy.materialized-view-grace-period

• The PARTITION_COLUMN and PARTITION_VALUE arguments for the flush_metadata_cache procedure of the Hive connector have been renamed to PARTITION_COLUMNS and PARTITION_VALUES, respectively. The old argument names no longer work.

• The BigQuery connector now enables Arrow serializaion by default, which requires a JVM configuration. You must either add --add-opens=java.base/java.nio=ALL-UNNAMED to your jvm.config or set the bigquery.arrow-serialization.enabled catalog configuration property to false in your BigQuery catalog configurations.

• Phoenix versions 5.1.x and earlier are no longer supported by the Phoenix connector.

• Warp Speed custom warmup rules are no longer stored in an external RDBMS. Warmup rules are now saved in object storage in a location specified in warp-speed.objectstore.store.path. In order to allow an existing warmup configuration to continue uninterrupted, you must export any existing rules from the external database and import them to object storage, then update your catalog configuration with the object store path.

• The optimizer.mark-distinct-strategy and optimizer.optimize-mixed-distinct-aggregations configuration properties have been removed and are replaced by optimizer.distinct-aggregations-strategy.

• The bigquery.parallelism configuration property has been removed as scan parallelism is now enabled by default on the BigQuery connector.

• The hive.experimental.schema-discovery.enabled catalog configuration property has been removed as schema discovery is enabled by default. You must remove this property from the cluster configuration or SEP fails to start.

453-e initial changes

General

• Released Schema discovery in general availability.

• Added support for running schema discovery in the Starburst Enterprise web UI.

• Added support for AWS Bottlerocket nodes for Amazon EKS workloads. This includes support for Warp Speed configurations.

Security

• Added support for geolocation-based access control in Ranger.

• Added IAM role support for query result caching.

Delta Lake connector

• Added native filesystem support for cloud storage systems. See the migration guide for more information on switching to native Azure storage, Google Cloud storage, and S3 storage support.

Hive connector

• Added native filesystem support for cloud storage systems. See the migration guide for more information on switching to native Azure storage, Google Cloud storage, and S3 storage support.

• Added support for excluding tables from caching with the hive.file-status-cache-tables.excluded catalog configuration property.

Hudi connector

• Added native filesystem support for cloud storage systems. See the migration guide for more information on switching to native Azure storage, Google Cloud storage, and S3 storage support.

Iceberg connector

• Added native filesystem support for cloud storage systems. See the migration guide for more information on switching to native Azure storage, Google Cloud storage, and S3 storage support.

Netezza connector

• Added support for execute procedure.

SAP HANA connector

• Added support for parallel read operations.

Snowflake connector

• Added support for enforcing DEFINER security authorization during query execution for views when using impersonation.

Teradata connector

• Added support for enforcing DEFINER security authorization during query execution for views when using impersonation.

• Added support for execute procedure.

453-e.1 changes (30 August 2024)

• Fixed failure when a user-defined type name contains uppercase characters.

• Fixed the Trino username incorrectly defaulting to the name of the user running the Trino process when no username is specified.

• Fixed query failure when file-based network topology is configured with the node-scheduler.network-topology.file configuration property.

• Fixed support for migration of Ranger policies in security zones.

• Fixed failure for queries involving json_parse() and a cast to array, map, or row.

• Fixed performance issues with partitioned table when using Lake Formation integration in Hive connector.

• Fixed an issue that affected managed statistics collection on wide Teradata tables in specific circumstances.