Release 356-e LTS (10 May 2021)#

Starburst Enterprise platform (SEP) 356-e is the follow up release to the 355-e STS release and the 350-e LTS release.

This release is a long term support (LTS) release.

The 350-e release includes all improvements from the following Trino project releases:

It contains all improvements from the Starburst Enterprise releases since 350-e LTS:

Highlights since 350-e#

Breaking changes#

This release includes no breaking changes since the 355-e release. However like 354-e and all future SEP releases, it is based on Trino. It is therefore the first LTS release based on Trino.

All breaking changes from 354-e and the tips from the migration guide apply. It is important that you review these if you are upgrading from 350-e or an earlier release.

356-e initial changes#

The following changes from 356-e.0 and 356-e.1 are all part of the first public release.

General#

Performance#

Security#

Delta Lake connector#

  • Add support for write operations

  • Improve predicate pushdown for the Parquet reader by using Parquet file statistics to read only the files and row groups that contain relevant data for SELECT, INSERT, UPDATE and DELETE queries.

Elasticsearch connector#

  • Added backpressure (HTTP 429 status) handling

Kafka connector#

  • Add OAuth 2.0 token pass-through

Snowflake connector#

  • Support for using the distributed connector with Azure object storage

  • Add OAuth 2.0 token pass-through

SQL Server connector#

  • Add password credential pass-through

Synapse connector#

  • Add Active Directory password authentication and credential pass-through

  • Add password credential pass-through

Teradata connectors#

  • Improve error message when query used in query pass-through is invalid.

  • Add support for CREATE TABLE WITH primary index.

  • Mask value of teradata-parallel-direct.https.keystore.password in log file writing.

Teradata Direct connector#

  • Use transmission statistics to calculate table statistics in SEP for Teradata views.

  • Add support for running connector on Kubernetes.

356-e.1 changes (14 May 2021)#

  • Mask value of teradata-parallel-direct.https.keystore.password in log file writing.

  • Add support for epoch milliseconds exposed as String in the Elasticsearch connector.

  • Support Databricks replace table with schema change in Delta Lake connector.

  • Validate ORC ACID version base on data file metadata as a fallback.

356-e.2 was skipped

356-e.3 changes (11 Jun 2021)#

  • Correct how delete markers are interpreted for ORC ACID tables in Hive connector, so SEP is not filtering out extraneous rows for certain tables.

  • Fix query failure when reading from a non-ORC insert-only transactional table in Hive connector.

  • Fix incorrect results when accessing BigQuery records with wrong index in BigQuery connector.

  • Fix query failures when accessing the information_schema table in Delta Lake connector.

  • Fix table statistics collection in the Teradata connector.

  • Fix reading Snowflake exported data from Azure WASB in >4MB chunks in Snowflake connector.

  • Add support for object mapping defined in JSON file to SQL Server connector.

356-e.4 was skipped

356-e.5 changes (23 Jun 2021)#

  • Delta Lake connector: Fix query failure after table location changed in the metastore.

356-e.6 changes (18 Aug 2021)#

  • Fix LIKE clause usage with char values.

  • Reject CTAS with skip_header_line_count > 0 in Hive connector.

  • Fix DROP SCHEMA and DROP SCHEMA RESTRICT not to drop then schema if it is not empty in MySQL connector.

  • Fix data corruption when performing UPDATE or INSERT on ORC ACID transactional table.

  • Fix column ordering bug in Delta Lake CTAS.

  • Properly handle number values with negative scale in Teradata.

  • Fix Teradata queries failing with No nodes available to run query.

  • Fix Teradata Direct queries failing with Empty reply from server.

  • Fix incorrect incorrect pushdown of large dynamic filters as range predicates on char and varchar columns for JDBC connectors where the remote database is case-insensitive or follows a different sort ordering for letters from Trino (Greenplum, MySQL, PostgreSQL, SingleStore, SQL Server).

356-e.7 changes (7 Sep 2021)#

  • Fix invalid result when two decimals are added together. This happened in certain queries where decimals had different precision.

  • Fix incorrect result when using the BigQuery TIME type.

  • Fix incorrect results for queries with a comparison between a VARCHAR column and a CHAR constant.

  • Fix query failure when inserting data into a Hive ACID table that is not explicitly bucketed.

  • Fix Sentry access control incorrectly assigning roles from Local system instead of LDAP.

  • Improve performance of updating Glue table statistics for partitioned tables.

  • Change default Glue statistics read/write parallelism from 1 to 5.

  • Fix the CData OEM key being written to server logs when the Salesforce connector is configured with an invalid connection URL.

  • Fix an inaccurate impersonation check when applying user mapping for password authentication.

  • Make the Insights UI aware of principal-field (configured with http-server.authentication.oauth2.principal-field) when using web-ui.authentication.type=OAUTH2.

356-e.8 changes (22 Sep 2021)#

  • Fix incorrect results of BigQuery parameterized NUMERIC type.

  • Fix locking of non-partitioned transactional tables.

  • Fix reading Delta Lake multipart checkpoints.

  • Fix security vulnerability in Okta authentication.

356-e.9 changes (13 Oct 2021)#

  • Fix QueryResult returns empty results for retries.

356-e.10 changes (10 Nov 2021)#

  • Re-enable aggregation pushdown for Redshift tables with diststyle AUTO(ALL)/ALL.

  • Fix incorrect results for queries with nested joins and IS NOT DISTINCT join clauses.

  • Upgrade Prometheus JMX Exporter to 0.16.1.

  • Fix incorrect DST result from Redshift TIMESTAMP type.

356-e.11 changes (17 Dec 2021)#

  • Fix deletion without predicate from a transactional table that has original uncompacted files.

  • Fix failure when a schema is dropped during listing tables from BigQuery.

  • Fix connection leak for INSERT, UPDATE, and DELETE operations in the Delta Lake connector.

  • Fix predicate pushdown with expressions using REAL types for MySQL, SingleStore and ClickHouse connectors.

  • Fix treatment of date values before 1582-10-14 in the Greenplum connector.

  • Remove unused log4j dependency from SEP to avoid false alarms about Log4Shell.

  • Upgrade log4j in Ranger Admin to version 2.16.0 to mitigate Log4Shell.

  • Disable support for ALTER VIEW ... SET AUTHORIZATION statement.

356-e.12 changes (23 Feb 2022)#

  • Fix data corruption when multiple queries DELETE from, INSERT into, or UPDATE a Delta Lake table.

  • Fix incorrect date result the value is <= 1582-10-14 in MySQL, SingleStore, and PostgreSQL connectors.

  • Migrate Docker image for Starburst Cache Service to UBI8 minimal base image.

356-e.13 changes (18 Mar 2022)#

  • Fix query failures due to exhausted file system resources after DELETE or UPDATE.

356-e.14 changes (25 Apr 2022)#

  • Fix CVE-2022-23848 in Alluxio client.

  • Fix RPM to include MapR Hive. libraries.

  • Fix failure of the sync_partition_metadata procedure when partition names differ from partition paths on the file system.

  • Fix query failure when selecting partition when the name corresponds with a reserved keyword.

  • Fix SHOW TABLES failure when hive.hide-delta-lake-tables is enabled, and the Glue metastore contains metadata about the table without properties.

356-e.15 changes (20 May 2022)#

  • Ignore non-redirected, non-Delta Lake tables or views when querying information_schema.columns.

  • Add support to the Hive connector for date type partition names with timestamp formatting.