Computing engine releases

更新时间:
复制 MD 格式

Lindorm is periodically updated with new features and bug fixes.

Check the computing engine version

  1. Go to the Spark UI. For more information, see Go to the Spark UI.

  2. Click the Environment tab.

  3. Find the version number. Locate the spark.kubernetes.container.image parameter. The image tag is in the format {Spark community version}-ldspark-{computing engine version}, where the two versions are separated by -ldspark-.

Releases

Compatible Spark version

Computing engine version

Type

Description

3.3.1

1.7.0

New features

Adds support for accessing the Lindorm time-series engine via the JDBC data source.

Feature optimization

  • Fixes a data read stability issue in the CDC data source.

  • Adds the TSDB SQL Dialect to the JDBC data source.

  • Improves query performance for the HBase data source.

1.6.0

New features

Adds System status monitoring.

1.5.0

New features

Adds support for SQL permission authentication.

Feature optimization

Optimizes the filter pushdown rules for the wide table engine data source.

1.4.1

Feature optimization

  • Adds support for reading complex data types from the wide table engine data source.

  • Optimizes the generation logic for resource request configurations.

1.3.0

New features

Adds data type conversion functions that parse HBase-encoded BINARY data into its actual data type, such as INT or LONG. For more information, see Access enhanced HBase data.

Feature optimization

  • The wide table engine data source can now access tables with completed HBase type mappings. For more information, see Use SQL to access HBase tables.

  • Fixes a CAST syntax bug introduced by Apache Spark.

1.2.0

New features

Adds Access Lindorm columnar data.

3.2.1

1.5.0

Feature optimization

  • Improves the handling of null values during data reads in the CDC data source.

  • Fixes stability issues.

1.3.1

New features

  • Adds support for Spark SQL jobs that run a specified SQL statement.

  • Resource configuration items now support the resourceTag parameter. For more information, see Resource configuration items.

Feature optimization

The CDC data source now supports parsing HBase data into its actual data type, such as INT or LONG.

1.2.0

New features

The CDC data source now supports reading HBase data.

Feature optimization

The wide table engine data source now supports reading BLOB data.