AWS Glue 5.1 now accessible across all AWS commercial and GovCloud regions

AWS Glue 5.1 has been officially launched and is now available in the Asia Pacific (New Zealand), AWS GovCloud (US-West), and AWS GovCloud (US-East) Regions. AWS Glue is a serverless and scalable data integration service that facilitates the discovery, preparation, movement, and integration of data from various sources. The latest version, AWS Glue 5.1, introduces upgrades to its core engines, including Apache Spark 3.5.6, Python 3.11, and Scala 2.12.18, which collectively enhance both performance and security.

This update also includes support for open table format libraries, such as Apache Hudi 1.0.2, Apache Iceberg 1.10.0, and Delta Lake 3.3.2. Notably, AWS Glue 5.1 introduces compatibility with Apache Iceberg format version 3.0, enabling features like default column values, deletion vectors for merge-on-read tables, multi-argument transforms, and row lineage tracking.

Furthermore, AWS Glue 5.1 extends AWS Lake Formation’s fine-grained access control to encompass write operations, including both Data Manipulation Language (DML) and Data Definition Language (DDL) for Spark DataFrames and Spark SQL. Previously, such control was available only for read operations. The new release also enhances security by implementing full-table access control in Apache Spark for Apache Hudi and Delta Lake tables.

With these advancements, AWS Glue 5.1 is now available across all AWS commercial and AWS GovCloud (US) Regions. Users can begin utilizing AWS Glue 5.1 through AWS APIs, AWS CLI, AWS SDK, or AWS Glue Studio. For additional information, interested parties are encouraged to visit the AWS Glue product page and consult the documentation.