The availability of AWS Glue 5.1 in all commercial regions and AWS GovCloud (US) regions of AWS Web Services is now available. AWS Glue 5.1 becomes regionally available as it extends to newer regions like Asia Pacific (New Zealand) and other recently launched GovCloud (US-East and US-West) regions of Amazon Web Services. This extension is another step towards the consistent and effective delivery of data integration services in a serverless environment by Amazon Web Services. In addition, enterprises as well as government bodies can now use the upgraded versions of AWS Glue to avail better data integration services. AWS Glue is the data integration service that AWS has introduced as a serverless service for their users, where the users can carry out tasks relating to data discovery, data preparation, and data integration easily.
Also Read: Tredence and Google Cloud Launch Gemini-Powered Agentic AI Accelerators to Drive Enterprise Adoption
The latest changes in the version 5.1 are the use of Apache Spark 3.5.6, Python 3.11, and Scala 2.12.18. There are also enhanced capabilities in opening table formats such as Apache Hudi 1.0.2, Apache Iceberg 1.10.0, and Delta Lake 3.3.2. Apache Iceberg 3.0 format version compatibility has been included in this version with several advanced functionalities such as default column values and deletion vectors for merge-on-read tables. Another significant improvement introduced by this release is the ability to apply granular access controls via AWS Lake Formation on Spark DataFrames and Spark SQL that can be applied on both write operations (DML and DDL). Previously, the access controls could be applied only on read operations. Also, AWS Glue 5.1 adds full-table access control support in Apache Spark for Hudi and Delta Lake tables, thus enhancing the capabilities for governing and securing the data assets. With its global deployment completed, AWS Glue 5.1 enables companies to establish unified data engineering processes in all their regions by gaining higher interoperability, governance, and performance.
