Delta Lake improvements in Spark experiences
Data Engineering · General availability · Shipped
Description
Having proper defaults and aligning with the latest standards are of the utmost importance to Delta Lake standards in Microsoft Fabric. INT64 will be the new default encoding type for all timestamp values. This moves away from INT96 encodings, which the Apache Parquet deprecated years ago. The changes don't affect any reading capabilities, it's transparent and compatible by default, but ensures that all new parquet files in your Delta Lake table are written in a more efficient and future proof way. We're also releasing a faster implementation of the OPTIMIZE command, making it skip already V-Ordered files.
Change History
-
2025-10-27
Release Status Planned -> Shipped -
2025-08-28
Roadmap Item Added
Workload: Data Engineering