Dataflows - Performance: Disable V-Order Compression
Data Factory · Public preview · Shipped
Description
Dataflow Gen2 will introduce a new preview capability that allows customers to disable V-Order (VertiParquet) compression for supported workloads and destinations, giving advanced users greater control over execution behavior, performance characteristics, and cost trade-offs.This capability is especially valuable for scenarios where write latency and refresh throughput are prioritized over downstream storage optimization. By disabling V-Order compression, customers can reduce processing overhead during writes, helping accelerate refresh performance for large or time-sensitive ingestion and transformation workloads.With this preview, organizations can better tune Dataflow Gen2 execution to meet the specific needs of their architectures and pipelines while continuing to leverage the scalability and flexibility of Microsoft Fabric.
Change History
-
2026-06-06
Feature Description We are continuing to expand the significant performance gains delivered by Dataflow Gen2 with a new set of targeted performance and latency improvements across the end-to-end experience. These enhancements focus on the most critical execution paths and user interactionsfurther differentiating Dataflow Gen2 from previous dataflow generations and raising the bar for low-code data transformations in Microsoft Fabric.This round of improvements addresses performance holistically--spanning data movementauthoringexecutionmonitoringand downstream consumption--to deliver a fastermore responsiveand more predictable experience at scale.Key enhancements include:* Reduced metadata refresh latencyimproving responsiveness when working with schemas and downstream consumers* The ability to turn off Vertiparquet compressiongiving advanced users greater control over performance and cost trade-offs for specific workloadsTogetherthese enhancements further extend the performance advantages of Dataflow Gen2 compared to earlier dataflow implementationsreducing latency across both runtime execution and day-to-day interactions. By streamlining the most common and time-sensitive operationsDataflow Gen2 continues to deliver faster refreshessmoother authoringand more predictable behavior as data volumes and usage scale.At the same timethese improvements materially enhance the customer experience around low-code data transformations in Fabric. Faster feedback loopsmore responsive monitoringand greater control over execution characteristics make it easier for both business users and data engineers to designoperateand reuse dataflows with confidence--reinforcing Dataflow Gen2 as a high-performanceproduction-ready transformation layer within Microsoft Fabric. -> Dataflow Gen2 will introduce a new preview capability that allows customers to disable V-Order (VertiParquet) compression for supported workloads and destinationsgiving advanced users greater control over execution behaviorperformance characteristicsand cost trade-offs.This capability is especially valuable for scenarios where write latency and refresh throughput are prioritized over downstream storage optimization. By disabling V-Order compressioncustomers can reduce processing overhead during writeshelping accelerate refresh performance for large or time-sensitive ingestion and transformation workloads.With this previeworganizations can better tune Dataflow Gen2 execution to meet the specific needs of their architectures and pipelines while continuing to leverage the scalability and flexibility of Microsoft Fabric.Name Dataflows - Performance and Latency Improvements -> Dataflows - Performance: Disable V-Order Compression -
2026-06-02
Release Status Planned -> Shipped -
2026-06-02
Roadmap Item Added
Workload: Data Factory