Dataflows - Performance Enhancements for Computed Entities to Lakehouse Destinations
Data Factory · Public preview · Shipped
Description
Dataflow Gen2 will deliver targeted performance improvements for a common pattern where data is processed in a Staging Warehouse (compute) and written to a Lakehouse data destination, such as when persisting the output of Computed Entities.These enhancements optimize how transformed data is materialized from warehouse compute into the Lakehouse data destinations, reducing data movement overhead, lowering end-to-end refresh times, and improving throughput for large and complex pipelines. Customers benefit from faster data availability in the Lakehouse, more reliable refresh performance at scale, and a smoother experience when using warehouses for intermediate computation before landing curated data for analytics, AI, and downstream consumption.This is especially valuable for organizations standardizing on Lakehouse architectures while leveraging Dataflow Gen2's Staging Warehouse Compute for transformation and shaping, enabling fresher insights with less operational friction.
Change History
-
2026-06-06
Feature Description Dataflow Gen2 will deliver targeted performance improvements for a common pattern where data is processed in a Staging Warehouse (compute) and written to a Lakehouse data destinationsuch as when persisting the output of Computed Entities.These enhancements optimize how transformed data is materialized from warehouse compute into the Lakehousereducing data movement overheadlowering end-to-end refresh timesand improving throughput for large and complex pipelines. Customers benefit from faster data availability in the Lakehousemore reliable refresh performance at scaleand a smoother experience when using warehouses for intermediate computation before landing curated data for analyticsAIand downstream consumption.This is especially valuable for organizations standardizing on Lakehouse architectures while leveraging Staging Warehouse Compute for transformation and shapingenabling fresher insights with less operational friction. -> Dataflow Gen2 will deliver targeted performance improvements for a common pattern where data is processed in a Staging Warehouse (compute) and written to a Lakehouse data destinationsuch as when persisting the output of Computed Entities.These enhancements optimize how transformed data is materialized from warehouse compute into the Lakehouse data destinationsreducing data movement overheadlowering end-to-end refresh timesand improving throughput for large and complex pipelines. Customers benefit from faster data availability in the Lakehousemore reliable refresh performance at scaleand a smoother experience when using warehouses for intermediate computation before landing curated data for analyticsAIand downstream consumption.This is especially valuable for organizations standardizing on Lakehouse architectures while leveraging Dataflow Gen2's Staging Warehouse Compute for transformation and shapingenabling fresher insights with less operational friction. -
2026-06-02
Release Status Planned -> Shipped -
2026-06-02
Roadmap Item Added
Workload: Data Factory