Shortcut Transformations - Customize ingestion with user configurations
OneLake · Public preview · Planned
Description
With the upcoming enhancements to Shortcut Transformations, you'll be able to fully customize how you bring in data from CSV, Parquet, JSON, and Excel files. You can define exactly which rows to skip, set file encoding, and choose custom quote or escape characters for your data. You'll also be able to remove duplicate rows based on key fields, specify date and timestamp formats, and decide how errors are handled--whether to skip problematic rows, insert nulls, or enforce strict schema rules. For Parquet and JSON files, you'll have options to partition or cluster your data and even flatten arrays if needed. When working with Excel, you can select which sheets to transform, up to 15 at a time. All these controls will be available directly in the user interface, giving you more flexibility, reliability, and efficiency in managing your data ingestion and transformation workflows.
Change History
-
2026-01-30
Release Date 2026-01-21 -> 2026-03-31 -
2025-12-11
Feature Description **Shortcut Transformations - User configurations to customize ingestion behavior**With the upcoming enhancements to Shortcut Transformationsyou'll be able to fully customize how you bring in data from CSVParquetJSONand Excel files. You can define exactly which rows to skipset file encodingand choose custom quote or escape characters for your data. You'll be able to remove duplicate rows based on key fieldsspecify date and timestamp formatsand decide how errors are handledwhether to skip problematic rowsinsert nullsor enforce strict schema rules. For Parquet and JSON filesyou'll have options to partition or cluster your data and even flatten arrays if needed. When working with Excelyou can select which sheets to transformup to 15 at a time. All these controls will be available directly in the user interfacegiving you more flexibilityreliabilityand efficiency in managing your data ingestion and transformation workflows. -> With the upcoming enhancements to Shortcut Transformationsyou'll be able to fully customize how you bring in data from CSVParquetJSONand Excel files. You can define exactly which rows to skipset file encodingand choose custom quote or escape characters for your data. You'll also be able to remove duplicate rows based on key fieldsspecify date and timestamp formatsand decide how errors are handled--whether to skip problematic rowsinsert nullsor enforce strict schema rules. For Parquet and JSON filesyou'll have options to partition or cluster your data and even flatten arrays if needed. When working with Excelyou can select which sheets to transformup to 15 at a time. All these controls will be available directly in the user interfacegiving you more flexibilityreliabilityand efficiency in managing your data ingestion and transformation workflows. -
2025-11-18
Roadmap Item Added
Workload: OneLake