Shortcut Transformations - Customize ingestion with user configurations
OneLake · Public preview · Planned
Description
With the upcoming enhancements to Shortcut Transformations, you'll be able to fully customize how you bring in data from CSV, Parquet, JSON, and Excel files. You can set file encoding, choose custom quote or escape characters for your data in case of CSV files. For CSV, Parquet and JSON files, you'll have options to decide refresh mode (Append Only or Mirror) and schema mode (Dynamic or Fixed). All these controls will be available directly in the user interface, giving you more flexibility, reliability, and efficiency in managing your data ingestion and transformation workflows.
Change History
-
2026-05-20
Feature Description With the upcoming enhancements to Shortcut Transformationsyou'll be able to fully customize how you bring in data from CSVParquetJSONand Excel files. You can define exactly which rows to skipset file encodingand choose custom quote or escape characters for your data. You'll also be able to remove duplicate rows based on key fieldsspecify date and timestamp formatsand decide how errors are handled--whether to skip problematic rowsinsert nullsor enforce strict schema rules. For Parquet and JSON filesyou'll have options to partition or cluster your data and even flatten arrays if needed. When working with Excelyou can select which sheets to transformup to 15 at a time. All these controls will be available directly in the user interfacegiving you more flexibilityreliabilityand efficiency in managing your data ingestion and transformation workflows. -> With the upcoming enhancements to Shortcut Transformationsyou'll be able to fully customize how you bring in data from CSVParquetJSONand Excel files. You can set file encodingchoose custom quote or escape characters for your data in case of CSV files. For CSVParquet and JSON filesyou'll have options to decide refresh mode (Append Only or Mirror) and schema mode (Dynamic or Fixed). All these controls will be available directly in the user interfacegiving you more flexibilityreliabilityand efficiency in managing your data ingestion and transformation workflows. -
2026-04-23
Release Date 2026-03-31 -> 2026-05-21 -
2026-01-30
Release Date 2026-01-21 -> 2026-03-31 -
2025-12-11
Feature Description **Shortcut Transformations - User configurations to customize ingestion behavior**With the upcoming enhancements to Shortcut Transformationsyou'll be able to fully customize how you bring in data from CSVParquetJSONand Excel files. You can define exactly which rows to skipset file encodingand choose custom quote or escape characters for your data. You'll be able to remove duplicate rows based on key fieldsspecify date and timestamp formatsand decide how errors are handledwhether to skip problematic rowsinsert nullsor enforce strict schema rules. For Parquet and JSON filesyou'll have options to partition or cluster your data and even flatten arrays if needed. When working with Excelyou can select which sheets to transformup to 15 at a time. All these controls will be available directly in the user interfacegiving you more flexibilityreliabilityand efficiency in managing your data ingestion and transformation workflows. -> With the upcoming enhancements to Shortcut Transformationsyou'll be able to fully customize how you bring in data from CSVParquetJSONand Excel files. You can define exactly which rows to skipset file encodingand choose custom quote or escape characters for your data. You'll also be able to remove duplicate rows based on key fieldsspecify date and timestamp formatsand decide how errors are handled--whether to skip problematic rowsinsert nullsor enforce strict schema rules. For Parquet and JSON filesyou'll have options to partition or cluster your data and even flatten arrays if needed. When working with Excelyou can select which sheets to transformup to 15 at a time. All these controls will be available directly in the user interfacegiving you more flexibilityreliabilityand efficiency in managing your data ingestion and transformation workflows. -
2025-11-18
Roadmap Item Added
Workload: OneLake