Apache Airflow job: Build data pipelines powered by Apache Airflow
Data Factory · General availability · Shipped
Description
The Apache Airflow job in Microsoft Fabric is now generally available, providing a fully integrated Apache Airflow runtime for developing, scheduling, and monitoring Python-based data workflows using Directed Acyclic Graphs (DAGs).What's New:* Introducing Fabric runtime versioning for Apache Airflow job - This includes Fabric runtime version 1.0, which comes with Apache Airflow 2.10.4 and Python 3 as the default runtime.* Public API - APIs are now available to interact with Apache Airflow jobs for seamless management.* Git Integration & Deployment Pipeline support - Users can utilize their Git repositories (Azure DevOps/GitHub) and deploy with Fabric's built-in CI/CD workflows.* Diagnostic logs - Users can access Apache Airflow generated logs through the Apache Airflow job UI for enhanced observability.
Change History
-
2025-03-31
Roadmap Item Added
Workload: Data Factory