Fabric Spark Real-Time Performance Monitoring for CPU, Memory, and vCores
Data Engineering · Public preview · Planned
Description
This feature provides an integrated, real-time dashboard for monitoring Spark application performance at both the driver and executor levels. Users can visualize CPU, memory, and core utilization across running and completed Spark applications--whether triggered through interactive notebooks or batch jobs. The dashboard aligns with the Fabric SaaS experience and enhances visibility into Spark vCore allocation and utilization.Users can inspect performance metrics at any moment in the application lifecycle, analyze utilization patterns, and access recommended actions to address bottlenecks. In addition to real-time insights, the experience includes summaries of active jobs and tasks, detailed Spark compute configurations, and the ability to drill into the Spark UI, application history, job-level details, or code-level snapshots.
Change History
-
2025-11-18
Roadmap Item Added
Workload: Data Engineering