Track and Manage Notebook Run Dependencies & Linage View

This feature delivers a comprehensive Notebook Run Lineage experience for Spark applications, enabling data engineers to monitor and analyze complex notebook workflows with ease. It provides an at-a-glance view of all notebook run statuses, helps quickly identify root-cause failures across nested executions, and highlights performance bottlenecks. Users can filter and explore large execution graphs, access detailed error and run-level information, and view aggregated summaries of execution health and resource usage--all in one place.