赞助商：德勤-与 Deloitte 一起简化 Databricks 工作流程的监控.pdf

1、2024 Databricks Inc.All rights reservedSTREAMLINED STREAMLINED MONITORING OF MONITORING OF DATABRICKS DATABRICKS WORKFLOWS WITH WORKFLOWS WITH DELOITTEDELOITTEAshvic GodinhoAshvic GodinhoJune 12June 12thth,2024,202412024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedCENTRA

2、LIZED ANAYTICS DATASTORE FOR MONITORINGCENTRALIZED ANAYTICS DATASTORE FOR MONITORINGData Pipelines have become more complexMore data workflows created over timeDatabricks adds new features oftenCurrent StateCurrent StateChallengesChallenges2Time spent investigating issuesAPI and Meta data can be tra

3、nsientMonitoring for anomalies is hardCustomers ecosystem dont always integrate with Databricks easily*Databricks ETL features have grown2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedGood overview,but limited or manual3MONITORING IN DATABRICKSMONITORING IN DATABRICKSW

4、hat tools are out there currently?What tools are out there currently?JobsJobs2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedDetailed,but not persistent4MONITORING IN DATABRICKSMONITORING IN DATABRICKSWhat tools are out there currently?What tools are out there currently

5、?Delta Live TablesDelta Live Tables2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedAll manual5MONITORING IN DATABRICKSMONITORING IN DATABRICKSWhat tools are out there currently?What tools are out there currently?AllAll-Purpose ClustersPurpose Clusters2024 Databricks Inc

6、.All rights reserved2024 Databricks Inc.All rights reserved6AUTOMATED MONITORING SOLUTIONAUTOMATED MONITORING SOLUTIONSingle Dashboard to view all Databricks WorkflowsSingle Dashboard to view all Databricks Workflows2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedAUTOMA