使用 UCX 自动执行 UNITY 目录迁移：在 DATABRICKS 上构建可靠的 PYTHON 应用程序.pdf

1、2024 Databricks Inc.All rights reserved1Robust Python Robust Python apps on apps on Databricks:Databricks:UCX case studyUCX case studySerge SmertinSerge Smertin2024 Databricks Inc.All rights reserved2WHAT PROBLEMS DID WE WHAT PROBLEMS DID WE HIT,SO YOU DONT HIT,SO YOU DONT HAVE TO.HAVE TO.2024 Datab

2、ricks Inc.All rights reserved2022 Databricks Inc.All rights reserved3About SergeAbout SergeUsing Apache Spark since 2015At Databricks since 2019Created Databricks Terraform ProviderAuthor of Databricks SDKs Driving Databricks Labs Years in cybersecurity and payments before that2024 Databricks Inc.Al

3、l rights reserved-OVERVIEWOVERVIEW-GROUP MIGRATIONGROUP MIGRATION-TABLE MIGRATIONTABLE MIGRATION-CODE MIGRATIONCODE MIGRATION2024 Databricks Inc.All rights reservedinventoryAssessment workflowGroup Migration WorkflowTable Migration WorkflowCode Migration WorkflowDatabricks CLIAWS AzureInstall StateD

4、ashboardsNotebooks and QueriesDatabricks AccountUnity CatalogWORKSPACELAPTOPWere here now2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved72024 Databricks Inc.All rights reservedGROUPGROUPMIGRATIONMIGRATION2024 Databricks Inc.All rights reservedinventoryAssessment workfl

5、owGroup Migration WorkflowDatabricks CLIDashboardDatabricks AccountWORKSPACELAPTOPConfigure on installGeneric ACL(clusters,policies,jobs,)Legacy Table/UDF/DB ACLSecret Scopes ACLRedash ACLSCIM Entitlements1.Rename WS groups2.Re-apply ACL3.Remove tmp groups2024 Databricks Inc.All rights reserved2024

6、Databricks Inc.All rights reserved10CHALLENGES:CHALLENGES:-CALLING APICALLING API-LOGGINGLOGGING-ERROR RECOVERYERROR RECOVERYDIRECT API DIRECT API INTEGRATION INTEGRATION IS HARDIS HARDRESTRPC2024 Databricks Inc.All rights reserved16USE DATABRICKS USE DATABRICKS SDK(FOR PYTHON)SDK(FOR PYTHON)TO SAVE