使用 Apache Airflow、MWAA 和 SageMaker Unified Studio 进行编排.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A N T 3 1 6Orchestrating with Apache Airflow,MWAA,and SageMaker Unified StudioJohn Jackson(he/him)Principal Product ManagerKamen Sharlandjiev(he/him)Sr.WW Specialist

2、 SA,Big Data 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Deployment ModelsArchitectural differences and use cases between self-managed,MWAA Provisioned,and Serverless(new)Best PracticesTransition strategies and workarounds when moving from Provisioned to ServerlessSageMaker Un

3、ified StudioExplore workflow orchestration capabilities including Visual DAG Builder Airflow on AWSOperationsOrchestrationSession Objectives 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.AgendaApache Airflow FundamentalsWhat is MWAAMWAA Provisioned or Serverless?Orchestration in

4、 SageMaker Unified StudioDemoQ&A 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Apache AirflowUSE CASESADOPTIONCOMMUNITYApache Airflow is an open-source Python framework for developing,scheduling,and monitoring workflows.2025,Amazon Web Services,Inc.or its affiliates.All rights r

5、eserved.MWAA Provisioned Simplified deployment Highly Available,Scalable and Secure 100%Open Source Airflowhttps:/ 2020,Amazon Web Services,Inc.or its Affiliates.All rights reserved.Amazon MWAA Architecture(Provisioned)2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.MWAA Serverles

6、s Infrastructure Management&Scaling Security&Access Control User Experience&Workflow Management 2020,Amazon Web Services,Inc.or its Affiliates.All rights reserved.Amazon MWAA Architecture(Serverless)2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Fixed Infrastructure Always-On Cos