掌握 Amazon Athena 的数据转换.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.A N T 3 2 6Mastering data transformations with Amazon AthenaPathik ShahSenior Analytics Architect,Data Processing EnginesAmazon AthenaKarthik PrabhakarSenior Analyti

2、cs Architect,Data Processing EnginesAmazon Elastic MapReduce(EMR)2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.TopicsFor Discussion Data Transformation Challenges Introduction to Amazon Athena Common transformation patterns Demo,Use Case Patterns,and Q&A 2025,Amazon Web Services

3、,Inc.or its affiliates.All rights reserved.What is Data Transformation?Analytics ready dataset and tablesSourcesProcess 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.ETL ComplexityManage infrastructureComplex Code Schema/PerformanceSchema evolution Optimizing file formats&compre

4、ssionRecord-Level OperationsUpdates&deletesFull table rewritesData Integrity&ManagementData consistencyPartitioning strategy changesData Transformation Challenges 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Simplify Transformations Using SQL And AthenaSimpleFamiliarDeclarative

5、ExtensibleSQLInstant startServerless,no setupPoint to S3 and start querying1B+queries per week6Amazon Athena 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.OptimizeTransformationPatternsFederateModernizeAutomate 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.T

6、ransforming with SQLCreate optimized tableCREATE TABLE sales_optimized ASSELECT*FROM raw_sales_dataWHERE year=2024Add incremental dataINSERT INTO sales_optimizedSELECT*FROM new_sales_batchWHERE year=2025CTAS+INSERT INTO 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Unloading the