使用 S3 元数据：从基本查询到自定义元数据.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S T G 3 4 2Gregory BenjaminJean-Sbastien LgarWorking with S3 Metadata:From basic queries to custom

2、 metadataHe/himPrincipal EngineerHe/himPrincipal Engineer 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Ever-growing datasetsNew access patternsExpanded potentialAmazon S3 holds more than 500 trillion objects and hundreds of exabytes of dataAmazon S3 stores exabytes of Apache Pa

3、rquet,and unstructured data lakes are growing fastGenerative AI workflows unlock new business value from unstructured dataData is more demanding than ever 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Define flexible datasets for query and analysis?Build workflows to enrich my d

4、ata with metadata?Audit my data and go from insight to action?Refresh metadata views as my data changes?Customer Challenges:How do I 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Apache IcebergIn S3 TablesOpen Table Format(OTF)supporting SQL-like query over Parquet data Accelera

5、ted performance,automated maintenance,and AWS security controlsManaged by AWSMetadata tables are only writable by S3,but you have full control over readsWhat is S3 Metadata?2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S 3 M E T A D A T AAudit changes made to your data in near-r

6、eal timeDelivers object create,delete,and update events to an AWS-managed S3 tableAnswer questions about what happened to your data,when,and by whomSupports automatic expiration of old records to manage costsJournal table 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.S 3 M E T A