数据产品架构.pdf

《数据产品架构.pdf》由会员分享，可在线阅读，更多相关《数据产品架构.pdf（67页珍藏版）》请在三个皮匠报告上搜索。

1、 2024 Thoughtworks|Confidential Architecting for Data ProductsDanilo SatoVP,Global Head of Technology-Data&AI1 2024 Thoughtworks|Confidential What is this organisations business?2Data sourcesConsumersIngestionProcessingServingERPCRMFinanceExternalDataData LakeDWMartsBronzeSilverGoldStreamingBatchDas

2、hboardsReportsEDAMLAppsStorage 2024 Thoughtworks|Confidential What is this organisations business?3Content supply chainViewerContentViewing activityViewerMarketingAudience segmentAudienceData productSystems 2024 Thoughtworks|Confidential Zooming in4StorageHarmoniseServeData PipelinesBatchIngestionSt

3、reamIngestionDashboardsReports 2024 Thoughtworks|Confidential Architecting for Data Products5 +Architecting with Data Products 2024 Thoughtworks|Confidential Hello Im Danilo Sato!Office of the CTO,Technology Advisory Board Head of Data&AI,UK and Europe 23+years career in technology 16+years at Thoug

4、htworksVP,Global Head of Technology-Data&AIAuthor of Continuous Delivery for Machine Learning 2024 Thoughtworks|Confidential 7Shift in data landscapeOperational WorldRunning the business and serving the usersAnalyticalWorldBusiness Intelligence and reportingETL 2024 Thoughtworks|Confidential Shift i

5、n data landscape8DBMS 2024 Thoughtworks|Confidential Shift in data landscape9Which Relational DB?OLAP vs.OLTP?Early 2000s 2024 Thoughtworks|Confidential Shift in data landscape10Which Relational DB?OLAP vs.OLTP?Object Database?XML Database?Early 2000s 2024 Thoughtworks|Confidential Shift in data lan

6、dscape11https:/ 2024 MAD LandscapeNow 2024 Thoughtworks|Confidential Analytical and operational worlds are getting closer Operational WorldRunning the business and serving the usersAnalyticalWorldOptimizing the business and user experienceTrustworthy and high-quality dataLast-mile:better,faster,conn