重新构想 Atlassian 的数据治理和访问.pdf

1、Reimagining Data Governance and Access at AtlassianAn inside look at Atlassians access controls and policy architecture on our new data platformGerald NakhleSenior EngineerAgendaSocrates vClassic-Pre Unity CatalogChallenges we faced pre Unity CatalogOur Solution-Policy ComponentsCurrent policy compo

2、nents architectureSocrates vNext-Unity CatalogWhat we got from using Unity CatalogTakeaways and future plansKey takeaways and future plansIntroductionLandscapeSocratesSocrates is Atlassians internal analytical Data Lakehouse.We called the platform Socrates in reference to the Socratic Method which i

3、s a form of cooperative argumentative dialogue between individuals,based on asking and answering questions to stimulate critical thinking and to draw out ideas and underlying presuppositions.Socrates vClassic is our legacy data lakehouse.Socrates vNext is our current“next-gen”data lakehouse.Lakehous

4、e Statistics 100KTables 1000Databases 50 PBData 5000 Data UsersCustomer TrustDeveloper ProductivityTime to Insight-Facilitating swift access to data-Data Insights quickly available for business decisions-Unified policy view-Access grants are straightforward-Self-service-Data is tagged and classified

5、-Data has an accountable steward-Auditing capabilitiesOur GoalChallenges we faced pre Unity CatalogSocrates vClassic-Pre Unity CatalogHow can I find out whos querying my table x?How can I find out who owns table x?COMMON USER QUESTIONS#help-data-our internal data platform slack support channelHow ca

6、n I find out whos querying my data?How can I find out who owns table x?COMMON USER QUESTIONS#help-data-our internal data platform slack support channelChallengesGovernance&SecurityRudimentary governance and guardrailsOperational EfficiencyManual work and scaling issuesCollaborationUnclear data owner