最大化GenAI性能：GPU及其他.pdf

1、Confidential Information Nscale Group B.V.2024Maximising GenAI Performance:The GPU&BeyondConfidential Information Nscale Group B.V.2024Karl HavardCOO NscaleSeptember 11,2024Maximising GenAI PerformanceConfidential Information Nscale Group B.V.202401 FactorsThe key elements of GenAI performance,its n

2、ot just the GPU.02 MaturityAs the market matures,values,priority and focus will change03 CorrelationGenAI performance will directly correlate to business performanceContextMaximising GenAI Performance /FactorsThe key elements of GenAI performance,its not just about the GPU.01 Factors02 Maturity03 Co

3、rrelationConfidential Information Nscale Group B.V.2024The Tech StackThe Tech StackExternal FactorsExternal FactorsConfidential Information Nscale Group B.V.2024Exper t i s eNet wor ki ngCool i ngPowerLocat i onSpecialismTrainingIn-houseExternalT1 LocationCostCapacityLatencyTypeCostBi-productEfficie

4、ncy100%RenewableCostScaleEfficiencyNatural SourcesSovereigntyCommunityMobilityGPUs&GPUI nt er connectSwi t ch Gear Et cSt or ageOr ches t r at i on LayerM odel Opt i mi s at i onUs er I nt er f aceTrainingTuningInferencingMaximising GenAI Performance /FactorsAs the market matures,values,priority and

5、 focus will change01 Factors:02 Maturity03 CorrelationMaximising GenAI Performance /MaturityConfidential Information Nscale Group B.V.2024Focused onThe Model MakerThe Model MakerHow many GPUs do you have?How much are they?When are they available?ScaleScaleTimeTimeCostCostMaximising GenAI Performance

6、 /MaturityConfidential Information Nscale Group B.V.2024TodayEnterprise Enterprise LeadershipLeadershipOutcomes&Outcomes&Business ValueBusiness ValueSecurity&Security&ResilienceResilienceSustainability&Sustainability&ComplianceComplianceMaximising GenAI Performance /MaturityConfidential Information