Delta推出的面向数据中心的800VDC电源和冷却解决方案.pdf

1、Ralf Pieper(Delta Power and System BG)Harry Petty(NVIDIA Accelerated Computing)Chih-Chung Chen(Delta Fans&Thermal Management BG)Delta 800 VDC Power and Cooling Solutions for Data Centers2AIto Shape the Future(by NVIDIA)AboutDeltaGrid-to-Chip Power for AI Training by 50 VDCEmpowering Giga-Watt AI Dat

2、a Centers by 800 VDCCooling Solutions for Data CentersAgendaDelta 800 VDC Power and Cooling Solutions for Data Center3AI to Shape the FutureDelta 800 VDC Power and Cooling Solutions for Data Centers2026202720282025202220232024$250$1,000$750$500Data Center Capex$1T+(DellOro Projections)Computing at I

3、nflection Point4The Next Era of Generative AIImage ClassificationLarge Language Models(Transformer)TransformerRESNET-50Identifying PhotosBERTLanguage ModelGPT-3Generative ChatbotLabeled DatasetsTEXTAUDIOIMAGE3DVIDEODNAPROTEINMOLECULEANIMATIONUnlabeled DatasetsGenerative AIMixture of Experts(MoE)Mult

4、imodal Generative AILarge Language Models(Transformer)TURING NLGLanguage ModelProduction GenAI InferenceSequence Length 32K inputParameters10TRealtime100 x One-shotEvolution of AI and AI Scaling LawsDrives exponential demands for accelerated computingPre-Training Scaling20T Tokens/Model100s of Pre-T

5、rained Models“Intelligence”ComputePost-Training ScalingTrillions of Tokens/Model100s of Thousands of Post-Trained ModelsTest-Time Scaling“Long Thinking”100s of Thousands of Tokens/Query100s of Millions of Queries/Month2012 AlexNetPerception AISpeech RecognitionDeep RecSysMedical ImagingGenerative AI

6、Digital Marketing Content CreationAgentic AICoding Assistant Customer ServicePatient CarePhysical AIAutonomous VehiclesGeneral Robotics6$3M GB200 NVL72 Investment Can Generate$30M Token Revenue“Free”compute is not cheap enoughFree GPU,1/4 PerfGB200 NVL72AI Factory ROINon-GPU CostsGPU CostProfit$8M R