通往卓越蓝图：QCT的模块化人工智能解决方案.pdf

1、Q C T C O N F I D E N T I A LThe Blueprint for Brilliance:QCTs Modular Approach to AI SolutionsJack Luoh Product and Solution Executive,QCT/QuantaQ C T C O N F I D E N T I A L020040060080010001200140016002014201620172019202020212023202420252027Faster Iterations of ASICs&XPUs for AINVIDIA BlackwellUl

2、traAMD Instinct MI355XNVIDIA BlackwellNVIDIA HGX B300Google TPUv7 IronwoodAmazonTrainium2AMD Instinct MI325/350XIntel Habana Gaudi3NVIDIA P100 SXM2GoogleTPU v2NVIDIA V100 SXM2NVIDIA A100 SXM4NVIDIA H100 SXM5NVIDIA GH200GoogleTPU v5eAMDInstinctMI300X5xNew Chips ReleasedPer Year2016-20187-8xNew Chips

3、ReleasedPer Year2019-202010+New Chips ReleasedPer Year2021TDP(W)Source:Epoch AIQ C T C O N F I D E N T I A LSmarter Strategy for Non-Proprietary GPUs202020212023202420252027NVIDIA BlackwellUltraAMD Instinct MI355XNVIDIA BlackwellNVIDIA HGX B300Google TPUv7 IronwoodAmazonTrainium2AMD Instinct MI325/3

4、50XIntel Habana Gaudi3NVIDIA A100 SXM4NVIDIA H100 SXM5NVIDIA GH200GoogleTPU v5eAMDInstinctMI300X8x New Chips ReleasedPer Year2019-202010+New Chips ReleasedPer Year2021ASICs&XPUsProprietaryBuilt for specific use casesGeneral GPUsModular design to address rapid transitionsQ C T C O N F I D E N T I A L

5、PCIe-based GPU ServerD54Q-2UIntel SPR/EMRD54U-3UIntel SPR/EMRModular Approach in QCTs AI Hardware Designx86 CPU+NVIDIA HGX H100/AMD MI300XD74H-7U/D74A-7Ux86 CPU+NVIDIA HGX B300D75H-10U/D75L-3Ux86 CPU+NVIDIA HGX H200/AMD MI325XD75F-7U/D75T-7U/D75M-5U8-way GPU Serverx86+Rubin2025 Merge HGX intoMGX Eco

6、systemD55Q-2UIntel Xeon 620241st DC-MHS M-FLW SystemNVIDIA GH200 Grace Hopper SuperchipS74G-2UNVIDIA GB300NVL72 NVIDIA GB200NVL72 NVIDIA GB200NVL72(36x2)EGX77GE-2UNVIDIA GH200 Grace Hopper SuperchipNVIDIA GH200NVL32MGXPOCD75E-4Ux86 CPU+PCIe-based GPUs20231st MGX system in the worldD75E-4Ux86 CPU+NVI