革新网络技术迎接智能人工智能时代2.pdf

1、Gilad Shainer,NVIDIARevolutionizing Networking for the Era of Agentic AIRevolutionizing Networking for the Era of Agentic AIGilad Shainer,NVIDIAOCP SPECIAL FOCUS:PHOTONICSThe Different Ethernet Architectures Hyperscale SpineHyperscale DC,cloud spineAI FactoriesHigh-performance,distributed computingS

2、ervice ProviderService provider core,carrier,DCIEnterpriseEnterprise,feature-rich DCSpectrum-X Brings High Performance to EthernetOTS Ethernet-Hyperscale CloudsSpectrum-X Ethernet AI FactoriesTCP(Low Bandwidth Flows and Utilization)RoCE(High Bandwidth Flows and Utilization)High Jitter ToleranceLow J

3、itter Tolerance(Long Tail Kills Performance)Heterogeneous Traffic Average Multi-PathingBursty Network Capacity Predictable PerformanceLoosely Coupled ApplicationsDistributed Tightly-Coupled ProcessingSpectrumX Ethernet Low Jitter Communications for AISpectrum-X Ethernet SwitchSpectrum-X Ethernet Sup

4、erNICSchedule Data Transmission to Avoid CongestionSpectrum-X Ethernet SuperNICUltra-High-Speed Traffic Monitoring Distribute Data Across All Switch Ports Ignoring Data OrderingReordering-Receive Data and Place it Back in OrderSchedule Data Transmission to Avoid CongestionSpectrum-X Ethernet isolate

5、s multi-tenant communication noise,35%higher performance vs.OTS Ethernet35%Higher NCCL Multi-Tenant PerformanceSpectrum-X Ethernet isolates multi-tenant application noise,higher performance with deterministic results 42%Higher LLAMA3 70B Training in Multi-Tenant Data Center42%15%42%Metas collaborati

6、ve,future-ready open Ethernet platformMeta to Introduce Switches Built on Spectrum Ethernet for FBOSSNVIDIA Spectrum Ethernet based MiniPack3N Switch for Facebook Open Switching System(FBOSS)Powering Fairwater,the worlds largest and fastest AI supercomputer with open standard EthernetAzure First to