以太网扩展网络互连方案.pdf

1、Pete Del VecchioProduct Manager Tomahawk Switch Family,BroadcomInterconnect Options for Ethernet Scale-Up NetworksBroadcom Switches for AI Scale-UpScale-UpScale-OutTomahawk6102.4 Tbps100G&200G PAM4Tomahawk Ultra51.2 Tbps250nsWhat Optics are Needed for These and Future Scale-Up Switches?taking into a

2、ccount the variety of packaging optionsSingle-Hop Scale-up Connectivity Up to 512 XPUsBroadcom Scale-Up EndpointsSwitchesNetwork Interfaces Tomahawk Ultra Tomahawk 6 Thor Ultra NIC Chiplets Scale-Up Ethernet SpecsOptics Must Work for a Wide Variety of Scale-Up EndpointsASICs Custom XPUs Full-Stack N

3、etworking IPScale-Up Cluster Size Trend64-128 XPUsToday256-512 XPUsVery Soon1024-2048 XPUsThree to Five YearsNo longer just a box-or rack-level networkMust be integrated into DC infrastructure:Not an island;no niche or proprietary protocols Must use common network management tools Must enable flexib

4、le deployments-electrical&optical linksScale-Up and Scale-Out Networking EthernetSpineLeafScale-UpScale-OutEthernet scale-up&scale-out Common technology stack,operational tools Fungible XPU interfaces for different workloads5High bandwidthEfficient data transferReliable connectivityEfficient on-chip

5、 interface IP123XPUHBMHBMHBMHBM4XPU Scale-Up RequirementsCurrent XPU Scale-Up Bandwidth RequirementsXPUHBMHBMHBMHBMXPUHBMHBMHBMHBM8 x HBM4(12.8Tbps)102.4TbpsScale-up bandwidth is 10%-20%of HBM bandwidthAI Scaling System Bandwidth Requirements10k100k1M10 Tbps100 TbpsXPUs per ClusterScale-Up per XPU80

6、0 Gbps1.6+TbpsScale-Out per XPU100,000 Terabits/sec 100,000,000 Terabits/secScale-Up Interconnect Options9DSP-based?LPO/LROSlow-and-wideLeverage packages for optimized copper interconnectLowest power and costFewest link flapsAlways the preferred optionEnable via SerDes and the best packages/channels