利用 PCIe Gen6 扩展下一代推理服务器.pdf

1、Scaling the Next Generation of Inference Servers with PCIe 6Astera Labs Scaling the Next Generation of Inference Servers with PCIe 6Chris PetersenFellow,Technology&Ecosystems/Astera LabsSERVERPresenter Bio The Opportunity and Challenge with Challenge with Scaling AI Infrastructure PCIe Gen6&CXL 3.x:

2、Powering Next-Gen Inference ArchitectureInference Compute Demand:Scalable Fabric Design AI Infrastructure Growth:Breaking the Limits of Signal ReachAI Infrastructure Growth:Bridging PCIe GenerationsCXL Optimized AI Inference Server Performance Results Purpose-Built Rack-Scale AI ConnectivitySummary&

3、Call to ActionScale AI inference with PCIe Gen6 and CXL 3.x to meet compute and memory demandsExtend signal reach with retimers,redrivers,and gearboxes as server sizes growAdopt CXL memory expansion and pooling to break DRAM capacity limitsBridge across PCIe generations to enable flexible,open AI in

4、frastructureCollaborate with the OCP ecosystem to co-develop scalable,interoperable I/OThank You!TBD Please use the appropriate APAC Track name and icon.CHIPLETS AND ADVANCED PACKAGING/PHOTONICSAI CLUSTERSADOPTION OF OCP-RECOGNIZED EQUIPMENT&FACILITIESNETWORKINGCOOLING ENVIRONMENTSFUTURE TECHNOLOGIE

5、S SYMPOSIUMPlease use the appropriate APAC Track name and icon.SERVERRACK&POWERSTORAGEOPTICAL COMMUNICATION NETWORKSPlease use one of these membership logos to designate your companys membership level.Click here to review OCP Trademark GuidelinesPlease use this logo if you are hosting an area in the

6、 Innovation Village.Please use one of these logos if your facility is an OCP Readyfacility or youre hosting an Experience Center.Please use one of these logos if your product has been recognized as an OCP certified product.Please use this l