从边缘计算到万亿代币人工智能：华硕基础设施满足各种规模的需求.pdf

1、From edge to Trillion-Token AI:ASUS Infrastructure for Every Scale2025 OCP Global SummitJerry WangProduct ManagerInfrastructure Solution GroupEvolution of AI Application LandscapePerception AIProcesses&interprets sensory dataAnomaly DetectionPredictive MaintenanceGenerative AIContent creationTextCod

2、eImageAgentic AIAutonomous systems makedecisionsReasoning/PlanningMulti-ModalityMuti-AgentPhysical AIIntegrates AI with physical systemsSelf-Driving CarsGeneral RoboticsAGIA theoretical AI system with capabilities that rival those of a humanSelf-AwarenessHuman CharacteristicMoving from Generative AI

3、 to Agentic AIMore token would be generated when reasoningProcedures to Build an AI Data CenterConsult&DesignDemand evaluationConfiguration and architecture designComputing and network topologyCooling,electricity,layout designInstallServer/switch set upCabling and labelingElectrical/UPSIn-row CDU/si

4、de carFire/safety systemValidateAcceptance test and accept reportingSystem foundation validationPort mappingRobust interconnectivityDeployRapid deploymentCentralized configurationAutomation&systemizationGenAI cloud serviceMaintain&SupportSLA complianceOperations and maintenanceContinuous monitoring

5、and managementAI Data Center Infrastructure PlanningElectricityCoolingLayoutElectrical InfrastructurePower ConsumptionFuture ScalabilityLiquid to Liquid,In-Row CDU Liquid to Air,Side Car Solution Air Conditioning PlanningCooling System Load Capacity Cable Routing Space Planning Safety Key to Success

6、 of Building AI Data Center 5SpecificationPerformanceScheduleCPU/GPU/Memory/NIC/RAID/NVME/Storage.Cores/Spine/Leaf Switch TopologyCabling&Port MappingComputing Power Evaluation Computing Networking BandwidthStorage Networking BandwidthPMOTimeline and MilestoneProject SOWSchedule WBSCoordination amon