012-Charlie-Su.pdf

1、RISC-V for Intelligent Edge Application ProcessingCharlie Su,Ph.D.CTO and President,AndesRISC-V Summit China,2024/08/21-232Subject to change without noticecopyright 2021-2024 Andes TechnologyRISC-V Market Research by SHD GroupD25F,D45,AX25MP,AX45MPD23,N25F,N45,AX45MPN25F,A25,A45MP,AX45MPN25F,N45Mobi

2、leNX27V,AX25,AX45MPV,AX65Large-Scale AI/MLAcceleration,bandwidth,extensibilityN25F-SE,AX45MPV Total RISC-V SoC Market$6.1B in 2023:276.8%growth over 2022$92.7B by 2030:a CAGR of 47.4%Andes has 30%of RISC-V IP Market Applications:Endpoint,Edge,Cloud3Subject to change without noticecopyright 2021-2024

3、 Andes TechnologyISCA 2023 paper,“MTIA:First Generation Silicon Targeting Metas Recommendation Systems”Proc-A/B:AX25-V100,an early version of the popular NX27V vector processorCustom extensions(ACE):create new interfaces/instructions/registersNext generation MTIA(Meta blog):Serving models in product

4、ionMTIA:Meta Training/Inference AcceleratorAll photos:courtesy of ACMAndesCore SubsystemHW Accelerators4Subject to change without noticecopyright 2021-2024 Andes TechnologyBased on NX27V/AX45MPV(RVV),AX65(OOO),and AX25With Andes Automated Custom Extensions(ACE)RISC-V Enables Innovations for Large-Sc

5、ale AI/ML AI Accelerator Using Photonics AI Accelerator for ADAS AI Accelerators Using SRAM-based Compute-In-Memory:AI Accelerator for Cloud Service5Subject to change without noticecopyright 2021-2024 Andes TechnologyMarket projection:Edge AI will be bigger than Cloud AIDefinition of IEAP:Not Cloud

6、AI/ML,Not AI PCIncluding application handling and AI/ML accelerationsAI/ML for Edge Applications:On-device IntelligenceIntelligent Edge Servers with domain knowledge(e.g.legal,medical,or enterprise)Smart Factory/Healthcare/Transportation:monitoring and predictive maintenanceNetwork Systems:performan