RISC-V异构编程范式：原子IO入队（AIOE）扩展和虚拟化AIOE.pdf

1、RISC-V Heterogeneous Programming ParadigmAlibaba Damo Academy,XUANTIE TeamAtomic IO Enqueue(AIOE)Extension&AIOE with VirtualizationGUO RENCONTENTSMotivationHeterogeneous Computing Trends&Problems011.Atomic IO Enqueue(AIOE)Extension2.AIOE with Virtualization:G-stage table In Process Context(GIPC)Exte

2、nsionSolution&Proposals02Final Remarking03Heterogeneous Computing Trends&ProblemsMotivationScalard=0Vectord=1Matrixd=2Tensord=3TPU/NPU/GPUTensor ComputingOffloadCPUISADSATPU/NPU/GPUCPUISADSATPU/NPU/GPUCPUISADSAHeterogeneous Computing TrendsScalard=0Vectord=1Matrixd=2Tensord=3ISP,DSP,CODEC,NVMe,Smart

3、 NIC,Encryption-Decryption,Compression-DecompressionTPU/NPU/GPUData ProcessingOffloadTensor ComputingOffloadCPUDPUISADSADSATPU/NPU/GPUCPUDPUISADSADSATPU/NPU/GPUCPUDPUISADSADSAHeterogeneous Computing TrendsFrom SoC to Chiplet to CXL,computing systems have become natively heterogeneous.But,when focusi

4、ng on DSA ISA design,who cares about the convenience of heterogeneous programming?Scalard=0Vectord=1Matrixd=2Tensord=3ISP,DSP,CODEC,NVMe,Smart NIC,Encryption-Decryption,Compression-DecompressionTPU/NPU/GPUData ProcessingOffloadTensor ComputingOffloadCPUDPUISADSADSATPU/NPU/GPUCPUDPUISADSADSATPU/NPU/G

5、PUCPUDPUISADSADSAHeterogeneous Computing TrendsTraditional Heterogeneous ProgrammingFebruary 1998Traditional Heterogeneous ProgrammingProcess 0Process 1Process 2Process 3Monolithic KernelMonolithic KernelSystem call interfaceVFSNetworkingIPCSecurityProcess ManagementMemory ManagementFile SystemBlock

6、 I/ODevice DriverDrv 0Drv 1Drv 2Drv 3Drv 4Drv 5Dev 0Dev 1Dev 2Dev 3Dev 4Dev 5User spaceComplex&DeepProgrammingStackHardware(DPU/TPU/NPU/GPU)Kernel space February 1998Problems:Privilege context-switch overheadSynchronization primitives overheadWeak isolation for device safety&securityDevelopment is c