利用智能体人工智能和以内存为中心的计算实现异构内存机遇.pdf

1、Jinin So,Senior Director&System ArchitectMemory Division,Samsung Electronics Khurram Malik,Senior DirectorMarvell TechnologyHeterogeneous Memory Opportunity with Agentic AI and Memory Centric ComputingHeterogeneous Memory Opportunity w/Agentic AI and Memory Centric ComputingJinin So,Senior Direct&Sy

2、stem Architect,Samsung ElectronicsKhurram Malik,Senior Director,Marvell TechnologySERVER:COMPOSABLE MEMORY SYSTEMS(CMS)Agentic AI is an intelligent system which operates autonomously,making adaptive decisions and taking actionsto achieve specific goals with minimal human interventionLLMs play a cruc

3、ial role with natural language understanding/planning/reasoning capability Some popular examples:Agentic RAG(ChatGPT,Perplexity),Coding Agent(Claude Code,Gemini CLI)Agentic AIFinal answerAnswerAnswer to UserAnswerAnswer to UserReflectionIs the responseRelevant?(multiple)ToolsUser QueryReflectionIs t

4、he responseRelevant?ReflectionIs the responseRelevant?ToolsToolsAnswerPlanningMake plan&Tool callPlanningMake plan&Tool callTool Call Agentic AI based on LLM requires significant memory capacity and bandwidth relying on external databases(Working)A space where agent temporarily stores and processes

5、information current tasks or reasoning(Procedural)Implicit knowledge stored in LLM weights,(Semantic)Agents knowledge about the world and itself(Episodic)Experiences from earlier decisions(e.g.training input-output pairs,history event flows,and game trajectories)Agentic AI:Memory ViewParseParseRetri

6、evalRetrievalProcedural MemoryPromptPromptLearningLearningRetrievalRetrievalLearningLearningSemantic MemoryRetrievalRetrievalLearningLearningEpisodicMemoryDecision ProcedureLLM with Reasoning(Working Memory)Step1Step2Step3OutputActionsActionsObservationObservationParseRetrievalProcedural MemoryProce