红队演练LLM - 实用防御策略.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Philipp Kaindl(he/him)Senior Applied ScientistAWSMohan Gowda Purushothama(he/him)Principal Solutio

2、ns Architect AI/MLAWSRed Teaming LLMs-Practical Defense StrategiesA I M 3 6 0 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.AgendaRisks&challenges in Agentic AI securityRed Teaming,Threat Variants,and Associated Testing StrategyWhiteboarding Session Prompt InjectionWhiteboarding

3、 Session Application Security for AI AgentsSummary 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025:The Raise of Agentic AIPivotal year for agentic AI,marking shift to autonomous,goal-oriented systems across industriesGartner,“Top strategic Technology Trends for 2025,”October

4、2024 Gartner,“Top Strategic Technology Trends:Agentic AIthe Evolution of Experience”February 202533%of enterprise software apps will include Agentic AI by 2028,up from less than 1%in 2024.15%of day-to-day work decisions will be made autonomously through Agentic AI by 2028.2025,Amazon Web Services,In

5、c.or its affiliates.All rights reserved.Agentic AI systems acquire greater autonomy and broader data access,securing GenAI applications becomes essential for maintaining integrity,privacy,and operational confidence.Production agentic AI demands secure,trustworthy intelligence 2025,Amazon Web Service

6、s,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Risks&challenges in Agentic AI security 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Risk Considerat