借助 Amazon EKS 混合节点随时随地解锁 GenAI 推理功能.pdf

1、 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.C N S 3 5 5Unlock GenAI inference anywhere with Amazon EKS Hybrid NodesEric ChapmanProduct ManagerAmazon EKSCurtis RissiPrincipal Solutions Architect Application Mod

2、ernization 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Lets set some expectations What is a Chalk Talk?Will you be able to interact and ask questions?What about my needs?2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Why run inference on-prem?2025,Amazon We

3、b Services,Inc.or its affiliates.All rights reserved.Why run inference on-prem?Compute capacity spread across environments Data residency requirements or data gravity Host inference endpoints near consumers for latency purposes Burst to or from cloud 2025,Amazon Web Services,Inc.or its affiliates.Al

4、l rights reserved.Customers can now use existing on-premises and edge infrastructure as nodes in Amazon EKS clusters for unified Kubernetes management across environments Improve operational efficiency by unifying Kubernetes operations across environmentsReduce total cost of ownership of managing Ku

5、bernetesGet the benefits of AWS Cloud on premisesGain the flexibility to run your workloads anywhereBring the power of Amazon EKS to your on-premises applicationsAmazon EKS Hybrid Nodes 2025,Amazon Web Services,Inc.or its affiliates.All rights reserved.Architecture diagram 2025,Amazon Web Services,I

6、nc.or its affiliates.All rights reserved.Check out these other sessionsCNS305:Bring the power of Amazon EKS to your on-premises applicationsThursday(Dec 4)2:00 PM-3:00 PM PST MGM|Level 1|Room 104Session type:Builders sessionCNS210:From monolith to microservice