AI 实际用例工程实现不可能：为 Netflix 构建“It's What's Inside： The Game”.pdf

1、Luke BallantineTechnology DirectorENGINEERINGTHE IMPOSSIBLEBuilding Its Whats Inside:The GameWHOS IMITATING CLIFF?Note:The above is not a“real”video,and was generated using AI IDEA On an innovative website,people will join their friends on a video call,swap bodies,and imitate one another.Then,in a c

2、utting edge game of deception,players will vote on who is who.BODYSWAPCALL“So.how would it work?”COULD WE DO REAL TIME?1.VIDEOCLONING2.AUDIOCLONING3.VIDEOCONFERENCINGOur three big rocksWe tried several options including face-swap and portrait animation,but Live Portrait was the best for our needsTo

3、run smoothly at 24 FPS required massive compute power!Real personLive Portrait1.VIDEO CLONINGAI cloneTrial with an NVIDIA 4090 GPU(24GB)+Real-time speech-to-speech voice conversion with low latency+Preserves the original speakers emotional tone and vocal attributes+Near-indistinguishable from“real l

4、ife”-when supported by sufficient computational resources!There was a start-up in this space,but they werent ready for the scale we needed Retrieval based voice conversion(RVC)2.AUDIO CLONINGBringing the audio&video together,into a Zoom-like experience+A video conferencing solution that can be compl

5、etely customised on the frontend+Able to modify the streams for audio&video Live Kit3.VIDEO CONFERENCINGCritical requirements:+NVIDIA A100 GPUs+Guaranteed capacitySecuring high-performance GPU infrastructureINFRASTRUCTUREARCHITECTURE+40%of infrastructure&orchestration code+95%of our backend room service codeTHE PRESSMerci beaucoupThank youThe future.Faster