1、2024 Databricks Inc.All rights reservedREVOLUTIONIZING REVOLUTIONIZING INSURANCE INSURANCE CUSTOMER CUSTOMER SERVICESERVICEEduardo Fernndez Carrin Eduardo Fernndez Carrin Manuel Valero MndezManuel Valero MndezSan Francisco San Francisco-June 2024June 202412024 Databricks Inc.All rights reservedWe de
2、livered an GenAI-based Assistant in few weeks!Available on smartphones,tablets,or laptops24-7Answers in real-time2THE FINAL PRODUCTTHE FINAL PRODUCTFor an insurance agents:from 1.5 minutes to 13 seconds2024 Databricks Inc.All rights reserved 100 xBase lineScenario 1Scenario 2Base lineScenario 1Scena
3、rio 231PRODUCTION NUMBERSPRODUCTION NUMBERSScenariosScenarios2024 Databricks Inc.All rights reserved24/7Chat historyStack:Azure Open AIAzure Cognitive SearchDatabricksCopilot StudioFor Agents8,000 usersAnnual cost:$140K-$160KFor customers1,000,000 usersAnnual cost:100 xBase lineScenario 1Scenario 2B
4、ase lineScenario 1Scenario 232PRODUCTION NUMBERSPRODUCTION NUMBERSScenariosScenariosChallenge!2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved33NEXT STEPSNEXT STEPS&CONCLUSIONS&CONCLUSIONS2024 Databricks Inc.All rights reserved34NEXT STEPSNEXT STEPSFocus on fine tuning
5、to improve performanceoEmbeddingso RetrievalScouting more Open Source LLMs(LLaMa 3,DBRX,Mistral,etc.)to reduce costsCollect Feedback from agents in each answerInclude links to the source in the answersEnrich answers with Platform data:Lakehouse connection SQL Agent(Text to SQL)Increase source volume
6、try,more docs and data bases!2024 Databricks Inc.All rights reservedAnswers accuracy Answers accuracy human behaviorhuman behaviorTime saved Time saved in document searchin document search35CONCLUSIONSCONCLUSIONSRecapRecapRAG Template at RA