通过 GPU 服务提供特定领域的 LLMs：IFC MALENA 案例.pdf

1、2024 Databricks Inc.All rights reservedOfficial Use OnlyBlaise Sandwidi,Ph.D.&Jonathan LorentzBlaise Sandwidi,Ph.D.&Jonathan LorentzInternational Finance CorporationInternational Finance Corporation1IFCS MACHINE IFCS MACHINE LEARNING ESG LEARNING ESG ANALYST PLATFORMANALYST PLATFORMDelivering domain

2、 specific LLMs with GPU serving:Case of IFC MALENA2024 Databricks Inc.All rights reservedOfficial Use Only22024 Databricks Inc.All rights reservedOfficial Use Only3IBRDIDAIFCMIGAICSID$44 billion$44 billionworker safetypollutionpreventionstakeholder engagement2024 Databricks Inc.All rights reservedOf

3、ficial Use Only42024 Databricks Inc.All rights reservedOfficial Use OnlyDATA+ARTIFICIAL INTELLIGENCE DATA+ARTIFICIAL INTELLIGENCE FORFOR DEVELOPMENT IMPACTDEVELOPMENT IMPACT570+Years IFC Historical DataIFC 200+ESG SpecialistsESG-domain Specific AIwww.malena.ifc.org2024 Databricks Inc.All rights rese

4、rvedOfficial Use OnlyINTRODUCTION TO MALENAINTRODUCTION TO MALENA62024 Databricks Inc.All rights reservedOfficial Use OnlySPEED&ACCURACYSPEED&ACCURACY719,000 19,000 sentences/minsentences/min91%accurate91%accurate2024 Databricks Inc.All rights reservedOfficial Use OnlyINFRASTRUCTURE SET UP INFRASTRU

5、CTURE SET UP 8Public&RegulatoryPublic&RegulatoryIFC Projects DataAlternate/News ReportsIFC Projects DataAlternate/News ReportsAzure DatabricksData FactoryINGEST+STOREINGEST+STORELLMsLLMs +TRAIN+TRAIN3.Model 3.Model ServingServing2.Azure 2.Azure Functions Functions 1.Workflow 1.Workflow Spark JobsSpa

6、rk JobsBatch inferenceRealtime inference Batch inferenceRealtime inference Mounting Mounting 2024 Databricks Inc.All rights reservedOfficial Use OnlyESGESG-DOMAIN AI FOR EMERGING MARKETS DOMAIN AI FOR EMERGING MARKETS 9ESGESG SentimentAnalysis(91%91%acc)RAG+Question&Answering(85%85%acc)TranslationNa