使用自定义开源 MLFLOW 对 LLM 驱动的应用程序进行高级实验跟踪.pdf

1、2024 Databricks Inc.All rights reserved1Advanced Experiment Advanced Experiment Tracking for LLMTracking for LLM-Powered Applications Powered Applications with Customized Openwith Customized Open-Source MLflowSource MLflowManas Mukherjee,Sr.Staff Software Engineer,IntuitManas Mukherjee,Sr.Staff Soft

2、ware Engineer,IntuitDate:06/11/2024 Date:06/11/2024 2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reserved LLM Applications Overview Why Open Source MLflow Evaluation Process Tracking&Selection of Run&Review Next Steps2AgendaAgendaLLM powered app evaluations tracking using ML

3、FlowLLM powered app evaluations tracking using MLFlow2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedLLM ApplicationsLLM Applications at Intuitat IntuitIntuit Assist:Guides small business owners in QuickBooksCreates launch announcements for marketers in MailchimpHelps C

4、redit Karma members make smart money decisionsTransforms tax preparation in TurboTax3Introduction to LLM-Powered Applications3Importance of ExperimentationImportance of ExperimentationTailoring prompts and configurations for diverse use casesEnsuring high-quality,reliable AI-driven solutionsContinuo

5、us improvement through iterative testing2024 Databricks Inc.All rights reserved2024 Databricks Inc.All rights reservedFlexibility Across Cloud Platforms&ToolsFlexibility Across Cloud Platforms&ToolsSupports various cloud tools:notebooks,spark,pipelines etc.Enables users to stay within their preferre

6、d cloud solutions and workflowsOffers a multi-tenant solution with an intuitive internal UXSelfSelf-managed backend datamanaged backend dataSeamless integration with internal databases and integrations with others MDLC components.mlflow server-backend-store-uri postgresql:/$DB_USER:$DB_PWD$DB_HOST:$