使用 LLM 进行文本摘要的生成式 AI.pdf

1、Generative AI for Text Summarization using LLMsApril,2024PresenterGagandeep Dua,Vice President Gagandeep Dua,Vice President JPMorgan ChaseAgenda1.LLM App Project Lifecycle2.Text Summarization Use Case and Scope 3.Selecting the Right LLM4.Training&Adaptationa.Summarization using Foundational Modelsb.

2、Fine Tuning c.Evaluation using Rouge Metrics5.Q&ALLM App Project Lifecycle Define the Use Case,ScopeSelect right LLM Training&Adaptation 01020304Deployment and MonitoringPretraining Prompt EngineeringFine TuningEvaluation and IterationDefine the Use Case and Scope1 1LLM Use CasesLLM Use Cases1.Text/

3、Content Generation2.Text Summarization3.Language Translation4.Text Classification 5.Question Answering6.Named Entity Recognition7.Automated Text SummarizationScope of Text SummarizationScope of Text Summarization1.Research Reports2.Blogs3.Financial Statements4.Dialogues5.News 6.Large Documents7.Doma

4、in-Finance,Legal,etc.Selecting the Right LLM 2 2Encoder OnlyEncoder Only BERT DistilBERT RoBERTa Decoder Branch Decoder Branch GPT Family Jurassic LLaMAEncoder/Decoder Encoder/Decoder T5 Pegasus BART Text Completion Text Generation Translation Q&A Text Classification Sentiment Analysis Named Entity

5、Recognition Translation Text Summarization Question&AnsweringTraining&Adaptation-Hugging Face OverviewModelsModelsDatasetsDatasetsMetricsMetricsDocsDocsTokenizersTokenizersTransformersTransformersDatasetsDatasetsAccelerateAccelerateHugging Face HubHugging Face HubHugging Face LibrariesHugging Face L

6、ibraries3 3Training&Adaptation:Summarization using Foundational ModelsDialogueDialogueEncoder OnlyEncoder OnlySandra asks Louis about Hugging Face for NLP.Sandra asks Louis about Hugging Face for NLP.Louis praises their text generation.Sandra talks BERT for sentiment analysis.Louis praises their tex