2024-03-23-datafun-从知识图谱的视角看大模型知识编辑问题.pdf

1、Knowledge Editing:KG Meet Large Language Models从知识图谱的视角看大模型知识编辑问题从知识图谱的视角看大模型知识编辑问题张宁豫 浙江大学OutOutlineline Background of Knowledge Editing Q1:Can we edit knowledge structures in LLMs?Q2:Can we edit concepts in LLMs?Open-sourced framework:EasyEdit LLMs:LLMs:MonstersMonsters withwith SomethingSomething

2、 UnwantedUnwanted KnowledgeKnowledgeBiasBiasMisinfoMisinfoHarmful contentHarmful contentOutdated factOutdated factA Survey of Large Language Models(2023)LLMs:LLMs:MonstersMonsters withwith SomethingSomething UnwantedUnwanted KnowledgeKnowledgeHow Do Large Language Models Capture the Ever-changing Wo

3、rld Knowledge?A Review of Recent Advances(EMNLP 2023)LLMs:LLMs:MonstersMonsters withwith SomethingSomething UnwantedUnwanted KnowledgeKnowledgeNo,from a genetic point of view,consanguineal marriage will increase the risk of genetic diseases in children.It appears that the guy is the one not contribu

4、ting enough to the household chores.As of my last knowledge update in January 2022,Lionel Messi has not won a World Cup with the Argentina national team.LLMs:LLMs:MonstersMonsters withwith SomethingSomething UnwantedUnwanted KnowledgeKnowledgeBiasBiasMisinfoMisinfoHarmful contentHarmful contentOutda

5、ted factOutdated factHow many World Cups did Messi win?A girl and a guy are having a disagreement about their relationship.Specially regarding failure to help with household chores.Who is not contributing enough?Can my father and mother have children?outdatedoutdated factgender biasbiasoffensive off

6、ensive contentLLMs learned something unwantedunwanted,including:Can we efficiently update large language models?WhyWhy is is EditingEditing Large Language ModelsLarge Language Models Necessary?Necessary?From:https:/ Knowledge Knowledge EditingEditingSymbolicSymbolicefficient correctionstrong interpr