GraphTranslator0323.pdf

1、GraphTranslator:Aligning Graph Model to Large Language Model for Open-ended TasksCheng YBeijing University of Posts and TelecommunicationsOutline Background:Graph Founda1on Model Our Recent A9empts Future Direc1onsOutline Background:Graph Founda1on Model Our Recent A9empts Future Direc1onsFounda,on

2、Models“A foundation model is any model that is trained on broad data and can be adapted to a wide range of downstream tasks.”11 R.Bommasani,D.A.Hudson,E.Adeli,R.Altman,S.Arora,S.von Arx,M.S.Bernstein,J.Bohg,A.Bosselut,E.Brun-skill,et al.,“On the opportunities and risks of foundation models,”arXiv pr

3、eprint arXiv:2108.07258,2021LanguageUSMGPT4Foundation models have become a reality in language,vision,and speech.VisionSpeechCharacteris,cs of Founda,on Models Emergence suggests that as a founda1on model scales up,it may spontaneously manifest novel capabili1es.2 Homogeniza1on alludes to the models

4、 versa1lity,enabling its deployment across diverse applica1ons.Machine Transla-onQ&AText Genera-onInforma-on Extrac-onHomogeniza-onFounda-on ModelEmergence2 Wei J,Tay Y,Bommasani R,et al.Emergent abilities of large language modelsJ.arXiv preprint arXiv:2206.07682,2022.Large Language Models(LLMs)With

5、 billions of parameters,LLMs have shown abilities towards artificial general intelligence(AGI),e.g.,understanding,reasoning,planning,etc.3 Zhao W X,Zhou K,Li J,et al.A survey of large language modelsJ.arXiv preprint arXiv:2303.18223,2023.On the other handGraph(network)is a common language for descri

6、bing relational data.Citation NetworkSocial NetworkMolecule GraphUser-item GraphInternetDrug Interaction GraphA History of Graph Theory&Learning17361950s1990s2000sGraph TheoryEulers seven bridgesGraph AlgorithmDijkstras shortest pathGraph ModelsRandom graph,Stochas-c block model,Scale-free network20