Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentation
University of Science and Technology of China(中国科学技术大学);City University of Hong Kong(香港城市大学);Jarvis Research Center(贾维斯研究中心);Tencent YouTu Lab(腾讯优图实验室);Peking University(北京大学)
Large Language Models (LLMs) demonstrate remarkable capabilities, yet struggle with hallucination and outdated knowledge when tasked with complex knowledge reasoning, resulting in factually incorrect outputs. Previous studies have attempted to mitigate it by retrieving factual knowledge from large-scale knowledge graphs (KGs) to assist LLMs in logical reasoning and prediction of answers. However, this kind of approach often introduces noise and irrelevant data, especially in situations with extensive context from multiple knowledge aspects. In this way, LLM attention can be potentially mislead from question and relevant information. In our study, we introduce an Adaptive Multi-Aspect Retrieval-augmented over KGs (Amar) framework. This method retrieves knowledge including entities, relations, and subgraphs, and converts each piece of retrieved text into prompt embeddings. The Amar framework comprises two key sub-components: 1) a self-alignment module that aligns commonalities among entities, relations, and subgraphs to enhance retrieved text, thereby reducing noise interference; 2) a relevance gating module that employs a soft gate to learn the relevance score between question and multi-aspect retrieved data, to determine which information should be used to enhance LLMs' output, or even filtered altogether. Our method has achieved state-of-the-art performance on two common datasets, WebQSP and CWQ, showing a 1.9\% improvement in accuracy over its best competitor and a 6.6\% improvement in logical form generation over a method that directly uses retrieved text as context prompts. These results demonstrate the effectiveness of Amar in improving the reasoning of LLMs.
Harnessing Collective Intelligence of LLMs for Robust Biomedical QA: A Multi-Model Approach
Department of Informatics;Kapodistrian University of Athens, Greece;Institute for Fundamental Biomedical Science, Biomedical Sciences Research Center "Alexander Fleming", Greece;Department of Informatics \& Telematics, School of Digital Technology, Harokopio University, Greece;Archimedes, Athena Research Center, Greece
AutoMedEval: Harnessing Language Models for Automatic Medical Capability Evaluation
East China Normal University(东华师范大学);Hasso Plattner Institute/University of Potsdam(哈索·platzer研究所/波茨坦大学);Tongji University(同济大学);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室)
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Self-Knowledge Guided Retrieval Augmentation for Large Language Models
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Institute for AI, Tsinghua University(清华大学人工智能研究院);Beijing National Research Center for Information Science and Technology(北京信息科学与技术国家研究中心)
Investigating the Factual Knowledge Boundary of Large Language Models with Retrieval Augmentation
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Baidu Inc.(百度公司);Beijing Key Laboratory of Big Data Management and Analysis Methods(北京市大数据管理与分析方法重点实验室)
The Atlas of In-Context Learning: How Attention Heads Shape In-Context Retrieval Augmentation
Department of Artificial Intelligence, Fraunhofer Heinrich Hertz Institute(人工智能系,弗劳恩霍夫海因里希·赫兹研究所);Department of Electrical Engineering and Computer Science, Technische Universität Berlin(电气工程与计算机科学系,柏林技术大学);BIFOLD - Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究所);Centre of eXplainable Artificial Intelligence, Technological University Dublin(可解释人工智能中心,都柏林技术大学)
Data Augmentation for Biomedical Factoid Question Answering
Athens University of Economics and Business(雅典经济与商业大学);Institute for Language and Speech Processing, Research Center ‘Athena’(“雅典娜”研究中心语言与语音处理研究所);Institute of Informatics and Telecommunications, NCSR ‘Demokritos’(国家科学研究中心“德谟克利特”信息与电信研究所)
Harnessing Multi-Role Capabilities of Large Language Models for Open-Domain Question Answering
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Nankai University(南开大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Moqi, Inc.(墨奇科技);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);University of Electronic Science and Technology of China(电子科技大学)
Technical report on Conversational Question Answering
ZhuiYi Technology(追一科技)
会话问答是一项具有挑战性的任务,因为它需要了解会话历史。在这个项目中,我们提出了一个新的系统RoBERTa + AT +KD,它涉及理性标记多任务,对抗训练,知识蒸馏和语言后处理策略。在没有数据增强的情况下,我们的单一模型在CoQA测试集上达到90.4(F1),比当前最先进的单一模型高出2.6%F1。
Gotta: Generative Few-shot Question Answering by Prompt-based Cloze Data Augmentation
University of California, Los Angeles(加州大学洛杉矶分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Univ of Technology Sydney(悉尼科技大学);Amazon Search(亚马逊搜索)