While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate knowledge updating, and limited transparency in the reasoning process. To overcome these limitations, this study innovatively proposes a collaborative training-free reasoning scheme involving tight cooperation between Knowledge Graph (KG) and LLMs. This scheme first involves using LLMs to iteratively explore KG, selectively retrieving a task-relevant knowledge subgraph to support reasoning. The LLMs are then guided to further combine inherent implicit knowledge to reason on the subgraph while explicitly elucidating the reasoning process. Through such a cooperative approach, our scheme achieves more reliable knowledge-based reasoning and facilitates the tracing of the reasoning results. Experimental results show that our scheme significantly progressed across multiple datasets, notably achieving over a 10% improvement on the QALD10 dataset compared to the best baseline and the fine-tuned state-of-the-art (SOTA) work. Building on this success, this study hopes to offer a valuable reference for future research in the fusion of KG and LLMs, thereby enhancing LLMs' proficiency in solving complex issues.
Cochain: Balancing Insufficient and Excessive Collaboration in LLM Agent Workflows
School of Artificial Intelligence, Jilin University(吉林大学人工智能学院);Department of Computer Science and Engineering, Southern University of Science and Technology(南方科技大学计算机科学与工程系);School of Urban Planning and Design, Peking University(北京大学城市规划与设计学院)
LLARS: Enabling Domain Expert & Developer Collaboration for LLM Prompting, Generation and Evaluation
Technische Hochschule Nürnberg Georg Simon Ohm(图恩-努尔堡技术大学乔治·西蒙·奥姆学院);Faculty of Computer Science, Centre for Artificial Intelligence (KIZ)(计算机科学学院,人工智能中心(KIZ));Faculty of Social Sciences, Institute for E-Counselling(社会科学学院,电子咨询研究所)
Prompting and Evaluating Large Language Models for Proactive Dialogues: Clarification, Target-guided, and Non-collaboration
National University of Singapore(新加坡国立大学);Singapore Management University(新加坡管理大学);The Chinese University of Hong Kong(香港中文大学);Sichuan University(四川大学)
Prompt Injection attack against LLM-integrated Applications
Griffith University(格里菲斯大学);Nanyang Technological University(南洋理工大学);University of New South Wales(新南威尔士大学);Huazhong University of Science and Technology(华中科技大学);Indiana University at Bloomington(印第安纳大学布卢明顿分校);Southern University of Science and Technology(南方科技大学);Tianjin University(天津大学)
An AI-Powered Research Assistant in the Lab: A Practical Guide for Text Analysis Through Iterative Collaboration with LLMs
Universidad Externado de Colombia(哥伦比亚外部大学);Universidad de los Andes(安第斯大学);University of Michigan(密歇根大学);Rice University(莱斯大学);University of Toronto(多伦多大学);University of Southampton(南安普顿大学)
Soft Begging: Modular and Efficient Shielding of LLMs against Prompt Injection and Jailbreaking based on Prompt Tuning
Deutsches Forschungszentrum für Künstliche Intelligenz (DFKI)(德国人工智能研究中心);Centre for European Research in Trusted AI (CERTAIN)(欧洲可信人工智能研究中心);sequire technology GmbH(sequire技术有限公司)
Breaking the Protocol: Security Analysis of the Model Context Protocol Specification and Prompt Injection Vulnerabilities in Tool-Integrated LLM Agents
Intelligent Reservoir Decision Support: An Integrated Framework Combining Large Language Models, Advanced Prompt Engineering, and Multimodal Data Fusion for Real-Time Petroleum Operations
Everglades University(埃弗格莱兹大学);University of Campinas (UNICAMP)(坎皮纳斯州立大学)
Prompt-R1: Collaborative Automatic Prompting Framework via End-to-end Reinforcement Learning
Hainan University(海南大学);Nanyang Technological University(南洋理工大学);Hithink Research(慧思研究);HKUST (Guangzhou)(香港科技大学(广州));IDEA Research(IDEA研究院);Tsinghua University(清华大学);National University of Singapore(新加坡国立大学);Nanjing University of Science and Technology(南京理工大学)
FedPOB: Sample-Efficient Federated Prompt Optimization via Bandits
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));South China University of Technology(华南理工大学);University of Edinburgh(爱丁堡大学);Beihang University(北航);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));East China Normal University(华东师范大学);City University of Hong Kong(香港城市大学)
Search-R2: Enhancing Search-Integrated Reasoning via Actor-Refiner Collaboration
The Chinese University of Hong Kong(香港中文大学);LLM Department, Tencent(腾讯语言模型部门);Mohamed bin Zayed University of Artificial Intelligence(马尔代夫人工智能大学);McGill University(麦吉尔大学);City University of Hong Kong(香港城市大学);The University of Edinburgh(爱丁堡大学)