Retrieval-augmented generation (RAG) has become integral to large language models (LLMs), particularly for conversational AI systems where user questions may reference knowledge beyond the LLMs' training cutoff. However, many natural user questions lack well-defined answers, either due to limited domain knowledge or because the retrieval system returns documents that are relevant in appearance but uninformative in content. In such cases, LLMs often produce hallucinated answers without flagging them. While recent work has largely focused on questions with false premises, we study out-of-scope questions, where the retrieved document appears semantically similar to the question but lacks the necessary information to answer it. In this paper, we propose a guided hallucination-based approach ELOQ to automatically generate a diverse set of out-of-scope questions from post-cutoff documents, followed by human verification to ensure quality. We use this dataset to evaluate several LLMs on their ability to detect out-of-scope questions and generate appropriate responses. Finally, we introduce an improved detection method that enhances the reliability of LLM-based question-answering systems in handling out-of-scope questions.
Attention Expansion: Enhancing Keyphrase Extraction from Long Documents with Attention-Augmented Contextualized Embeddings
Institute for Research in Technology, ICAI School of Engineering, Comillas Pontifical University(技术研究所,ICAI工程学院,科米利亚斯宗座大学);DD-AIM, Senior Machine Learning Researcher(DD-AIM,高级机器学习研究员)
LevelRAG: Enhancing Retrieval-Augmented Generation with Multi-hop Logic Planning over Rewriting Augmented Searchers
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Chinese Academy of Sciences(中国科学院);University of Chinese Academy of Sciences(中国科学院大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Enhancing Autonomous Vehicle Training with Language Model Integration and Critical Scenario Generation
Imperial College London(帝国理工学院);Centre for Transport Engineering and Modelling(交通工程与建模中心);Department of Civil and Environmental Engineering(土木与环境工程系);Personal Robotics Laboratory(个人机器人实验室)
Automating Bibliometric Analysis with Sentence Transformers and Retrieval-Augmented Generation (RAG): A Pilot Study in Semantic and Contextual Search for Customized Literature Characterization for High-Impact Urban Research
Oak Ridge National Laboratory(橡树岭国家实验室);The University of Tennessee(田纳西大学)
Gradient Co-occurrence Analysis for Detecting Unsafe Prompts in Large Language Models
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);IT Innovation and Research Center, Huawei Technologies(华为技术有限公司IT创新研究中心);Artificial Intelligence Academy, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院)
Machine Learning Information Retrieval and Summarisation to Support Systematic Review on Outcomes Based Contracting
University of Warwick(华威大学);Alan Turing Institute for Data Science and AI(艾伦·图灵数据科学与人工智能研究所);Cranfield University(克兰菲尔德大学);Government Outcomes Lab(政府成果实验室);Blavatnik School of Government(布拉瓦尼克政府学院);University of Oxford(牛津大学)
Context-Fidelity Boosting: Enhancing Faithful Generation through Watermark-Inspired Decoding
Hunyuan AI Digital Human, Tencent(腾讯文深AI数字人);McGill University(麦吉尔大学);Mila - Quebec AI Institute(魁北克人工智能研究所);Wuhan University(武汉大学);University of Montreal(蒙特利尔大学);Tsinghua University(清华大学);MBZUAI