Multi-hop QA benchmarks often reward Large Language Models (LLMs) for spurious correctness, where models reach correct answers through invalid intermediate reasoning. We propose SAFE, an LLM-as-verifier framework for evidence-grounded multi-hop QA. Rather than judging only the final answer after generation, SAFE verifies reasoning during generation by checking intermediate steps against the provided passages and previous reasoning trajectory. To make this process checkable, SAFE decomposes reasoning into atomic, evidence-grounded units represented with Knowledge Graph (KG) triples. At train-time, SAFE verifies benchmark supervision under KG-grounded constraints and constructs reliable verifier training data. At inference-time, an external verifier checks each generated step, identifies invalid reasoning, and provides correction feedback before errors propagate. Across three multi-hop QA benchmarks, SAFE improves accuracy by 8.8 pp on average. These results show that evidence-grounded multi-hop QA benefits from shifting LLM-based evaluation from post-hoc answer judgment to stepwise reasoning verification.
University of Macau(澳门大学);Xiamen University(厦门大学);Peking University(北京大学);Hanyang University(翰阳大学);University of Liverpool(利物浦大学);Zhejiang University(浙江大学)
Automated Proof Generation for Rust Code via Self-Evolution
Peking University(北京大学);Microsoft Research(微软研究院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Columbia University(哥伦比亚大学);University of California Irvine(加州大学 Irvine 分校)
Safety Testing LLM Agents at Scale: From Risk Discovery to Evidence-Grounded Verification
AntGroup(蚂蚁集团);Zhejiang University(浙江大学);Fudan University(复旦大学);Alibaba Group(阿里巴巴集团);Hunan Institute of Advanced Technology(湖南先进技术研究院);Deakin University(迪肯大学)
A Two-Stage LLM Framework for Accessible and Verified XAI Explanations
Department of Computer Engineering and Informatics, University of Patras(帕特拉大学计算机工程与信息学系);Department of Informatics and Telecommunications, University of Ioannina(伊奥安尼纳大学信息与电信系);Industrial Systems Institute, Athena Research Center(雅典研究中心工业系统研究所);Archimedes Unit, Athena Research Center(雅典研究中心阿基米德单位)