arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.13489cs.ETcs.IR
收藏

PolicyBot——面向政策文档的可靠问答系统

PolicyBot - Reliable Question Answering over Policy Documents

Shiv Nadar University(希夫·纳德大学);IIT Madras(印度理工学院马德拉斯分校)

Gautam Nagarajan, Omir Kumar, Sudarsun Santhiappan

AI总结:

针对政策文档冗长复杂、普通民众难以检索理解相关信息的问题,提出开源RAG系统PolicyBot,通过多模块优化实现可信可复现的政策问答,可适配其他文档问答场景。

摘要:

一个国家的全体公民都会受到政府出台的法律与政策的影响,这些法律政策对公民发挥着关键作用,比如赋予其特定权利或规定明确义务。但这类文档通常篇幅冗长、内容复杂、难以检索查阅,导致公民很难定位并理解其中的相关信息。本研究提出PolicyBot,这是一款面向政策文档回答用户查询的检索增强生成(RAG)系统,核心聚焦透明度与可复现性。该系统融合了领域特定语义分块、多语言稠密嵌入、带重排序的多阶段检索以及来源感知生成技术,可生成基于原始文档的回复。我们实现了引用追踪功能以减少幻觉、提升用户信任度,同时评估了不同的检索与生成配置方案以确定有效的设计选择。整套端到端流程完全基于开源工具构建,可轻松适配其他需要基于文档的问答场景的领域。本研究还梳理了在治理相关场景部署可信RAG系统时的设计考量、实际挑战与经验总结。

英文摘要:

All citizens of a country are affected by the laws and policies introduced by their government. These laws and policies serve essential functions for citizens. Such as granting them certain rights or imposing specific obligations. However, these documents are often lengthy, complex, and difficult to navigate, making it challenging for citizens to locate and understand relevant information. This work presents PolicyBot, a retrieval-augmented generation (RAG) system designed to answer user queries over policy documents with a focus on transparency and reproducibility. The system combines domain-specific semantic chunking, multilingual dense embeddings, multi-stage retrieval with reranking, and source-aware generation to provide responses grounded in the original documents. We implemented citation tracing to reduce hallucinations and improve user trust, and evaluated alternative retrieval and generation configurations to identify effective design choices. The end-to-end pipeline is built entirely with open-source tools, enabling easy adaptation to other domains requiring document-grounded question answering. This work highlights design considerations, practical challenges, and lessons learned in deploying trustworthy RAG systems for governance-related contexts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑