arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.11567cs.CL
收藏

AUEB-Archimedes 在 RIRAG-2025 中:义务拼接真的是全部所需吗?

AUEB-Archimedes at RIRAG-2025: Is obligation concatenation really all you need?

Athens University of Economics and Business(雅典经济与商业大学);Archimedes/Athena RC(阿基米德/雅典娜研究中心)

Ioannis Chasandras, Odysseas S. Chlapanis, Ion Androutsopoulos

AI总结:

本文提出结合三种检索模型与重排序器,利用RePASs提取义务并迭代优化,生成可读且高分的监管问答答案。

摘要:

本文介绍了我们为 RIRAG-2025 共享任务开发的系统,该任务要求通过检索相关段落来回答监管问题。生成的答案使用 RePASs(一种无参考且基于模型的评估指标)进行评测。我们的系统结合了三种检索模型和一个重排序器。我们展示了通过利用 RePASs 中从检索段落提取重要句子(“义务”)的神经组件,我们获得了可疑的高分(0.947),尽管答案直接从检索段落中提取,并非真正生成的答案。随后,我们展示了通过在几个生成的候选中选择具有最佳 RePASs 分数的答案,并通过减少矛盾、覆盖更多义务来迭代优化该答案,我们可以生成可读、连贯的答案,获得更合理且相对较高的分数(0.639)。

英文摘要:

This paper presents the systems we developed for RIRAG-2025, a shared task that requires answering regulatory questions by retrieving relevant passages. The generated answers are evaluated using RePASs, a reference-free and model-based metric. Our systems use a combination of three retrieval models and a reranker. We show that by exploiting a neural component of RePASs that extracts important sentences ('obligations') from the retrieved passages, we achieve a dubiously high score (0.947), even though the answers are directly extracted from the retrieved passages and are not actually generated answers. We then show that by selecting the answer with the best RePASs among a few generated alternatives and then iteratively refining this answer by reducing contradictions and covering more obligations, we can generate readable, coherent answers that achieve a more plausible and relatively high score (0.639).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑