arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.03053cs.CL
收藏

DOLFIN——面向机器翻译的文档级金融测试集

DOLFIN -- Document-Level Financial test set for Machine Translation

Univ. Grenoble Alpes(格勒诺布尔大学);CNRS(法国国家科学研究中心);Grenoble INP(格勒诺布尔理工学院);Institute of Engineering Univ. Grenoble Alpes(格勒诺布尔大学工程学院);LIG(信息与信号处理实验室);Lingua Custodia

Mariam Nakhlé, Marco Dinarelli, Raheel Qader, Emmanuelle Esperança-Rodier, Hervé Blanchon

AI总结:

本文提出文档级金融机器翻译测试集DOLFIN,以章节对齐替代句子对齐,覆盖五个语言对,能有效区分上下文敏感与上下文无关模型并暴露金融翻译缺陷。

摘要:

尽管文档级机器翻译(MT)受到了强烈的学术关注,但专门用于该任务的测试集仍然稀缺。现有测试集主要覆盖通用领域的话题,在法律和金融等专业领域存在明显不足。此外,尽管它们具有文档级特征,但仍遵循句子级逻辑,无法涵盖信息重组等特定语言现象。在本工作中,我们旨在通过提出一个新的测试集DOLFIN来填补这一空白。该数据集由专业金融文档构建而成,通过放弃完美对齐句子的范式、以章节而非句子为单位呈现数据,向真正的文档级机器翻译迈出了一步。该测试集在五个语言对上平均包含1950个对齐章节。我们详细介绍了一套数据收集流程,可为对齐新的文档级数据集提供参考。我们通过评估多个模型证明了该测试集的实用性和质量。结果表明,该测试集能够区分上下文敏感模型与上下文无关模型,并揭示模型在准确翻译金融文本时的不足。该测试集已向社区公开发布。

英文摘要:

Despite the strong research interest in document-level Machine Translation (MT), the test sets dedicated to this task are still scarce. The existing test sets mainly cover topics from the general domain and fall short on specialised domains, such as legal and financial. Also, in spite of their document-level aspect, they still follow a sentence-level logic that does not allow for including certain linguistic phenomena such as information reorganisation. In this work, we aim to fill this gap by proposing a novel test set: DOLFIN. The dataset is built from specialised financial documents, and it makes a step towards true document-level MT by abandoning the paradigm of perfectly aligned sentences, presenting data in units of sections rather than sentences. The test set consists of an average of 1950 aligned sections for five language pairs. We present a detailed data collection pipeline that can serve as inspiration for aligning new document-level datasets. We demonstrate the usefulness and quality of this test set by evaluating a number of models. Our results show that the test set is able to discriminate between context-sensitive and context-agnostic models and shows the weaknesses when models fail to accurately translate financial texts. The test set is made public for the community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑