ForMaT:用于视觉接地多语言PDF翻译的数据集
ForMaT: Dataset for Visually-Grounded Multilingual PDF Translation
AI总结:
ForMaT通过3956个PDF构建多语言翻译数据集,保留布局元数据以提升多模态翻译效果,采用K-Medoids采样捕捉复杂元素,揭示当前MT系统在空间接地与几何同步上的不足,为布局感知翻译模型提供基准。
摘要:
我们介绍了ForMaT(Format-Preserving Multilingual Translation),一个包含3956个PDF的平行语料库,覆盖15种语言对,旨在为多模态机器翻译保留原始布局元数据。为确保数据集的结构多样性,我们采用K-Medoids采样45种几何特征,捕捉复杂元素如嵌套表格和公式,以专注于视觉上多样的PDF文档。我们的评估显示,当前MT系统在空间接地和几何同步方面存在困难,常常失去文本与其视觉上下文之间的联系。ForMaT为开发能够整合视觉和文本上下文的布局感知翻译模型提供了基准,以实现高保真的文档重建。
英文摘要:
We present ForMaT (Format-Preserving Multilingual Translation), a parallel corpus of 3,956 PDFs across 15 language pairs that preserves original layout metadata proposed for multimodal machine translation. To ensure structural diversity in the dataset, we employ K-Medoids sampling over 45 geometric features, capturing complex elements like nested tables and formulas to focus only on visually diverse PDF documents. Our evaluation reveals that current MT systems struggle with spatial grounding and geometric synchronization, often losing the link between text and its visual context. ForMaT provides a benchmark for developing layout-aware translation models that integrate visual and textual context for high-fidelity document reconstruction.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。