arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.04699cs.CLcs.CV

跨语言 SynthDocs:一个面向任意语言到阿拉伯语 OCR 与文档理解的大规模合成语料库

Cross-Lingual SynthDocs: A Large-Scale Synthetic Corpus for Any to Arabic OCR and Document Understanding

Haneen Al-Homoud, Asma Ibrahim, Murtadha Al-Jubran, Fahad Al-Otaibi, Yazeed Al-Harbi, Daulet Toibazar, Kesen Wang, Pedro J. Moreno

AI总结:

本文提出大规模合成语料库 Cross-Lingual SynthDocs,通过真实扫描背景、双语版面与变音符号感知字体构建超 250 万样本,微调 Qwen-2.5-VL 后在阿拉伯语 OCR 和文档理解多项指标上取得一致提升。

摘要:

跨语言 SynthDocs 是一个大规模合成语料库,旨在解决阿拉伯语在光学字符识别(OCR)和文档理解(DU)方面资源稀缺的问题。该数据集包含超过 250 万个样本,其中包括 150 万条文本数据、27 万张完全标注的表格,以及数十万张基于真实数据的图表。我们的构建流程利用真实扫描背景、双语版面布局和区分变音符号的字体,以捕捉阿拉伯语文档在排版和结构上的复杂性。除文本外,该语料库还包含多种渲染风格的图表和表格。在 SynthDocs 上微调 Qwen-2.5-VL 后,在多个公开阿拉伯语基准上,OCR 方面的词错误率(WER)和字符错误率(CER)均取得一致改进,同时在其他模态中,树编辑距离相似度(TEDS)和图表提取分数(CharTeX)也有所提升。SynthDocs 为推进多语言文档分析研究提供了一个可扩展且视觉逼真的资源。

英文摘要:

Cross-Lingual SynthDocs is a large-scale synthetic corpus designed to address the scarcity of Arabic resources for Optical Character Recognition (OCR) and Document Understanding (DU). The dataset comprises over 2.5 million of samples, including 1.5 million textual data, 270K fully annotated tables, and hundred thousands of real data based charts. Our pipeline leverages authentic scanned backgrounds, bilingual layouts, and diacritic aware fonts to capture the typographic and structural complexity of Arabic documents. In addition to text, the corpus includes variety of rendered styles for charts and tables. Finetuning Qwen-2.5-VL on SynthDocs yields consistent improvements in Word Error Rate (WER) and Character Error Rate (CER) in terms of OCR across multiple public Arabic benchmarks, Tree-Edit Distance Similarity (TEDS) and Chart Extraction Score (CharTeX) improved as well in other modalities. SynthDocs provides a scalable, visually realistic resource for advancing research in multilingual document analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑