使用图像比较进行多语言文档中的文本变化检测
Text Change Detection in Multilingual Documents Using Image Comparison
AI总结:
针对多语言文档比较中OCR语言模型选择困难及混合模型性能受限的问题,提出基于词级图像比较和多尺度注意力特征的TCD模型,并构建多语言打印扫描词对数据集进行验证。
摘要:
文档比较通常依赖光学字符识别(OCR)作为其核心技术。然而,OCR需要为每个文档选择适当的语言模型,并且多语言或混合模型的性能仍然有限。为克服这些挑战,我们提出使用专为多语言文档定制的图像比较模型进行文本变化检测(TCD)。与基于OCR的方法不同,我们的方法采用词级文本图像到图像比较来检测变化。我们的模型生成源文档与目标文档之间的双向变化分割图。为在无需显式文本对齐或缩放预处理的情况下提升性能,我们利用多尺度注意力特征之间的相关性。我们还构建了一个基准数据集,包含各种语言的实际打印和扫描词对,用于评估我们的模型。我们使用该基准数据集以及公开基准 Distorted Document Images 和 LRDE Document Binarization Dataset 验证了我们的方法。我们将模型与最先进的语义分割和变化检测模型以及传统的基于OCR的模型进行了比较。
英文摘要:
Document comparison typically relies on optical character recognition (OCR) as its core technology. However, OCR requires the selection of appropriate language models for each document and the performance of multilingual or hybrid models remains limited. To overcome these challenges, we propose text change detection (TCD) using an image comparison model tailored for multilingual documents. Unlike OCR-based approaches, our method employs word-level text image-to-image comparison to detect changes. Our model generates bidirectional change segmentation maps between the source and target documents. To enhance performance without requiring explicit text alignment or scaling preprocessing, we employ correlations among multi-scale attention features. We also construct a benchmark dataset comprising actual printed and scanned word pairs in various languages to evaluate our model. We validate our approach using our benchmark dataset and public benchmarks Distorted Document Images and the LRDE Document Binarization Dataset. We compare our model against state-of-the-art semantic segmentation and change detection models, as well as to conventional OCR-based models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。