arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.02253cs.CL
收藏

推进OCR后纠错:合成数据的比较研究

Advancing Post-OCR Correction: A Comparative Study of Synthetic Data

Insight Centre for Data Analytics(数据分析洞察中心);School of Computer Science, University College Dublin(都柏林大学学院计算机科学学院)

Shuhao Guan, Derek Greene

AI总结:

该研究探索合成数据在OCR后纠错中的应用,提出基于计算机视觉字形相似度的合成数据生成算法,验证ByT5等模型无需人工标注即可降低CER,且新方法在低资源语言上更具优势。

摘要:

本文从多个维度探索合成数据在OCR后处理领域的应用,通过实验评估数据量、增强方式及合成数据生成方法对模型性能的影响。此外,我们提出一种新算法,利用计算机视觉特征检测算法计算字形相似度,用于构建OCR后处理合成数据。通过在包括多种低资源语言在内的多语言上开展实验,我们证明ByT5等模型无需人工标注数据即可显著降低字符错误率(CER),且我们提出的合成数据生成方法优于传统方法,在低资源语言中优势尤为明显。

英文摘要:

This paper explores the application of synthetic data in the post-OCR domain on multiple fronts by conducting experiments to assess the impact of data volume, augmentation, and synthetic data generation methods on model performance. Furthermore, we introduce a novel algorithm that leverages computer vision feature detection algorithms to calculate glyph similarity for constructing post-OCR synthetic data. Through experiments conducted across a variety of languages, including several low-resource ones, we demonstrate that models like ByT5 can significantly reduce Character Error Rates (CER) without the need for manually annotated data, and our proposed synthetic data generation method shows advantages over traditional methods, particularly in low-resource languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑