arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.17428cs.CLcs.DL
收藏

CLOCR-C:利用预训练语言模型进行上下文感知的OCR纠错

CLOCR-C: Context Leveraging OCR Correction with Pre-trained Language Models

Centre for Advanced Spatial Analysis, University College London(伦敦大学学院高级空间分析中心)

Jonathan Bourne

AI总结:

本文提出CLOCR-C方法,利用预训练语言模型的上下文能力进行OCR后纠错,实验显示可显著降低字符错误率并提升下游任务性能,同时发布新数据集以促进研究。

摘要:

历史印刷媒体档案的数字化对于提高当代记录的可访问性至关重要。然而,用于将物理记录转换为数字文本的光学字符识别(OCR)过程容易出错,尤其是在报纸和期刊等具有复杂版式的材料中。本文介绍了上下文感知的OCR纠错(CLOCR-C),该方法利用基于Transformer的语言模型(LMs)的填充和上下文自适应能力来提高OCR质量。本研究旨在确定语言模型能否执行OCR后纠错、改善下游自然语言处理任务,以及在纠错过程中提供社会文化背景的价值。实验使用了七种语言模型,在三个数据集上进行:19世纪期刊版(NCSE)和来自Overproof集合的两个数据集。结果表明,一些语言模型能够显著降低错误率,其中表现最好的模型在NCSE数据集上实现了字符错误率降低超过60%。OCR的改进延伸到了下游任务,如命名实体识别,余弦命名实体相似度有所提高。此外,研究表明,在提示中提供社会文化背景可以提高性能,而误导性提示则会降低性能。除上述发现外,本研究还发布了一个包含91篇来自NCSE的转录文章的数据集,总计4万词,以支持该领域的进一步研究。研究结果表明,CLOCR-C是一种通过利用语言模型中嵌入的社会文化信息和需要纠正的文本来提高现有数字档案质量的有前景的方法。

英文摘要:

The digitisation of historical print media archives is crucial for increasing accessibility to contemporary records. However, the process of Optical Character Recognition (OCR) used to convert physical records to digital text is prone to errors, particularly in the case of newspapers and periodicals due to their complex layouts. This paper introduces Context Leveraging OCR Correction (CLOCR-C), which utilises the infilling and context-adaptive abilities of transformer-based language models (LMs) to improve OCR quality. The study aims to determine if LMs can perform post-OCR correction, improve downstream NLP tasks, and the value of providing the socio-cultural context as part of the correction process. Experiments were conducted using seven LMs on three datasets: the 19th Century Serials Edition (NCSE) and two datasets from the Overproof collection. The results demonstrate that some LMs can significantly reduce error rates, with the top-performing model achieving over a 60\% reduction in character error rate on the NCSE dataset. The OCR improvements extend to downstream tasks, such as Named Entity Recognition, with increased Cosine Named Entity Similarity. Furthermore, the study shows that providing socio-cultural context in the prompts improves performance, while misleading prompts lower performance. In addition to the findings, this study releases a dataset of 91 transcribed articles from the NCSE, containing a total of 40 thousand words, to support further research in this area. The findings suggest that CLOCR-C is a promising approach for enhancing the quality of existing digital archives by leveraging the socio-cultural information embedded in the LMs and the text requiring correction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑