arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2509.16977cs.CVcs.LG

低资源场景下手写文本识别的最优传输方法

Optimal Transport for Handwritten Text Recognition in a Low-Resource Regime

Robotics Institute, Athena Research Center(机器人研究所,亚特兰蒂斯研究中心);School of ECE, National Technical University of Athens(电子工程学院,国家技术大学雅典);Department of SGE, University of West Attica(SGE系,西阿提卡大学);HERON - Hellenic Robotics Center of Excellence, Athens, Greece(HERON - 希腊机器人卓越中心)

Petros Georgoulas Wraight, Giorgos Sfikas, Ioannis Kordonis, Petros Maragos, George Retsinas

AI总结:

针对低资源场景下手写文本识别标注数据稀缺的问题,本文提出基于最优传输的迭代自举框架,通过视觉-语义对齐生成伪标签提升识别准确率,在基准测试中效果显著。

摘要:

手写文本识别(Handwritten Text Recognition,HTR)是文档图像理解领域的核心任务。当前最先进的HTR方法需依赖大量标注集训练,在历史档案或小规模现代集合等低资源领域难以应用。本文提出一种新型框架,不同于标准HTR模型范式,该框架可利用温和的词汇特征先验知识,适用于标注数据稀缺的场景。我们提出一种迭代自举方法,使用最优传输(Optimal Transport,OT)将从未标注图像提取的视觉特征与语义词表示对齐:从最小标注示例集开始,框架迭代将词图像与文本标签匹配,为高置信度对齐生成伪标签,并在不断增长的数据集上重新训练识别器。数值实验表明,该迭代视觉-语义对齐方案可显著提升低资源HTR基准的识别准确率。

英文摘要:

Handwritten Text Recognition (HTR) is a task of central importance in the field of document image understanding. State-of-the-art methods for HTR require the use of extensive annotated sets for training, making them impractical for low-resource domains like historical archives or limited-size modern collections. This paper introduces a novel framework that, unlike the standard HTR model paradigm, can leverage mild prior knowledge of lexical characteristics; this is ideal for scenarios where labeled data are scarce. We propose an iterative bootstrapping approach that aligns visual features extracted from unlabeled images with semantic word representations using Optimal Transport (OT). Starting with a minimal set of labeled examples, the framework iteratively matches word images to text labels, generates pseudo-labels for high-confidence alignments, and retrains the recognizer on the growing dataset. Numerical experiments demonstrate that our iterative visual-semantic alignment scheme significantly improves recognition accuracy on low-resource HTR benchmarks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑