arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.06244cs.CV
收藏

CLEval:文本检测和识别任务的计算机级评估

CLEval: Character-Level Evaluation for Text Detection and Recognition Tasks

Clova AI Research, NAVER Corp.(NAVER公司Clova人工智能研究院);Yale University(耶鲁大学)

Youngmin Baek, Daehyun Nam, Sungrae Park, Junyeop Lee, Seung Shin, Jeonghun Baek, Chae Young Lee, Hwalsuk Lee

摘要:

尽管文本检测和识别方法最近取得了成功,但现有的评估指标无法在这些方法之间提供公平可靠的比较。此外,不存在将OCR任务的特征考虑在内的端到端评估度量。先前的端到端度量包含来自检测和识别任务中应用的二进制评分过程的级联错误。忽略部分正确的结果会增加定量和定性分析之间的差距,并阻止细粒度的评估。基于文字是文本的关键元素这一事实,本文提出了一个文本级评价指标(CLEval)。在CLEval中,\textit{instance matching}进程处理拆分和合并检测案例,而\textit{scoring process}执行字符级评估。通过聚合字符级别的分数,CLEval指标提供了对端到端结果的细粒度评估,包括检测和识别以及从最终性能角度对每个模块的单独评估。我们相信,我们的指标可以在开发和分析最先进的文本检测和识别方法中发挥关键作用。评估代码可在https://github.com/clovaai/CLEval上公开获取。

英文摘要:

Despite the recent success of text detection and recognition methods, existing evaluation metrics fail to provide a fair and reliable comparison among those methods. In addition, there exists no end-to-end evaluation metric that takes characteristics of OCR tasks into account. Previous end-to-end metric contains cascaded errors from the binary scoring process applied in both detection and recognition tasks. Ignoring partially correct results raises a gap between quantitative and qualitative analysis, and prevents fine-grained assessment. Based on the fact that character is a key element of text, we hereby propose a Character-Level Evaluation metric (CLEval). In CLEval, the \textit{instance matching} process handles split and merge detection cases, and the \textit{scoring process} conducts character-level evaluation. By aggregating character-level scores, the CLEval metric provides a fine-grained evaluation of end-to-end results composed of the detection and recognition as well as individual evaluations for each module from the end-performance perspective. We believe that our metrics can play a key role in developing and analyzing state-of-the-art text detection and recognition methods. The evaluation code is publicly available at https://github.com/clovaai/CLEval.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑