Ancient-Bench:用于中国古代文物文字识别的综合多千年、多介质、多文字基准数据集
Ancient-Bench: A Comprehensive Multi-millennial, Multi-medium, and Multi-script Benchmark for Ancient Chinese Artifact Text Recognition
- South China University of Technology(华南理工大学)
- Huawei Technologies Co., Ltd.(华为技术有限公司)
机构由 AI 辅助整理,请以论文原文为准。
AI总结:
针对现有古代文本基准数据集碎片化问题,推出Ancient-Bench基准数据集,含2700张图像,覆盖多千年、多介质、多文字,经实验发现古代文物文字识别仍存在异体字等挑战。
AI中文摘要:
中国古代文物文字识别是文化遗产数字化的基础,而古代文本基准数据集对于评估当前模型性能至关重要。然而,现有基准数据集存在“碎片化”问题,表现为时间覆盖有限、介质多样性不足、文字类型不完整。为此,我们推出Ancient-Bench,这是一个包含2700张图像的中国古代文物文字识别综合基准数据集,涵盖三个维度:多千年(跨越3000年的文字演变)、多介质(涵盖9类文物)、多文字(包含7种历史文字形式)。为实现不同介质间一致且公平的评估,我们还针对古代文本的介质特定特性定义了三项标注标准:符号标准化、文字标准化和解析标准化。针对Ancient-Bench开展的涵盖通用视觉语言模型(VLMs)和OCR专用模型的大量实验表明,中国古代文物文字识别问题仍未得到根本解决,在异体字、特殊符号和模型幻觉方面存在持续挑战。该数据集可通过此https链接获取。
英文摘要:
Ancient Chinese artifact text recognition is fundamental to heritage digitization, and benchmarks for ancient texts are essential for evaluating current model capabilities. However, existing benchmarks suffer from ''fragmentation'', manifested in limited temporal coverage, limited medium diversity, and incomplete script types. Therefore, we present Ancient-Bench, a comprehensive benchmark of 2,700 images for ancient Chinese artifact text recognition, featuring three dimensions: Multi-millennial (spanning 3,000 years of character evolution), Multi-medium (covering nine artifact categories), and Multi-script (encompassing seven historical script forms). To enable consistent and fair evaluation across heterogeneous media, we further define three annotation standards tailored to the medium-specific characteristics of ancient texts: symbol standardization, character standardization, and parsing standardization. Extensive experiments on Ancient-Bench covering general Vision-Language Models (VLMs) and OCR-specialist models reveal that ancient Chinese artifact text recognition remains fundamentally unsolved, with persistent challenges in variant characters, specialized symbols, and hallucination. The dataset is available at https://github.com/SCUT-DLVCLab/Ancient_Bench.