文本规范化与中世纪宪章分类相关吗?
Is text normalization relevant for classifying medieval charters?
AI总结:
本文评估文本规范化对中世纪宪章年代与地点分类的影响,发现规范化仅微弱改善定位却损害断代,且支持向量机和梯度提升优于 Transformer,主张选择性保留原文特征。
摘要:
本研究考察历史文本规范化对中世纪宪章分类的影响,特别聚焦于文献年代测定和地点定位。利用来自一个数字档案馆的中古高地德语宪章数据集,我们评估了多种分类器,包括传统模型和基于 Transformer 的模型,并分别在有规范化和无规范化条件下进行比较。结果表明,所采用的规范化仅对地点定位任务有微弱提升,却降低了年代测定的准确率,这意味着原始文本包含可能被规范化掩盖的关键特征。我们发现,支持向量机和梯度提升优于其他模型,从而令人质疑 Transformer 在该使用场景中的效率。结果提示应采取选择性的历史文本规范化方法,并强调保留某些对文献分析中的分类任务至关重要的文本特征的重要性。
英文摘要:
This study examines the impact of historical text normalization on the classification of medieval charters, specifically focusing on document dating and locating. Using a data set of Middle High German charters from a digital archive, we evaluate various classifiers, including traditional and transformer-based models, with and without normalization. Our results indicate that the given normalization minimally improves locating tasks but reduces accuracy for dating, implying that original texts contain crucial features that normalization may obscure. We find that support vector machines and gradient boosting outperform other models, questioning the efficiency of transformers for this use case. Results suggest a selective approach to historical text normalization, emphasizing the significance of preserving some textual characteristics that are critical for classification tasks in document analysis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。