arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2112.01846cs.CLcs.AI
收藏

一种文本自动纠错的方案

A Proposal of Automatic Error Correction in Text

Universidad Autónoma Metropolitana – Cuajimalpa(墨西哥自治都会大学 – 库阿希马尔帕校区)

Wulfrano A. Luna-Ramírez, Carlos R. Jaimez-González

摘要:

电子媒体所能存储的信息量与日俱增。其中许多主要是通过打字获得的,如从web 2.0网站获得的大量信息;或通过光学字符识别软件扫描和处理,如图书馆和政府办公室的文本。这两个过程都会在文本中引入错误,因此很难将数据用于除了阅读之外的其他目的,即通过其他应用程序处理这些文本,如电子学习,语言学习,电子教程,数据挖掘,信息检索以及甚至更专业的系统,如tiflologic软件,特别是像自动阅读这样的面向人的盲应用程序,本文介绍了一种电子文本中的自动识别与纠正方法,该方法是在电子文本中自动识别与纠正字形错误的一个应用。该任务由三个阶段组成:a)错误检测; b)候选校正生成;以及c)校正-选择最佳候选。该方案基于西班牙语的词性文本分类、词相似度、词典、统计度量、形态学分析和基于n-gram的语言模型。

英文摘要:

The great amount of information that can be stored in electronic media is growing up daily. Many of them is got mainly by typing, such as the huge of information obtained from web 2.0 sites; or scaned and processing by an Optical Character Recognition software, like the texts of libraries and goverment offices. Both processes introduce error in texts, so it is difficult to use the data for other purposes than just to read it, i.e. the processing of those texts by other applications like e-learning, learning of languages, electronic tutorials, data minning, information retrieval and even more specialized systems such as tiflologic software, specifically blinded people-oriented applications like automatic reading, where the text would be error free as possible in order to make easier the text to speech task, and so on. In this paper it is showed an application of automatic recognition and correction of ortographic errors in electronic texts. This task is composed of three stages: a) error detection; b) candidate corrections generation; and c) correction -selection of the best candidate. The proposal is based in part of speech text categorization, word similarity, word diccionaries, statistical measures, morphologic analisys and n-grams based language model of Spanish.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑