arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1701.03682cs.CLcs.NE
收藏

LIDE:文本文档的语言识别

LIDE: Language Identification from Text Documents

Adobe Systems(奥多比系统公司);Stanford University(斯坦福大学);Target Corporation(塔吉特公司);Garanti Technology(担保技术公司)

Priyank Mathur, Arkajyoti Misra, Emrah Budur

摘要:

微博使用的增加是伴随着简短语言数据的快速增长。另一方面,深度学习被认为是以自动化方式从大量原始数据中提取有意义信息的新前沿。在这项研究中,我们利用这两个新兴领域提出了一个强大的语言识别器,即语言识别引擎(LIDE)。因此,我们在2015年的相似语言(DSL)共享任务数据集中实现了95.12%的准确率,这与迄今为止达到的95.54%的最高准确率相当。

英文摘要:

The increase in the use of microblogging came along with the rapid growth on short linguistic data. On the other hand deep learning is considered to be the new frontier to extract meaningful information out of large amount of raw data in an automated manner. In this study, we engaged these two emerging fields to come up with a robust language identifier on demand, namely Language Identification Engine (LIDE). As a result, we achieved 95.12% accuracy in Discriminating between Similar Languages (DSL) Shared Task 2015 dataset, which is comparable to the maximum reported accuracy of 95.54% achieved so far.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑