arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2204.08975cs.CL

检测文本正式度:文本分类方法研究

Detecting Text Formality: A Study of Text Classification Approaches

Technical University of Munich(慕尼黑工业大学);Centro Singular de Investigación en Tecnoloxías Intelixentes (CiTIUS)(智能技术单一研究中心);Universidade de Santiago de Compostela(圣地亚哥德孔波斯特拉大学);Skolkovo Institute of Science and Technology(斯科尔科沃科技学院);Artificial Intelligence Research Institute(人工智能研究所)

Daryna Dementieva, Nikolay Babakov, Alexander Panchenko

AI总结:

本研究首次系统探讨了基于统计、神经网络和Transformer的文本正式度检测方法,通过单语、多语和跨语种实验发现Char BiLSTM在单语和多语任务上更优,而Transformer在跨语种迁移上更稳定。

摘要:

正式度是文本文档的重要特征之一。自动检测文本的正式度水平对各种自然语言处理任务具有潜在益处。此前,已有两个包含多语言正式度标注的大规模数据集被引入——GYAFC和X-FORMAL。然而,它们主要用于训练风格迁移模型。同时,文本正式度检测本身也可能是一项有用的应用。据我们所知,本研究首次系统地探讨了基于统计、基于神经网络的以及基于Transformer的机器学习方法的正式度检测方法,并提供了性能最佳的模型供公众使用。我们进行了三种类型的实验——单语、多语和跨语种。研究表明,在单语和多语正式度分类任务中,Char BiLSTM模型优于基于Transformer的模型,而基于Transformer的分类器在跨语种知识迁移方面更为稳定。

英文摘要:

Formality is one of the important characteristics of text documents. The automatic detection of the formality level of a text is potentially beneficial for various natural language processing tasks. Before, two large-scale datasets were introduced for multiple languages featuring formality annotation -- GYAFC and X-FORMAL. However, they were primarily used for the training of style transfer models. At the same time, the detection of text formality on its own may also be a useful application. This work proposes the first to our knowledge systematic study of formality detection methods based on statistical, neural-based, and Transformer-based machine learning methods and delivers the best-performing models for public usage. We conducted three types of experiments -- monolingual, multilingual, and cross-lingual. The study shows the overcome of Char BiLSTM model over Transformer-based ones for the monolingual and multilingual formality classification task, while Transformer-based classifiers are more stable to cross-lingual knowledge transfer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑