arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.06100cs.CLcs.AIcs.LG
收藏

自适应序列到序列模型用于社交媒体中的文本规范化

Adapting Sequence to Sequence models for Text Normalization in Social Media

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Ismini Lourentzou, Kabir Manghnani, ChengXiang Zhai

摘要:

社交媒体提供了丰富的有价值的原始数据来源,但非正式的写作可能很快成为许多自然语言处理(NLP)任务的瓶颈。现成的工具通常是在正式文本上训练的,不能显式地处理简短的在线帖子中发现的噪音。此外,频繁出现的语言变体的多样性带来了一些挑战,即使对于可能无法理解这些帖子的含义的人来说,特别是当它们包含俚语和缩写时。文本规范化旨在将在线用户生成的文本转换为规范形式。目前的文本规范化系统依赖于字符串或语音相似性和分类模型,这些模型以本地方式工作。我们认为,处理上下文信息是至关重要的这项任务,并介绍了一个社交媒体文本规范化混合字字符注意力为基础的编码器-解码器模型,可以作为NLP应用程序的预处理步骤,以适应社会媒体中的嘈杂文本。我们基于字符的组件是在合成对抗性示例上训练的,这些示例旨在捕获在线用户生成文本中常见的错误。实验表明,我们的模型超越了为文本规范化设计的神经架构,并实现了与最先进的相关工作相当的性能。

英文摘要:

Social media offer an abundant source of valuable raw data, however informal writing can quickly become a bottleneck for many natural language processing (NLP) tasks. Off-the-shelf tools are usually trained on formal text and cannot explicitly handle noise found in short online posts. Moreover, the variety of frequently occurring linguistic variations presents several challenges, even for humans who might not be able to comprehend the meaning of such posts, especially when they contain slang and abbreviations. Text Normalization aims to transform online user-generated text to a canonical form. Current text normalization systems rely on string or phonetic similarity and classification models that work on a local fashion. We argue that processing contextual information is crucial for this task and introduce a social media text normalization hybrid word-character attention-based encoder-decoder model that can serve as a pre-processing step for NLP applications to adapt to noisy text in social media. Our character-based component is trained on synthetic adversarial examples that are designed to capture errors commonly found in online user-generated text. Experiments show that our model surpasses neural architectures designed for text normalization and achieves comparable performance with state-of-the-art related work.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑