arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.11943cs.CLcs.AIcs.LG
收藏

BERT:自然语言处理与理解应用综述

BERT: A Review of Applications in Natural Language Processing and Understanding

Financial University under the government of the Russian Federation(俄罗斯联邦政府金融大学)

M. V. Koroteev

摘要:

在这篇综述中,我们描述了最流行的基于深度学习的语言模型之一-- BERT的应用。本文介绍了该模型的操作机制,其应用的文本分析任务的主要领域,在每个任务中与类似的模型进行比较,以及一些专有模型的描述。在编写这份综述时,对过去几年中发表的几十篇原创科学文章的数据进行了系统整理,这些文章在科学界引起了最多的关注。本调查将有助于所有希望了解自然语言文本分析领域最新进展的学生和研究人员。

英文摘要:

In this review, we describe the application of one of the most popular deep learning-based language models - BERT. The paper describes the mechanism of operation of this model, the main areas of its application to the tasks of text analytics, comparisons with similar models in each task, as well as a description of some proprietary models. In preparing this review, the data of several dozen original scientific articles published over the past few years, which attracted the most attention in the scientific community, were systematized. This survey will be useful to all students and researchers who want to get acquainted with the latest advances in the field of natural language text analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑