arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2105.03314cs.CL
收藏

NATOM的识别与处理

Recognition and Processing of NATOM

Civil Aviation Flight University of China(中国民用航空飞行学院)

YiPeng Deng, YinHui Luo

摘要:

本文介绍了如何对民航现场的NOTAM(Notice to Airmen)数据进行处理。主要研究内容如下:1.数据预处理:对于航行通告的原始数据,中英文混杂,结构性较差。对原始数据进行清洗,将中文数据和英文数据分别处理,完成分词,去除停用词。使用Glove词向量方法来表示数据,用于使用自定义映射词汇表。2.解耦特征和分类器:为了提高文本分类模型识别少数样本的能力,从算法整体的角度将整个模型训练过程解耦,分为特征学习和分类器学习两个阶段。特征学习阶段和分类器学习阶段的权值采用不同的策略来克服不平衡数据集的头部数据和尾部数据对分类模型的影响。实验证明,采用基于神经网络分类模型的解耦特征和分类器方法,可以完成民航领域的文本多分类任务,同时可以提高数据集中少数样本的识别精度。

英文摘要:

In this paper we show how to process the NOTAM (Notice to Airmen) data of the field in civil aviation. The main research contents are as follows: 1.Data preprocessing: For the original data of the NOTAM, there is a mixture of Chinese and English, and the structure is poor. The original data is cleaned, the Chinese data and the English data are processed separately, word segmentation is completed, and stopping-words are removed. Using Glove word vector methods to represent the data for using a custom mapping vocabulary. 2.Decoupling features and classifiers: In order to improve the ability of the text classification model to recognize minority samples, the overall model training process is decoupled from the perspective of the algorithm as a whole, divided into two stages of feature learning and classifier learning. The weights of the feature learning stage and the classifier learning stage adopt different strategies to overcome the influence of the head data and tail data of the imbalanced data set on the classification model. Experiments have proved that the use of decoupling features and classifier methods based on the neural network classification model can complete text multi-classification tasks in the field of civil aviation, and at the same time can improve the recognition accuracy of the minority samples in the data set.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑