arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.04723cs.SEcs.AI
收藏

基于零样本学习的需求分类研究

Zero-Shot Learning for Requirements Classification: An Exploratory Study

Imam Mohammad Ibn Saud Islamic University(伊玛目·穆罕默德·本·沙特伊斯兰大学);Consiglio Nazionale delle Ricerche(意大利国家研究委员会);University of Manchester(曼彻斯特大学)

Waad Alhoshan, Alessio Ferrari, Liping Zhao

摘要:

内容:需求工程研究人员一直在试验机器学习和深度学习方法,用于一系列RE任务,例如需求分类,需求跟踪,模糊检测和建模。然而,当今大多数ML/DL方法都基于监督学习技术,这意味着它们需要使用大量特定于任务的标记训练数据进行训练。这种限制对RE研究人员构成了巨大的挑战,因为缺乏标记数据使他们难以充分利用先进的ML/DL技术的优势。目的:本文通过展示如何在不使用任何标记训练数据的情况下使用零样本学习方法进行需求分类来解决这个问题。我们专注于分类任务,因为许多RE任务可以框架分类问题。方法:在我们的研究中使用的CNOL方法采用上下文的词嵌入和基于transformer的语言模型。我们通过一系列的实验来证明这种方法,以执行三个分类任务:(1)FR/NFR:分类功能需求与非功能需求;(2)NFR:识别NFR类;(3)安全性:安全性与非安全性需求的分类。结果:研究表明,在FR/NFR任务中,CNOL方法的F1得分为0.66。对于NFR任务,考虑到最频繁的类,该方法产生F1~0.72-0.80。对于安全任务,F1~0.66。所有上述F1分数都是通过零训练努力实现的。结论:这项研究表明,需求分类的潜在的CNOL。一个重要的含义是,有可能只有很少或没有训练数据来执行分类任务。因此,所提出的方法有助于解决RE中的数据短缺的长期问题。

英文摘要:

Context: Requirements engineering researchers have been experimenting with machine learning and deep learning approaches for a range of RE tasks, such as requirements classification, requirements tracing, ambiguity detection, and modelling. However, most of today's ML/DL approaches are based on supervised learning techniques, meaning that they need to be trained using a large amount of task-specific labelled training data. This constraint poses an enormous challenge to RE researchers, as the lack of labelled data makes it difficult for them to fully exploit the benefit of advanced ML/DL technologies. Objective: This paper addresses this problem by showing how a zero-shot learning approach can be used for requirements classification without using any labelled training data. We focus on the classification task because many RE tasks can be framed as classification problems. Method: The ZSL approach used in our study employs contextual word-embeddings and transformer-based language models. We demonstrate this approach through a series of experiments to perform three classification tasks: (1)FR/NFR: classification functional requirements vs non-functional requirements; (2)NFR: identification of NFR classes; (3)Security: classification of security vs non-security requirements. Results: The study shows that the ZSL approach achieves an F1 score of 0.66 for the FR/NFR task. For the NFR task, the approach yields F1~0.72-0.80, considering the most frequent classes. For the Security task, F1~0.66. All of the aforementioned F1 scores are achieved with zero-training efforts. Conclusion: This study demonstrates the potential of ZSL for requirements classification. An important implication is that it is possible to have very little or no training data to perform classification tasks. The proposed approach thus contributes to the solution of the long-standing problem of data shortage in RE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑