arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.01657cs.SEcs.AI
收藏

PassionNet:一种用于识别重复和冲突需求的创新框架

PassionNet: An Innovative Framework for Duplicate and Conflicting Requirements Identification

Rhineland-Palatinate Technical University of Kaiserslautern-Landau(莱茵兰-普法尔茨州 Kaiserslautern-Landau 技术大学);German Research Center for Artificial Intelligence GmbH(德国人工智能研究中心有限公司)

Summra Saleem, Muhammad Nabeel Asim, Andreas Dengel

AI总结:

本文提出PassionNet框架,支持构建语言模型、多模型相似性知识及LLM上下文混合三类需求识别流水线,并在6个基准上验证混合方案以13%的F1优势超越现有方法。

摘要:

及早发现并解决重复和冲突需求,可以显著提升项目效率和整体软件质量。研究人员已经利用人工智能(AI)的潜力开发了多种计算预测器,以检测重复和冲突需求。然而,这些预测器在性能上存在不足,需要更有效的方法来赋能软件开发过程。为满足对能够准确识别重复和冲突需求的独特预测器的需要,本研究提供了一个综合框架,可促进开发3种不同类型的预测流水线:基于语言模型的预测流水线、多模型相似性知识驱动的预测流水线,以及大语言模型(LLMs)上下文加多模型相似性知识驱动的预测流水线。在第一类预测流水线中,该框架通过利用8种不同类型的LLM来促进冲突/重复需求识别。在第二类中,框架支持开发利用多尺度、多模型相似性知识的预测流水线,范围从传统相似性计算方法到由LLM生成的高级相似性向量。在第三类中,框架通过将来自LLM的上下文洞察与多模型相似性知识相结合,综合构建预测流水线。在6个公开基准数据集上,对760条不同预测流水线进行的广泛测试表明,混合预测流水线在准确识别重复和冲突需求方面始终优于另外两类预测流水线。该预测流水线在F1分数上以13%的总体性能优势超过了现有最先进预测器的性能。

英文摘要:

Early detection and resolution of duplicate and conflicting requirements can significantly enhance project efficiency and overall software quality. Researchers have developed various computational predictors by leveraging Artificial Intelligence (AI) potential to detect duplicate and conflicting requirements. However, these predictors lack in performance and requires more effective approaches to empower software development processes. Following the need of a unique predictor that can accurately identify duplicate and conflicting requirements, this research offers a comprehensive framework that facilitate development of 3 different types of predictive pipelines: language models based, multi-model similarity knowledge-driven and large language models (LLMs) context + multi-model similarity knowledge-driven. Within first type predictive pipelines landscape, framework facilitates conflicting/duplicate requirements identification by leveraging 8 distinct types of LLMs. In second type, framework supports development of predictive pipelines that leverage multi-scale and multi-model similarity knowledge, ranging from traditional similarity computation methods to advanced similarity vectors generated by LLMs. In the third type, the framework synthesizes predictive pipelines by integrating contextual insights from LLMs with multi-model similarity knowledge. Across 6 public benchmark datasets, extensive testing of 760 distinct predictive pipelines demonstrates that hybrid predictive pipelines consistently outperforms other two types predictive pipelines in accurately identifying duplicate and conflicting requirements. This predictive pipeline outperformed existing state-of-the-art predictors performance with an overall performance margin of 13% in terms of F1-score

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑