arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.16977cs.SEcs.CL
收藏

处理需求工程的数据:缓解使用 NLP 和生成式 AI 时的挑战

Dealing with Data for RE: Mitigating Challenges while using NLP and Generative AI

TCS Research(塔塔咨询服务研究机构)

Smita Ghaisas, Anmol Singhal

AI总结:

本章面向 AI 融合背景下的需求工程,分析企业集成 NLP 与生成式 AI 时的数据、训练、评估及流程挑战,并给出实践方案与新型 RE 任务建议。

摘要:

在当今不断变化的商业环境中,企业面临着日益增多的各类挑战。这些挑战包括持续演变的监管环境、软件应用内不断增长的个性化需求,以及对治理的高度重视。为应对这些多方面需求,大型企业一直在采用自动化,其范围从优化核心业务流程延伸到提升客户体验。事实上,人工智能(AI)已成为现代软件系统的关键组成部分。在这一背景下,数据发挥着不可或缺的作用。基于监督学习并在工业规模上运行的以 AI 为中心的软件系统,需要大量训练数据才能有效运行。此外,生成式 AI 的引入也使充分评估基准的需求不断增长。我们在该领域的经验表明,对用于训练和评估的大型数据集的需求带来了一系列复杂挑战。本图书章节探讨了在 AI 融合这一时代,总体上软件工程(SE),尤其是需求工程(RE)不断演变的格局。我们讨论了将自然语言处理(NLP)和生成式 AI 集成到企业关键软件系统时出现的挑战。该章节提供了实用的见解、解决方案和示例,使读者掌握有效构建以 NLP 为核心的解决方案所需的知识和工具。我们还思考了这些以文本数据为中心的任务如何与传统 RE 过程相协调,并强调了一些新的 RE 任务;在开发软件系统时,为处理日益重要的文本数据中心性,这些任务可能是必要的。

英文摘要:

Across the dynamic business landscape today, enterprises face an ever-increasing range of challenges. These include the constantly evolving regulatory environment, the growing demand for personalization within software applications, and the heightened emphasis on governance. In response to these multifaceted demands, large enterprises have been adopting automation that spans from the optimization of core business processes to the enhancement of customer experiences. Indeed, Artificial Intelligence (AI) has emerged as a pivotal element of modern software systems. In this context, data plays an indispensable role. AI-centric software systems based on supervised learning and operating at an industrial scale require large volumes of training data to perform effectively. Moreover, the incorporation of generative AI has led to a growing demand for adequate evaluation benchmarks. Our experience in this field has revealed that the requirement for large datasets for training and evaluation introduces a host of intricate challenges. This book chapter explores the evolving landscape of Software Engineering (SE) in general, and Requirements Engineering (RE) in particular, in this era marked by AI integration. We discuss challenges that arise while integrating Natural Language Processing (NLP) and generative AI into enterprise-critical software systems. The chapter provides practical insights, solutions, and examples to equip readers with the knowledge and tools necessary for effectively building solutions with NLP at their cores. We also reflect on how these text data-centric tasks sit together with the traditional RE process. We also highlight new RE tasks that may be necessary for handling the increasingly important text data-centricity involved in developing software systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑