arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.06310cs.SE
收藏

可信赖的AI软件工程师

Trustworthy AI Software Engineers

Monash University(蒙纳士大学);Columbia University(哥伦比亚大学)

Aldeida Aleti, Baishakhi Ray, Rashina Hoda, Simin Chen

AI总结:

本文探讨AI代理作为软件工程师的信任问题,提出以证据为中心的检查方法,从技术质量、透明度、认知谦逊和社会伦理等维度定义可信赖性。

摘要:

随着AI编码代理的迅速崛起,软件工程师的基本前提受到质疑。在这篇愿景论文中,我们探讨了AI代理被视为软件工程师意味着什么,然后批判性地思考什么使得这样的代理值得信赖。基于软件工程(SE)的既定定义,并借鉴近期关于代理AI系统的研究,我们将AI软件工程师概念化为由人类软件工程师和AI代理组成的人机SE团队的参与者,并将可信赖性区分为这些系统和参与者的关键属性,而非主观的人类态度。扩展历史视角和新兴愿景,我们确定了构成AI软件工程师可信赖性的关键维度,涵盖技术质量、透明度和问责制、认知谦逊以及社会与伦理一致性。除了定义这些维度,我们还解决了一个关键但未被充分探索的挑战:如何在实践中操作化可信赖性。因此,我们引入了以证据为中心的检查概念,认为开发者应评估可信赖性的选择性信号和理由,而非原始输出,并概述了在人机SE团队中重新思考验证、确认和代码审查的意义。

英文摘要:

With the rapid rise of AI coding agents, the fundamental premise of what it means to be a software engineer is in question. In this vision paper, we examine what it means for an AI agent to be considered a software engineer and then critically think about what makes such an agent trustworthy. Grounded in established definitions of SE (SE) and informed by recent research on agentic AI systems, we conceptualise AI software engineers as participants in human-AI SE teams composed of human software engineers and AI agents, and we distinguish trustworthiness as a key property of these systems and actors rather than a subjective human attitude. Extending on historical perspectives and emerging visions, we identify key dimensions that contribute to the trustworthiness of AI software engineers, spanning technical quality, transparency and accountability, epistemic humility, and societal and ethical alignment. Beyond defining these dimensions, we address a critical but underexplored challenge: how trustworthiness can be operationalised in practice. We therefore introduce the notion of evidence-centric inspection, arguing that developers should evaluate selective signals and justifications of trustworthiness rather than raw outputs, and we outline implications for rethinking verification, validation, and code review in human-AI SE teams.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑