对LLM而言,是使用还是不使用:设计师和开发者如何将LLM视为工具或队友
To LLM, or Not to LLM: How Designers and Developers Navigate LLMs as Tools or Teammates
AI总结:
研究探讨了设计师和开发者在系统设计过程中如何将LLM视为工具或队友,分析了角色框架对决策权、问责制、监督策略和组织接受度的影响。
摘要:
大型语言模型(LLMs)正越来越多地整合到设计和开发流程中,但其使用决策往往并非二元或纯粹技术性。本文基于对33名来自三大科技公司的设计师和开发者的访谈,发现参与者在评估LLM时不仅考虑其能力,还考虑其在工作流中的角色及其与现有责任结构和组织问责制的互动。当LLM被明确视为受人类控制的工具时,其使用通常可接受并能融入现有治理结构。而当LLM被视为具有共享或模糊代理的队友时,从业者则表现出犹豫,特别是在无法明确证明结果责任时。同时,参与者也描述了 productive 的队友配置,其中LLM支持协作推理但仍嵌套在明确的监督结构中。本文将工具和队友框架识别为设计师和开发者在人类工作与LLM之间定位的常见方式,并提出了描述角色框架如何影响决策权、问责制、监督策略和组织接受度的分析量表。通过强调设计时的推理,本文将“对LLM使用还是不使用”重新定义为系统设计过程中出现的社技术定位问题,而非部署后评估期间的问题。
英文摘要:
Large language models (LLMs) are increasingly integrated into design and development workflows, yet decisions about their use are rarely binary or purely technical. We report findings from a constructivist grounded theory study based on interviews with 33 designers and developers across three large technology organisations. Rather than evaluating LLMs solely by capability, participants reasoned about the role an LLM could occupy within a workflow and how that role would interact with existing structures of responsibility and organisational accountability. When LLMs were framed as tools under clear human control, their use was typically acceptable and could be integrated within existing governance structures. When framed as teammates with shared or ambiguous agency, practitioners expressed hesitation, particularly when responsibility for outcomes could not be clearly justified. At the same time, participants also described productive teammate configurations in which LLMs supported collaborative reasoning while remaining embedded within explicit oversight structures. We identify tool and teammate framings as recurring ways in which designers and developers position LLMs relative to human work and present an analytic rubric describing how role framing shapes decision authority, accountability ownership, oversight strategies, and organisational acceptability. By foregrounding design-time reasoning, this work reframes To LLM or Not to LLM as a sociotechnical positioning problem that emerges during system design rather than during post-deployment evaluation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。