arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.12116cs.AIcs.SE

A-R行为空间:组织部署中工具使用语言模型代理的执行层剖析

The A-R Behavioral Space: Execution-Level Profiling of Tool-Using Language Model Agents in Organizational Deployment

Cardiff School of Technologies, Cardiff Metropolitan University(卡迪夫技术学院,卡迪夫市政大学);School of Professional Studies, Clark University(专业研究学院,克拉克大学);Harvard Medical School, Harvard University(哈佛医学院,哈佛大学)

Shasha Yu, Fiona Carroll, Barry L. Bentley

AI总结:

提出基于动作率(A)和拒绝信号(R)的二维A-R空间及散度(D)来测量执行层行为,评估不同规范制度和自主性配置下语言模型代理的执行与拒绝分布模式。

摘要:

大型语言模型(LLMs)越来越多地被部署为能够执行系统级操作的工具增强型代理。虽然现有基准主要评估文本对齐或任务成功,但较少关注在不同自主性支架下语言信号与可执行行为之间的结构关系。本研究引入了一种基于二维A-R空间的执行层行为测量方法,该空间由动作率(A)和拒绝信号(R)定义,散度(D)捕捉两者之间的协调性。模型在四种规范制度(控制、灰色、困境和恶意)和三种自主性配置(直接执行、规划和反思)下进行评估。该方法不是分配聚合安全分数,而是描述执行和拒绝如何随上下文框架和支架深度重新分布。实证结果表明,执行和拒绝构成了可分离的行为维度,其联合分布在制度和自主性水平上系统性地变化。基于反思的支架通常会在风险情境中促使配置转向更高的拒绝,但重新分布模式在不同模型间存在结构性差异。A-R表示使得横截面行为剖面、支架诱导的转变和协调变异性直接可观察。通过将执行层表征置于标量排名之上,这项工作为在组织环境中分析和选择工具增强的LLM代理提供了面向部署的视角,其中执行权限和风险容忍度各不相同。

英文摘要:

Large language models (LLMs) are increasingly deployed as tool-augmented agents capable of executing system-level operations. While existing benchmarks primarily assess textual alignment or task success, less attention has been paid to the structural relationship between linguistic signaling and executable behavior under varying autonomy scaffolds. This study introduces an execution-layer be-havioral measurement approach based on a two-dimensional A-R space defined by Action Rate (A) and Refusal Signal (R), with Divergence (D) capturing coor-dination between the two. Models are evaluated across four normative regimes (Control, Gray, Dilemma, and Malicious) and three autonomy configurations (di-rect execution, planning, and reflection). Rather than assigning aggregate safety scores, the method characterizes how execution and refusal redistribute across contextual framing and scaffold depth. Empirical results show that execution and refusal constitute separable behavioral dimensions whose joint distribution varies systematically across regimes and autonomy levels. Reflection-based scaffolding often shifts configurations toward higher refusal in risk-laden contexts, but redis-tribution patterns differ structurally across models. The A-R representation makes cross-sectional behavioral profiles, scaffold-induced transitions, and coordination variability directly observable. By foregrounding execution-layer characterization over scalar ranking, this work provides a deployment-oriented lens for analyzing and selecting tool-enabled LLM agents in organizational settings where execution privileges and risk tolerance vary.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑