模拟器支持的工程智能体中的编辑后重新验证：验证节奏指导的受控比较
Post-Edit Re-Verification in Simulator-Backed Engineering Agents: A Controlled Comparison of Verification-Cadence Guidance
浏览论文内容
中文总结 AI 辅助
本研究对比有无显式验证节奏指导时模拟器支持的工程智能体编辑后重新验证情况，发现保留该指导可提升重新验证率、降低违规率并提高有限成功率，支持将验证节奏作为交互协议组件。
中文摘要 AI 辅助
与外部模拟器交互的工程智能体可能需要协调设计修改与修改状态下工程证据的重新获取。我们在验证相关状态/事实保持不变的情况下，探究保留显式验证节奏指导与省略该指导时，编辑后首次重新验证是否会发生变化。验证节奏指导组（CG）保留了在实质性修改后请求新模拟的指令，而验证节奏省略组（CO）删除了该指令；两组均未使用硬性门槛。因此，本研究测量的是指令约束下的编辑后验证策略依从性，而非对先前证据已失效的自发识别。以DWSIM为模拟器后端，采用连续阀压调整，对5个Alibaba/Qwen模型在8个合成案例上进行评估；每个模型-案例-条件组合通过实时API调用执行3次，每个条件共产生120个评估槽位。CG组中94/120个槽位观察到重新验证，CO组为32/120；节奏违规在CG组为26/120，CO组为87/120；有限最终成功在CG组为95/120，CO组为35/120。qwen3.5-35b-a3b的重新验证最少（CG组1/24，CO组0/24），且两组均无最终成功。在该有限协议内，显式编辑后验证节奏指导与更多重新验证、更少节奏违规及更频繁的有限最终成功相关，支持将验证节奏视为显式交互协议组件。
英文摘要
Engineering agents that interact with external simulators may need to coordinate design modification with reacquisition of engineering evidence for the modified state. We ask whether first post-edit re-verification changes when explicit verification-cadence guidance is retained versus omitted while verification-relevant state/facts are held constant. Cadence-Guided (CG) retained an instruction to request a new simulation after a substantive modification, whereas Cadence-Omitted (CO) removed that instruction; neither condition used a hard gate. The study therefore measures instruction-conditioned post-edit verification-policy adherence rather than spontaneous recognition that prior evidence has become stale. Using DWSIM as the simulator backend and continuous valve-pressure adjustment, five Alibaba/Qwen models were evaluated on eight synthetic cases; each model-case-condition combination was executed three times via live API calls, yielding 120 evaluation slots per condition. Re-verification was observed in 94/120 CG slots versus 32/120 CO slots; cadence violations occurred in 26/120 versus 87/120; and bounded final success was reached in 95/120 versus 35/120. qwen3.5-35b-a3b showed minimal re-verification (1/24 in CG and 0/24 in CO) and no final success in either condition. Within this bounded protocol, explicit post-edit verification-cadence guidance was associated with more re-verification, fewer cadence violations, and more frequent bounded final success, supporting the treatment of verification cadence as an explicit interaction-protocol component.
