arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.00611cs.AI
收藏

TRACE: 面向长程智能体安全的轨迹风险感知压缩

TRACE: Trajectory Risk-Aware Compression for Long-Horizon Agent Safety

University of Science and Technology of China(中国科学技术大学);National University of Singapore(新加坡国立大学);South China Normal University(华南师范大学)

Zhepei Hong, Lin Wang, Liting Li, Haokai Ma, Junfeng Fang, Fei Shen, Dan Zhang, Xiang Wang

AI总结:

提出轨迹风险感知压缩方法TRACE,通过压缩器-阅读器架构将长轨迹压缩为潜在证据状态,以聚合稀疏风险信号并提升长程安全检测准确率。

摘要:

长程LLM智能体在长轨迹中产生安全证据,其中稀疏、延迟和组合的风险信号常常逃脱局部审核。现有的轮次级或短上下文检测器难以在长时间跨度内可靠地保留和聚合此类证据。我们将长程智能体安全检测重新定义为轨迹级证据压缩,并提出面向长程智能体安全的轨迹风险感知压缩(TRACE)。TRACE采用压缩器-阅读器设计:压缩器在轨迹级监督下将完整轨迹编码为紧凑的潜在证据状态,阅读器以该潜在证据状态作为安全参考来判断原始轨迹。该设计有助于聚合分散的风险线索并减少过早的证据丢失。在ASSEBench、Pre-Ex-Bench和R-Judge上,TRACE在所有评估基线上取得了最佳准确率,相比强基线最高提升12.6个百分点。在LongSafety上,TRACE随着上下文长度增加表现出更小的性能下降。注意力可视化和案例研究表明,压缩后的参考有助于阅读器聚焦于风险关键片段并恢复跨步证据。代码可在https://github.com/Peregrine123/TRACE_official获取。

英文摘要:

Long-horizon LLM agents produce safety evidence across long trajectories, where sparse, delayed, and compositional risk signals often escape local moderation. Existing turn-level or short-context detectors struggle to reliably retain and aggregate such evidence over extended horizons. We reframe long-horizon agent safety detection as trajectory-level evidence compression and propose Trajectory Risk-Aware Compression for Long-Horizon Agent Safety (TRACE). TRACE uses a Compressor-Reader design: the Compressor encodes the full trajectory into a compact latent evidence state under trajectory-level supervision, and the Reader judges the raw trajectory with this latent evidence state as a safety reference. This design helps aggregate dispersed risk cues and reduce premature evidence loss. Across ASSEBench, Pre-Ex-Bench, and R-Judge, TRACE achieves the best accuracy on all evaluated backbones, improving over strong baselines by up to 12.6 percentage points. On LongSafety, TRACE shows smaller performance degradation as context length grows. Attention visualizations and case studies suggest that the compressed reference helps the Reader focus on risk-critical segments and recover cross-step evidence. Code is available at https://github.com/Peregrine123/TRACE_official.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑