LLM agents rely heavily on high-quality trajectory data to guide their problem-solving behaviors, yet producing such data requires substantial task design, high-capacity model generation, and manual filtering. Despite the high cost of creating these datasets, existing literature has overlooked copyright protection for LLM agent trajectories. This gap leaves creators vulnerable to data theft and makes it difficult to trace misuse or enforce ownership rights. This paper introduces ActHook, the first watermarking method tailored for agent trajectory datasets. Inspired by hook mechanisms in software engineering, ActHook embeds hook actions that are activated by a secret input key and do not alter the original task outcome. Like software execution, LLM agents operate sequentially, allowing hook actions to be inserted at decision points without disrupting task flow. When the activation key is present, an LLM agent trained on watermarked trajectories can produce these hook actions at a significantly higher rate, enabling reliable black-box detection. Experiments on mathematical reasoning, web searching, and software engineering agents show that ActHook achieves an average detection AUC of 94.3 on Qwen-2.5-Coder-7B while incurring negligible performance degradation.
Overview of PAN 2026: Voight-Kampff Generative AI Detection, Text Watermarking, Multi-Author Writing Style Analysis, Generative Plagiarism Detection, and Reasoning Trajectory Detection
Friedrich Schiller University Jena(耶纳弗里德里希·施勒格尔大学);University of Applied Sciences BFI(应用科学大学BFI);Mohamed bin Zayed University of Artificial Intelligence(马尔代夫 bin Zayed 人工智能大学);University of Kassel(卡塞尔大学);INSAIT, Sofia University ``St. Kliment Ohridski''(INSAIT,索菲亚大学『圣克莱门特·奥赫里迪斯』);University of Innsbruck(因斯布鲁克大学)
PAN 2026旨在通过客观评估推进计算风格学和文本取证,涵盖生成式AI检测、文本水印、多作者写作分析、抄袭检测及推理轨迹检测等五个新旧任务。
AgentBank: Towards Generalized LLM Agents via Fine-Tuning on 50000+ Interaction Trajectories
National Key Laboratory for Multimedia Information Processing(多媒体信息处理国家重点实验室);School of Computer Science, Peking University(北京大学计算机学院);University of Edinburgh(爱丁堡大学);Huawei Technologies(华为技术有限公司)
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);CAS Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所人工智能安全重点实验室)
Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretraining
National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University(国家多媒体信息处理重点实验室,计算机科学学院,北京大学);The University of Hong Kong(香港大学);Renmin University of China(中国人民大学)
MemMark: State-Evolution Attribution Watermarking for Agent Long-Term Memory Systems
Zhejiang University of Technology(浙江工业大学);National University of Singapore(新加坡国立大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Bairong(柏荣);Tongji University(同济大学);Universiti Malaya(马来亚大学);University of Hong Kong(香港大学)