Large language model agents increasingly undertake long-horizon tasks in complex environments characterized by fragmented evidence, partially completed states, and dependencies across resources and artifacts. Existing agents may satisfy individual requirements while failing to maintain these relationships, producing locally correct but incomplete outcomes. These failures arise because task completion depends on relationships among environmental evidence, consequential decisions, and required effects. To address this completion gap, we propose Interlock, a framework for task synthesis that represents each task as a typed completion graph. Grounding edges connect public evidence to decisions, coupling hyperedges impose joint constraints across components, and realization edges connect decisions to all required downstream effects. Interlock compiles this graph into a resettable workspace, a public request, and an evaluation rubric. A source-coverage review checks whether the original requirements survive generation, while a public-input review checks whether the rubric is supported by the materials available to the solver. An agent-as-judge inspects execution artifacts and runs verification scripts, retaining trajectories judged to satisfy all mandatory requirements. To evaluate training utility, we fine-tune two Qwen3.6 backbones on their own accepted trajectories. Across the two backbones, training improves AutomationBench task pass rates by 4.00-4.50 percentage points, JobBench weighted scores by 3.20-6.64 points, and Harvey LAB criterion pass rates by 3.89-4.16 percentage points. These results demonstrate the training utility of the synthesized experience across external task environments.
Evaluating and Achieving Controllable Code Completion in Code LLM
University of Science and Technology of China(中国科学技术大学);Alibaba Group(阿里巴巴集团);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
WorldBench: Culturally Grounded Benchmark for Multilingual Agents
University of Edinburgh(爱丁堡大学);School of Informatics, University of Edinburgh(爱丁堡大学信息学院);School of Artificial Intelligence, Shanghai Jiao Tong University(上海交通大学人工智能学院)
$Φ$-Bench: Can Large Language Models Engineer the Infrastructure That Powers Them?
University of Science and Technology of China(中国科学技术大学);StepFun(阶跃星辰);Peking University(北京大学);The Hong Kong University of Science and Technology(香港科技大学);Yale University(耶鲁大学);University of Pennsylvania(宾夕法尼亚大学)