As large language models (LLMs) increasingly tackle complex reasoning tasks, test-time scaling has become critical for enhancing capabilities. However, in agentic scenarios with frequent tool calls, the traditional generation-length-based definition breaks down: tool latency decouples inference time from generation length. We propose Timely Machine, redefining test-time as wall-clock time, where models dynamically adjust strategies based on time budgets. We introduce Timely-Eval, a benchmark spanning high-frequency tool calls, low-frequency tool calls, and time-constrained reasoning. By varying tool latency, we find smaller models excel with fast feedback through more interactions, while larger models dominate high-latency settings via superior interaction quality. Moreover, existing models fail to adapt reasoning to time budgets. We propose Timely-RL to address this gap. After cold-start supervised fine-tuning, we use reinforcement learning to enhance temporal planning. Timely-RL improves time budget awareness and consistently boosts performance across Timely-Eval. We hope our work offers a new perspective on test-time scaling for the agentic era.
Zhejiang University(浙江大学);Alibaba Group(阿里巴巴集团);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);Zhejiang Key Laboratory of Big Data Intelligent Computing(浙江省大数据智能计算重点实验室)
University of Cambridge(剑桥大学);ELLIS Institute Tübingen(ELLIS研究所图宾根);MPI-IS(马克斯·普朗克智能系统研究所);Tübingen AI Center(图宾根人工智能中心);Mila(Mila魁北克人工智能研究所);University of Montreal(蒙特利尔大学)
Agentic Retrieval-Augmented Generation: A Survey on Agentic RAG
Cleveland State University(克利夫兰州立大学);Kent State University(肯特州立大学);Northeastern University(东北大学);Roux Institute at Northeastern University(东北大学鲁克斯研究所);University of Agder (UiA)(阿格德尔大学)
Agentic Business Process Management: A Research Manifesto
Free University of Bozen-Bolzano(博尔扎诺自由大学);University of Oxford(牛津大学);University of Tartu(塔尔图大学);IBM Research(IBM研究院);Umeå University(于默奥大学);paluno (Ruhr Institute for Software Technology), University of Duisburg Essen(帕卢诺(鲁尔软件技术研究所),杜伊斯堡-埃森大学);University of Ottawa(渥太华大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Saarland University(萨尔大学);The University of Melbourne(墨尔本大学);TUM School of Computation, Information, and Technology, TU Munich(慕尼黑工业大学计算、信息与技术学院);RMIT University(皇家墨尔本理工大学);Meta;University of St. Gallen(圣加仑大学)
Agentic AI Ecosystems in Higher Education: A Perspective on AI Agents to Emerging Inclusive, Agentic Multi-Agent AI Framework for Learning, Teaching and Institutional Intelligence
College of Computing and Data Science, Nanyang Technological University, NTU, Singapore(南洋理工大学计算机与数据科学学院);DeepMed Ptd Ltd, India(印度DeepMed公司)
Your AI Travel Agent Would Book You a Bullfight: An Agentic Benchmark for Implicit Animal Welfare in Frontier AI Models
Compassion Aligned Machine Learning(同情对齐机器学习);Sentient Futures(感知未来);Harvard Kennedy School(哈佛肯尼迪学院);Appalachian State University Department of Management(阿巴拉契亚州立大学管理系)
DeepRead: Document Structure-Aware Reasoning to Enhance Agentic Search
State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences (CAS)(人工智能安全国家重点实验室,计算技术研究所,中国科学院);University of Chinese Academy of Sciences, CAS(中国科学院大学);Wenlan School of Business, Zhongnan University of Economics(中南财经政法大学文澜商学院)
Autonomous Information Seeking: A Roadmap for Agentic Recommender Systems
National University of Singapore(新加坡国立大学);Polytechnic University of Bari(巴里理工大学);Renmin University of China(中国人民大学);University of Science and Technology of China(中国科学技术大学)
Memory as Action: Autonomous Context Curation for Long-Horizon Agentic Tasks
School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);Hithink Research(慧思科技);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Huawei Noah’s Ark Lab(华为诺亚实验室);Peng Cheng Lab(鹏城实验室)
An Agentic Operationalization of DISARM for FIMI Investigation on Social Media
Center of Research Acquisition National Institute of Cyber Security Taipei City, Taiwan;Department of Mathematics Royal Military Academy Brussels, Belgium;Research Division OpenMinds Ltd. Kyiv, Ukraine;Department of Sustainable Communication Technologies SINTEF Oslo, Norway (Corresponding Author)
VideoGAIA: A Benchmark for General AI Assistants on Agentic Video Understanding
The Chinese University of Hong Kong(香港中文大学);Ant Group(蚂蚁集团);Tsinghua University(清华大学);Tongji University(同济大学);The Hong Kong University of Science and Technology(香港科技大学)
BAPO: Boundary-Aware Policy Optimization for Reliable Agentic Search
Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院);Meituan Inc.(美团公司);School of Informatics, Xiamen University(厦门大学信息学院);Westlake University(西湖大学);Jilin University(吉林大学);Key Laboratory of Digital Protection and Intelligent Processing of Intangible Cultural Heritage of Fujian and Taiwan (Xiamen University), Ministry of Culture and Tourism, China(福建省和台湾非物质文化遗产数字化保护与智能处理重点实验室(厦门大学),中华人民共和国文旅部,中国)
Agentic AI for Scaling Diagnosis and Care in Neurodegenerative Disease
Goizueta Brain Health Institute, Emory University(埃默里大学戈伊苏埃塔大脑健康研究所);University of California, San Francisco(加州大学旧金山分校);Georgia Institute of Technology(佐治亚理工学院);University of California, Berkeley(加州大学伯克利分校)
TuneAgent: Agentic Operating System Kernel Tuning with Reinforcement Learning
Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学)
A Practical Guide to Agentic AI Transition in Organizations
Old Dominion University(旧 Dominion 大学);Florida International University(佛罗里达国际大学);Nanyang Technological University(南洋理工大学);University of Colombo(科伦坡大学);Center for Wireless Communications, University of Oulu(无线通信中心,奥卢大学);University of Sri Jayewardenepura(斯里贾yenepura大学);Accenture Technology Labs(埃森哲技术实验室)
An Agentic System for Rare Disease Diagnosis with Traceable Reasoning
Shanghai Jiao Tong University(上海交通大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Xinhua Hospital affiliated to Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属新华医院);Shanghai Institute for Pediatric Research(上海市儿科医学研究所);Harvard Medical School(哈佛医学院);The Affiliated Children’s Hospital of Xiangya School of Medicine(湘雅医学院附属儿童医院)
Towards 6G Native-AI Edge Networks: A Semantic-Aware and Agentic Intelligence Paradigm
College of Computer Science, University of Exeter, Exeter, U.K.(埃克塞特大学计算机科学学院);Sony China Research Laboratory, Beijing, China(索尼中国研究实验室);School of Information Science and Engineering, Southeast University, Nanjing, China(东南大学信息科学与工程学院);Purple Mountain Laboratories, Nanjing, China(紫金山实验室);Information System Technology and Design Pillar, Singapore University of Technology and Design, Singapore(新加坡科技设计大学信息系统技术与设计支柱)
Large Language Models Lack Temporal Awareness of Medical Knowledge
University of Virginia(弗吉尼亚大学);National Institutes of Health(美国国家卫生研究院);Dana-Farber Cancer Institute(达纳-法伯癌症研究所);Yale University(耶鲁大学);Weill Cornell Medicine(韦氏 Cornell 医学院)
Agentic-V2X: Small Language Model Agents for Deadline-Aware V2X Scheduling in 5G/6G Networks
Department of Informatics, University of Piraeus(比雷埃克斯大学信息学院);Department of Informatics and Telecommunications, University of Peloponnese(希腊佩拉索斯大学信息与电信学院)