Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction
Carnegie Mellon University(卡内基梅隆大学);Scribe(Scribe公司);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Toronto(多伦多大学);University of California, Berkeley(加州大学伯克利分校);The AGI Company(AGI公司);New York University(纽约大学)
The current paradigm of test-time scaling relies on generating long reasoning traces ("thinking" more) before producing a response. In agent problems that require interaction, this can be done by generating thinking traces before acting in the world. However, this process does not allow agents to acquire new information from the environment or adapt their behavior over time. In this work, we propose to scale test-time interaction, an untapped dimension of test-time scaling that increases the agent's interaction horizon to enable running rich behaviors such as exploration, backtracking, and dynamic re-planning within a single rollout. To demonstrate the promise of this scaling dimension, we study the domain of web agents. We first show that even prompting-based interaction scaling without any training can improve task success on web benchmarks non-trivially. Building on this, we introduce TTI (Test-Time Interaction), a curriculum-based online reinforcement learning (RL) approach that trains agents by adaptively adjusting their rollout lengths. Using a Gemma 3 12B model, TTI produces state-of-the-art open-source, open-data web agents on WebVoyager and WebArena benchmarks. We further show that TTI enables agents to balance exploration and exploitation adaptively. Our results establish interaction scaling as a powerful, complementary axis to scaling per-step compute, offering new avenues for training adaptive agents.
School of Computing, National University of Singapore, Singapore(新加坡国立大学计算机学院);Department of Statistics, University of Oxford, United Kingdom(英国牛津大学统计系);School of Intelligence Science(智能科学学院);Technology, Nanjing University, China(技术学院,南京大学,中国)
MER-R1: Multimodal Emotion Reasoning via Slow-Fast Thinking Synergy
University of Science and Technology of China(中国科学技术大学);SenseTime Research(商汤科技研究院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)