arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.04254cs.CL
收藏

为竞争编程设计的扩展代理验证器

Scaling Agentic Verifier for Competitive Coding

Renmin University of China(中国人民大学);Qwen Team, Alibaba Group(通义实验室,阿里巴巴集团)

Zeyao Ma, Jing Zhang, Xiaokang Zhang, Jiaxi Yang, Zongmeng Zhang, Jiajun Zhang, Yuheng Jing, Lei Zhang, Hao Zheng, Wenting Zhao, Junyang Lin, Binyuan Hui

AI总结:

本文提出Agentic Verifier,通过主动推理和高效测试输入生成,提升竞争编程问题解决的准确性与效率。

摘要:

大型语言模型(LLMs)在编码能力方面表现强劲,但仍难以在单次尝试中正确解决竞争性编程问题。基于执行的重新排序提供了一种有前景的测试时扩展策略,但现有方法受限于难以生成测试用例或低效的随机输入采样。为了解决这一限制,我们提出了Agentic Verifier,这是一种基于执行的代理,能够主动推理程序行为,并搜索高度判别性的测试输入,以暴露候选解决方案之间的行为差异。通过与代码执行环境的多轮交互,验证器迭代优化候选输入生成器,并生成定向反例而非盲目采样输入。我们通过结合大规模数据合成、拒绝微调和代理强化学习的可扩展管道训练验证器,使其获得这种判别性输入生成能力。在五个竞争性编程基准上的广泛实验表明,与强大的基于执行的基线相比,有持续的改进,实现了Best@K准确率的绝对提升高达+10-15%。进一步分析揭示了清晰的测试时扩展行为,并突显了验证器在重新排序之外的更广泛潜力。

英文摘要:

Large language models (LLMs) have demonstrated strong coding capabilities but still struggle to solve competitive programming problems correctly in a single attempt. Execution-based re-ranking offers a promising test-time scaling strategy, yet existing methods are constrained by either difficult test case generation or inefficient random input sampling. To address this limitation, we propose Agentic Verifier, an execution-based agent that actively reasons about program behaviors and searches for highly discriminative test inputs that expose behavioral discrepancies among candidate solutions. Through multi-turn interaction with code execution environments, the verifier iteratively refines the candidate input generator and produces targeted counterexamples rather than blindly sampling inputs. We train the verifier to acquire this discriminative input generation capability via a scalable pipeline combining large-scale data synthesis, rejection fine-tuning, and agentic reinforcement learning. Extensive experiments across five competitive programming benchmarks demonstrate consistent improvements over strong execution-based baselines, achieving up to +10-15% absolute gains in Best@K accuracy. Further analysis reveals clear test-time scaling behavior and highlights the verifier's broader potential beyond reranking.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑