arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11241cs.CVcs.LG
收藏

主动零:通过主动环境探索实现自我进化的视觉-语言模型

Active Zero: Self-Evolving Vision-Language Models through Active Environment Exploration

Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);National University of Singapore(新加坡国立大学);Wuhan AI Research(武汉人工智能研究所);Tsinghua University(清华大学)

Jinghan He, Junfeng Fang, Feng Xiong, Zijun Yao, Fei Shen, Haiyun Guo, Jinqiao Wang, Tat-Seng Chua

AI总结:

Active-Zero通过主动环境探索实现视觉-语言模型的自我进化,提升推理和理解任务的性能。

摘要:

自我博弈使大语言模型能够通过自动生成的挑战自主提高。然而,现有针对视觉-语言模型的自我博弈方法依赖于与静态图像集合的被动交互,导致对初始数据集有很强的依赖性,并且学习效率低下。没有能力主动寻求与其日益发展能力相适应的视觉数据,代理会浪费计算资源在那些要么是琐碎的要么超出当前技能水平的样本上。为了解决这些限制,我们提出了Active-Zero,一个框架,从被动交互转向对视觉环境的主动探索。Active-Zero采用三个共进化代理:一个Searcher根据模型的能力前沿从开放世界存储库中检索图像,一个Questioner合成校准的推理任务,一个Solver通过准确性奖励进行优化。这种闭环使模型能够实现自我支撑的自动课程,模型可以自主构建其学习轨迹。在Qwen2.5-VL-7B-Instruct上跨12个基准测试中,Active-Zero在推理任务上实现了53.97的平均准确率(5.7%的提升),在一般理解上实现了59.77(3.9%的提升),在现有自我博弈基线中始终表现优异。这些结果突显了主动探索作为可扩展和适应性强的自我进化视觉-语言系统关键成分的重要性。

英文摘要:

Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in strong dependence on initial datasets and inefficient learning. Without the ability to actively seek visual data tailored to their evolving capabilities, agents waste computational effort on samples that are either trivial or beyond their current skill level. To address these limitations, we propose Active-Zero, a framework that shifts from passive interaction to active exploration of visual environments. Active-Zero employs three co-evolving agents: a Searcher that retrieves images from open-world repositories based on the model's capability frontier, a Questioner that synthesizes calibrated reasoning tasks, and a Solver refined through accuracy rewards. This closed loop enables self-scaffolding auto-curricula where the model autonomously constructs its learning trajectory. On Qwen2.5-VL-7B-Instruct across 12 benchmarks, Active-Zero achieves 53.97 average accuracy on reasoning tasks (5.7% improvement) and 59.77 on general understanding (3.9% improvement), consistently outperforming existing self-play baselines. These results highlight active exploration as a key ingredient for scalable and adaptive self-evolving vision-language systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑