arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2602.01756cs.CV

Mind-Brush: 将代理认知搜索与推理整合到图像生成中

Mind-Brush: Integrating Agentic Cognitive Search and Reasoning into Image Generation

Sun Yat-sen University(中山大学);Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);MMLab, The Chinese University of Hong Kong(香港中文大学MMLab)

Jun He, Junyan Ye, Zilong Huang, Dongzhi Jiang, Chenjue Zhang, Leqi Zhu, Renrui Zhang, Xiang Zhang, Weijia Li

AI总结:

Mind-Brush通过整合代理认知搜索与推理,提升图像生成模型对复杂知识推理和动态适应能力,实现性能显著跃升。

摘要:

尽管文本到图像生成已实现了前所未有的保真度,但现有大多数模型本质上仍是以静态文本到像素解码器为基础。因此,它们往往无法理解隐含的用户意图。尽管新兴的统一理解和生成模型在意图理解方面有所改善,但仍难以在单一模型中完成涉及复杂知识推理的任务。此外,受限于静态内部先验,这些模型仍然无法适应现实世界的动态变化。为了弥合这些差距,我们引入了Mind-Brush,一个统一的代理框架,将生成转变为一个动态、知识驱动的工作流程。模拟人类般的'思考-研究-创造'范式,Mind-Brush主动检索多模态证据以确定分布外概念,并利用推理工具解决隐含的视觉约束。为了严格评估这些能力,我们提出了Mind-Bench,一个包含500个不同样本的综合基准,涵盖实时新闻、新兴概念以及数学和Geo-Reasoning等领域。广泛的实验表明,Mind-Brush显著增强了统一模型的能力,在Mind-Bench上实现了Qwen-Image基准的零到一能力飞跃,同时在已建立的基准如WISE和RISE上也取得了更优的结果。

英文摘要:

While text-to-image generation has achieved unprecedented fidelity, the vast majority of existing models function fundamentally as static text-to-pixel decoders. Consequently, they often fail to grasp implicit user intentions. Although emerging unified understanding-generation models have improved intent comprehension, they still struggle to accomplish tasks involving complex knowledge reasoning within a single model. Moreover, constrained by static internal priors, these models remain unable to adapt to the evolving dynamics of the real world. To bridge these gaps, we introduce Mind-Brush, a unified agentic framework that transforms generation into a dynamic, knowledge-driven workflow. Simulating a human-like 'think-research-create' paradigm, Mind-Brush actively retrieves multimodal evidence to ground out-of-distribution concepts and employs reasoning tools to resolve implicit visual constraints. To rigorously evaluate these capabilities, we propose Mind-Bench, a comprehensive benchmark comprising 500 distinct samples spanning real-time news, emerging concepts, and domains such as mathematical and Geo-Reasoning. Extensive experiments demonstrate that Mind-Brush significantly enhances the capabilities of unified models, realizing a zero-to-one capability leap for the Qwen-Image baseline on Mind-Bench, while achieving superior results on established benchmarks like WISE and RISE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑