arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.19497cs.CV

MICON-Bench: 多图像上下文图像生成的基准测试与增强

MICON-Bench: Benchmarking and Enhancing Multi-Image Context Image Generation in Unified Multimodal Models

Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University(多媒体可信感知与高效计算重点实验室,中国教育部,厦门大学);Zhongguancun Academy, Beijing, China(中关村学院,北京,中国)

Mingrui Wu, Hang Liu, Jiayi Ji, Xiaoshuai Sun, Rongrong Ji

AI总结:

MICON-Bench通过六个任务评估多图像上下文生成能力,并提出DAR机制提升生成质量与连贯性。

摘要:

近年来,统一多模态模型(UMMs)的进步使图像理解和生成能力有了显著提升。然而,尽管像Gemini-2.5-Flash-Image这样的模型展现出对多张相关图像进行推理的能力,现有基准测试很少解决多图像上下文生成的挑战,主要集中在文本到图像或单图像编辑任务上。在本工作中,我们介绍了MICON-Bench,一个涵盖六个任务的全面基准测试,评估跨图像组成、上下文推理和身份保持能力。我们进一步提出了一种基于MLLM的Evaluation-by-Checkpoint框架,用于自动验证语义和视觉一致性,其中多模态大语言模型(MLLM)充当验证者。此外,我们还提出了动态注意力再平衡(DAR),一种无需训练的即插即用机制,能够在推理过程中动态调整注意力以提高连贯性和减少幻觉。在各种最先进的开源模型上的广泛实验表明,MICON-Bench在暴露多图像推理挑战方面的严谨性以及DAR在提高生成质量和跨图像连贯性方面的有效性。Github: https://github.com/Angusliuuu/MICON-Bench。

英文摘要:

Recent advancements in Unified Multimodal Models (UMMs) have enabled remarkable image understanding and generation capabilities. However, while models like Gemini-2.5-Flash-Image show emerging abilities to reason over multiple related images, existing benchmarks rarely address the challenges of multi-image context generation, focusing mainly on text-to-image or single-image editing tasks. In this work, we introduce \textbf{MICON-Bench}, a comprehensive benchmark covering six tasks that evaluate cross-image composition, contextual reasoning, and identity preservation. We further propose an MLLM-driven Evaluation-by-Checkpoint framework for automatic verification of semantic and visual consistency, where multimodal large language model (MLLM) serves as a verifier. Additionally, we present \textbf{Dynamic Attention Rebalancing (DAR)}, a training-free, plug-and-play mechanism that dynamically adjusts attention during inference to enhance coherence and reduce hallucinations. Extensive experiments on various state-of-the-art open-source models demonstrate both the rigor of MICON-Bench in exposing multi-image reasoning challenges and the efficacy of DAR in improving generation quality and cross-image coherence. Github: https://github.com/Angusliuuu/MICON-Bench.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑