Unified multimodal models (UMMs) provide an interface for interleaved text-image generation, where generated visual states can directly inform subsequent reasoning and synthesis. However, existing systems are still primarily demonstrated on short trajectories or simplified visual content. We develop a large UMM natively trained on interleaved multimodal data, with strong capabilities in image synthesis, text rendering, complex composition, and multimodal planning, and study how to extend these native capabilities to substantially longer autoregressive trajectories. The main challenge is that generated images continuously accumulate in context: irrelevant or imperfect visual states interfere with future synthesis, while previously established characters and scenes must still be recovered after long intervals. We introduce a visual-memory framework that maintains persistent visual references, selectively retrieves scene-relevant historical states while preserving the complete semantic history, and uses few-step self-rollout to adapt the model to imperfect generated histories. We further introduce LongMIG-Bench for evaluating long-horizon text-to-multi-image and image-to-multi-image generation. Our model achieves high-fidelity long-horizon interleaved generation with strong character and scene consistency, demonstrating how visual memory can scale native interleaved generation to substantially longer trajectories.
Illuminating Unified Multimodal Model for Free-form Interleaved Text-Image Generation
Harbin Institute of Technology(哈尔滨工业大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Zhengzhou Advanced Research Institute of Harbin Institute of Technology(哈尔滨工业大学郑州先进研究院);Nankai University(南开大学)
ARMOR: Empowering Multimodal Understanding Model with Interleaved Multimodal Generation Capability
Nankai University(南开大学);Shanghai Innovation Institute(上海创新研究院);University of Science and Technology of China(中国科学技术大学);Wuhan University(武汉大学);Shanghai AI Laboratory(上海人工智能实验室)
Beyond Textual CoT: Interleaved Text-Image Chains with Deep Confidence Reasoning for Image Editing
Shanghai Jiaotong University(上海交通大学);Huawei Noah’s Ark Lab(华为诺亚实验室);East China Normal University(华东师范大学);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院)
InterCoG: Towards Spatially Precise Image Editing with Interleaved Chain-of-Grounding Reasoning
Faculty of Computing, Harbin Institute of Technology(哈尔滨工业大学计算机学院);Zhengzhou Advanced Research Institute of Harbin Institute of Technology(哈尔滨工业大学郑州先进研究院);Huawei Noah’s Ark Lab(华为诺亚实验室);Artificial Intelligence Research Institute, Shenzhen University of Advanced Technology(深圳先进技术大学人工智能研究院)
Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs
Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院(AIR));Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Software and Microelectronics, Peking University(北京大学软件与微电子学院);College of Computer Science, Zhejiang University(浙江大学计算机学院);College of Computer Science and Technology, Harbin Engineering University(哈尔滨工程大学计算机科学与技术学院)
WEAVE: Unleashing and Benchmarking the In-context Interleaved Comprehension and Generation
National University of Singapore(新加坡国立大学);Nanyang Technological University(南洋理工大学);University of Maryland, College Park(马里兰大学学院公园分校);Zhejiang University(浙江大学)
Think in Strokes, Not Pixels: Process-Driven Image Generation via Interleaved Reasoning
Meta Superintelligence Labs(Meta超级智能实验室);University of California, San Diego(加州大学圣迭戈分校);Worcester Polytechnic Institute(伍斯特理工学院);Northwestern University(西北大学)
CoMM: A Coherent Interleaved Image-Text Dataset for Multimodal Understanding and Generation
The Hong Kong University of Science and Technology(香港科技大学);Wuhan University(武汉大学);AI Chip Center for Emerging Smart Systems(新兴智能系统人工智能芯片中心);Kuaishou Technology(快手科技)
ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning
National University of Singapore(新加坡国立大学);Zhejiang University(浙江大学);University of Washington(华盛顿大学);Stanford University(斯坦福大学);absolute AI;The Chinese University of Hong Kong(香港中文大学)
Bridging Modal Isolation in Interleaved Thinking: Supervising Modality Transitions via Stepwise Reinforcement
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Jiaotong University(上海交通大学);Zhejiang University(浙江大学);University of Chinese Academy of Sciences(中国科学院大学)
Tsinghua University(清华大学);Meituan Inc(美团公司);Central South University(中南大学);Peking University(北京大学);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学)
Sun Yat-sen University(中山大学);Shenzhen Loop Area Institute(深圳河套学院);Harbin Institute of Technology (HIT)(哈尔滨工业大学);Fudan University(复旦大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学)
OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
Shanghai AI Laboratory(上海人工智能实验室);RIT(罗切斯特理工学院);RUC(中国人民大学);SJTU(上海交通大学);NUS(新加坡国立大学);USTC(中国科学技术大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学);Shanghai Innovation Institute(上海创新研究院)
MINT-1T: Scaling Open-Source Multimodal Data by 10x: A Multimodal Dataset with One Trillion Tokens
University of Washington(华盛顿大学);Salesforce Research(Salesforce研究院);University of Texas at Austin(德克萨斯大学奥斯汀分校);Stanford University(斯坦福大学);University of California, Berkeley(加州大学伯克利分校)
Contextual AD Narration with Interleaved Multimodal Sequence
State Key Laboratory for Novel Software Technology, Nanjing University(南京大学计算机软件新技术国家重点实验室);ESAT, KU Leuven(鲁汶大学ESAT学院);Ant Group(蚂蚁集团);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
TumorChain: Interleaved Multimodal Chain-of-Thought Reasoning for Traceable Clinical Tumor Analysis
Zhejiang University(浙江大学);DAMO Academy, Alibaba Group(阿里集团达摩院);Hupan Lab(虎扑实验室);Shanghai Institution of Pancreatic Disease(上海胰腺疾病研究所);Shengjing Hospital of China Medical University(中国医科大学盛京医院);Sun Yat-sen University Cancer Center(中山大学肿瘤中心)