Unified multimodal models aim to integrate understanding and generation within a single framework, yet bridging the gap between discrete semantic reasoning and high-fidelity visual synthesis remains challenging. We present MammothModa2 (Mammoth2), a unified autoregressive-diffusion (AR-Diffusion) framework designed to effectively couple autoregressive semantic planning with diffusion-based generation. Mammoth2 adopts a serial design: an AR path equipped with generation experts performs global semantic modeling over discrete tokens, while a single-stream Diffusion Transformer (DiT) decoder handles high-fidelity image synthesis. A carefully designed AR-Diffusion feature alignment module combines multi-layer feature aggregation, unified condition encoding, and in-context conditioning to stably align AR's representations with the diffusion decoder's continuous latents. Mammoth2 is trained end-to-end with joint Next-Token Prediction and Flow Matching objectives, followed by supervised fine-tuning and reinforcement learning over both generation and editing. With roughly 60M supervised generation samples and no reliance on pre-trained generators, Mammoth2 delivers strong text-to-image and instruction-based editing performance on public benchmarks, achieving 0.87 on GenEval, 87.2 on DPGBench, and 4.06 on ImgEdit, while remaining competitive with understanding-only backbones (e.g., Qwen3-VL-8B) on multimodal understanding tasks. These results suggest that a carefully coupled AR-Diffusion architecture can provide high-fidelity generation and editing while maintaining strong multimodal comprehension within a single, parameter- and data-efficient model.
Consolidating Diffusion-Generated Video Detection with Unified Multimodal Forgery Learning
School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院);School of Information Science and Electronic Engineering, Shanghai Jiao Tong University(上海交通大学信息科学与电子工程学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Department of Computer Science and Engineering, Michigan State University(密歇根州立大学计算机科学与工程系)
Novel Diffusion Models for Multimodal 3D Hand Trajectory Prediction
IRMV Lab, the Department of Automation, Shanghai Jiao Tong University(IRMV实验室,自动化系,上海交通大学);Meta Reality Labs(Meta现实实验室);the Department of Electronic Engineering, Shanghai Jiao Tong University(电子工程系,上海交通大学);the School of Information and Control Engineering, China University of Mining and Technology(信息与控制工程学院,中国矿业大学);the College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院,国防科技大学)
Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing
Media Integration and Communication Center (MICC), University of Florence(佛罗伦萨大学媒体集成与传播中心(MICC));University of Florence(佛罗伦萨大学);University of Modena and Reggio Emilia(摩德纳-雷焦艾米利亚大学);University of Pisa(比萨大学)
Diagnosing and Correcting Concept Omission in Multimodal Diffusion Transformers
Interdisciplinary Program in Artificial Intelligence, Seoul National University, Seoul, South Korea;Department of Electrical;Computer Engineering, Seoul National University, Seoul, South Korea;Department of Computer Science \& Engineering, Korea University, Seoul, South Korea;ISRC, Seoul National University, Seoul, South Korea
Intention Enhanced Diffusion Model for Multimodal Pedestrian Trajectory Prediction
Guangdong Provincial Key Laboratory of Fully Actuated System Control Theory and Technology, the Southern University of Science and Technology, Shenzhen 518055, China(广东省全自动化系统控制理论与技术重点实验室,南方科技大学,深圳518055,中国);Department of Mechanical Engineering, City University of Hong Kong, Hong Kong SAR, China(香港城市大学机械工程系,香港特别行政区,中国)
Adversarial-Guided Diffusion for Multimodal LLM Attacks
School of Information Science and Engineering, Lanzhou University(兰州大学信息科学与工程学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院)
Rethinking Cross-Modal Interaction in Multimodal Diffusion Transformers
The University of Hong Kong(香港大学);Nanjing University(南京大学);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学);Harbin Institute of Technology(哈尔滨工业大学)
Diff4MMLiTS: Advanced Multimodal Liver Tumor Segmentation via Diffusion-Based Image Synthesis and Alignment
Department of Electronic and Electrical Engineering, Southern University of Science and Technology, Shenzhen, China(电子与电气工程系,南方科技大学,深圳,中国);Department of Electrical and Electronic Engineering, The University of Hong Kong, Hong Kong SAR, China(电气与电子工程系,香港大学,香港特别行政区,中国);Department of Radiology, Zhongda Hospital, Medical School, Southeast University, Nanjing, China(放射科,中大医院,医学院,东南大学,南京,中国);Jiaxing Research Institute, Southern University of Science and Technology, Jiaxing, China(嘉兴研究所,南方科技大学,嘉兴,中国)
MMA-Diffusion: MultiModal Attack on Diffusion Models
The Chinese University of Hong Kong(香港中文大学);Huawei(华为);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Beijing Wenge Technology Co. Ltd(北京文格科技有限公司)
DPDEdit: Detail-Preserved Diffusion Models for Multimodal Fashion Image Editing
Shenzhen Technology University(深圳科技大学);University of Washington(华盛顿大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院)
OSDM-MReg: Multimodal Image Registration based One Step Diffusion Model
Shanghai Key Laboratory of Intelligent Sensing and Recognition(上海智能感知与识别重点实验室);Shanghai Jiao Tong University(上海交通大学);Center of Digital Innovation(数字创新中心)
Multimodal Data Augmentation for Image Captioning using Diffusion Models
School of Economics and Management, Tsinghua University(清华大学经济管理学院);Department of Decision, Operations & Information Technologies, University of Maryland(马里兰大学决策、运营与信息技术系)
A Unified Framework for Multimodal Image Reconstruction and Synthesis using Denoising Diffusion Models
Department of Computer Science and Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校计算机科学与工程系);Mallinckrodt Institute of Radiology, Washington University in St. Louis(华盛顿大学圣路易斯分校马林克罗德特放射医学研究所);Department of Electrical and Systems Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校电气与系统工程系);Department of Neurology, Washington University in St. Louis(华盛顿大学圣路易斯分校神经病学系);Department of Biomedical Engineering, Washington University in St. Louis(华盛顿大学圣路易斯分校生物医学工程系);Division of Biology and Biomedical Sciences, Washington University in St. Louis(华盛顿大学圣路易斯分校生物学与生物医学科学 division);Department of Electrical and Computer Engineering, University of Wisconsin–Madison(威斯康星大学麦迪逊分校电气与计算机工程系)
LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuning
Gaoling School of AI, Renmin University of China(中国人民大学人工智能学院);Beijing Key Laboratory of Research on Large Models and Intelligent Governance(北京大型模型与智能治理研究重点实验室);Engineering Research Center of Next-Generation Intelligent Search and Recommendation, MOE(下一代智能搜索与推荐工程技术研究中心,教育部);Ant Group(蚂蚁集团)