多模态大模型

FakeShield: Explainable Image Forgery Detection and Localization via Multi-modal Large Language Models

Zhipei Xu, Xuanyu Zhang, Runyi Li, Zecheng Tang, Qing Huang, Jian Zhang

专题命中 多模态生成 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments Accepted by ICLR 2025

Phantom: Subject-consistent video generation via cross-modal alignment

Lijie Liu, Tianxiang Ma, Bingchuan Li, Zhuowei Chen, Jiawei Liu, Gen Li, Siyu Zhou, Qian He, Xinglong Wu

专题命中 多模态生成 ：cross-modal(title,abstract)；分类 cs.CV、cs.AI

Multimodal Quantitative Language for Generative Recommendation

Jianyang Zhai, Zi-Feng Mai, Chang-Dong Wang, Feidiao Yang, Xiawu Zheng, Hui Li, Yonghong Tian

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Stance-Driven Multimodal Controlled Statement Generation: New Dataset and Task

Bingqian Wang, Quan Fang, Jiachen Sun, Xiaoxiao Ma

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

OmniCam: Unified Multimodal Video Generation via Camera Control

Xiaoda Yang, Jiayang Xu, Kaixuan Luan, Xinyu Zhan, Hongshun Qiu, Shijun Shi, Hao Li, Shuai Yang, Li Zhang, Checheng Yu, Cewu Lu, Lixin Yang

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Evaluating Compositional Scene Understanding in Multimodal Generative Models

Shuhao Fu, Andrew Jun Lee, Anna Wang, Ida Momennejad, Trevor Bihl, Hongjing Lu, Taylor W. Webb

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

UGen: Unified Autoregressive Multimodal Model with Progressive Vocabulary Learning

Hongxuan Tang, Hao Liu, Xinyan Xiao

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Unified Multimodal Discrete Diffusion

Alexander Swerdlow, Mihir Prabhudesai, Siddharth Gandhi, Deepak Pathak, Katerina Fragkiadaki

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments Project Website: https://unidisc.github.io

Zero-Shot Human-Object Interaction Synthesis with Multimodal Priors

Yuke Lou, Yiming Wang, Zhen Wu, Rui Zhao, Wenjia Wang, Mingyi Shi, Taku Komura

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Do Multimodal Large Language Models Understand Welding?

Grigorii Khvatskii, Yong Suk Lee, Corey Angst, Maria Gibbs, Robert Landers, Nitesh V. Chawla

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 16 pages

MMLNB: Multi-Modal Learning for Neuroblastoma Subtyping Classification Assisted with Textual Description Generation

Huangwei Chen, Yifei Chen, Zhenyu Yan, Mingyang Ding, Chenlei Li, Zhu Zhu, Feiwei Qin

专题命中 多模态生成 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 25 pages, 7 figures

IDEA: Inverted Text with Cooperative Deformable Aggregation for Multi-modal Object Re-Identification

Yuhao Wang, Yongfeng Lv, Pingping Zhang, Huchuan Lu

专题命中 多模态生成 ：multi-modal(title,abstract)；分类 cs.CV、cs.MM

Comments This work is accepted by CVPR2025. More modifications may be performed

MGHanD: Multi-modal Guidance for authentic Hand Diffusion

Taehyeon Eum, Jieun Choi, Tae-Kyun Kim

专题命中 多模态生成 ：multi-modal(title,abstract)；分类 cs.CV、cs.AI

Comments 8 pages, 7 figures

AV-Link: Temporally-Aligned Diffusion Features for Cross-Modal Audio-Video Generation

Moayed Haji-Ali, Willi Menapace, Aliaksandr Siarohin, Ivan Skorokhodov, Alper Canberk, Kwot Sin Lee, Vicente Ordonez, Sergey Tulyakov

专题命中 多模态生成 ：cross-modal(title,abstract)；分类 cs.CV、eess.AS

Comments Project Page: snap-research.github.io/AVLink/

FoodMLLM-JP: Leveraging Multimodal Large Language Models for Japanese Recipe Generation

Yuki Imajuku, Yoko Yamakata, Kiyoharu Aizawa

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.MM

Comments 15 pages, 5 figures. We found errors in the calculation of evaluation metrics, which were corrected in this version with $\color{blue}{\text{modifications highlighted in blue}}$. Please also see the Appendix

PaliGemma-CXR: A Multi-task Multimodal Model for TB Chest X-ray Interpretation

Denis Musinguzi, Andrew Katumba, Sudi Murindanyi

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Multimodal Representation Alignment for Image Generation: Text-Image Interleaved Control Is Easier Than You Think

Liang Chen, Shuai Bai, Wenhao Chai, Weichu Xie, Haozhe Zhao, Leon Vinci, Junyang Lin, Baobao Chang

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments 13 pages, 9 figures, codebase in https://github.com/chenllliang/DreamEngine

Code-Vision: Evaluating Multimodal LLMs Logic Understanding and Code Generation Capabilities

Hanbin Wang, Xiaoxuan Zhou, Zhipeng Xu, Keyuan Cheng, Yuxin Zuo, Kai Tian, Jingwei Song, Junting Lu, Wenhui Hu, Xueyang Liu

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages

PolyPath: Adapting a Large Multimodal Model for Multi-slide Pathology Report Generation

Faruk Ahmed, Lin Yang, Tiam Jaroensri, Andrew Sellergren, Yossi Matias, Avinatan Hassidim, Greg S. Corrado, Dale R. Webster, Shravya Shetty, Shruthi Prabhakara, Yun Liu, Daniel Golden, Ellery Wulczyn, David F. Steiner

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 8 main pages, 21 pages in total

Protecting Privacy in Multimodal Large Language Models with MLLMU-Bench

Zheyuan Liu, Guangyao Dou, Mengzhao Jia, Zhaoxuan Tan, Qingkai Zeng, Yongle Yuan, Meng Jiang

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL Main 2025

MuDoC: An Interactive Multimodal Document-grounded Conversational AI System

Karan Taneja, Ashok K. Goel

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.AI、cs.MM

Comments 5 pages, 3 figures, AAAI-MAKE 2025

Design2Code: Benchmarking Multimodal Code Generation for Automated Front-End Engineering

Chenglei Si, Yanzhe Zhang, Ryan Li, Zhengyuan Yang, Ruibo Liu, Diyi Yang

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments NAACL 2025; The first two authors contributed equally

On Fairness of Unified Multimodal Large Language Model for Image Generation

Ming Liu, Hao Chen, Jindong Wang, Liwen Wang, Bhiksha Raj Ramakrishnan, Wensheng Zhang

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Personalized Image Generation with Large Multimodal Models

Yiyan Xu, Wenjie Wang, Yang Zhang, Biao Tang, Peng Yan, Fuli Feng, Xiangnan He

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.AI、cs.MM

Comments Accepted for publication in WWW'25

3D-MoE: A Mixture-of-Experts Multi-modal LLM for 3D Vision and Pose Diffusion via Rectified Flow

Yueen Ma, Yuzheng Zhuang, Jianye Hao, Irwin King

专题命中 多模态生成 ：multi-modal(title,abstract)；分类 cs.CV、cs.CL

Comments Preprint. Work in progress

Diffusion-based Hierarchical Negative Sampling for Multimodal Knowledge Graph Completion

Guanglin Niu, Xiaowei Zhang

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CL、cs.AI

Comments The version of a full paper accepted to DASFAA 2025

ICM-Assistant: Instruction-tuning Multimodal Large Language Models for Rule-based Explainable Image Content Moderation

Mengyang Wu, Yuzhi Zhao, Jialun Cao, Mingjie Xu, Zhongming Jiang, Xuehui Wang, Qinbin Li, Guangneng Hu, Shengchao Qin, Chi-Wing Fu

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.CL

Comments Accepted by the AAAI 2025

A Multi-Modal AI Copilot for Single-Cell Analysis with Instruction Following

Yin Fang, Xinle Deng, Kangwei Liu, Ningyu Zhang, Jingyang Qian, Penghui Yang, Xiaohui Fan, Huajun Chen

专题命中 多模态生成 ：multi-modal(title,abstract)；分类 cs.CL、cs.AI

Comments 37 pages; 13 figures; Code: https://github.com/zjunlp/Instructcell, Models: https://huggingface.co/zjunlp/Instructcell-chat, https://huggingface.co/zjunlp/InstructCell-instruct

Face-MakeUp: Multimodal Facial Prompts for Text-to-Image Generation

Dawei Dai, Mingming Jia, Yinxiu Zhou, Hang Xing, Chenghang Li

专题命中 多模态生成 ：multimodal(title)；image-text(abstract)；分类 cs.CV、cs.AI

Multimodal Urban Areas of Interest Generation via Remote Sensing Imagery and Geographical Prior

Chuanji Shi, Yingying Zhang, Jiaotuan Wang, Xin Guo, Qiqi Zhu

专题命中 多模态生成 ：multimodal(title,abstract)；分类 cs.CV、cs.AI

Comments 9 pages, 9 figures

Journal ref International Journal of Applied Earth Observation and Geoinformation, 136(2025)