多模态大模型

TextInVision: Text and Prompt Complexity Driven Visual Text Generation Benchmark

Forouzan Fallah, Maitreya Patel, Agneet Chatterjee, Vlad I. Morariu, Chitta Baral, Yezhou Yang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.CL

Evaluating the Posterior Sampling Ability of Plug&Play Diffusion Methods in Sparse-View CT

Liam Moroy, Guillaume Bourmaud, Frédéric Champagnat, Jean-François Giovannelli

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

Compose Your Aesthetics: Empowering Text-to-Image Models with the Principles of Art

Zhe Jin, Tat-Seng Chua

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

CHOrD: Generation of Collision-Free, House-Scale, and Organized Digital Twins for 3D Indoor Scenes with Controllable Floor Plans and Optimal Layouts

Chong Su, Yingbin Fu, Zheyuan Hu, Jing Yang, Param Hanji, Shaojun Wang, Xuan Zhao, Cengiz Öztireli, Fangcheng Zhong

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Chong Su and Yingbin Fu contributed equally to this work

Augmenting Image Annotation: A Human-LMM Collaborative Framework for Efficient Object Selection and Label Generation

He Zhang, Xinyi Fu, John M. Carroll

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments This paper will appear at ICLR 2025 Workshop on Bidirectional Human-AI Alignment

OminiControl2: Efficient Conditioning for Diffusion Transformers

Zhenxiong Tan, Qiaochu Xue, Xingyi Yang, Songhua Liu, Xinchao Wang

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Adv-CPG: A Customized Portrait Generation Framework with Facial Adversarial Attacks

Junying Wang, Hongyuan Zhang, Yuan Yuan

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted by CVPR-25

MAGIC: Mastering Physical Adversarial Generation in Context through Collaborative LLM Agents

Yun Xing, Nhat Chung, Jie Zhang, Yue Cao, Ivor Tsang, Yang Liu, Lei Ma, Qing Guo

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Can Large Language Models Unveil the Mysteries? An Exploration of Their Ability to Unlock Information in Complex Scenarios

Chao Wang, Luning Zhang, Zheng Wang, Yang Zhou

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments 11pages

DEEM: Diffusion Models Serve as the Eyes of Large Language Models for Image Perception

Run Luo, Yunshui Li, Longze Chen, Wanwei He, Ting-En Lin, Ziqiang Liu, Lei Zhang, Zikai Song, Xiaobo Xia, Tongliang Liu, Min Yang, Binyuan Hui

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments 25 pages. arXiv admin note: text overlap with arXiv:2401.10208 by other authors

Safety Without Semantic Disruptions: Editing-free Safe Image Generation via Context-preserving Dual Latent Reconstruction

Jordan Vice, Naveed Akhtar, Mubarak Shah, Richard Hartley, Ajmal Mian

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments This research is supported by the NISDRG project #20100007, funded by the Australian Government

Modular Conversational Agents for Surveys and Interviews

Jiangbo Yu, Jinhua Zhao, Luis Miranda-Moreno, Matthew Korp

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CL、cs.MM

RDT-1B: a Diffusion Foundation Model for Bimanual Manipulation

Songming Liu, Lingxuan Wu, Bangguo Li, Hengkai Tan, Huayu Chen, Zhengyi Wang, Ke Xu, Hang Su, Jun Zhu

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments 10 pages, conference

DKDM: Data-Free Knowledge Distillation for Diffusion Models with Any Architecture

Qianlong Xiang, Miao Zhang, Yuzhang Shang, Jianlong Wu, Yan Yan, Liqiang Nie

专题命中 多模态生成 ：image-text(abstract)；分类 cs.CV、cs.AI

Both Ears Wide Open: Towards Language-Driven Spatial Audio Generation

Peiwen Sun, Sitong Cheng, Xiangtai Li, Zhen Ye, Huadai Liu, Honggang Zhang, Wei Xue, Yike Guo

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、eess.AS

Comments Accepted by ICLR 2025

Vision-Enhanced Time Series Forecasting via Latent Diffusion Models

Weilin Ruan, Siru Zhong, Haomin Wen, Yuxuan Liang

专题命中 多模态生成 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Exploiting Point-Language Models with Dual-Prompts for 3D Anomaly Detection

Jiaxiang Wang, Haote Xu, Xiaolu Chen, Haodi Xu, Yue Huang, Xinghao Ding, Xiaotong Tu

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments 10 pages, 7 figures

Effective Black-Box Multi-Faceted Attacks Breach Vision Large Language Model Guardrails

Yijun Yang, Lichao Wang, Xiao Yang, Lanqing Hong, Jun Zhu

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

ETA: Evaluating Then Aligning Safety of Vision Language Models at Inference Time

Yi Ding, Bolian Li, Ruqi Zhang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments 29pages

Evaluating Image Hallucination in Text-to-Image Generation with Question-Answering

Youngsun Lim, Hojun Choi, Hyunjung Shim

专题命中 多模态生成 ：image-text(abstract)；分类 cs.CV、cs.AI

Comments 20 pages

Cached Multi-Lora Composition for Multi-Concept Image Generation

Xiandong Zou, Mingzhu Shen, Christos-Savvas Bouganis, Yiren Zhao

专题命中 多模态生成 ：MLLM(abstract)；分类 cs.CV、cs.AI

Comments The Thirteenth International Conference on Learning Representations (ICLR 2025)

A-Bench: Are LMMs Masters at Evaluating AI-generated Images?

Zicheng Zhang, Haoning Wu, Chunyi Li, Yingjie Zhou, Wei Sun, Xiongkuo Min, Zijian Chen, Xiaohong Liu, Weisi Lin, Guangtao Zhai

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

FCBoost-Net: A Generative Network for Synthesizing Multiple Collocated Outfits via Fashion Compatibility Boosting

Dongliang Zhou, Haijun Zhang, Jianghong Ma, Jicong Fan, Zhao Zhang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.MM

Comments This paper has been accepted for presentation at ACM Multimedia 2023

PhiP-G: Physics-Guided Text-to-3D Compositional Scene Generation

Qixuan Li, Chao Wang, Zongjin He, Yan Peng

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 13 pages.8 figures

Long Tail Image Generation Through Feature Space Augmentation and Iterated Learning

Rafael Elberg, Denis Parra, Mircea Petrache

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

FlexMotion: Lightweight, Physics-Aware, and Controllable Human Motion Generation

Arvin Tashakori, Arash Tashakori, Gongbo Yang, Z. Jane Wang, Peyman Servati

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

Dynamic Token Reduction during Generation for Vision Language Models

Xiaoyu Liang, Chaofeng Guan, Jiaying Lu, Huiyao Chen, Huan Wang, Haoji Hu

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、cs.AI

Audio-Agent: Leveraging LLMs For Audio Generation, Editing and Composition

Zixuan Wang, Chi-Keung Tang, Yu-Wing Tai

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV、eess.AS

Skip Mamba Diffusion for Monocular 3D Semantic Scene Completion

Li Liang, Naveed Akhtar, Jordan Vice, Xiangrui Kong, Ajmal Saeed Mian

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted by AAAI 2025

Unispeaker: A Unified Approach for Multimodality-driven Speaker Generation

Zhengyan Sheng, Zhihao Du, Heng Lu, Shiliang Zhang, Zhen-Hua Ling

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.AI、eess.AS