多模态大模型

OFER: Occluded Face Expression Reconstruction

Pratheba Selvaraju, Victoria Fernandez Abrevaya, Timo Bolkart, Rick Akkerman, Tianyu Ding, Faezeh Amjadi, Ilya Zharkov

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

Exploring Rewriting Approaches for Different Conversational Tasks

Md Mehrab Tanjim, Ryan A. Rossi, Mike Rimer, Xiang Chen, Sungchul Kim, Vaishnavi Muppala, Tong Yu, Zhengmian Hu, Ritwik Sinha, Wei Zhang, Iftikhar Ahamath Burhanuddin, Franck Dernoncourt

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CL

Comments Preprint

DGFM: Full Body Dance Generation Driven by Music Foundation Models

Xinran Liu, Zhenhua Feng, Diptesh Kanojia, Wenwu Wang

专题命中 多模态生成 ：cross-modal(abstract)；分类 eess.AS

Comments Accepted to the Audio Imagination Workshop of NeurlPS 2024

ProxyTransformation: Preshaping Point Cloud Manifold With Proxy Attention For 3D Visual Grounding

Qihang Peng, Henry Zheng, Gao Huang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

Comments 12 pages, 3 figures. Accepted by CVPR2025

A Survey on Diffusion Models for Anomaly Detection

Jing Liu, Zhenchao Ma, Zepu Wang, Chenxuanyin Zou, Jiayang Ren, Zehua Wang, Liang Song, Bo Hu, Yang Liu, Victor C. M. Leung

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.AI

Generator Matching: Generative modeling with arbitrary Markov processes

Peter Holderrieth, Marton Havasi, Jason Yim, Neta Shaul, Itai Gat, Tommi Jaakkola, Brian Karrer, Ricky T. Q. Chen, Yaron Lipman

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.AI

PixWizard: Versatile Image-to-Image Visual Assistant with Open-Language Instructions

Weifeng Lin, Xinyu Wei, Renrui Zhang, Le Zhuo, Shitian Zhao, Siyuan Huang, Huan Teng, Junlin Xie, Yu Qiao, Peng Gao, Hongsheng Li

专题命中 多模态生成 ：image-text(abstract)；分类 cs.CV

Comments Code is released at https://github.com/AFeng-x/PixWizard

LDGen: Enhancing Text-to-Image Synthesis via Large Language Model-Driven Language Representation

Pengzhi Li, Pengfei Yu, Zide Liu, Wei He, Xuhao Pan, Xudong Rao, Tao Wei, Wei Chen

专题命中 多模态生成 ：cross-modal(abstract)；分类 cs.CV

FPGA: Flexible Portrait Generation Approach

Zhaoli Deng, Fanyi Wang, Junkang Zhang, Fan Chen, Meng Zhang, Wendong Zhang, Wen Liu, Zhenpeng Mi

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

Comments 20 pages, 17 figures

Controlling Structured Output Representations from Attributes using Conditional Generative Models

Mohamed Debbagh

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

OrthoGAN:High-Precision Image Generation for Teeth Orthodontic Visualization

Feihong Shen, JIngjing Liu, Jianwen Lou, Haizhen Li, Bing Fang, Chenglong Ma, Jin Hao, Yang Feng, Youyi Zheng

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

LAVID: An Agentic LVLM Framework for Diffusion-Generated Video Detection

Qingyuan Liu, Yun-Yun Tsai, Ruijian Zha, Victoria Li, Pengyuan Shi, Chengzhi Mao, Junfeng Yang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

SayAnything: Audio-Driven Lip Synchronization with Conditional Video Diffusion

Junxian Ma, Shiwen Wang, Jian Yang, Junyi Hu, Jian Liang, Guosheng Lin, Jingbo chen, Kai Li, Yu Meng

专题命中 多模态生成 ：audio-visual(abstract)；分类 cs.CV

Skillful Nowcasting of Convective Clouds With a Cascade Diffusion Model

Haoming Chen, Xiaohui Zhong, Qiang Zhai, Xiaomeng Li, Ying Wa Chan, Pak Wai Chan, Yuanyuan Huang, Hao Li, Xiaoming Shi

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

Magic 1-For-1: Generating One Minute Video Clips within One Minute

Hongwei Yi, Shitong Shao, Tian Ye, Jiantong Zhao, Qingyu Yin, Michael Lingelbach, Li Yuan, Yonghong Tian, Enze Xie, Daquan Zhou

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

Comments Serious updates are needed

Artificial Intelligence in Spectroscopy: Advancing Chemistry from Prediction to Generation and Beyond

Kehan Guo, Yili Shen, Gisela Abigail Gonzalez-Montiel, Yue Huang, Yujun Zhou, Mihir Surve, Zhichun Guo, Prayel Das, Nitesh V Chawla, Olaf Wiest, Xiangliang Zhang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.AI

Learning a Diffusion Model Policy from Rewards via Q-Score Matching

Michael Psenka, Alejandro Escontrela, Pieter Abbeel, Yi Ma

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.AI

Comments ICML 2024. 21 pages, 9 figures

Long-Term TalkingFace Generation via Motion-Prior Conditional Diffusion Model

Fei Shen, Cong Wang, Junyao Gao, Qin Guo, Jisheng Dang, Jinhui Tang, Tat-Seng Chua

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

Redistribute Ensemble Training for Mitigating Memorization in Diffusion Models

Xiaoliu Guan, Yu Wu, Huayang Huang, Xiao Liu, Jiaxu Miao, Yi Yang

专题命中 多模态生成 ：cross-modal(abstract)；分类 cs.CV

Comments 12 pages,9 figures. arXiv admin note: substantial text overlap with arXiv:2407.15328

SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration

Yuhong Zhang, Hengsheng Zhang, Zhengxue Cheng, Rong Xie, Li Song, Wenjun Zhang

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

Comments To be published in IEEE TCSVT

Journal ref Y. Zhang, H. Zhang, Z. Cheng, R. Xie, L. Song and W. Zhang, "SSP-IR: Semantic and Structure Priors for Diffusion-based Realistic Image Restoration," in IEEE Transactions on Circuits and Systems for Video Technology, 2025

OpenVid-1M: A Large-Scale High-Quality Dataset for Text-to-video Generation

Kepan Nan, Rui Xie, Penghao Zhou, Tiehan Fan, Zhenheng Yang, Zhijie Chen, Xiang Li, Jian Yang, Ying Tai

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

Comments 20 pages, 15 figures, Published as a conference paper at ICLR 2025

DiffListener: Discrete Diffusion Model for Listener Generation

Siyeol Jung, Taehwan Kim

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CL

Comments Accepted at ICASSP 2025

Bidirectional Multi-Step Domain Generalization for Visible-Infrared Person Re-Identification

Mahdi Alehdaghi, Pourya Shamsolmoali, Rafael M. O. Cruz, Eric Granger

专题命中 多模态生成 ：cross-modal(abstract)；分类 cs.CV

Fg-T2M++: LLMs-Augmented Fine-Grained Text Driven Human Motion Generation

Yin Wang, Mu Li, Jiapeng Liu, Zhiying Leng, Frederick W. B. Li, Ziyao Zhang, Xiaohui Liang

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

Diffusion-Based Planning for Autonomous Driving with Flexible Guidance

Yinan Zheng, Ruiming Liang, Kexin Zheng, Jinliang Zheng, Liyuan Mao, Jianxiong Li, Weihao Gu, Rui Ai, Shengbo Eben Li, Xianyuan Zhan, Jingjing Liu

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.AI

CookingDiffusion: Cooking Procedural Image Generation with Stable Diffusion

Yuan Wang, Bin Zhu, Yanbin Hao, Chong-Wah Ngo, Yi Tan, Xiang Wang

专题命中 多模态生成 ：multi-modal(abstract)；分类 cs.CV

Iterative Ensemble Training with Anti-Gradient Control for Mitigating Memorization in Diffusion Models

Xiao Liu, Xiaoliu Guan, Yu Wu, Jiaxu Miao

专题命中 多模态生成 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted in ECCV 2024, 20 pages with 7 figures

Adaptive Generation of Privileged Intermediate Information for Visible-Infrared Person Re-Identification

Mahdi Alehdaghi, Arthur Josi, Pourya Shamsolmoali, Rafael M. O. Cruz, Eric Granger

专题命中 多模态生成 ：cross-modal(abstract)；分类 cs.CV

Multitwine: Multi-Object Compositing with Text and Layout Control

Gemma Canet Tarrés, Zhe Lin, Zhifei Zhang, He Zhang, Andrew Gilbert, John Collomosse, Soo Ye Kim

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CV

DreamDPO: Aligning Text-to-3D Generation with Human Preferences via Direct Preference Optimization

Zhenglin Zhou, Xiaobo Xia, Fan Ma, Hehe Fan, Yi Yang, Tat-Seng Chua

专题命中 多模态生成 ：multimodal(abstract)；分类 cs.CL

Comments 20 pages, 12 figures