多模态大模型 - arXivDaily 专题

2407.05996 2024-07-09 cs.RO 78%

Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals

Moritz Reuss, Ömer Erdinç Yağmurlu, Fabian Wenzel, Rudolf Lioutikov

专题命中多模态生成：multimodal(title,abstract)

Comments RSS 2024

2402.04997 2024-06-07 stat.ML cs.LG q-bio.QM 78%

Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design

Andrew Campbell, Jason Yim, Regina Barzilay, Tom Rainforth, Tommi Jaakkola

专题命中多模态生成：multimodal(title,abstract)

Comments 60 pages, 11 figures, 6 tables; ICML 2024

2406.00681 2024-06-04 cs.LG 78%

Learning Multimodal Behaviors from Scratch with Diffusion Policy Gradient

Zechu Li, Rickmer Krohn, Tao Chen, Anurag Ajay, Pulkit Agrawal, Georgia Chalvatzaki

专题命中多模态生成：multimodal(title,abstract)

2303.06458 2024-06-04 cs.CL cs.AI cs.CV 78%

ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation

Bang Yang, Fenglin Liu, Yuexian Zou, Xian Wu, Yaowei Wang, David A. Clifton

专题命中多模态生成：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted by TPAMI (Our code and data are available at https://github.com/yangbang18/ZeroNLG)

2405.06927 2024-05-14 cs.IR 78%

Multimodal Pretraining and Generation for Recommendation: A Tutorial

Jieming Zhu, Chuhan Wu, Rui Zhang, Zhenhua Dong

专题命中多模态生成：multimodal(title,abstract)

Comments Published in WWW 2024 Tutorial. Find the tutorial materials at https://mmrec.github.io/tutorial/www2024/

2309.05273 2024-04-30 cs.IR 78%

Formalizing Multimedia Recommendation through Multimodal Deep Learning

Daniele Malitesta, Giandomenico Cornacchia, Claudio Pomo, Felice Antonio Merra, Tommaso Di Noia, Eugenio Di Sciascio

专题命中多模态生成：multimodal(title,abstract)

Comments Accepted in the Special Issue on Knowledge Transferring for Recommender Systems (KT4Rec) in ACM Transactions on Recommender Systems

2404.13898 2024-04-23 cs.NI 78%

Cross-Modal Generative Semantic Communications for Mobile AIGC: Joint Semantic Encoding and Prompt Engineering

Yinqiu Liu, Hongyang Du, Dusit Niyato, Jiawen Kang, Zehui Xiong, Shiwen Mao, Ping Zhang, Xuemin Shen

专题命中多模态生成：cross-modal(title,abstract)

2307.16075 2024-03-28 eess.SY cs.SY math.OC 78%

Redesigning Large-Scale Multimodal Transit Networks with Shared Autonomous Mobility Services

Max T. M. Ng, Hani S. Mahmassani, Ömer Verbas, Taner Cokyasar, Roman Engelhardt

专题命中多模态生成：multimodal(title,abstract)

Comments 48 pages, 18 figures, accepted for publication in Transportation Research Part C: Emerging Technologies, and presentation in the 25th International Symposium on Transportation and Traffic Theory (ISTTT25)

2403.16988 2024-03-26 physics.chem-ph physics.optics 78%

Multimodal operando microscopy reveals that interfacial chemistry and nanoscale performance disorder dictate perovskite solar cell stability

Kyle Frohna, Cullen Chosy, Amran Al-Ashouri, Florian Scheler, Yu-Hsien Chiang, Milos Dubajic, Julia E. Parker, Jessica M. Walker, Lea Zimmermann, Thomas A. Selby, Yang Lu, Bart Roose, Steve Albrecht, Miguel Anaya, Samuel D. Stranks

专题命中多模态生成：multimodal(title,abstract)

Comments Main text and supplementary information. Main text 26 pages, 4 figures. Supplementary information 79 pages, 76 figures. Kyle Frohna and Cullen Chosy contributed equally

2403.09391 2024-03-15 physics.optics physics.med-ph 78%

A hollow-core fiber based stand-alone multimodal (2-photon, 3-photon, SHG, THG) nonlinear flexible imaging endoscope

D. Septier, G. Brévalle-Wasilewski, E. Lefebvre, N. Gajendra Kumar, Y. J. Wang, A. Kaszas, H. Rigneault, A. Kudlinski

专题命中多模态生成：multimodal(title,abstract)

2311.06284 2024-03-11 physics.comp-ph cs.GR physics.flu-dyn 78%

Efficient Generation of Multimodal Fluid Simulation Data

Daniele Baieri, Donato Crisostomi, Stefano Esposito, Filippo Maggioli, Emanuele Rodolà

专题命中多模态生成：multimodal(title)；multi-modal(abstract)

Comments 10 pages, 7 figures

2403.00106 2024-03-05 cs.HC 78%

Umwelt: Accessible Structured Editing of Multimodal Data Representations

Jonathan Zong, Isabella Pedraza Pineros, Mengzhu Katie Chen, Daniel Hajas, Arvind Satyanarayan

专题命中多模态生成：multimodal(title,abstract)

Comments ACM CHI 2024

2401.08199 2024-02-26 physics.optics physics.comp-ph 78%

Photonic Modes Prediction via Multi-Modal Diffusion Model

Jinyang Sun, Xi Chen, Xiumei Wang, Dandan Zhu, Xingping Zhou

专题命中多模态生成：multi-modal(title,abstract)

2312.15665 2024-01-05 q-bio.QM cs.LG q-bio.BM 78%

A Multi-Modal Contrastive Diffusion Model for Therapeutic Peptide Generation

Yongkang Wang, Xuan Liu, Feng Huang, Zhankun Xiong, Wen Zhang

专题命中多模态生成：multi-modal(title,abstract)

Comments This paper is accepted by AAAI 2024

2311.18837 2023-12-01 cs.CV cs.AI cs.LG cs.MM 78%

VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models

Zhen Xing, Qi Dai, Zihao Zhang, Hui Zhang, Han Hu, Zuxuan Wu, Yu-Gang Jiang

专题命中多模态生成：multi-modal(title)；分类 cs.CV、cs.AI、cs.MM

2311.17951 2023-12-01 cs.LG 78%

C3Net: Compound Conditioned ControlNet for Multimodal Content Generation

Juntao Zhang, Yuehuai Liu, Yu-Wing Tai, Chi-Keung Tang

专题命中多模态生成：multimodal(title,abstract)

2306.14143 2023-11-21 eess.SP 78%

Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines

Xiang Cheng, Haotian Zhang, Jianan Zhang, Shijian Gao, Sijiang Li, Ziwei Huang, Lu Bai, Zonghui Yang, Xinhu Zheng, Liuqing Yang

专题命中多模态生成：multi-modal(title,abstract)

Comments This paper has been accepted by IEEE Communications Surveys & Tutorials

2311.03815 2023-11-08 cs.NI eess.SP 78%

Integrated Sensing, Communication, and Computing for Cost-effective Multimodal Federated Perception

Ning Chen, Zhipeng Cheng, Xuwei Fan, Bangzhen Huang, Yifeng Zhao, Lianfen Huang, Xiaojiang Du, Mohsen Guizani

专题命中多模态生成：multimodal(title,abstract)

2210.17237 2023-10-03 stat.ME cs.LG stat.ML 78%

Latent Multimodal Functional Graphical Model Estimation

Katherine Tsai, Boxin Zhao, Sanmi Koyejo, Mladen Kolar

专题命中多模态生成：multimodal(title,abstract)

2309.16685 2023-10-02 q-bio.BM cs.LG 78%

Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learning

Nhat Khang Ngo, Truong Son Hy

专题命中多模态生成：multimodal(title,abstract)

2309.04997 2023-09-12 cs.CY 78%

Gender Bias in Multimodal Models: A Transnational Feminist Approach Considering Geographical Region and Culture

Abhishek Mandal, Suzanne Little, Susan Leavy

专题命中多模态生成：multimodal(title,abstract)

Comments Selected for publication at the Aequitas 2023: Workshop on Fairness and Bias in AI | co-located with ECAI 2023, Kraków, Poland

2308.11211 2023-08-23 physics.optics cond-mat.mtrl-sci 78%

Simultaneous 3D Construction and Imaging of Plant Cells Using Plasmonic Nanoprobe Assisted Multimodal Nonlinear Optical Microscopy

Kun Liu, Yutian Lei, Dawei Li

专题命中多模态生成：multimodal(title,abstract)

Comments 18 pages, 5 figures

2002.02572 2023-05-09 cs.LG stat.ML 78%

Multimodal Controller for Generative Models

Enmao Diao, Jie Ding, Vahid Tarokh

专题命中多模态生成：multimodal(title,abstract)

2110.04616 2023-01-24 cs.LG stat.ML 78%

Discriminative Multimodal Learning via Conditional Priors in Generative Models

Rogelio A. Mancisidor, Michael Kampffmeyer, Kjersti Aas, Robert Jenssen

专题命中多模态生成：multimodal(title)；multi-modal(abstract)

2211.01774 2022-11-04 stat.ML math.PR 78%

Jump-Diffusion Langevin Dynamics for Multimodal Posterior Sampling

Jacopo Guidolin, Vyacheslav Kungurtsev, Ondřej Kuželka

专题命中多模态生成：multimodal(title,abstract)

2206.14476 2022-10-13 stat.ML cs.LG 78%

Can Push-forward Generative Models Fit Multimodal Distributions?

Antoine Salmona, Valentin de Bortoli, Julie Delon, Agnès Desolneux

专题命中多模态生成：multimodal(title,abstract)

Comments In Thirty-sixth Conference on Neural Information Processing Systems

2204.09007 2022-08-18 cs.HC 78%

Opal: Multimodal Image Generation for News Illustration

Vivian Liu, Han Qiao, Lydia Chilton

专题命中多模态生成：multimodal(title,abstract)

2206.04496 2022-06-10 cs.LG 78%

Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization

Adrián Javaloy, Maryam Meghdadi, Isabel Valera

专题命中多模态生成：multimodal(title,abstract)

Comments Accepted as a Spotlight paper at ICML 2022. 27 pages, 10 figures

2101.05395 2022-05-30 math.OC 78%

Resiliency of On-Demand Multimodal Transit Systems During a Pandemic

Ramon Auad, Kevin Dalmeijer, Connor Riley, Tejas Santanam, Anthony Trasatti, Pascal Van Hentenryck, Hanyu Zhang

专题命中多模态生成：multimodal(title,abstract)

Comments 25 pages, 23 figures, 6 tables

2203.16706 2022-04-01 eess.SP cs.SY eess.SY 78%

Going Beyond RF: How AI-enabled Multimodal Beamforming will Shape the NextG Standard

Debashri Roy, Batool Salehi, Stella Banou, Subhramoy Mohanti, Guillem Reus-Muns, Mauro Belgiovine, Prashant Ganesh, Carlos Bocanegra, Chris Dick, Kaushik Chowdhury

专题命中多模态生成：multimodal(title,abstract)

1. 多模态生成 4979 篇

Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goals

Generative Flows on Discrete State-Spaces: Enabling Multimodal Flows with Applications to Protein Co-Design

Learning Multimodal Behaviors from Scratch with Diffusion Policy Gradient

ZeroNLG: Aligning and Autoencoding Domains for Zero-Shot Multimodal and Multilingual Natural Language Generation

Multimodal Pretraining and Generation for Recommendation: A Tutorial

Formalizing Multimedia Recommendation through Multimodal Deep Learning

Cross-Modal Generative Semantic Communications for Mobile AIGC: Joint Semantic Encoding and Prompt Engineering

Redesigning Large-Scale Multimodal Transit Networks with Shared Autonomous Mobility Services

Multimodal operando microscopy reveals that interfacial chemistry and nanoscale performance disorder dictate perovskite solar cell stability

A hollow-core fiber based stand-alone multimodal (2-photon, 3-photon, SHG, THG) nonlinear flexible imaging endoscope

Efficient Generation of Multimodal Fluid Simulation Data

Umwelt: Accessible Structured Editing of Multimodal Data Representations

Photonic Modes Prediction via Multi-Modal Diffusion Model

A Multi-Modal Contrastive Diffusion Model for Therapeutic Peptide Generation

VIDiff: Translating Videos via Multi-Modal Instructions with Diffusion Models

C3Net: Compound Conditioned ControlNet for Multimodal Content Generation

Intelligent Multi-Modal Sensing-Communication Integration: Synesthesia of Machines

Integrated Sensing, Communication, and Computing for Cost-effective Multimodal Federated Perception

Latent Multimodal Functional Graphical Model Estimation

Target-aware Variational Auto-encoders for Ligand Generation with Multimodal Protein Representation Learning

Gender Bias in Multimodal Models: A Transnational Feminist Approach Considering Geographical Region and Culture

Simultaneous 3D Construction and Imaging of Plant Cells Using Plasmonic Nanoprobe Assisted Multimodal Nonlinear Optical Microscopy

Multimodal Controller for Generative Models

Discriminative Multimodal Learning via Conditional Priors in Generative Models

Jump-Diffusion Langevin Dynamics for Multimodal Posterior Sampling

Can Push-forward Generative Models Fit Multimodal Distributions?

Opal: Multimodal Image Generation for News Illustration

Mitigating Modality Collapse in Multimodal VAEs via Impartial Optimization

Resiliency of On-Demand Multimodal Transit Systems During a Pandemic

Going Beyond RF: How AI-enabled Multimodal Beamforming will Shape the NextG Standard