arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4975 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态生成 4975 篇

2402.04119 2025-01-06 cs.LG cs.CE 50%

A quantitative analysis of knowledge-learning preferences in large language models in molecular science

Pengfei Liu, Jun Tao, Zhixiang Ren

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.07078 2024-12-31 cs.RO 50%

FlowBotHD: History-Aware Diffuser Handling Ambiguities in Articulated Objects Manipulation

Yishu Li, Wen Hui Leng, Yiming Fang, Ben Eisner, David Held

专题命中 多模态生成 :multi-modal(abstract)

Comments Accepted to CoRL 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.15980 2024-12-23 cs.HC 50%

iRadar: Synthesizing Millimeter-Waves from Wearable Inertial Inputs for Human Gesture Sensing

Huanqi Yang, Mingda Han, Xinyue Li, Di Duan, Tianxing Li, Weitao Xu

专题命中 多模态生成 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.12953 2024-12-18 cs.LG cs.RO 50%

Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learning

Moritz Reuss, Jyothish Pari, Pulkit Agrawal, Rudolf Lioutikov

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.08398 2024-12-12 cs.RO cs.LG 50%

Grasp Diffusion Network: Learning Grasp Generators from Partial Point Clouds with Diffusion Models in SO(3)xR3

Joao Carvalho, An T. Le, Philipp Jahr, Qiao Sun, Julen Urain, Dorothea Koert, Jan Peters

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.20313 2024-12-12 cs.LG q-bio.BM 50%

Sequence-Augmented SE(3)-Flow Matching For Conditional Protein Backbone Generation

Guillaume Huguet, James Vuckovic, Kilian Fatras, Eric Thibodeau-Laufer, Pablo Lemos, Riashat Islam, Cheng-Hao Liu, Jarrid Rector-Brooks, Tara Akhound-Sadegh, Michael Bronstein, Alexander Tong, Avishek Joey Bose

专题命中 多模态生成 :multi-modal(abstract)

Comments Presented at NeurIPS 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.07539 2024-12-11 cs.LG 50%

Anomaly detection using Diffusion-based methods

Aryan Bhosale, Samrat Mukherjee, Biplab Banerjee, Fabio Cuzzolin

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.00960 2024-12-06 cs.GR cs.RO 50%

PDP: Physics-Based Character Animation via Diffusion Policy

Takara E. Truong, Michael Piseno, Zhaoming Xie, C. Karen Liu

专题命中 多模态生成 :multi-modal(abstract)

Journal ref In SIGGRAPH Asia 2024 Conference Papers (Article No. 86, 10 pages)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.03220 2024-12-05 cs.LG 50%

Survey of different Large Language Model Architectures: Trends, Benchmarks, and Challenges

Minghao Shao, Abdul Basit, Ramesh Karri, Muhammad Shafique

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.12736 2024-11-27 cs.SE 50%

Large Language Model Supply Chain: A Research Agenda

Shenao Wang, Yanjie Zhao, Xinyi Hou, Haoyu Wang

专题命中 多模态生成 :multimodal(abstract)

Comments Accepted by ACM Transactions on Software Engineering and Methodology (TOSEM) Special Issue: 2030 Software Engineering Roadmap

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.11768 2024-11-19 q-bio.QM cs.CE cs.LG 50%

Geometric Deep Learning for Structure-Based Drug Design: A Survey

Zaixi Zhang, Jiaxian Yan, Yining Huang, Qi Liu, Enhong Chen, Mengdi Wang, Marinka Zitnik

专题命中 多模态生成 :multimodal(abstract)

Comments 28 pages, under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.14411 2024-11-15 cs.RO 50%

Scaling Diffusion Policy in Transformer to 1 Billion Parameters for Robotic Manipulation

Minjie Zhu, Yichen Zhu, Jinming Li, Junjie Wen, Zhiyuan Xu, Ning Liu, Ran Cheng, Chaomin Shen, Yaxin Peng, Feifei Feng, Jian Tang

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.00704 2024-11-14 physics.optics quant-ph 50%

Measuring, processing, and generating partially coherent light with self-configuring optics

Charles Roques-Carmes, Shanhui Fan, David Miller

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.04140 2024-11-08 math.NA cs.NA math.DS 50%

Bayesian inference for geophysical fluid dynamics using generative models

Alexander Lobbe, Dan Crisan, Oana Lang

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.15022 2024-11-07 quant-ph 50%

Evidence of the quantum-optical nature of high-harmonic generation

David Theidel, Viviane Cotte, René Sondenheimer, Viktoriia Shiriaeva, Marie Froidevaux, Vladislav Severin, Philip Mosel, Adam Merdji-Larue, Sven Fröhlich, Kim-Alessandro Weber, Uwe Morgner, Milutin Kovacev, Jens Biegert, Hamed Merdji

专题命中 多模态生成 :multimodal(abstract)

Comments 39 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.10678 2024-11-07 eess.SP 50%

Graph Laplacian Diffusion Localization of Connected and Automated Vehicles

Nikos Piperigkos, Aris S. Lalos, Kostas Berberidis

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.16727 2024-10-23 cs.RO 50%

DiffusionSeeder: Seeding Motion Optimization with Diffusion for Rapid Motion Planning

Huang Huang, Balakumar Sundaralingam, Arsalan Mousavian, Adithyavairavan Murali, Ken Goldberg, Dieter Fox

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.07658 2024-10-23 cs.LG stat.ML 50%

Treeffuser: Probabilistic Predictions via Conditional Diffusions with Gradient-Boosted Trees

Nicolas Beltran-Velez, Alessandro Antonio Grande, Achille Nazaret, Alp Kucukelbir, David Blei

专题命中 多模态生成 :multimodal(abstract)

Comments NeurIPS 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.12381 2024-10-22 cs.RO 50%

Flow Matching Imitation Learning for Multi-Support Manipulation

Quentin Rouxel, Andrea Ferrari, Serena Ivaldi, Jean-Baptiste Mouret

专题命中 多模态生成 :multi-modal(abstract)

Comments 2024 IEEE-RAS 23rd International Conference on Humanoid Robots (Humanoids), Nov 2024, Nancy, France

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.13897 2024-10-21 cs.CR cs.LG 50%

A Formal Framework for Assessing and Mitigating Emergent Security Risks in Generative AI Models: Bridging Theory and Dynamic Risk Mitigation

Aviral Srivastava, Sourav Panda

专题命中 多模态生成 :multi-modal(abstract)

Comments This paper was accepted in NeurIPS 2024 workshop on Red Teaming GenAI: What can we learn with Adversaries?

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.01812 2024-10-16 cs.RO cs.LG 50%

Equivariant Diffusion Policy

Dian Wang, Stephen Hart, David Surovik, Tarik Kelestemur, Haojie Huang, Haibo Zhao, Mark Yeatman, Jiuguang Wang, Robin Walters, Robert Platt

专题命中 多模态生成 :multimodal(abstract)

Comments Conference on Robot Learning 2024, Oral Presentation

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.09862 2024-10-15 eess.IV 50%

Conditioning 3D Diffusion Models with 2D Images: Towards Standardized OCT Volumes through En Face-Informed Super-Resolution

Coen de Vente, Mohammad Mohaiminul Islam, Philippe Valmaggia, Carel Hoyng, Adnan Tufail, Clara I. Sánchez

专题命中 多模态生成 :multimodal(abstract)

Comments Accepted at NeurIPS 2024 Workshop on GenAI for Health

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.07138 2024-10-10 q-bio.NC cs.LG stat.AP 50%

Diagnosis and Pathogenic Analysis of Autism Spectrum Disorder Using Fused Brain Connection Graph

Lu Wei, Yi Huang, Guosheng Yin, Fode Zhang, Manxue Zhang, Bin Liu

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.04261 2024-10-08 cs.RO cs.LG cs.SY eess.SY math.OC 50%

Compositional Diffusion Models for Powered Descent Trajectory Generation with Flexible Constraints

Julia Briden, Yilun Du, Enrico M. Zucchelli, Richard Linares

专题命中 多模态生成 :multi-modal(abstract)

Comments Full manuscript submitted to IEEE Aerospace 2025 on 4-Oct-2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.14643 2024-10-08 physics.optics 50%

Dynamic gain and frequency comb formation in exceptional-point lasers

Xingwei Gao, Hao He, Scott Sobolewski, Alexander Cerjan, Chia Wei Hsu

专题命中 多模态生成 :multi-modal(abstract)

Journal ref Nat Commun 15, 8618 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.17429 2024-09-27 cs.RO 50%

Real-World Data Inspired Interactive Connected Traffic Scenario Generation

Junwei You, Pei Li, Yang Cheng, Keshu Wu, Rui Gan, Steven T. Parker, Bin Ran

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03078 2024-09-25 astro-ph.IM 50%

ATAT: Astronomical Transformer for time series And Tabular data

G. Cabrera-Vives, D. Moreno-Cartagena, N. Astorga, I. Reyes-Jainaga, F. Förster, P. Huijse, J. Arredondo, A. M. Muñoz Arancibia, A. Bayo, M. Catelan, P. A. Estévez, P. Sánchez-Sáez, A. Álvarez, P. Castellanos, P. Gallardo, A. Moya, D. Rodriguez-Mancini

专题命中 多模态生成 :multimodal(abstract)

Journal ref A&A 689, A289 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.11667 2024-09-19 cs.SE 50%

Bridging Design and Development with Automated Declarative UI Code Generation

Ting Zhou, Yanjie Zhao, Xinyi Hou, Xiaoyu Sun, Kai Chen, Haoyu Wang

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.10484 2024-09-17 eess.SY cs.SY 50%

XLM for Autonomous Driving Systems: A Comprehensive Review

Sonda Fourati, Wael Jaafar, Noura Baccar, Safwan Alfattani

专题命中 多模态生成 :multimodal(abstract)

Comments 30 pages, 18 figures, submitted to IEEE Open Journal of Intelligent Transportation Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.04226 2024-09-09 physics.geo-ph stat.ML 50%

Seismic Data Interpolation via Denoising Diffusion Implicit Models with Coherence-corrected Resampling

Xiaoli Wei, Chunxia Zhang, Hongtao Wang, Chengli Tan, Deng Xiong, Baisong Jiang, Jiangshe Zhang, Sang-Woon Kim

专题命中 多模态生成 :multi-modal(abstract)

Comments 14 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏