arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4975 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态生成 4975 篇

2404.02170 2024-04-04 physics.optics physics.app-ph physics.ins-det 50%

Non-Destructive, High-Resolution, Chemically Specific, 3D Nanostructure Characterization using Phase-Sensitive EUV Imaging Reflectometry

Michael Tanksalvala, Christina L. Porter, Yuka Esashi, Bin Wang, Nicholas W. Jenkins, Zhe Zhang, Galen P. Miley, Joshua L. Knobloch, Brendan McBennett, Naoto Horiguchi, Sadegh Yazdi, Jihan Zhou, Matthew N. Jacobs, Charles S. Bevis, Robert M. Karl, Peter Johnsen, David Ren, Laura Waller, Daniel E. Adams, Seth L. Cousin, Chen-Ting Liao, Jianwei Miao, Michael Gerrity, Henry C. Kapteyn, Margaret M. Murnane

专题命中 多模态生成 :multimodal(abstract)

Comments 47 pages, 16 figures (4 in main text, 12 supplement) 2 tables

Journal ref Science Advances 7(5), eabd9667 (2021)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.15427 2024-03-27 eess.SP physics.app-ph 50%

Metasurface-Enabled Multifunctional Single-Frequency Sensors without External Power

Masaya Tashiro, Kosuke Ide, Kosei Asano, Satoshi Ishii, Yuta Sugiura, Akira Uchiyama, Ashif A. Fathnan, Hiroki Wakatsuchi

专题命中 多模态生成 :multimodal(abstract)

Comments 47 pages, 23 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.16730 2024-03-26 cs.RO 50%

A Robotic Skill Learning System Built Upon Diffusion Policies and Foundation Models

Nils Ingelhag, Jesper Munkeby, Jonne van Haastregt, Anastasia Varava, Michael C. Welle, Danica Kragic

专题命中 多模态生成 :multimodal(abstract)

Comments https://roboskillframework.github.io

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.16984 2024-03-18 cs.LG 50%

Consistency Models as a Rich and Efficient Policy Class for Reinforcement Learning

Zihan Ding, Chi Jin

专题命中 多模态生成 :multi-modal(abstract)

Comments published as a paper in ICLR 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.04137 2024-03-15 cs.RO 50%

Diffusion Policy: Visuomotor Policy Learning via Action Diffusion

Cheng Chi, Zhenjia Xu, Siyuan Feng, Eric Cousineau, Yilun Du, Benjamin Burchfiel, Russ Tedrake, Shuran Song

专题命中 多模态生成 :multimodal(abstract)

Comments An extended journal version of the original RSS2023 paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.08193 2024-03-14 cs.LG cs.AR cs.ET 50%

Learning-driven Physically-aware Large-scale Circuit Gate Sizing

Yuyang Ye, Peng Xu, Lizheng Ren, Tinghuan Chen, Hao Yan, Bei Yu, Longxing Shi

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.02037 2024-03-14 stat.ML cs.LG math.OC 50%

Reverse Diffusion Monte Carlo

Xunpeng Huang, Hanze Dong, Yifan Hao, Yi-An Ma, Tong Zhang

专题命中 多模态生成 :multi-modal(abstract)

Comments 44 pages, 16 figures, ICLR 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.14544 2024-03-12 cs.CR cs.SE 50%

{A New Hope}: Contextual Privacy Policies for Mobile Applications and An Approach Toward Automated Generation

Shidong Pan, Zhen Tao, Thong Hoang, Dawen Zhang, Tianshi Li, Zhenchang Xing, Sherry Xu, Mark Staples, Thierry Rakotoarivelo, David Lo

专题命中 多模态生成 :multimodal(abstract)

Comments USENIX Security 2024. arXiv admin note: text overlap with arXiv:2307.01691

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.13123 2024-02-21 cs.HC 50%

Exploring AI-assisted Ideation and Prototyping for Choreography

Yimeng Liu, Misha Sra

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.18671 2024-02-15 stat.ML cs.LG 50%

Perturbation-Assisted Sample Synthesis: A Novel Approach for Uncertainty Quantification

Yifei Liu, Rex Shen, Xiaotong Shen

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.08079 2024-02-14 cs.HC 50%

ReNeLiB: Real-time Neural Listening Behavior Generation for Socially Interactive Agents

Daksitha Withanage Don, Philipp Müller, Fabrizio Nunnari, Elisabeth André, Patrick Gebhard

专题命中 多模态生成 :multi-modal(abstract)

Comments 8 pages, 11 figures, ICMI conference, project page https://daksitha.github.io/ReNeLib/

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.02125 2024-02-06 eess.IV 50%

DCE-FORMER: A Transformer-based Model With Mutual Information And Frequency-based Loss Functions For Early And Late Response Prediction In Prostate DCE-MRI

Sadhana S, Sriprabha Ramanarayanan, Arunima Sarkar, Matcha Naga Gayathri, Keerthi Ram, Mohanasankar Sivaprakasam

专题命中 多模态生成 :multimodal(abstract)

Comments Accepted at IEEE ISBI 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.01112 2024-02-05 stat.ME stat.AP stat.OT 50%

Gerontologic Biostatistics 2.0: Developments over 10+ years in the age of data science

Chixiang Chen, Michelle Shardell, Jaime Lynn Speiser, Karen Bandeen-Roche, Heather Allore, Thomas G Travison, Michael Griswold, Terrence E. Murphy

专题命中 多模态生成 :multi-modal(abstract)

Comments Corresponding Author: Michelle Shardell, PhD (Email: mshardell@som.umaryland.edu)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.09332 2024-01-31 cs.LG cs.DS 50%

Fit Like You Sample: Sample-Efficient Generalized Score Matching from Fast Mixing Diffusions

Yilong Qin, Andrej Risteski

专题命中 多模态生成 :multimodal(abstract)

Comments 41 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.06244 2024-01-15 cs.RO cs.LG cs.MA 50%

Diffusion Models for Multi-target Adversarial Tracking

Sean Ye, Manisha Natarajan, Zixuan Wu, Matthew Gombolay

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.02675 2024-01-08 cs.NI cs.GT cs.LG 50%

LMaaS: Exploring Pricing Strategy of Large Model as a Service for Communication

Panlong Wu, Qi Liu, Yanjie Dong, Fangxin Wang

专题命中 多模态生成 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.13568 2023-12-29 eess.SP cs.LG 50%

Region-Disentangled Diffusion Model for High-Fidelity PPG-to-ECG Translation

Debaditya Shome, Pritam Sarkar, Ali Etemad

专题命中 多模态生成 :cross-modal(abstract)

Comments Accepted at AAAI 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.15044 2023-11-28 physics.med-ph 50%

High-resolution 3T to 7T MRI Synthesis with a Hybrid CNN-Transformer Model

Zach Eidex, Jing Wang, Mojtaba Safari, Eric Elder, Jacob Wynne, Tonghe Wang, Hui-Kuo Shu, Hui Mao, Xiaofeng Yang

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.12171 2023-11-14 cs.RO 50%

Diffusion Co-Policy for Synergistic Human-Robot Collaborative Tasks

Eley Ng, Ziang Liu, Monroe Kennedy

专题命中 多模态生成 :multimodal(abstract)

Comments IEEE Robotics and Automation Letters (RA-L), 2023. 8 pages, 7 figures, 3 tables. Supplementary material at https://sites.google.com/view/diffusion-co-policy-hrc

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.11837 2023-10-25 astro-ph.SR 50%

Stellar model calibrations with the Ai Phe binary system. Open questions about the robustness of the fit

G. Valle, M. Dell'Omodarme, P. G. Prada Moroni, S. Degl'Innocenti

专题命中 多模态生成 :multi-modal(abstract)

Comments Accepted for publication in A&A. Abstract abridged

Journal ref A&A 678, A203 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.10453 2023-10-25 cond-mat.mes-hall cond-mat.mtrl-sci physics.chem-ph 50%

A composite electrodynamic mechanism to reconcile spatiotemporally resolved exciton transport in quantum dot superlattices

Rongfeng Yuan, Trevor D. Roberts, Rafaela M. Brinn, Alexander A. Choi, Ha H. Park, Chang Yan, Justin C. Ondry, Siamak Khorasani, David J. Masiello, Ke Xu, A. Paul Alivisatos, Naomi S. Ginsberg

专题命中 多模态生成 :multimodal(abstract)

Comments 48 pages, including supplement

Journal ref Science Advances, Vol 9, Issue 42, eadh241 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2304.05420 2023-10-24 quant-ph cond-mat.quant-gas physics.atom-ph 50%

High-fidelity parallel entangling gates on a neutral atom quantum computer

Simon J. Evered, Dolev Bluvstein, Marcin Kalinowski, Sepehr Ebadi, Tom Manovitz, Hengyun Zhou, Sophie H. Li, Alexandra A. Geim, Tout T. Wang, Nishad Maskara, Harry Levine, Giulia Semeghini, Markus Greiner, Vladan Vuletic, Mikhail D. Lukin

专题命中 多模态生成 :any-to-any(abstract)

Comments 5 pages, 4 figures. Methods: 13 pages, 10 figures

Journal ref Nature 622, 268-272 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.12518 2023-10-20 physics.optics cond-mat.mtrl-sci 50%

Light-enhanced van der Waals force microscopy

Han Yu-Xiao, Bai Benfeng, Zhang Jian-Yu, Huang Jia-Tai, Feng Peng-Yi, Sun Hong-Bo

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.03449 2023-10-16 physics.med-ph 50%

Dual-encoded magnetization transfer and diffusion imaging and its application to tract-specific microstructure mapping

Ilana R Leppert, Pietro Bontempi, Christopher D Rowley, Jennifer SW Campbell, Mark C Nelson, Simona Schiavi, G Bruce Pike, Alessandro Daducci, Christine L Tardif

专题命中 多模态生成 :multi-modal(abstract)

Comments 26 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.08532 2023-10-13 cs.CY 50%

Platform for generating medical datasets for machine learning in public health

Anna Andreychenko, Viktoriia Korzhuk, Stanislav Kondratenko, Polina Cheraneva

专题命中 多模态生成 :multimodal(abstract)

Comments 12 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.09482 2023-10-02 nlin.PS math.AP physics.comp-ph quant-ph 50%

Higher-dimensional soliton generation, stability and excitations of the PT-symmetric nonlinear Schrödinger equations

Yong Chen, Zhenya Yan, Boris A. Malomed

专题命中 多模态生成 :multimodal(abstract)

Comments 26 pages, 12 figures. To be published in Physica D, nonlinear phenomena

Journal ref Physica D 430 (2022) 133099

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.06599 2023-09-14 cs.LG 50%

Reasoning with Latent Diffusion in Offline Reinforcement Learning

Siddarth Venkatraman, Shivesh Khaitan, Ravi Tej Akella, John Dolan, Jeff Schneider, Glen Berseth

专题命中 多模态生成 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.01454 2023-09-06 hep-ph stat.ML 50%

Accelerating Markov Chain Monte Carlo sampling with diffusion models

N. T. Hunt-Smith, W. Melnitchouk, F. Ringer, N. Sato, A. W Thomas, M. J. White

专题命中 多模态生成 :multimodal(abstract)

Comments 21 pages, 8 figures, 1 table

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.06193 2023-08-29 cs.LG stat.ML 50%

Diffusion Policies as an Expressive Policy Class for Offline Reinforcement Learning

Zhendong Wang, Jonathan J Hunt, Mingyuan Zhou

专题命中 多模态生成 :multimodal(abstract)

Comments ICLR 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.13355 2023-08-28 cs.HC 50%

WorldSmith: Iterative and Expressive Prompting for World Building with a Generative AI

Hai Dang, Frederik Brudy, George Fitzmaurice, Fraser Anderson

专题命中 多模态生成 :multi-modal(abstract)

Comments User Interface Software and Technology 2023

详情

展开后加载摘要…

URL PDF HTML 收藏