arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 6942 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6942 篇

2405.01565 2024-05-06 cs.SE 50%

The Role of Code Proficiency in the Era of Generative AI

Gregorio Robles, Christoph Treude, Jesus M. Gonzalez-Barahona, Raula Gaikovina Kula

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments submitted to Software Engineering 2030

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.17811 2024-04-30 cs.RO 50%

Efficient Bi-manipulation using RGBD Multi-model Fusion based on Attention Mechanism

Jian Shen, Jiaxin Huang, Zhigong Song

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 14 pages,5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.13673 2024-04-24 eess.SP cs.SY eess.SY 50%

In-situ process monitoring and adaptive quality enhancement in laser additive manufacturing: a critical review

Lequn Chen, Guijun Bi, Xiling Yao, Jinlong Su, Chaolin Tan, Wenhe Feng, Michalis Benakis, Youxiang Chew, Seung Ki Moon

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 107 Pages, 29 Figures. Paper Accepted At Journal of Manufacturing Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.08023 2024-04-15 q-bio.QM cs.LG 50%

Pathology-genomic fusion via biologically informed cross-modality graph learning for survival analysis

Zeyu Zhang, Yuanshen Zhao, Jingxian Duan, Yaou Liu, Hairong Zheng, Dong Liang, Zhenyu Zhang, Zhi-Cheng Li

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.06182 2024-04-10 cs.NI 50%

Streamlined Transmission: A Semantic-Aware XR Deployment Framework Enhanced by Generative AI

Wanting Yang, Zehui Xiong, Tony Q. S. Quek, Xuemin Shen

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments Under review with IEEE Network

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.02516 2024-04-04 cs.RO 50%

On-the-Go Tree Detection and Geometric Traits Estimation with Ground Mobile Robots in Fruit Tree Groves

Dimitrios Chatziparaschis, Hanzhe Teng, Yipeng Wang, Pamodya Peiris, Elia Scudiero, Konstantinos Karydis

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 7 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.02184 2024-04-04 cs.IT cs.LG math.IT 50%

Channel-Feedback-Free Transmission for Downlink FD-RAN: A Radio Map based Complex-valued Precoding Network Approach

Jiwei Zhao, Jiacheng Chen, Zeyu Sun, Yuhang Shi, Haibo Zhou, Xuemin, Shen

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments Content error, and I don't like to make it public now

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.19248 2024-04-01 cs.CR cs.NI 50%

Genos: General In-Network Unsupervised Intrusion Detection by Rule Extraction

Ruoyu Li, Qing Li, Yu Zhang, Dan Zhao, Xi Xiao, Yong Jiang

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments accepted by IEEE International Conference on Computer Communications (INFOCOM 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.10367 2024-03-29 cs.IR 50%

Query2GMM: Learning Representation with Gaussian Mixture Model for Reasoning over Knowledge Graphs

Yuhan Wu, Yuanyuan Xu, Wenjie Zhang, Xiwei Xu, Ying Zhang

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 10 pages, 4 figures, accepted by WWW 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.18639 2024-03-28 cs.DC cs.LG 50%

Dependency Aware Incident Linking in Large Cloud Systems

Supriyo Ghosh, Karish Grover, Jimmy Wong, Chetan Bansal, Rakesh Namineni, Mohit Verma, Saravan Rajmohan

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.13923 2024-03-19 cs.LG cs.IR q-bio.BM 50%

Towards 3D Molecule-Text Interpretation in Language Models

Sihang Li, Zhiyuan Liu, Yanchen Luo, Xiang Wang, Xiangnan He, Kenji Kawaguchi, Tat-Seng Chua, Qi Tian

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.04619 2024-03-19 cs.RO 50%

Learning Fine Pinch-Grasp Skills using Tactile Sensing from A Few Real-world Demonstrations

Xiaofeng Mao, Yucheng Xu, Ruoshi Wen, Mohammadreza Kasaei, Wanming Yu, Efi Psomopoulou, Nathan F. Lepora, Zhibin Li

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17572 2024-02-28 cs.LG q-bio.QM 50%

Hyperdimensional computing: a fast, robust and interpretable paradigm for biological data

Michiel Stock, Dimitri Boeckaerts, Pieter Dewulf, Steff Taelman, Maxime Van Haeverbeke, Wim Van Criekinge, Bernard De Baets

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.12260 2024-02-20 cs.LG 50%

Non-orthogonal Age-Optimal Information Dissemination in Vehicular Networks: A Meta Multi-Objective Reinforcement Learning Approach

A. A. Habob, H. Tabassum, O. Waqar

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.00664 2024-02-13 cs.LG 50%

Latent Space Translation via Semantic Alignment

Valentino Maiorca, Luca Moschella, Antonio Norelli, Marco Fumero, Francesco Locatello, Emanuele Rodolà

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Accepted at NeurIPS 2023. 21 pages, 13 figures, 8 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.17615 2024-02-05 cs.LG cs.CE 50%

Graph Multi-Similarity Learning for Molecular Property Prediction

Hao Xu, Zhengyang Zhou, Pengyu Hong

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.00199 2024-02-02 cs.RO 50%

ViTacTip: Design and Verification of a Novel Biomimetic Physical Vision-Tactile Fusion Sensor

Wen Fan, Haoran Li, Weiyong Si, Shan Luo, Nathan Lepora, Dandan Zhang

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 7 pages, 5 figures, 2024 IEEE International Conference on Robotics and Automation (ICRA 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.15559 2024-01-30 cs.HC 50%

IntentTuner: An Interactive Framework for Integrating Human Intents in Fine-tuning Text-to-Image Generative Models

Xingchen Zeng, Ziyao Gao, Yilin Ye, Wei Zeng

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 26 pages, 10 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.14314 2024-01-26 cs.SE 50%

MultiTest: Physical-Aware Object Insertion for Testing Multi-sensor Fusion Perception Systems

Xinyu Gao, Zhijie Wang, Yang Feng, Lei Ma, Zhenyu Chen, Baowen Xu

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments The first two authors contributed equally. To appear in the proceedings of the 46th International Conference on Software Engineering (ICSE 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.09517 2024-01-19 cs.LG eess.IV q-bio.QM 50%

Dimensional Neuroimaging Endophenotypes: Neurobiological Representations of Disease Heterogeneity Through Machine Learning

Junhao Wen, Mathilde Antoniades, Zhijian Yang, Gyujoon Hwang, Ioanna Skampardoni, Rongguang Wang, Christos Davatzikos

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.09145 2024-01-18 cs.CY 50%

Your blush gives you away: detecting hidden mental states with remote photoplethysmography and thermal imaging

Ivan Liu, Fangyuan Liu, Qi Zhong, Fei Ma, Shiguang Ni

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 28 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.08390 2024-01-17 physics.data-an physics.ins-det physics.plasm-ph 50%

Physics-informed Meta-instrument for eXperiments (PiMiX) with applications to fusion energy

Zhehui Wang, Shanny Lin, Miles Teng-Levy, Pinghan Chu, Bradley T. Wolfe, Chun-Shang Wong, Christopher S. Campbell, Xin Yue, Liyuan Zhang, Derek Aberle, Mariana Alvarado Alvarez, David Broughton, Ray T. Chen, Baolian Cheng, Feng Chu, Eric R. Fossum, Mark A. Foster, Chengkun Huang, Velat Kilic, Karl Krushelnick, Wenting Li, Eric Loomis, Thomas Schmidt, Sky K. Sjue, Chris Tomkins, Dmitry A. Yarotski, Renyuan Zhu

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 24 pages, 46 references, and 13 Figures. Manuscript extended a recent presentation in the 29th IAEA Fusion Energy Conference (FEC), London, UK, Oct. 16 - 21, 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.04368 2024-01-10 cs.LG 50%

Enhancing Acute Kidney Injury Prediction through Integration of Drug Features in Intensive Care Units

Gabriel D. M. Manalu, Mulomba Mukendi Christian, Songhee You, Hyebong Choi

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 9 pages, 2 tables

Journal ref International Journal of Advanced Smart Convergence Vol.12 No.4 434- 442 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.08409 2024-01-09 astro-ph.HE astro-ph.SR nucl-th 50%

X-PSI Parameter Recovery for Temperature Map Configurations Inspired by PSR J0030+0451

Serena Vinciguerra, Tuomo Salmi, Anna L. Watts, Devarshi Choudhury, Yves Kini, Thomas E. Riley

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 27 pages, 13 figures

Journal ref ApJ, 959, 55 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.10753 2024-01-02 quant-ph 50%

A Novel Approach to Threshold Quantum Images by using Unsharp Measurements

Ayan Barui, Mayukha Pal, Prasanta K. Panigrahi

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.01440 2024-01-02 math.ST cs.IT math.IT stat.TH 50%

Arithmetic Average Density Fusion -- Part I: Some Statistic and Information-theoretic Results

Tiancheng Li, Yan Song, Enbin Song, Hongqi Fan

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 30 pages, 14 figures, 3 tables. Information Fusion, 2024

Journal ref Information Fusion, Vol.104, April 2024, 102199

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.16697 2023-12-29 cs.HC 50%

Multi-channel Sensor Network Construction, Data Fusion and Challenges for Smart Home

He Zhang, Robin Ananda, Xinyi Fu, Zhe Sun, Xiaoyu Wang, Keqi Chen, John M. Carroll

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 8 pages, accepted by CHCHI2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.15926 2023-12-27 cs.LG cs.DC 50%

FedMS: Federated Learning with Mixture of Sparsely Activated Foundations Models

Panlong Wu, Kangshuo Li, Ting Wang, Fangxin Wang

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.02841 2023-12-19 cs.IR 50%

CTRL: Connect Collaborative and Language Model for CTR Prediction

Xiangyang Li, Bo Chen, Lu Hou, Ruiming Tang

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.03674 2023-12-07 physics.soc-ph 50%

Building a Digital Twin for British Cities

Michael Batty, Richard Milton

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 26 pages, 8 figures, 4 tables

详情

展开后加载摘要…

URL PDF HTML 收藏