arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 6942 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6942 篇

2304.05984 2023-12-07 cs.HC 50%

A Deep Cybersickness Predictor through Kinematic Data with Encoded Physiological Representation

Ruichen Li, Yuyang Wang, Handi Yin, Jean-Rémy Chardonnet, Pan Hui

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Published in IEEE ISMAR 2023 as conference paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.11270 2023-11-29 cs.IR 50%

Graph Neural Networks for Recommendation: Reproducibility, Graph Topology, and Node Representation

Daniele Malitesta, Claudio Pomo, Tommaso Di Noia

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.14742 2023-11-28 cs.IR 50%

Query-LIFE: Query-aware Language Image Fusion Embedding for E-Commerce Relevance

Hai Zhu, Yuankai Guo, Ronggang Dou, Kai Liu

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.09962 2023-11-17 cs.LG q-bio.QM 50%

Self-supervised learning of multi-omics embeddings in the low-label, high-data regime

Christian John Hurry, Emma Slade

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 27 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.08134 2023-11-15 astro-ph.IM astro-ph.HE 50%

Applying hybrid clustering in pulsar candidate sifting with multi-modality for FAST survey

Zi-Yi You, Yun-Rong Pan, Zhi Ma, Li Zhang, Shuo Xiao, Dan-Dan Zhang, Shi-Jun Dang, Ru-Shuang Zhao, Pei Wang, Ai-Jun Dong, Jia-Tao Jiang, Ji-Bing Leng, Wei-An Li, Si-Yao Li

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.20487 2023-11-01 cs.IR 50%

Large Language Model Can Interpret Latent Space of Sequential Recommender

Zhengyi Yang, Jiancan Wu, Yanchen Luo, Jizhi Zhang, Yancheng Yuan, An Zhang, Xiang Wang, Xiangnan He

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.13710 2023-10-24 cs.HC 50%

Exploring the Creation and Humanization of Digital Life: Consciousness Simulation and Human-Machine Interaction

Qikang Zhang

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 10 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.08315 2023-10-13 eess.SP 50%

Fusion framework and multimodality for the Laplacian approximation of Bayesian neural networks

Magnus Malmström, Isaac Skog, Daniel Axehill, Fredrik Gustafsson

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 10 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.15390 2023-09-28 cs.RO 50%

MINS: Efficient and Robust Multisensor-aided Inertial Navigation System

Woosik Lee, Patrick Geneva, Chuchu Chen, Guoquan Huang

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 29 pages, 16 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.08096 2023-09-18 cs.RO 50%

GelSplitter: Tactile Reconstruction from Near Infrared and Visible Images

Yuankai Lin, Yulin Zhou, Kaiji Huang, Qi Zhong, Tao Cheng, Hua Yang, Zhouping Yin

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2309.04427 2023-09-11 cs.LG cs.CR 50%

Robust Representation Learning for Privacy-Preserving Machine Learning: A Multi-Objective Autoencoder Approach

Sofiane Ouaari, Ali Burak Ünal, Mete Akgün, Nico Pfeifer

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.16056 2023-08-31 cs.LG 50%

Low-Rank Multitask Learning based on Tensorized SVMs and LSSVMs

Jiani Liu, Qinghua Tao, Ce Zhu, Yipeng Liu, Xiaolin Huang, Johan A. K. Suykens

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.15980 2023-08-31 cs.IR 50%

Adaptive Multi-Modalities Fusion in Sequential Recommendation Systems

Hengchang Hu, Wei Guo, Yong Liu, Min-Yen Kan

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments CIKM'2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.04706 2023-08-25 cs.IR cs.LG 50%

Pareto Invariant Representation Learning for Multimedia Recommendation

Shanshan Huang, Haoxuan Li, Qingsong Li, Chunyuan Zheng, Li Liu

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments ACM MM 2023 full paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.11492 2023-08-23 cs.RO 50%

A LiDAR-Inertial SLAM Tightly-Coupled with Dropout-Tolerant GNSS Fusion for Autonomous Mine Service Vehicles

Yusheng Wang, Yidong Lou, Weiwei Song, Bing Zhan, Feihuang Xia, Qigeng Duan

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.06783 2023-08-23 math.OC 50%

A Framework for Population-Based Stochastic Optimization on Abstract Riemannian Manifolds

Robert Simon Fong, Peter Tino

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments The present abstract is slightly altered from the PDF version due to the limitation "The abstract field cannot be longer than 1,920 characters"

详情

展开后加载摘要…

URL PDF HTML 收藏
2308.03514 2023-08-08 cs.LG eess.SP 50%

Worker Activity Recognition in Manufacturing Line Using Near-body Electric Field

Sungho Suh, Vitor Fortes Rey, Sizhen Bian, Yu-Chi Huang, Jože M. Rožanec, Hooman Tavakoli Ghinani, Bo Zhou, Paul Lukowicz

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.13042 2023-08-01 cs.RO 50%

Self-Supervised Visuo-Tactile Pretraining to Locate and Follow Garment Features

Justin Kerr, Huang Huang, Albert Wilcox, Ryan Hoque, Jeffrey Ichnowski, Roberto Calandra, Ken Goldberg

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments RSS 2023, site: https://sites.google.com/berkeley.edu/ssvtp

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.11332 2023-07-24 cs.LG stat.ML 50%

Beyond Convergence: Identifiability of Machine Learning and Deep Learning Models

Reza Sameni

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.10826 2023-07-19 cs.CR 50%

GraphMoco:a Graph Momentum Contrast Model that Using Multimodel Structure Information for Large-scale Binary Function Representation Learning

Sun Runjin, Guo ShiZe, Li Wei, Zhang XingYu, Guo Xi, Pan ZhiSong

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 22 pages,7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.12040 2023-07-06 q-bio.BM cs.LG 50%

ProtST: Multi-Modality Learning of Protein Sequences and Biomedical Texts

Minghao Xu, Xinyu Yuan, Santiago Miret, Jian Tang

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Accpeted by ICML 2023 (Oral), code and data released

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.01408 2023-07-06 cs.RO cs.LG cs.SY eess.SY 50%

Multi-Predictor Fusion: Combining Learning-based and Rule-based Trajectory Predictors

Sushant Veer, Apoorva Sharma, Marco Pavone

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2305.09790 2023-06-28 q-bio.BM cs.LG 50%

Molecule-Morphology Contrastive Pretraining for Transferable Molecular Representation

Cuong Q. Nguyen, Dante Pertusi, Kim M. Branson

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments ICML 2023 Workshop on Computational Biology

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.01255 2023-06-12 cs.LG 50%

adSformers: Personalization from Short-Term Sequences and Diversity of Representations in Etsy Ads

Alaa Awad, Denisa Roberts, Eden Dolev, Andrea Heyman, Zahra Ebrahimzadeh, Zoe Weil, Marcin Mejran, Vaibhav Malpani, Mahir Yavuz

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.04453 2023-05-09 q-bio.GN 50%

Deep Learning in Spatially Resolved Transcriptomics: A Comprehensive Technical View

Roxana Zahedi Nasab, Mohammad Reza Eftekhariyan Ghamsari, Ahmadreza Argha, Callum Macphillamy, Amin Beheshti, Roohallah Alizadehsani, Nigel H. Lovell, Mohammad Lotfollahi, Hamid Alinejad-Rokny

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.08017 2023-03-15 cs.IT cs.LG eess.SP math.IT 50%

Reliable Beamforming at Terahertz Bands: Are Causal Representations the Way Forward?

Christo Kurisummoottil Thomas, Walid Saad

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments Accepted at IEEE ICASSP 2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.12830 2023-01-31 cs.SE 50%

A sustainable infrastructure concept for improved accessibility, reusability, and archival of research software

Timo Koch, Dennis Gläser, Anett Seeland, Sarbani Roy, Katharina Schulze, Kilian Weishaupt, David Boehringer, Sibylle Hermann, Bernd Flemisch

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.07441 2023-01-19 quant-ph physics.optics 50%

Modeling the space-time correlation of pulsed twin beams

Alessandra Gatti, Ottavia Jedrkiewicz, Enrico Brambilla

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.05170 2022-12-13 q-bio.GN 50%

Reconstructing gene expression and knockout effect scores from DNA mutation (Mut2Ex): methodology and application to cancer prediction problems

Maya Ramchandran, Maayan Baron

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 9 pages, 3 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.07746 2022-11-23 cond-mat.soft cond-mat.mtrl-sci 50%

Polymer threadings and rigidity dictate the viscoelasticity and nonlinear relaxation dynamics of entangled ring-linear blends and their composites with rigid rod microtubules

Karthik R. Peddireddy, Ryan Clairmont, Rae M. Robertson-Anderson

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 22 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏