arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4735 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4735 篇

2301.07310 2023-01-30 cs.HC 50%

MR.Brick: Designing A Remote Mixed-reality Educational Game System for Promoting Children's Social & Collaborative Skills

Yudan Wu, Shanhe You, Zixuan Guo, Xiangyang Li, Guyue Zhou, Jiangtao Gong

专题命中 视频多模态 :multi-modal(abstract)

Comments 14 pages, 9 figures

Journal ref CHI2023

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.08660 2023-01-25 cs.CY eess.SP 50%

A Big-Data Driven Framework to Estimating Vehicle Volume based on Mobile Device Location Data

Mofeng Yang, Weiyu Luo, Mohammad Ashoori, Jina Mahmoudi, Chenfeng Xiong, Jiawei Lu, Guangchen Zhao, Saeed Saleh Namadi, Songhua Hu, Aliakbar Kabiri

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.04017 2023-01-23 cs.HC 50%

What Do You Get from Turning on Your Video? Effects of Videoconferencing Affordances on Remote Class Experience During COVID-19

Yanting Wu, Yuan Sun, S. Shyam Sundar

专题命中 视频多模态 :audio-visual(abstract)

Comments The paper has been published in Proceedings of the ACM on Human-Computer Interaction (https://dl.acm.org/doi/abs/10.1145/3555773)

Journal ref Proceedings of the ACM on Human-Computer Interaction 6, no.353 CSCW2 (2022): 1-21

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.07691 2022-12-15 cs.GT cs.SY eess.SY 50%

The Design and Analysis of a Mobility Game

Ioannis Vasileios Chremos, Andreas A. Malikopoulos

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.06679 2022-12-14 cs.IR cs.HC 50%

Predicting Knowledge Gain for MOOC Video Consumption

Christian Otto, Markos Stamatakis, Anett Hoppe, Ralph Ewerth

专题命中 视频多模态 :multimodal(abstract)

Comments 13 pages, 1 figure, 3 tables

Journal ref AIED 2022. Lecture Notes in Computer Science, vol 13356, pp. 458-462

详情

展开后加载摘要…

URL PDF HTML 收藏
2212.03377 2022-12-08 eess.SP cs.CE 50%

GaitVibe+: Enhancing Structural Vibration-based Footstep Localization Using Temporary Cameras for In-home Gait Analysis

Yiwen Dong, Jingxiao Liu, Hae Young Noh

专题命中 视频多模态 :multi-modal(abstract)

Comments 7 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.08422 2022-12-06 cs.RO 50%

Imitation and Mirror Systems in Robots through Deep Modality Blending Networks

M. Y. Seker, A. Ahmetoglu, Y. Nagai, M. Asada, E. Oztop, E. Ugur

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.14910 2022-11-17 gr-qc astro-ph.HE hep-th 50%

A novel ringdown amplitude-phase consistency test

Xisco Jiménez Forteza, Swetha Bhagwat, Sumit Kumar, Paolo Pani

专题命中 视频多模态 :multimodal(abstract)

Comments Matches the version to appear in PRL

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.07209 2022-11-15 eess.IV 50%

Learning Neural Optimal Interpolation Models and Solvers

Maxime Beauchamp, Joseph Thompson, Hugo Georgenthum, Quentin Febvre, Ronan Fablet

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.03253 2022-11-08 cs.RO 50%

Soft Robotic Link with Controllable Transparency for Vision-based Tactile and Proximity Sensing

Quan Khanh Luu, Dinh Quang Nguyen, Nhan Huu Nguyen, Van Anh Ho

专题命中 视频多模态 :multimodal(abstract)

Comments Submitted to RoboSoft 2023 for review. Final content subjected to change

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.02622 2022-11-07 eess.SP cs.LG 50%

PhysioGait: Context-Aware Physiological Context Modeling for Person Re-identification Attack on Wearable Sensing

James O Sullivan, Mohammad Arif Ul Alam

专题命中 视频多模态 :multi-modal(abstract)

Comments Accepted in IEEE MSN 2022. arXiv admin note: substantial text overlap with arXiv:2106.11900

Journal ref The 18th International Conference on Mobility, Sensing and Networking (MSN 2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.10168 2022-10-20 cs.LG q-bio.GN 50%

Granger causal inference on DAGs identifies genomic loci regulating transcription

Rohit Singh, Alexander P. Wu, Bonnie Berger

专题命中 视频多模态 :multimodal(abstract)

Comments Presented at the International Conference on Learning Representations 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.09596 2022-09-21 cs.HC 50%

Synapse: Interactive Guidance by Demonstration with Trial-and-Error Support for Older Adults to Use Smartphone Apps

Xiaofu Jin, Xiaozhu Hu, Xiaoying Wei, Mingming Fan

专题命中 视频多模态 :multimodal(abstract)

Journal ref Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 6, 3, Article 121 (September 2022), 24 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.11525 2022-09-14 cs.IR cs.LG 50%

GIFT: Graph-guIded Feature Transfer for Cold-Start Video Click-Through Rate Prediction

Sihao Hu, Yi Cao, Yu Gong, Zhao Li, Yazheng Yang, Qingwen Liu, Shouling Ji

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2208.10858 2022-08-24 cs.IR 50%

VILT: Video Instructions Linking for Complex Tasks

Sophie Fischer, Carlos Gemmell, Iain Mackie, Jeffrey Dalton

专题命中 视频多模态 :multimodal(abstract)

Comments 7 pages, IMuR Preprint

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.13473 2022-08-09 q-bio.NC physics.data-an 50%

Multiscale modeling of brain network organization

Charley Presigny, Fabrizio De Vico Fallani

专题命中 视频多模态 :multimodal(abstract)

Journal ref Rev. Mod. Phys. 94, 031002 (2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.04914 2022-07-12 cs.RO 50%

Team CERBERUS Wins the DARPA Subterranean Challenge: Technical Overview and Lessons Learned

Marco Tranzatto, Mihir Dharmadhikari, Lukas Bernreiter, Marco Camurri, Shehryar Khattak, Frank Mascarich, Patrick Pfreundschuh, David Wisth, Samuel Zimmermann, Mihir Kulkarni, Victor Reijgwart, Benoit Casseau, Timon Homberger, Paolo De Petris, Lionel Ott, Wayne Tubby, Gabriel Waibel, Huan Nguyen, Cesar Cadena, Russell Buchanan, Lorenz Wellhausen, Nikhil Khedekar, Olov Andersson, Lintong Zhang, Takahiro Miki, Tung Dang, Matias Mattamala, Markus Montenegro, Konrad Meyer, Xiangyu Wu, Adrien Briod, Mark Mueller, Maurice Fallon, Roland Siegwart, Marco Hutter, Kostas Alexis

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.13281 2022-06-28 cs.CY 50%

Extracting Large Scale Spatio-Temporal Descriptions from Social Media

Carlo Bono, Barbara Pernici

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.14931 2022-05-31 cs.IR 50%

A multimedia recommendation model based on collaborative graph

Breda Lim, Shubhi Bansal, Ahmed Buru, Kayla Manthey

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.14579 2022-05-31 cs.RO 50%

Leg Shaping and Event-Driven Control of a Small-Scale, Low-DoF, Two-Mode Robot

Dingkun Guo, Larissa Wermers, Kenn R. Oldham

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.11276 2022-05-24 cs.NE cs.LG q-bio.NC 50%

Memory-enriched computation and learning in spiking neural networks through Hebbian plasticity

Thomas Limbacher, Ozan Özdenizci, Robert Legenstein

专题命中 视频多模态 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.09088 2022-05-19 cs.IR cs.IT math.IT 50%

A Birds Eye View on Knowledge Graph Embeddings, Software Libraries, Applications and Challenges

Satvik Garg, Dwaipayan Roy

专题命中 视频多模态 :multimodal(abstract)

Comments Work done during summer project by the first author at IISER Kolkata in 2021-2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.07284 2022-05-17 cs.LG 50%

TranAD: Deep Transformer Networks for Anomaly Detection in Multivariate Time Series Data

Shreshth Tuli, Giuliano Casale, Nicholas R. Jennings

专题命中 视频多模态 :multi-modal(abstract)

Comments Accepted in VLDB 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.04697 2022-05-11 cs.RO 50%

An Empirical Evaluation of Various Information Gain Criteria for Active Tactile Action Selection for Pose Estimation

Prajval Kumar Murali, Ravinder Dahiya, Mohsen Kaboli

专题命中 视频多模态 :multi-modal(abstract)

Comments arXiv admin note: substantial text overlap with arXiv:2109.13540

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.13540 2022-05-10 cs.RO 50%

Comparison of Information-Gain Criteria for Action Selection

Prajval Kumar Murali, Mohsen Kaboli

专题命中 视频多模态 :multi-modal(abstract)

Comments arXiv admin note: substantial text overlap with arXiv:2108.04015

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.13735 2022-05-05 stat.ML cs.LG math.DS math.PR 50%

Learning the temporal evolution of multivariate densities via normalizing flows

Yubin Lu, Romit Maulik, Ting Gao, Felix Dietrich, Ioannis G. Kevrekidis, Jinqiao Duan

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.01222 2022-05-04 physics.flu-dyn cs.LG 50%

Leveraging Stochastic Predictions of Bayesian Neural Networks for Fluid Simulations

Maximilian Mueller, Robin Greif, Frank Jenko, Nils Thuerey

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.11008 2022-05-04 physics.soc-ph quant-ph 50%

Role of collective information in networks of quantum operating agents

V. I. Yukalov, E. P. Yukalova, D. Sornette

专题命中 视频多模态 :multimodal(abstract)

Comments Latex file, 37 pages, 10 figures

Journal ref Physica A 598 (2022) 127365

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.04266 2022-04-29 q-bio.NC stat.ML 50%

Forecasting Brain Activity Based on Models of Spatio-Temporal Brain Dynamics: A Comparison of Graph Neural Network Architectures

Simon Wein, Alina Schüller, Ana Maria Tomé, Wilhelm M. Malloni, Mark W. Greenlee, Elmar W. Lang

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.07612 2022-04-05 stat.ML cs.LG math.OC 50%

Online nonnegative CP-dictionary learning for Markovian data

Hanbaek Lyu, Christopher Strohmeier, Deanna Needell

专题命中 视频多模态 :multi-modal(abstract)

Comments 41 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏