arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4735 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4735 篇

2103.05334 2021-03-25 cs.LG 50%

CNNATT: Deep EEG & fNIRS Real-Time Decoding of bimanual forces

Pablo Ortega, Tong Zhao, Aldo Faisal

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.07757 2021-03-16 cs.HC 50%

Model-based Task Analysis and Large-scale Video-based Remote Evaluation Methods for Extended Reality Research

Yalda Ghasemi, Heejin Jeong

专题命中 视频多模态 :multimodal(abstract)

Comments 3 pages, 1 figure

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.09144 2021-02-19 cs.RO math.OC physics.app-ph 50%

Stochastic Spatio-Temporal Optimization for Control and Co-Design of Systems in Robotics and Applied Physics

Ethan N. Evans, Andrew P. Kendall, Evangelos A. Theodorou

专题命中 视频多模态 :multimodal(abstract)

Comments 34 pages, 10 figures. Submitted to Autonomous Robots special issue of RSS 2020. arXiv admin note: text overlap with arXiv:2002.01397

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.08529 2021-01-22 math.ST stat.TH 50%

Information theoretic results for stationary time series and the Gaussian-generalized von Mises time series

Riccardo Gatto

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.00661 2021-01-05 cs.LG stat.AP 50%

Combining Graph Neural Networks and Spatio-temporal Disease Models to Predict COVID-19 Cases in Germany

Cornelius Fritz, Emilio Dorigatti, David Rügamer

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.08754 2020-12-30 physics.geo-ph physics.flu-dyn 50%

Dune initiation in a bimodal wind regime

Pauline Delorme, Giles. F. S. Wiggs, Matthew. C. Baddock, Philippe Claudin, Joanna. M. Nield and, Andrew Valdez

专题命中 视频多模态 :multimodal(abstract)

Comments 19 pages, 6 figures electronic ISSN: 2169-9011 print ISSN: 2169-9003

Journal ref Journal of Geophysical Research: EarthSurface, 125, e2020JF005757 (2020)

详情

展开后加载摘要…

URL PDF HTML 收藏
2007.13794 2020-12-08 cs.LG stat.ML 50%

Neural Temporal Point Processes For Modelling Electronic Health Records

Joseph Enguehard, Dan Busbridge, Adam Bozson, Claire Woodcock, Nils Y. Hammerla

专题命中 视频多模态 :multi-modal(abstract)

Comments Version accepted to Machine Learning for Health (ML4H) workshop at NeurIPS 2020. 10 pages, 5 figures, 3 tables. Code, pre-trained models and datasets available at https://github.com/babylonhealth/neuralTPPs

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.07143 2020-10-15 q-bio.NC cs.LG 50%

A Graph Neural Network Framework for Causal Inference in Brain Networks

Simon Wein, Wilhelm Malloni, Ana Maria Tomé, Sebastian M. Frank, Gina-Isabelle Henze, Stefan Wüst, Mark W. Greenlee, Elmar W. Lang

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.06423 2020-10-14 q-bio.QM eess.IV 50%

A comprehensive protocol for manual segmentation of the human claustrum and its sub-regions using high-resolution MRI

Seung Suk Kang, Joseph Bodenheimer, Tracey Butler

专题命中 视频多模态 :multimodal(abstract)

Comments 15 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.02167 2020-10-06 cs.LG eess.SP q-bio.NC 50%

Latent neural source recovery via transcoding of simultaneous EEG-fMRI

Xueqing Liu, Linbi Hong, Paul Sajda

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.02054 2020-10-06 cs.LG stat.ML 50%

Improving Generative Imagination in Object-Centric World Models

Zhixuan Lin, Yi-Fu Wu, Skand Peri, Bofeng Fu, Jindong Jiang, Sungjin Ahn

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted in ICML 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.07083 2020-09-16 cs.RO 50%

Event-Driven Visual-Tactile Sensing and Learning for Robots

Tasbolat Taunyazov, Weicong Sng, Hian Hian See, Brian Lim, Jethro Kuan, Abdul Fatir Ansari, Benjamin C. K. Tee, Harold Soh

专题命中 视频多模态 :multi-modal(abstract)

Comments RSS 2020, Code and Datasets are available at https://clear-nus.github.io/visuotactile/index.html

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.05135 2020-09-14 cs.LG stat.ML 50%

Deep Switching Auto-Regressive Factorization:Application to Time Series Forecasting

Amirreza Farnoosh, Bahar Azari, Sarah Ostadabbas

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1812.00793 2020-09-10 cs.LG cs.DS math.PR stat.ML 50%

Simulated Tempering Langevin Monte Carlo II: An Improved Proof using Soft Markov Chain Decomposition

Rong Ge, Holden Lee, Andrej Risteski

专题命中 视频多模态 :multi-modal(abstract)

Comments 69 pages. arXiv admin note: text overlap with arXiv:1710.02736

Journal ref Advances in Neural Information Processing Systems 31 (2018)

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.03668 2020-09-09 cs.IR 50%

IAI MovieBot: A Conversational Movie Recommender System

Javeria Habib, Shuo Zhang, Krisztian Balog

专题命中 视频多模态 :multi-modal(abstract)

Comments Proceedings of the 29th ACM International Conference on Information and Knowledge Management, Oct 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.10471 2020-08-25 cs.RO cs.LG 50%

Learning and Sequencing of Object-Centric Manipulation Skills for Industrial Tasks

Leonel Rozo, Meng Guo, Andras G. Kupcsik, Marco Todescato, Philipp Schillinger, Markus Giftthaler, Matthias Ochs, Markus Spies, Nicolai Waniek, Patrick Kesper, Mathias Büerger

专题命中 视频多模态 :multimodal(abstract)

Comments First three authors equally contributed. Pre-print accepted for publication in IROS'2020. Video: https://youtu.be/dRGLadt32o4

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.09983 2020-08-25 cs.LG cs.DB stat.ML 50%

Leveraging Organizational Resources to Adapt Models to New Data Modalities

Sahaana Suri, Raghuveer Chanda, Neslihan Bulut, Pradyumna Narayana, Yemao Zeng, Peter Bailis, Sugato Basu, Girija Narlikar, Christopher Re, Abishek Sethi

专题命中 视频多模态 :multi-modal(abstract)

Journal ref PVLDB,13(12): 3396-3410, 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.09951 2020-08-25 cs.LG stat.ML 50%

DSP: A Differential Spatial Prediction Scheme for Comprehensive real industrial datasets

Junjie Zhang, Cong Zhang, Neal N. Xiong

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.09779 2020-08-19 cs.LG stat.ML 50%

Deep Markov Spatio-Temporal Factorization

Amirreza Farnoosh, Behnaz Rezaei, Eli Zachary Sennesh, Zulqarnain Khan, Jennifer Dy, Ajay Satpute, J Benjamin Hutchinson, Jan-Willem van de Meent, Sarah Ostadabbas

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2007.14013 2020-07-29 cs.SI cs.CY 50%

Fake News Detection using Temporal Features Extracted via Point Process

Taichi Murayama, Shoko Wakamiya, Eiji Aramaki

专题命中 视频多模态 :multi-modal(abstract)

Comments CySoc 2020 International Workshop on Cyber Social Threats, ICWSM 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.12888 2020-06-02 cs.LG cs.IT cs.RO math.IT stat.ML 50%

Imitation Learning as $f$-Divergence Minimization

Liyiming Ke, Sanjiban Choudhury, Matt Barnes, Wen Sun, Gilwoo Lee, Siddhartha Srinivasa

专题命中 视频多模态 :multi-modal(abstract)

Comments International Workshop on the Algorithmic Foundations of Robotics (WAFR) 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.14398 2020-05-29 cs.LG cs.RO stat.ML 50%

Robotic Table Tennis with Model-Free Reinforcement Learning

Wenbo Gao, Laura Graesser, Krzysztof Choromanski, Xingyou Song, Nevena Lazic, Pannag Sanketi, Vikas Sindhwani, Navdeep Jaitly

专题命中 视频多模态 :multi-modal(abstract)

Comments V2: new URL of supplementary video. 8 pages, 4 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.05717 2020-05-11 eess.IV cs.LG stat.ML 50%

Video Compression With Rate-Distortion Autoencoders

Amirhossein Habibian, Ties van Rozendaal, Jakub M. Tomczak, Taco S. Cohen

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted to ICCV 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.14185 2020-05-04 eess.SP cs.LG q-bio.NC 50%

Augmenting interictal mapping with neurovascular coupling biomarkers by structured factorization of epileptic EEG and fMRI data

Simon Van Eyndhoven, Patrick Dupont, Simon Tousseyn, Nico Vervliet, Wim Van Paesschen, Sabine Van Huffel, Borbála Hunyadi

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1709.00512 2020-04-29 physics.ins-det physics.bio-ph physics.optics 50%

Spectro-temporal encoded Multiphoton Microscopy

Sebastian Karpf, Carson Riche, Dino di Carlo, Anubhuti Goel, William A. Zeiger, Anand Suresh, Carlos Portera-Cailliau, Bahram Jalali

专题命中 视频多模态 :multi-modal(abstract)

Journal ref NATURE COMMUNICATIONS | (2020)11:2062

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.07311 2020-04-17 eess.SP cs.CY cs.NI 50%

Edge Computing For Smart Health: Context-aware Approaches, Opportunities, and Challenges

Alaa Awad Abdellatif, Amr Mohamed, Carla Fabiana Chiasserini, Mounira Tlili, Aiman Erbad

专题命中 视频多模态 :multimodal(abstract)

Journal ref IEEE Network (Volume: 33 , Issue: 3 , May/June 2019)

详情

展开后加载摘要…

URL PDF HTML 收藏
1912.02305 2020-04-17 cs.LG eess.SP 50%

HABNet: Machine Learning, Remote Sensing Based Detection and Prediction of Harmful Algal Blooms

P. R. Hill, A. Kumar, M. Temimi, D. R. Bull

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.08874 2020-03-20 stat.AP 50%

On the Detectability of Conflict: a Remote Sensing Study of the Rohingya Conflict

Christopher X. Ren, Matthew T. Calef, Alice M. S. Durieux, A. Ziemann, J. Theiler

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.04805 2020-03-11 q-bio.QM q-bio.NC stat.AP 50%

Modelling the Neuroanatomical Progression of Alzheimer's Disease and Posterior Cortical Atrophy

Razvan V. Marinescu

专题命中 视频多模态 :multimodal(abstract)

Comments PhD thesis; Defended in Jan 2019 at University College London

详情

展开后加载摘要…

URL PDF HTML 收藏
1711.03889 2019-12-19 cs.IR 50%

Enhanced Movie Content Similarity Based on Textual, Auditory and Visual Information

Konstantinos Bougiatiotis, Theodore Giannakopoulos

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏