arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4735 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4735 篇

1912.00773 2019-12-03 cs.LG 50%

Time-Guided High-Order Attention Model of Longitudinal Heterogeneous Healthcare Data

Yi Huang, Xiaoshan Yang, Changsheng Xu

专题命中 视频多模态 :multimodal(abstract)

Comments PRICAI-2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1901.00171 2019-11-13 cs.IR 50%

Disparity-preserved Deep Cross-platform Association for Cross-platform Video Recommendation

Shengze Yu, Xin Wang, Wenwu Zhu, Peng Cui, Jingdong Wang

专题命中 视频多模态 :multi-modal(abstract)

Journal ref Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence. (2019) 4635-4641

详情

展开后加载摘要…

URL PDF HTML 收藏
1911.01831 2019-11-06 cs.LG cs.NE 50%

Quinoa: a Q-function You Infer Normalized Over Actions

Jonas Degrave, Abbas Abdolmaleki, Jost Tobias Springenberg, Nicolas Heess, Martin Riedmiller

专题命中 视频多模态 :multimodal(abstract)

Comments Deep RL Workshop/NeurIPS

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.04202 2019-10-08 cs.LG cs.SY eess.SY stat.ML 50%

Variational Inference MPC for Bayesian Model-based Reinforcement Learning

Masashi Okada, Tadahiro Taniguchi

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted to CoRL2019. Camera-ready ver

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.08286 2019-09-24 cs.LG stat.ML 50%

Learning stochastic differential equations using RNN with log signature features

Shujian Liao, Terry Lyons, Weixin Yang, Hao Ni

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.07611 2019-08-22 q-bio.TO q-bio.QM 50%

A physiological model of the inflammatory-thermal-pain-cardiovascular interactions during a pathogen challenge

Atanaska Dobreva, Renee Brady, Kamila Larripa, Charles Puelz, Jesper Mehlsen, Mette S. Olufsen

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.07214 2019-08-21 cs.GR cs.LG 50%

Spatio-temporal Manifold Learning for Human Motions via Long-horizon Modeling

He Wang, Edmond S. L. Ho, Hubert P. H. Shum, Zhanxing Zhu

专题命中 视频多模态 :multi-modal(abstract)

Comments 12 pages, Accepted in IEEE Transaction on Visualization and Computer Graphics

Journal ref IEEE Transaction on Visualization and Computer Graphics, 2019

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.00077 2019-08-05 q-bio.NC 50%

Learning in brain-computer interface control evidenced by joint decomposition of brain and behavior

Jennifer Stiso, Marie-Constance Corsi, Jean M. Vettel, Javier O. Garcia, Fabio Pasqualetti, Fabrizio De Vico Fallani, Timothy H. Lucas, Danielle S. Bassett

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1907.02222 2019-07-05 cs.SI 50%

Tracking Temporal Evolution of Graphs using Non-Timestamped Data

Sujit Rokka Chhetri, Palash Goyal, Arquimedes Canedo

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1906.06189 2019-06-17 q-bio.NC 50%

The scientific case for brain simulations

Gaute T. Einevoll, Alain Destexhe, Markus Diesmann, Sonja Grün, Viktor Jirsa, Marc de Kamps, Michele Migliore, Torbjørn V. Ness, Hans E. Plesser, Felix Schürmann

专题命中 视频多模态 :multimodal(abstract)

Journal ref Einevoll et al. (2019) The Scientific Case for Brain Simulations. Neuron 102:735-744

详情

展开后加载摘要…

URL PDF HTML 收藏
1905.08846 2019-05-23 cs.LG stat.ML 50%

Discovering Hidden Structure in High Dimensional Human Behavioral Data via Tensor Factorization

Homa Hosseinmardi, Hsien-Te Kao, Kristina Lerman, Emilio Ferrara

专题命中 视频多模态 :multimodal(abstract)

Comments 2018 WSDM Heteronam Workshop

Journal ref 2018 ACM International WSDM Conference, Heteronam Workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
1903.09530 2019-04-09 cs.HC 50%

The Multi-Event-Class Synchronization (MECS) Algorithm

Paolo Alborno, Gualtiero Volpe, Maurizio Mancini, Radoslaw Niewiadomski, Stefano Piana, Antonio Camurri

专题命中 视频多模态 :multimodal(abstract)

Comments 21 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
1903.09227 2019-03-25 q-bio.QM 50%

A probabilistic atlas for cell identification

Greg Bubnis, Steven Ban, Matthew D. DiFranco, Saul Kato

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1809.08095 2019-03-07 cs.RO cs.HC 50%

Gaze-based, Context-aware Robotic System for Assisted Reaching and Grasping

Ali Shafti, Pavel Orlov, A. Aldo Faisal

专题命中 视频多模态 :multi-modal(abstract)

Comments 7 pages, 7 figures, 4 tables. Submitted to IEEE ICRA 2019 - under review

详情

展开后加载摘要…

URL PDF HTML 收藏
1801.08760 2019-02-05 cs.RO cs.HC 50%

A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction

Elena Sibirtseva, Dimosthenis Kontogiorgos, Olov Nykvist, Hakan Karaoguz, Iolanda Leite, Joakim Gustafson, Danica Kragic

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1901.00114 2019-01-07 cs.RO cs.LG 50%

Closing the gap towards end-to-end autonomous vehicle system

Yonatan Glassner, Liran Gispan, Ariel Ayash, Tal Furman Shohet

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1810.09757 2018-10-24 eess.SP 50%

Estimation of Spatial-Temporal Gait Parameters based on the Fusion of Inertial and Film-Pressure Signals

Cheng Wang, Xiangdong Wang, Zhou Long, Tian Tian, Mingming Gao, Xiaoping Yun, Yueliang Qian, Jintao Li

专题命中 视频多模态 :multimodal(abstract)

Comments 8 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
1810.07605 2018-10-18 cond-mat.soft cond-mat.mtrl-sci 50%

Multi-step self-guided pathways for shape-changing metamaterials

Corentin Coulais, Alberico Sabbadini, Fré Vink, Martin van Hecke

专题命中 视频多模态 :multimodal(abstract)

Comments 16 pages, 3 main figures, 10 extended data figures. See https://youtu.be/8m1QfkMFL0I for an explanatory video

Journal ref Nature, vol. 561, pages 512-515 (2018)

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.01006 2018-09-25 cs.IR cs.LG stat.ML 50%

A Hybrid Variational Autoencoder for Collaborative Filtering

Kilol Gupta, Mukund Yelahanka Raghuprasad, Pankhuri Kumar

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1809.00510 2018-09-11 cs.LG stat.ML 50%

Flatland: a Lightweight First-Person 2-D Environment for Reinforcement Learning

Hugo Caselles-Dupré, Louis Annabi, Oksana Hagen, Michael Garcia-Ortiz, David Filliat

专题命中 视频多模态 :multi-modal(abstract)

Comments Accepted to the Workshop on Continual Unsupervised Sensorimotor Learning (ICDL-EpiRob 2018)

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.09801 2018-08-30 cs.NI cs.SI 50%

PS-Sim: A Framework for Scalable Simulation of Participatory Sensing Data

Rajesh P Barnwal, Nirnay Ghosh, Soumya K Ghosh, Sajal K Das

专题命中 视频多模态 :multi-modal(abstract)

Comments Published and Appeared in Proceedings of IEEE International Conference on Smart Computing (SMARTCOMP-2018)

详情

展开后加载摘要…

URL PDF HTML 收藏
1808.08766 2018-08-28 cs.LG stat.ML 50%

Learning behavioral context recognition with multi-stream temporal convolutional networks

Aaqib Saeed, Tanir Ozcelebi, Stojan Trajanovski, Johan Lukkien

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1807.11096 2018-07-31 cs.RO cs.HC 50%

Spiking Neural Networks for Early Prediction in Human Robot Collaboration

Tian Zhou, Juan P. Wachs

专题命中 视频多模态 :multimodal(abstract)

Comments Under review for journal

详情

展开后加载摘要…

URL PDF HTML 收藏
1805.11085 2018-07-30 cs.RO cs.LG stat.ML 50%

More Than a Feeling: Learning to Grasp and Regrasp using Vision and Touch

Roberto Calandra, Andrew Owens, Dinesh Jayaraman, Justin Lin, Wenzhen Yuan, Jitendra Malik, Edward H. Adelson, Sergey Levine

专题命中 视频多模态 :multimodal(abstract)

Comments 8 pages. Published on IEEE Robotics and Automation Letters (RAL). Website: https://sites.google.com/view/more-than-a-feeling

详情

展开后加载摘要…

URL PDF HTML 收藏
1807.00956 2018-07-04 cs.RO 50%

Leveraging Robotic Prior Tactile Exploratory Action Experiences For Learning New Objects's Physical Properties

Di Feng

专题命中 视频多模态 :multi-modal(abstract)

Comments Master's thesis in the Faculty of Electrical and Computer Engineering, Technical University of Munich

详情

展开后加载摘要…

URL PDF HTML 收藏
1806.02890 2018-06-11 physics.soc-ph stat.AP 50%

A Comprehensive Framework for Dynamic Bike Rebalancing in a Large Bike Sharing Network

Lei Lin

专题命中 视频多模态 :multi-modal(abstract)

Comments Accepted by THE 7TH INTERNATIONAL SYMPOSIUM ON DYNAMIC TRAFFIC ASSIGNMENT, Hongkong, 2018

详情

展开后加载摘要…

URL PDF HTML 收藏
1805.09838 2018-05-28 stat.ME physics.data-an 50%

Strategic Monte Carlo Methods for State and Parameter Estimation in High Dimensional Nonlinear Problems

Sasha Shirman, Henry D. I. Abarbanel

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
1804.03307 2018-04-11 cs.HC 50%

A Web-based Large-scale Timelapse Editor for Creating and Sharing Guided Video Tours and Interactive Slideshows

Yen-Chia Hsu, Paul Dille, Randy Sargent, Christopher Bartley, Illah Nourbakhsh

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted by 2015 IEEE Information Visualization Posters

详情

展开后加载摘要…

URL PDF HTML 收藏
1803.08264 2018-03-23 cs.HC 50%

IMHOTEP - Virtual Reality Framework for Surgical Applications

Micha Pfeiffer, Hannes Kenngott, Anas Preukschas, Matthias Huber, Lisa Bettscheider, Beat Müller-Stich, Stefanie Speidel

专题命中 视频多模态 :multi-modal(abstract)

Comments This is a post-peer-review, pre-copyedit version of an article published in the International Journal of Computer Assisted Radiology and Surgery (IJCARS). The final authenticated version is available online at: https://doi.org/10.1007/s11548-018-1730-x

Journal ref Int J CARS (2018)

详情

展开后加载摘要…

URL PDF HTML 收藏
1709.09269 2017-09-28 cs.RO 50%

Early Prediction for Physical Human Robot Collaboration in the Operating Room

Tian Zhou, Juan P. Wachs

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏