arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4735 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4735 篇

2203.09033 2022-03-18 cs.LG 50%

Phased Flight Trajectory Prediction with Deep Learning

Kai Zhang, Bowen Chen

专题命中 视频多模态 :multi-modal(abstract)

Comments 20 pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.00834 2022-03-03 cs.HC 50%

Driver State Modeling through Latent Variable State Space Framework in the Wild

Arash Tavakoli, Steven Boker, Arsalan Heydarian

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.06451 2022-03-01 math.OC cs.RO 50%

Maximum Entropy Differential Dynamic Programming

Oswin So, Ziyi Wang, Evangelos A. Theodorou

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted to ICRA 2022. Supplementary video available at https://youtu.be/NHr9Kj_jnAI

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.10698 2022-03-01 cs.RO cs.LG 50%

AutoTune: Controller Tuning for High-Speed Flight

Antonio Loquercio, Alessandro Saviolo, Davide Scaramuzza

专题命中 视频多模态 :multi-modal(abstract)

Comments Video: https://youtu.be/m2q_y7C01So; Code: https://github.com/uzh-rpg/mh_autotune

Journal ref IEEE Robotics and Automation Letters 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.07423 2022-02-16 stat.ML cs.LG 50%

DeepPAMM: Deep Piecewise Exponential Additive Mixed Models for Complex Hazard Structures in Survival Analysis

Philipp Kopper, Simon Wiegrebe, Bernd Bischl, Andreas Bender, David Rügamer

专题命中 视频多模态 :multimodal(abstract)

Comments 13 pages, 2 figures, This work has been accepted by the 26th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.02153 2022-02-03 physics.plasm-ph cs.LG 50%

Inference and De-Noising of Non-Gaussian Particle Distribution Functions: A Generative Modeling Approach

John Donaghy, Kai Germaschewski

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.06360 2022-01-19 gr-qc astro-ph.HE 50%

A detailed analysis of GW190521 with phenomenological waveform models

Héctor Estellés, Sascha Husa, Marta Colleoni, Maite Mateu-Lucena, Maria de Lluc Planas, Cecilio García-Quirós, David Keitel, Antoni Ramos-Buades, Ajit Kumar Mehta, Alessandra Buonanno, Serguei Ossokine

专题命中 视频多模态 :multi-modal(abstract)

Comments 20 pages, 13 figures, 7 tables. Data release at https://zenodo.org/record/4751655

详情

展开后加载摘要…

URL PDF HTML 收藏
2010.14406 2022-01-07 cs.RO 50%

Transporter Networks: Rearranging the Visual World for Robotic Manipulation

Andy Zeng, Pete Florence, Jonathan Tompson, Stefan Welker, Jonathan Chien, Maria Attarian, Travis Armstrong, Ivan Krasin, Dan Duong, Ayzaan Wahid, Vikas Sindhwani, Johnny Lee

专题命中 视频多模态 :multi-modal(abstract)

Comments Project webpage: https://transporternets.github.io Summary video: https://youtu.be/8afHfReCfPo?t=12214

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.03550 2022-01-05 physics.optics 50%

Roadmap on multimode light shaping

Marco Piccardo, Vincent Ginis, Andrew Forbes, Simon Mahler, Asher A. Friesem, Nir Davidson, Haoran Ren, Ahmed H. Dorrah, Federico Capasso, Firehun T. Dullo, Balpreet S. Ahluwalia, Antonio Ambrosio, Sylvain Gigan, Nicolas Treps, Markus Hiekkamäki, Robert Fickler, Michael Kues, David Moss, Roberto Morandotti, Johann Riemensberger, Tobias J. Kippenberg, Jérôme Faist, Giacomo Scalari, Nathalie Picqué, Theodor W. Hänsch, Giulio Cerullo, Cristian Manzoni, Luigi A. Lugiato, Massimo Brambilla, Lorenzo Columbo, Alessandra Gatti, Franco Prati, Abbas Shiri, Ayman F. Abouraddy, Andrea Alù, Emanuele Galiffi, J. B. Pendry, Paloma A. Huidobro

专题命中 视频多模态 :multimodal(abstract)

Comments Under review in J. Opt

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.10062 2021-12-15 math.NA cs.NA 50%

The ensemble Kalman filter for rare event estimation

Fabian Wagner, Iason Papaioannou, Elisabeth Ullmann

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2101.12026 2021-12-07 cond-mat.mtrl-sci 50%

Optimal transportation of grain boundaries: A forward model for predicting migration mechanisms

Ian Chesser, Elizabeth Holm, Brandon Runnels

专题命中 视频多模态 :multimodal(abstract)

Journal ref Acta Materialia, 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.01750 2021-11-03 cs.LG cs.NE eess.SP 50%

Spiking Generative Adversarial Networks With a Neural Network Discriminator: Local Training, Bayesian Models, and Continual Meta-Learning

Bleema Rosenfeld, Osvaldo Simeone, Bipin Rajendran

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.10225 2021-11-02 cs.LG 50%

What Averages Do Not Tell -- Predicting Real Life Processes with Sequential Deep Learning

István Ketykó, Felix Mannhardt, Marwan Hassani, Boudewijn van Dongen

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.13298 2021-10-27 q-bio.PE stat.CO 50%

Scalable Bayesian divergence time estimation with ratio transformations

Xiang Ji, Alexander A. Fisher, Shuo Su, Jeffrey L. Thorne, Barney Potter, Philippe Lemey, Guy Baele, Marc A. Suchard

专题命中 视频多模态 :multimodal(abstract)

Comments 34 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.09904 2021-10-22 cs.RO cs.LG 50%

Learning Robotic Manipulation Skills Using an Adaptive Force-Impedance Action Space

Maximilian Ulmer, Elie Aljalbout, Sascha Schwarz, Sami Haddadin

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.09612 2021-10-20 stat.ME 50%

Semi-supervised Approach to Event Time Annotation Using Longitudinal Electronic Health Records

Liang Liang, Jue Hou, Hajime Uno, Kelly Cho, Yanyuan Ma, Tianxi Cai

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2102.07904 2021-09-30 cs.CR 50%

SK-Tree: a systematic malware detection algorithm on streaming trees via the signature kernel

Thomas Cochrane, Peter Foster, Varun Chhabra, Maud Lemercier, Cristopher Salvi, Terry Lyons

专题命中 视频多模态 :multimodal(abstract)

Comments Published at IEEE-CSR (International Conference on Cybersecurity and Resilience) 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.07365 2021-09-16 cs.RO 50%

Maneuver-based Trajectory Prediction for Self-driving Cars Using Spatio-temporal Convolutional Networks

Benedikt Mersch, Thomas Höllen, Kun Zhao, Cyrill Stachniss, Ribana Roscher

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted for IROS 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.09042 2021-07-20 cs.HC 50%

From Jam Session to Recital: Synchronous Communication and Collaboration Around Data in Organizations

Matthew Brehmer, Robert Kosara

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted to IEEE VIS 2021; to appear in IEEE Transactions on Visualization & Computer Graphics

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.06865 2021-07-15 cs.NE cs.LG 50%

Exploiting Spiking Dynamics with Spatial-temporal Feature Normalization in Graph Learning

Mingkun Xu, Yujie Wu, Lei Deng, Faqiang Liu, Guoqi Li, Jing Pei

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted by IJCAI-21

详情

展开后加载摘要…

URL PDF HTML 收藏
2003.10654 2021-07-07 quant-ph 50%

Detecting the event of a single photon loss on quantum signals

A. Mandilara, Y. Balkybek, V. M. Akulin

专题命中 视频多模态 :multi-modal(abstract)

Comments 7 pages, 2 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.11900 2021-06-23 cs.CR cs.HC 50%

Person Re-identification Attack on Wearable Sensing

Mohammad Arif Ul Alam

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.04165 2021-06-09 cs.LG cs.NE cs.SY eess.SY math.DS 50%

Neural Hybrid Automata: Learning Dynamics with Multiple Modes and Stochastic Transitions

Michael Poli, Stefano Massaroli, Luca Scimeca, Seong Joon Oh, Sanghyuk Chun, Atsushi Yamashita, Hajime Asama, Jinkyoo Park, Animesh Garg

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2006.04744 2021-06-09 eess.SP 50%

Deep learning framework for subject-independent emotion detection using wireless signals

Ahsan Noor Khan, Achintha Avin Ihalage, Yihan Ma, Baiyang Liu, Yujie Liu, Yang Hao

专题命中 视频多模态 :multimodal(abstract)

Comments 13 Pages, 7 Figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2005.08665 2021-06-02 cs.LG stat.AP stat.ML 50%

Spatio-Temporal Point Processes with Attention for Traffic Congestion Event Modeling

Shixiang Zhu, Ruyi Ding, Minghe Zhang, Pascal Van Hentenryck, Yao Xie

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.14164 2021-06-01 eess.IV 50%

A Joint Intensity-Neuromorphic Event Imaging System for Resource Constrained Devices

Srutarshi Banerjee, Henry H. Chopp, Jianping Zhang, Zihao W. Wang, Oliver Cossairt, Aggelos Katsaggelos

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.12976 2021-05-28 q-bio.NC 50%

Spatio-Temporal Investigation of Brain-Wide Sequences

Ohad Felsenstein, Moshe Abeles

专题命中 视频多模态 :multimodal(abstract)

Comments 40 pages, 10 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.12271 2021-05-27 stat.ML cs.LG stat.AP stat.CO 50%

SG-PALM: a Fast Physically Interpretable Tensor Graphical Model

Yu Wang, Alfred Hero

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted in ICML 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.13889 2021-04-29 cs.HC 50%

Driver State and Behavior Detection Through Smart Wearables

Arash Tavakoli, Shashwat Kumar, Mehdi Boukhechba, Arsalan Heydarian

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted in IEEE Intelligent Vehicles Symposium 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.13178 2021-03-25 cs.RO 50%

iMHS: An Incremental Multi-Hypothesis Smoother

Fan Jiang, Varun Agrawal, Russell Buchanan, Maurice Fallon, Frank Dellaert

专题命中 视频多模态 :multi-modal(abstract)

Comments Submitted to IROS 2021

详情

展开后加载摘要…

URL PDF HTML 收藏