arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4735 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 视频多模态 4735 篇

2501.02321 2025-01-14 cs.CY 50%

KD-MSLRT: Lightweight Sign Language Recognition Model Based on Mediapipe and 3D to 1D Knowledge Distillation

Yulong Li, Bolin Ren, Ke Hu, Changyuan Liu, Zhengyong Jiang, Kang Dang, Jionglong Su

专题命中 视频多模态 :cross-modal(abstract)

Comments AAAI 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.05345 2025-01-10 cs.HC 50%

Video-Conferencing Beyond Screen-Sharing and Thumbnail Webcam Videos: Gesture-Aware Augmented Reality Video for Data-Rich Remote Presentations

Matthew Brehmer

专题命中 视频多模态 :multimodal(abstract)

Comments Position paper for the ACM GROUP '25 Workshop on "Beyond Video-Conferencing": Telepresence Technologies for Extending Expertise Reach and Specialised Skill Sharing, January 12, 2025 in Hilton Head Island, South Carolina

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.14770 2024-12-30 cs.RO 50%

Aim My Robot: Precision Local Navigation to Any Object

Xiangyun Meng, Xuning Yang, Sanghun Jung, Fabio Ramos, Srid Sadhan Jujjavarapu, Sanjoy Paul, Dieter Fox

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.12963 2024-12-18 hep-ph hep-ex 50%

Phase space sampling with Markov Chain Monte Carlo methods

Salvatore La Cagnina, Cornelius Grunwald, Timo Janßen, Kevin Kröninger, Steffen Schumann

专题命中 视频多模态 :multi-modal(abstract)

Comments 8 pages, 4 figures, Conference proceeding for CHEP 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.07005 2024-12-11 cs.LG cs.CR cs.IT math.IT 50%

In-Application Defense Against Evasive Web Scans through Behavioral Analysis

Behzad Ousat, Mahshad Shariatnasab, Esteban Schafir, Farhad Shirani Chaharsooghi, Amin Kharraz

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.19878 2024-12-02 stat.CO stat.ME 50%

Nonparametric Estimation for a Log-concave Distribution Function with Interval-censored Data

Chi Wing Chu, Hok Kan Ling, Chaoyu Yuan

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.19840 2024-12-02 q-bio.NC q-bio.BM 50%

Neuroplasticity and Psychedelics: a comprehensive examination of classic and non-classic compounds in pre and clinical models

Claudio Agnorelli, Meg Spriggs, Kate Godfrey, Gabriela Sawicka, Bettina Bohl, Hannah Douglass, Andrea Fagiolini, Hashemi Parastoo, Robin Carhart-Harris, David Nutt, David Erritzoe

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.17703 2024-11-28 physics.space-ph cs.LG 50%

Probabilistic Forecasting of Radiation Exposure for Spaceflight

Rutuja Gurav, Elena Massara, Xiaomei Song, Kimberly Sinclair, Edward Brown, Matt Kusner, Bala Poduval, Atilim Gunes Baydin

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.17134 2024-11-27 cs.RO 50%

TRIP: Terrain Traversability Mapping With Risk-Aware Prediction for Enhanced Online Quadrupedal Robot Navigation

Minho Oh, Byeongho Yu, I Made Aswin Nahrendra, Seoyeon Jang, Hyeonwoo Lee, Dongkyu Lee, Seungjae Lee, Yeeun Kim, Marsim Kevin Christiansen, Hyungtae Lim, Hyun Myung

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.10016 2024-11-18 cs.RO 50%

'What did the Robot do in my Absence?' Video Foundation Models to Enhance Intermittent Supervision

Kavindie Katuwandeniya, Leimin Tian, Dana Kulić

专题命中 视频多模态 :multi-modal(abstract)

Comments This work has been submitted to the IEEE RAL for possible publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.08476 2024-11-14 cond-mat.mtrl-sci physics.app-ph 50%

Concurrent operando neutron imaging and diffraction analysis revealing spatial lithiation phase evolution in an ultra-thick graphite electrode

Markus Strobl, Monica E. Baur, Stavros Samothraktis, Florencia Malamud, Xiaolong Zhang, Patrick K. M. Tung, Søren Schmidt, R. Woracek, J. Lee, Ryoji Kiyanagi, Luise Theil Kuhn, Inbal Gavish Segev, Yair Ein-Eli

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.10621 2024-11-13 cs.RO 50%

Traversability-Aware Legged Navigation by Learning from Real-World Visual Data

Hongbo Zhang, Zhongyu Li, Xuanqi Zeng, Laura Smith, Kyle Stachowicz, Dhruv Shah, Linzhu Yue, Zhitao Song, Weipeng Xia, Sergey Levine, Koushil Sreenath, Yun-hui Liu

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.14440 2024-11-13 cs.RO 50%

Admittance Visuomotor Policy Learning for General-Purpose Contact-Rich Manipulations

Bo Zhou, Ruixuan Jiao, Yi Li, Xiaogang Yuan, Fang Fang, Shihua Li

专题命中 视频多模态 :multimodal(abstract)

Comments 8 pages, 7 figures. This is the second version of the paper, and it is subject to further revisions. The current submission does not necessarily reflect the final quality or content of the paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.22956 2024-10-31 cs.IT eess.SP math.IT 50%

ISAC Prototype System for Multi-Domain Cooperative Communication Networks

Jie Yang, Hang Que, Tao Du, Le Liang, Xiao Li, Chao-Kai Wen, Shi Jin

专题命中 视频多模态 :multimodal(abstract)

Comments 5 pages, 4 figures, accepted by IEEE Wireless Communications Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.00552 2024-10-31 cs.RO cs.HC 50%

Long-Term Human Trajectory Prediction using 3D Dynamic Scene Graphs

Nicolas Gorlo, Lukas Schmid, Luca Carlone

专题命中 视频多模态 :multi-modal(abstract)

Comments 8 pages, 6 figures. Accepted at IEEE Robotics and Automation Letters (RA-L). Code released at: https://github.com/MIT-SPARK/LP2

Journal ref IEEE Robotics and Automation Letters, vol. 9, no. 12, pp. 10978-10985, Dec. 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.16303 2024-10-23 eess.SP cs.LG 50%

Spatio-Temporal 3D Point Clouds from WiFi-CSI Data via Transformer Networks

Tuomas Määttä, Sasan Sharifipour, Miguel Bordallo López, Constantino Álvarez Casado

专题命中 视频多模态 :multimodal(abstract)

Comments 7 pages, 5 figures, 1 table

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.02344 2024-10-23 cs.LG 50%

Incorporating Navigation Context into Inland Vessel Trajectory Prediction: A Gaussian Mixture Model and Transformer Approach

Kathrin Donandt, Dirk Söffker

专题命中 视频多模态 :multi-modal(abstract)

Journal ref 2024 27th International Conference on Information Fusion (FUSION)

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.02274 2024-10-16 cs.RO 50%

DextrAH-G: Pixels-to-Action Dexterous Arm-Hand Grasping with Geometric Fabrics

Tyler Ga Wei Lum, Martin Matak, Viktor Makoviychuk, Ankur Handa, Arthur Allshire, Tucker Hermans, Nathan D. Ratliff, Karl Van Wyk

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.16047 2024-10-15 cs.IT eess.SP math.IT 50%

Unified Timing Analysis for Closed-Loop Goal-Oriented Wireless Communication

Lintao Li, Anders E. Kalør, Petar Popovski, Wei Chen

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.00054 2024-10-15 cs.LG 50%

Transferable Unsupervised Outlier Detection Framework for Human Semantic Trajectories

Zheng Zhang, Hossein Amiri, Dazhou Yu, Yuntong Hu, Liang Zhao, Andreas Zufle

专题命中 视频多模态 :multi-modal(abstract)

Comments This is an accepted paper on accepted-papers/" target="_blank" rel="noopener">https://sigspatial2024.sigspatial.org/accepted-papers/

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.08504 2024-10-14 cs.RO cs.HC 50%

CoHRT: A Collaboration System for Human-Robot Teamwork

Sujan Sarker, Haley N. Green, Mohammad Samin Yasar, Tariq Iqbal

专题命中 视频多模态 :multi-modal(abstract)

Comments 8 Pages, Robotics Science and Systems (RSS), Safety and Normative Behaviors in Human-Robot Interaction Workshop 2024 (accepted), accepted-papers" target="_blank" rel="noopener">https://sites.google.com/view/safe-hri/accepted-papers

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.05359 2024-10-10 cs.LG cs.SI 50%

Interactive Event Sifting using Bayesian Graph Neural Networks

José Nascimento, Nathan Jacobs, Anderson Rocha

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted in IEEE International Workshop on Information Forensics and Security - WIFS 2024, Rome, Italy

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.04288 2024-10-08 cs.LG 50%

Enhancing Carbon Emission Reduction Strategies using OCO and ICOS data

Oskar Åström, Carina Geldhauser, Markus Grillitsch, Ola Hall, Alexandros Sopasakis

专题命中 视频多模态 :multimodal(abstract)

Comments 18 pages, 7 figures, 1 table, 1 algorithm

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.19331 2024-10-01 eess.SP 50%

Wireless Environment Information Sensing, Feature, Semantic, and Knowledge: Four Steps Towards 6G AI-Enabled Air Interface

Jianhua Zhang, Yichen Cai, Li Yu, Zhen Zhang, Yuxiang Zhang, Jialin Wang, Tao Jiang, Liang Xia, Ping Zhang

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.15487 2024-09-25 cs.RO 50%

AgriNeRF: Neural Radiance Fields for Agriculture in Challenging Lighting Conditions

Samarth Chopra, Fernando Cladera, Varun Murali, Vijay Kumar

专题命中 视频多模态 :multi-modal(abstract)

Comments 7 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.07343 2024-09-12 cs.RO 50%

Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matching

Eugenio Chisari, Nick Heppert, Max Argus, Tim Welschehold, Thomas Brox, Abhinav Valada

专题命中 视频多模态 :multimodal(abstract)

Comments Presented at CoRL 2024. Project website at http://pointflowmatch.cs.uni-freiburg.de/

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.10672 2024-08-28 cs.RO cs.LG 50%

Riemannian Flow Matching Policy for Robot Motion Learning

Max Braun, Noémie Jaquier, Leonel Rozo, Tamim Asfour

专题命中 视频多模态 :multimodal(abstract)

Comments Accepted for publication at IROS'24. 8 pages, 5 figures, 4 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.13408 2024-08-27 physics.med-ph 50%

Multi-Modality and Temporal Analysis of Cervical Cancer Treatment Response

Haotian Feng, Emi Yoshida, Ke Sheng

专题命中 视频多模态 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.11170 2024-08-22 eess.IV 50%

Ophthalmic Biomarker Detection: Highlights from the IEEE Video and Image Processing Cup 2023 Student Competition

Ghassan AlRegib, Mohit Prabhushankar, Kiran Kokilepersaud, Prithwijit Chowdhury, Zoe Fowler, Stephanie Trejo Corona, Lucas Thomaz, Angshul Majumdar

专题命中 视频多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.06926 2024-08-20 stat.ME stat.CO 50%

Bayesian inference and cure rate modeling for event history data

Panagiotis Papastamoulis, Fotios Milienos

专题命中 视频多模态 :multimodal(abstract)

Comments accepted to Test

Journal ref Test, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏