多模态大模型 - arXivDaily 专题

2404.04929 2024-07-31 cs.RO 78%

RoboMP$^2$: A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models

Qi Lv, Hao Li, Xiang Deng, Rui Shao, Michael Yu Wang, Liqiang Nie

专题命中多模态Agent ：multimodal(title,abstract)

Comments Accepted by ICML 2024; Project page: https://aopolin-lv.github.io/RoboMP2.github.io/

Journal ref Proceedings of the 41st International Conference on Machine Learning, PMLR 235:33558-33574, 2024

2311.11898 2024-07-03 cs.RO 78%

Multimodal Safe Control for Human-Robot Interaction

Ravi Pandya, Tianhao Wei, Changliu Liu

专题命中多模态Agent ：multimodal(title,abstract)

Comments American Control Conference (ACC) 2024

2406.16118 2024-06-25 cs.SE cs.ET 78%

Beyond words and actions: Exploring Multimodal Analytics and Collaboration in the Digital Age

Diego Miranda, Rene Noel, Jaime Godoy, Carlos Escobedo, Cristian Cechinel, Roberto Munoz

专题命中多模态Agent ：multimodal(title,abstract)

2402.17387 2024-06-21 cs.RO 78%

RACP: Risk-Aware Contingency Planning with Multi-Modal Predictions

Khaled A. Mustafa, Daniel Jarne Ornia, Jens Kober, Javier Alonso-Mora

专题命中多模态Agent ：multi-modal(title,abstract)

Comments Accepted at IEEE Transactions on Intelligent Vehicles (T-IV)

2405.12565 2024-05-22 q-fin.RM 78%

Resilience Analysis of Multi-modal Logistics Service Network Through Robust Optimization with Budget-of-Uncertainty

Yaxin Pang, Shenle Pan, Eric Ballot

专题命中多模态Agent ：multi-modal(title,abstract)

2404.06570 2024-05-14 cs.RO 78%

MORPHeus: a Multimodal One-armed Robot-assisted Peeling System with Human Users In-the-loop

Ruolin Ye, Yifei Hu, Yuhan, Bian, Luke Kulm, Tapomayukh Bhattacharjee

专题命中多模态Agent ：multimodal(title,abstract)

2405.03470 2024-05-07 cs.RO cs.SY eess.SY 78%

Motion Planning under Uncertainty: Integrating Learning-Based Multi-Modal Predictors into Branch Model Predictive Control

Mohamed-Khalil Bouzidi, Bojan Derajic, Daniel Goehring, Joerg Reichardt

专题命中多模态Agent ：multi-modal(title,abstract)

2311.08354 2024-04-16 cs.RO 78%

Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal

Max Asselmeier, Jane Ivanova, Ziyi Zhou, Patricio A. Vela, Ye Zhao

专题命中多模态Agent ：multi-modal(title,abstract)

Comments Accepted to 2024 International Conference on Robotics and Automation (ICRA)

2212.12677 2024-04-02 math.OC cs.SY eess.SY 78%

Towards a Multimodal Charging Network: Joint Planning of Charging Stations and Battery Swapping Stations for Electrified Ride-Hailing Fleets

Zhijie Lai, Sen Li

专题命中多模态Agent ：multimodal(title,abstract)

2403.16151 2024-03-26 cs.MA cs.IR 78%

Ultra Low-Cost Two-Stage Multimodal System for Non-Normative Behavior Detection

Albert Lu, Stephen Cranefield

专题命中多模态Agent ：multimodal(title,abstract)

Comments to be appear in International Workshop on Coordination, Organizations, Institutions, Norms and Ethics for Governance of Multi-Agent Systems

2311.08244 2024-03-22 cs.RO 78%

Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework

Weiqin Zu, Wenbin Song, Ruiqing Chen, Ze Guo, Fanglei Sun, Zheng Tian, Wei Pan, Jun Wang

专题命中多模态Agent ：multimodal(title,abstract)

2403.04503 2024-03-19 cs.IR 78%

Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation

Matteo Attimonelli, Danilo Danese, Daniele Malitesta, Claudio Pomo, Giuseppe Gassi, Tommaso Di Noia

专题命中多模态Agent ：multimodal(title,abstract)

2402.06295 2024-03-11 cs.LG q-bio.QM 78%

Multimodal Interpretable Data-Driven Models for Early Prediction of Antimicrobial Multidrug Resistance Using Multivariate Time-Series

Sergio Martínez-Agüero, Antonio G. Marques, Inmaculada Mora-Jiménez, Joaquín Alvárez-Rodríguez, Cristina Soguero-Ruiz

专题命中多模态Agent ：multimodal(title,abstract)

2308.07173 2024-02-14 cs.RO 78%

Enhancing State Estimator for Autonomous Racing : Leveraging Multi-modal System and Managing Computing Resources

Daegyu Lee, Hyunwoo Nam, Chanhoe Ryu, Sungwon Nah, Seongwoo Moon, D. Hyunchul Shim

专题命中多模态Agent ：multi-modal(title)；multimodal(abstract)

Comments arXiv admin note: text overlap with arXiv:2207.12232

Journal ref IEEE Transactions on Intelligent Vehicles(2024)

2402.04867 2024-02-12 cs.IR 78%

Multimodal Query Suggestion with Multi-Agent Reinforcement Learning from Human Feedback

Zheng Wang, Bingzheng Gan, Wei Shi

专题命中多模态Agent ：multimodal(title,abstract)

Comments This paper has been accepted by WWW 2024

2402.00697 2024-02-05 eess.SY cs.SY 78%

Combining Belief Function Theory and Stochastic Model Predictive Control for Multi-Modal Uncertainty in Autonomous Driving

Tommaso Benciolini, Yuntian Yan, Dirk Wollherr, Marion Leibold

专题命中多模态Agent ：multi-modal(title,abstract)

Comments This work has been accepted to the 2024 American Control Conference

2310.20554 2023-11-07 cs.DS 78%

Fast and Delay-Robust Multimodal Journey Planning

Dominik Bez, Jonas Sauer

专题命中多模态Agent ：multimodal(title,abstract)

2310.20561 2023-11-01 cs.RO cs.SY eess.SY math.OC 78%

Predictive Control for Autonomous Driving with Uncertain, Multi-modal Predictions

Siddharth H. Nair, Hotae Lee, Eunhyek Joa, Yan Wang, H. Eric Tseng, Francesco Borrelli

专题命中多模态Agent ：multi-modal(title,abstract)

Comments The first three authors contributed equally

2310.14075 2023-10-24 cs.RO 78%

Unsupervised Sim-to-Real Adaptation of Soft Robot Proprioception using a Dual Cross-modal Autoencoder

Chaeree Park, Hyunkyu Park, Jung Kim

专题命中多模态Agent ：cross-modal(title,abstract)

Comments 13 pages, 12 figures

2310.08746 2023-10-16 cs.LG 78%

Robustness to Multi-Modal Environment Uncertainty in MARL using Curriculum Learning

Aakriti Agrawal, Rohith Aralikatti, Yanchao Sun, Furong Huang

专题命中多模态Agent ：multi-modal(title,abstract)

2309.15283 2023-09-28 cs.RO 78%

Multi-Modal Planning on Regrasping for Stable Manipulation

Jiaming Hu, Zhao Tang, Henrik I. Christensen

专题命中多模态Agent ：multi-modal(title,abstract)

2212.11819 2023-09-14 eess.SY cs.SY 78%

Interaction-Aware Motion Planning for Autonomous Vehicles with Multi-Modal Obstacle Uncertainty Predictions

Jian Zhou, Björn Olofsson, Erik Frisk

专题命中多模态Agent ：multi-modal(title,abstract)

Comments 15 pages

2308.13972 2023-08-29 cs.RO cs.SY eess.SY 78%

Towards Autonomous Multi-Modal Mobility Morphobot (M4) Robot: Traversability Estimation and 3D Path Planning

Rohit Hiraman Rajput

专题命中多模态Agent ：multi-modal(title,abstract)

Comments 61 pages, masters thesis

2308.11644 2023-08-24 eess.SP cs.LG 78%

Synergistic Signal Denoising for Multimodal Time Series of Structure Vibration

Yang Yu, Han Chen

专题命中多模态Agent ：multimodal(title,abstract)

2307.00877 2023-07-04 stat.AP cs.LG 78%

Exploring the Multi-modal Demand Dynamics During Transport System Disruptions

Ali Shateri Benam, Angelo Furno, Nour-Eddin El Faouzi

专题命中多模态Agent ：multi-modal(title,abstract)

2306.06465 2023-06-13 cs.RO 78%

Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning

Mengchao Zhang, Devesh K. Jha, Arvind U. Raghunathan, Kris Hauser

专题命中多模态Agent ：multi-modal(title,abstract)

Comments 10 pages, 9 figures, to be published in RSS 2023

2304.13676 2023-04-27 cs.RO 78%

Multimodal Grounding for Embodied AI via Augmented Reality Headsets for Natural Language Driven Task Planning

Selma Wanna, Fabian Parra, Robert Valner, Karl Kruusamäe, Mitch Pryor

专题命中多模态Agent ：multimodal(title,abstract)

Comments 18 pages, 15 figures

2207.03039 2023-02-14 cond-mat.mtrl-sci physics.ins-det 78%

Learning the right channel in multimodal imaging: automated experiment in Piezoresponse Force Microscopy

Yongtao Liu, Rama K. Vasudevan, Kyle P. Kelley, Hiroshi Funakubo, Maxim Ziatdinov, Sergei V. Kalinin

专题命中多模态Agent ：multimodal(title,abstract)

Comments 17 pages, 5 figures

1906.04832 2023-02-02 cs.DS 78%

UnLimited TRAnsfers for Multi-Modal Route Planning: An Efficient Solution

Moritz Baum, Valentin Buchhold, Jonas Sauer, Dorothea Wagner, Tobias Zündorf

专题命中多模态Agent ：multi-modal(title)；multimodal(abstract)

Journal ref 27th Annual European Symposium on Algorithms (ESA 2019) (Leibniz International Proceedings in Informatics (LIPIcs)), Vol. 144, 14:1-14:16

2301.07189 2023-01-19 cs.RO cs.HC 78%

Multimodal Robot Programming by Demonstration: A Preliminary Exploration

Gopika Ajaykumar, Chien-Ming Huang

专题命中多模态Agent ：multimodal(title,abstract)

Comments 6 pages, 6 figures, 2021 RSS Workshop on Accessibility of Robot Programming and the Work of the Future

1. 多模态Agent 2797 篇

RoboMP$^2$: A Robotic Multimodal Perception-Planning Framework with Multimodal Large Language Models

Multimodal Safe Control for Human-Robot Interaction

Beyond words and actions: Exploring Multimodal Analytics and Collaboration in the Digital Age

RACP: Risk-Aware Contingency Planning with Multi-Modal Predictions

Resilience Analysis of Multi-modal Logistics Service Network Through Robust Optimization with Budget-of-Uncertainty

MORPHeus: a Multimodal One-armed Robot-assisted Peeling System with Human Users In-the-loop

Motion Planning under Uncertainty: Integrating Learning-Based Multi-Modal Predictors into Branch Model Predictive Control

Hierarchical Experience-informed Navigation for Multi-modal Quadrupedal Rebar Grid Traversal

Towards a Multimodal Charging Network: Joint Planning of Charging Stations and Battery Swapping Stations for Electrified Ride-Hailing Fleets

Ultra Low-Cost Two-Stage Multimodal System for Non-Normative Behavior Detection

Language and Sketching: An LLM-driven Interactive Multimodal Multitask Robot Navigation Framework

Ducho 2.0: Towards a More Up-to-Date Unified Framework for the Extraction of Multimodal Features in Recommendation

Multimodal Interpretable Data-Driven Models for Early Prediction of Antimicrobial Multidrug Resistance Using Multivariate Time-Series

Enhancing State Estimator for Autonomous Racing : Leveraging Multi-modal System and Managing Computing Resources

Multimodal Query Suggestion with Multi-Agent Reinforcement Learning from Human Feedback

Combining Belief Function Theory and Stochastic Model Predictive Control for Multi-Modal Uncertainty in Autonomous Driving

Fast and Delay-Robust Multimodal Journey Planning

Predictive Control for Autonomous Driving with Uncertain, Multi-modal Predictions

Unsupervised Sim-to-Real Adaptation of Soft Robot Proprioception using a Dual Cross-modal Autoencoder

Robustness to Multi-Modal Environment Uncertainty in MARL using Curriculum Learning

Multi-Modal Planning on Regrasping for Stable Manipulation

Interaction-Aware Motion Planning for Autonomous Vehicles with Multi-Modal Obstacle Uncertainty Predictions

Towards Autonomous Multi-Modal Mobility Morphobot (M4) Robot: Traversability Estimation and 3D Path Planning

Synergistic Signal Denoising for Multimodal Time Series of Structure Vibration

Exploring the Multi-modal Demand Dynamics During Transport System Disruptions

Simultaneous Trajectory Optimization and Contact Selection for Multi-Modal Manipulation Planning

Multimodal Grounding for Embodied AI via Augmented Reality Headsets for Natural Language Driven Task Planning

Learning the right channel in multimodal imaging: automated experiment in Piezoresponse Force Microscopy

UnLimited TRAnsfers for Multi-Modal Route Planning: An Efficient Solution

Multimodal Robot Programming by Demonstration: A Preliminary Exploration