多模态大模型 - arXivDaily 专题

2502.07837 2025-05-02 cs.RO cs.LG 78%

RoboBERT: An End-to-end Multimodal Robotic Manipulation Model

Sicheng Wang, Sheng Liu, Weiheng Wang, Jianhua Shan, Bin Fang

机构 * Casbot Robotic Corporation（Casbot机器人公司）； Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）； Anhui University of Technology（安徽理工大学）

专题命中多模态Agent ：multimodal(title,abstract)

2502.14904 2025-03-25 cond-mat.mtrl-sci cs.LG 78%

Towards an automated workflow in materials science for combining multi-modal simulative and experimental information using data mining and large language models

Balduin Katzer, Steffen Klinder, Katrin Schulz

专题命中多模态Agent ：multi-modal(title,abstract)

2503.16824 2025-03-24 cs.HC 78%

Toward AI-driven Multimodal Interfaces for Industrial CAD Modeling

Jiin Choi, Yugyeong Jang, Kyung Hoon Hyun

专题命中多模态Agent ：multimodal(title,abstract)

Comments 4 pages, 1 table

2503.13964 2025-03-19 cs.LG 78%

MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding

Siwei Han, Peng Xia, Ruiyi Zhang, Tong Sun, Yun Li, Hongtu Zhu, Huaxiu Yao

专题命中多模态Agent ：multi-modal(title,abstract)

2503.06779 2025-03-11 cs.RO cs.SY eess.SY 78%

Chance-Constrained Trajectory Planning with Multimodal Environmental Uncertainty

Kai Ren, Heejin Ahn, Maryam Kamgarpour

专题命中多模态Agent ：multimodal(title,abstract)

Comments Published in IEEE Control Systems Letters

Journal ref in IEEE Control Systems Letters, vol. 7, pp. 13-18, 2023

2503.06733 2025-03-11 cs.RO 78%

Embodied multi-modal sensing with a soft modular arm powered by physical reservoir computing

Jun Wang, Suyi Li

专题命中多模态Agent ：multi-modal(title,abstract)

2312.07434 2025-03-06 cs.LG cs.SY eess.SY 78%

Multi-Modal Conformal Prediction Regions with Simple Structures by Optimizing Convex Shape Templates

Renukanandan Tumu, Matthew Cleaveland, Rahul Mangharam, George J. Pappas, Lars Lindemann

专题命中多模态Agent ：multi-modal(title,abstract)

Comments Accepted to L4DC 2024. 14 pages, 3 figures. The source code and toolbox are available at https://github.com/nandantumu/conformal_region_designer

Journal ref PMLR 242:1343-1356, 2024

2503.00401 2025-03-05 cs.CL cs.AI cs.CV cs.HC 78%

Smoothing Grounding and Reasoning for MLLM-Powered GUI Agents with Query-Oriented Pivot Tasks

Zongru Wu, Pengzhou Cheng, Zheng Wu, Tianjie Ju, Zhuosheng Zhang, Gongshen Liu

专题命中多模态Agent ：MLLM(title)；分类 cs.CV、cs.CL、cs.AI

2502.06026 2025-02-11 cs.LG cs.NA math.NA 78%

A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions

Elisa Negrini, Yuxuan Liu, Liu Yang, Stanley J. Osher, Hayden Schaeffer

专题命中多模态Agent ：multimodal(title,abstract)

2502.02550 2025-02-05 eess.SY cs.SY 78%

Reachability-Based Contingency Planning against Multi-Modal Predictions with Branch MPC

Mohamed-Khalil Bouzidi, Bojan Derajic, Daniel Goehring, Joerg Reichardt

专题命中多模态Agent ：multi-modal(title,abstract)

2412.00276 2025-01-31 math.OC 78%

Assessing How Ride-hailing Rebalancing Strategies Improve the Resilience of Multi-modal Transportation Systems

Euntak Lee, Rim Slama, Ludovic Leclercq

专题命中多模态Agent ：multi-modal(title,abstract)

2408.07806 2025-01-30 cs.RO 78%

From Decision to Action in Surgical Autonomy: Multi-Modal Large Language Models for Robot-Assisted Blood Suction

Sadra Zargarzadeh, Maryam Mirzaei, Yafei Ou, Mahdi Tavakoli

专题命中多模态Agent ：multi-modal(title,abstract)

Comments Accepted for Publication in IEEE Robotics and Automation Letters, 2025

2408.10738 2025-01-24 cs.CR 78%

PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection

Tri Cao, Chengyu Huang, Yuexin Li, Huilin Wang, Amy He, Nay Oo, Bryan Hooi

专题命中多模态Agent ：multimodal(title,abstract)

Comments Accepted at AAAI 2025 (Oral)

2501.12799 2025-01-23 cs.RO 78%

Int2Planner: An Intention-based Multi-modal Motion Planner for Integrated Prediction and Planning

Xiaolei Chen, Junchi Yan, Wenlong Liao, Tao He, Pai Peng

专题命中多模态Agent ：multi-modal(title,abstract)

2312.02328 2025-01-22 cs.RO 78%

Multi-Modal MPPI and Active Inference for Reactive Task and Motion Planning

Yuezhe Zhang, Corrado Pezzato, Elia Trevisan, Chadi Salmi, Carlos Hernández Corbato, Javier Alonso-Mora

专题命中多模态Agent ：multi-modal(title,abstract)

Comments Accepted for IEEE RA-L, June 2024. Project's website: https://autonomousrobots.nl/paper_websites/m3p2i-aip

2412.17293 2024-12-24 q-fin.PM 78%

Multimodal Deep Reinforcement Learning for Portfolio Optimization

Sumit Nawathe, Ravi Panguluri, James Zhang, Sashwat Venkatesh

专题命中多模态Agent ：multimodal(title,abstract)

2412.14210 2024-12-20 cs.HC cs.CY cs.SI 78%

Mobilizing Waldo: Evaluating Multimodal AI for Public Mobilization

Manuel Cebrian, Petter Holme, Niccolo Pescetelli

专题命中多模态Agent ：multimodal(title,abstract)

Comments 11 pages, 2 figures, 2 tables

2412.11683 2024-12-17 cs.LG 78%

Multimodal LLM for Intelligent Transportation Systems

Dexter Le, Aybars Yunusoglu, Karn Tiwari, Murat Isik, I. Can Dikmen

专题命中多模态Agent ：multimodal(title,abstract)

Comments Accepted at IEEE Symposium Series on Computational Intelligence (SSCI) 2025

2412.09001 2024-12-13 cs.HC 78%

MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI

Yunnong Chen, Shuhong Xiao, Yaxuan Song, Zejian Li, Lingyun Sun, Liuqing Chen

专题命中多模态Agent ：multimodal(title,abstract)

Comments 18 pages,7 figures

2411.14438 2024-11-25 cs.MA 78%

Agent-Based Modeling for Multimodal Transportation of $CO_2$ for Carbon Capture, Utilization, and Storage: CCUS-Agent

Majbah Uddin, Robin Clark, Michael Hilliard, Joshua Thompson, Matthew Langholtz, Erin Webb

专题命中多模态Agent ：multimodal(title,abstract)

2411.00522 2024-11-04 cs.LG cs.IT math.IT 78%

Analyzing Multimodal Integration in the Variational Autoencoder from an Information-Theoretic Perspective

Carlotta Langer, Yasmin Kim Georgie, Ilja Porohovoj, Verena Vanessa Hafner, Nihat Ay

专题命中多模态Agent ：multimodal(title,abstract)

2410.09054 2024-10-15 cs.AR 78%

Circuits and Systems for Embodied AI: Exploring uJ Multi-Modal Perception for Nano-UAVs on the Kraken Shield

Viviane Potocnik, Alfio Di Mauro, Lorenzo Lamberti, Victor Kartsch, Moritz Scherer, Francesco Conti, Luca Benini

专题命中多模态Agent ：multi-modal(title,abstract)

Comments 5 pages, 5 figures

2410.04223 2024-10-08 cs.LG physics.chem-ph q-bio.BM 78%

Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planning

Gang Liu, Michael Sun, Wojciech Matusik, Meng Jiang, Jie Chen

专题命中多模态Agent ：multimodal(title,abstract)

Comments 27 pages, 11 figures, 4 tables

2405.03806 2024-10-03 cs.HC 78%

In Situ AI Prototyping: Infusing Multimodal Prompts into Mobile Settings with MobileMaker

Savvas Petridis, Michael Xieyang Liu, Alexander J. Fiannaca, Vivian Tsai, Michael Terry, Carrie J. Cai

专题命中多模态Agent ：multimodal(title,abstract)

2409.13993 2024-09-24 cs.RO cs.GT 78%

Integrated Decision Making and Trajectory Planning for Autonomous Driving Under Multimodal Uncertainties: A Bayesian Game Approach

Zhenmin Huang, Tong Li, Shaojie Shen, Jun Ma

专题命中多模态Agent ：multimodal(title,abstract)

2409.11981 2024-09-19 cs.RO 78%

LMMCoDrive: Cooperative Driving with Large Multimodal Model

Haichao Liu, Ruoyu Yao, Zhenmin Huang, Shaojie Shen, Jun Ma

专题命中多模态Agent ：multimodal(title,abstract)

Comments 7 pages, 5 figures

2409.00636 2024-09-04 cs.IR cs.MA 78%

A Learnable Agent Collaboration Network Framework for Personalized Multimodal AI Search Engine

Yunxiao Shi, Min Xu, Haimin Zhang, Xing Zi, Qiang Wu

专题命中多模态Agent ：multimodal(title,abstract)

Comments ACMMM 2024 MMGR WORKSHOP

2408.16850 2024-09-02 eess.SP 78%

MPADA: Open source framework for multimodal time series antenna array measurements

Yuyi Chang, Yingzhe Zhang, Asimina Kiourti, Emre Ertin

专题命中多模态Agent ：multimodal(title)；cross-modal(abstract)

Comments AMTA 2024

2303.07265 2024-08-26 cs.RO 78%

Multimodal Reinforcement Learning for Robots Collaborating with Humans

Afagh Mehri Shervedani, Siyu Li, Natawut Monaikul, Bahareh Abbasi, Barbara Di Eugenio, Milos Zefran

专题命中多模态Agent ：multimodal(title)；multi-modal(abstract)

2408.07311 2024-08-15 cs.HC 78%

MultiSurf-GPT: Facilitating Context-Aware Reasoning with Large-Scale Language Models for Multimodal Surface Sensing

Yongquan Hu, Black Sun, Pengcheng An, Zhuying Li, Wen Hu, Aaron J. Quigley

专题命中多模态Agent ：multimodal(title,abstract)

Comments 6 pages. MOBILEHCI Adjunct '24, 26th International Conference on Mobile Human-Computer Interaction, September 30-October 3, 2024, Melbourne, VIC, Australia

1. 多模态Agent 2797 篇

RoboBERT: An End-to-end Multimodal Robotic Manipulation Model

Towards an automated workflow in materials science for combining multi-modal simulative and experimental information using data mining and large language models

Toward AI-driven Multimodal Interfaces for Industrial CAD Modeling

MDocAgent: A Multi-Modal Multi-Agent Framework for Document Understanding

Chance-Constrained Trajectory Planning with Multimodal Environmental Uncertainty

Embodied multi-modal sensing with a soft modular arm powered by physical reservoir computing

Multi-Modal Conformal Prediction Regions with Simple Structures by Optimizing Convex Shape Templates

Smoothing Grounding and Reasoning for MLLM-Powered GUI Agents with Query-Oriented Pivot Tasks

A Multimodal PDE Foundation Model for Prediction and Scientific Text Descriptions

Reachability-Based Contingency Planning against Multi-Modal Predictions with Branch MPC

Assessing How Ride-hailing Rebalancing Strategies Improve the Resilience of Multi-modal Transportation Systems

From Decision to Action in Surgical Autonomy: Multi-Modal Large Language Models for Robot-Assisted Blood Suction

PhishAgent: A Robust Multimodal Agent for Phishing Webpage Detection

Int2Planner: An Intention-based Multi-modal Motion Planner for Integrated Prediction and Planning

Multi-Modal MPPI and Active Inference for Reactive Task and Motion Planning

Multimodal Deep Reinforcement Learning for Portfolio Optimization

Mobilizing Waldo: Evaluating Multimodal AI for Public Mobilization

Multimodal LLM for Intelligent Transportation Systems

MindScratch: A Visual Programming Support Tool for Classroom Learning Based on Multimodal Generative AI

Agent-Based Modeling for Multimodal Transportation of $CO_2$ for Carbon Capture, Utilization, and Storage: CCUS-Agent

Analyzing Multimodal Integration in the Variational Autoencoder from an Information-Theoretic Perspective

Circuits and Systems for Embodied AI: Exploring uJ Multi-Modal Perception for Nano-UAVs on the Kraken Shield

Multimodal Large Language Models for Inverse Molecular Design with Retrosynthetic Planning

In Situ AI Prototyping: Infusing Multimodal Prompts into Mobile Settings with MobileMaker

Integrated Decision Making and Trajectory Planning for Autonomous Driving Under Multimodal Uncertainties: A Bayesian Game Approach

LMMCoDrive: Cooperative Driving with Large Multimodal Model

A Learnable Agent Collaboration Network Framework for Personalized Multimodal AI Search Engine

MPADA: Open source framework for multimodal time series antenna array measurements

Multimodal Reinforcement Learning for Robots Collaborating with Humans

MultiSurf-GPT: Facilitating Context-Aware Reasoning with Large-Scale Language Models for Multimodal Surface Sensing