arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2821 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2821 篇

2409.13837 2024-09-24 cs.RO 50%

Adaptive Robot Perception in Construction Environments using 4D BIM

Mani Amani, Reza Akhavian

专题命中 多模态Agent :multi-modal(abstract)

Comments International Conference on Computing in Civil Engineering 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.10906 2024-09-18 cs.RO 50%

Multi-Floor Zero-Shot Object Navigation Policy

Lingfeng Zhang, Hao Wang, Erjia Xiao, Xinyao Zhang, Qiang Zhang, Zixuan Jiang, Renjing Xu

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.17439 2024-09-18 cs.NI cs.LG cs.SY eess.SY 50%

An Overview of Machine Learning-Enabled Optimization for Reconfigurable Intelligent Surfaces-Aided 6G Networks: From Reinforcement Learning to Large Language Models

Hao Zhou, Chengming Hu, Xue Liu

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.10446 2024-09-17 cs.HC 50%

KoroT-3E: A Personalized Musical Mnemonics Tool for Enhancing Memory Retention of Complex Computer Science Concepts

Xiangzhe Yuan, Jiajun Wang, Siying Hu, Andrew Cheung, Zhicong Lu

专题命中 多模态Agent :multimodal(abstract)

Comments 26 pages , 2 tables,7 figures, undereview

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.06725 2024-09-12 cs.CE cs.HC cs.LG 50%

DefectTwin: When LLM Meets Digital Twin for Railway Defect Inspection

Rahatara Ferdousi, M. Anwar Hossain, Chunsheng Yang, Abdulmotaleb El Saddik

专题命中 多模态Agent :multimodal(abstract)

Comments 12 pages, 10 figures, IEEE transaction on consumer electronics

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.05543 2024-09-11 physics.ins-det 50%

Advanced Techniques in Automated High Resolution Scanning Transmission Electron Microscopy

Alexander Pattison, Cassio C. S. Pedroso, Bruce E. Cohen, Justin C. Ondry, A. Paul Alivisatos, Wolfgang Theis, Peter Ercius

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.02198 2024-08-27 cond-mat.mtrl-sci cs.LG 50%

Co-orchestration of Multiple Instruments to Uncover Structure-Property Relationships in Combinatorial Libraries

Boris N. Slautin, Utkarsh Pratiush, Ilia N. Ivanov, Yongtao Liu, Rohit Pant, Xiaohang Zhang, Ichiro Takeuchi, Maxim A. Ziatdinov, Sergei V. Kalinin

专题命中 多模态Agent :multimodal(abstract)

Comments 22 pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.06578 2024-08-20 cs.RO 50%

Hierarchical Learned Risk-Aware Planning Framework for Human Driving Modeling

Nathan Ludlow, Yiwei Lyu, John Dolan

专题命中 多模态Agent :multimodal(abstract)

Comments 7 pages, 5 figures, accepted to the 2024 IEEE International Conference on Robotics and Automation (ICRA 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.09228 2024-08-16 cs.RO 50%

A Survey on Integration of Large Language Models with Intelligent Robots

Yeseung Kim, Dohyun Kim, Jieun Choi, Jisang Park, Nayoung Oh, Daehyung Park

专题命中 多模态Agent :multimodal(abstract)

Comments 24 pages, 5 figures, Published in Intelligent Service Robotics (ISR)

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.05176 2024-08-12 eess.SY cs.SY 50%

Modeling Transit in a Fully Integrated Agent-Based Framework: Methodology and Large-Scale Application

Omer Verbas, Taner Cokyasar, Pedro Veiga de Camargo, Krishna Murthy Gurumurthy, Natalia Zuniga-Garcia, Joshua Auld

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.03876 2024-08-08 cs.HC 50%

From Data to Story: Towards Automatic Animated Data Video Creation with LLM-based Multi-Agent Systems

Leixian Shen, Haotian Li, Yun Wang, Huamin Qu

专题命中 多模态Agent :multi-modal(abstract)

Comments 6 pages, 2 figures, IEEE VIS 2024 Gen4DS Workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.07146 2024-07-19 cs.RO 50%

CompdVision: Combining Near-Field 3D Visual and Tactile Sensing Using a Compact Compound-Eye Imaging System

Lifan Luo, Boyang Zhang, Zhijie Peng, Yik Kin Cheung, Guanlan Zhang, Zhigang Li, Michael Yu Wang, Hongyu Yu

专题命中 多模态Agent :multi-modal(abstract)

Comments Accepted to IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.12388 2024-07-18 cs.HC 50%

Demonstrating PilotAR: A Tool to Assist Wizard-of-Oz Pilot Studies with OHMD

Nuwan Janaka, Runze Cai, Shengdong Zhao, David Hsu

专题命中 多模态Agent :multi-modal(abstract)

Comments 10 pages, 5 figures, 1 table

Journal ref UbiComp Companion (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.08731 2024-07-12 cs.RO 50%

Dynamic On-Palm Manipulation via Controlled Sliding

William Yang, Michael Posa

专题命中 多模态Agent :multi-modal(abstract)

Comments Project website: https://dynamic-controlled-sliding.github.io/

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.05017 2024-07-09 cs.RO 50%

VIPS-Odom: Visual-Inertial Odometry Tightly-coupled with Parking Slots for Autonomous Parking

Xuefeng Jiang, Fangyuan Wang, Rongzhang Zheng, Han Liu, Yixiong Huo, Jinzhang Peng, Lu Tian, Emad Barsoum

专题命中 多模态Agent :multi-modal(abstract)

Comments A SLAM Method for Autonomous Parking

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.05036 2024-07-04 quant-ph physics.optics 50%

Stimulated emission tomography for efficient characterization of spatial entanglement

Yang Xu, Saumya Choudhary, Robert W. Boyd

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.05303 2024-06-25 cs.LG cs.DC 50%

Beyond Efficiency: Scaling AI Sustainably

Carole-Jean Wu, Bilge Acun, Ramya Raghavendra, Kim Hazelwood

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.15315 2024-06-19 cs.RO 50%

Learning Online Belief Prediction for Efficient POMDP Planning in Autonomous Driving

Zhiyu Huang, Chen Tang, Chen Lv, Masayoshi Tomizuka, Wei Zhan

专题命中 多模态Agent :multi-modal(abstract)

Comments IEEE Robotics and Automation Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.01814 2024-06-05 cs.RO 50%

ZAPP! Zonotope Agreement of Prediction and Planning for Continuous-Time Collision Avoidance with Discrete-Time Dynamics

Luca Paparusso, Shreyas Kousik, Edward Schmerling, Francesco Braghin, Marco Pavone

专题命中 多模态Agent :multimodal(abstract)

Comments 8 pages, 3 figures, 1 table, submitted to 2024 IEEE International Conference on Robotics and Automation (ICRA)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.00841 2024-06-04 cs.RO 50%

Understanding On-the-Fly End-User Robot Programming

Laura Stegner, Yuna Hwang, David Porfirio, Bilge Mutlu

专题命中 多模态Agent :multimodal(abstract)

Comments To appear at DIS'24. Stegner and Hwang contributed equally to this research

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.19527 2024-05-31 eess.SY cs.SY 50%

Flexible Agent-based Modeling Framework to Evaluate Integrated Microtransit and Fixed-route Transit Designs: Mode Choice, Supernetworks, and Fleet Simulation

Siwei Hu, Michael F. Hyland, Ritun Saha, Jacob J. Berkel, Geoffrey Vander Veen

专题命中 多模态Agent :multi-modal(abstract)

Comments 49 pages, 25 figures, 8 tables; Submitted To: Transportation Research Part C: Emerging Technologies on May 1st, 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.10313 2024-05-22 cs.CR cs.LG cs.RO cs.SY eess.SY 50%

Hacking Predictors Means Hacking Cars: Using Sensitivity Analysis to Identify Trajectory Prediction Vulnerabilities for Autonomous Driving Security

Marsalis Gibson, David Babazadeh, Claire Tomlin, Shankar Sastry

专题命中 多模态Agent :multi-modal(abstract)

Comments 10 pages, 5 figures, 1 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.05445 2024-05-10 cs.LG 50%

Large Language Model Enhanced Machine Learning Estimators for Classification

Yuhang Wu, Yingfei Wang, Chu Wang, Zeyu Zheng

专题命中 多模态Agent :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.04498 2024-05-08 cs.RO 50%

Generative Planning with Fast Collision Checks for High Speed Navigation

Craig Knuth, Cora Dimmig, Brian Bittner

专题命中 多模态Agent :multi-modal(abstract)

Comments Presented at Agile Robotics ICRA 2024 workshop

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.11699 2024-04-19 cs.RO 50%

Retrieval-Augmented Embodied Agents

Yichen Zhu, Zhicai Ou, Xiaofeng Mou, Jian Tang

专题命中 多模态Agent :multi-modal(abstract)

Comments CVPR2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.00951 2024-04-16 cs.RO cs.SY eess.SY 50%

AV4EV: Open-Source Modular Autonomous Electric Vehicle Platform for Making Mobility Research Accessible

Zhijie Qiao, Mingyan Zhou, Zhijun Zhuang, Tejas Agarwal, Felix Jahncke, Po-Jen Wang, Jason Friedman, Hongyi Lai, Divyanshu Sahu, Tomáš Nagy, Martin Endler, Jason Schlessman, Rahul Mangharam

专题命中 多模态Agent :multi-modal(abstract)

Comments 6 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.01747 2024-04-16 cs.RO 50%

Communicating Inferred Goals with Passive Augmented Reality and Active Haptic Feedback

James F. Mullen, Josh Mosier, Sounak Chakrabarti, Anqi Chen, Tyler White, Dylan P. Losey

专题命中 多模态Agent :multimodal(abstract)

Comments 8 pages, 5 figures

Journal ref IEEE Robotics and Automation Letters 6.4 (2021) 8522-8529

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.04070 2024-04-09 cs.RO cs.SY eess.SY 50%

Spatial Assisted Human-Drone Collaborative Navigation and Interaction through Immersive Mixed Reality

Luca Morando, Giuseppe Loianno

专题命中 多模态Agent :multi-modal(abstract)

Comments Currently Accepted at International Conference on Robotics and Automation (ICRA) 2024, Nominated as Finalist for IEEE ICRA 2024 Best Paper Award on Unmanned Aerial Vehicles

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.15157 2024-04-04 cs.SE 50%

AllHands: Ask Me Anything on Large-scale Verbatim Feedback via Large Language Models

Chaoyun Zhang, Zicheng Ma, Yuhao Wu, Shilin He, Si Qin, Minghua Ma, Xiaoting Qin, Yu Kang, Yuyi Liang, Xiaoyu Gou, Yajie Xue, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

专题命中 多模态Agent :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.00300 2024-04-02 cs.HC 50%

Enhancing Empathy in Virtual Reality: An Embodied Approach to Mindset Modulation

Seoyeon Bae, Yoon Kyung Lee, Jungcheol Lee, Jaeheon Kim, Haeseong Jeon, Seung-Hwan Lim, Byung-Cheol Kim, Sowon Hahn

专题命中 多模态Agent :multimodal(abstract)

Comments 9 pages, 2 figures, 1 table

详情

展开后加载摘要…

URL PDF HTML 收藏