arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 2821 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态Agent 2821 篇

2206.07505 2022-08-09 cs.AI 57%

Revisiting Some Common Practices in Cooperative Multi-Agent Reinforcement Learning

Wei Fu, Chao Yu, Zelai Xu, Jiaqi Yang, Yi Wu

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments 16 pages, published as a conference paper in ICML 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2207.08096 2022-07-19 cs.AI 57%

Nonmyopic Distilled Data Association Belief Space Planning Under Budget Constraints

Moshe Shienman, Vadim Indelman

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Accepted to International Symposium of Robotic Research (ISRR) 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.04954 2022-07-19 cs.AI 57%

D2A-BSP: Distilled Data Association Belief Space Planning with Performance Guarantees Under Budget Constraints

Moshe Shienman, Vadim Indelman

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments 8 pages, 2 figures, Accepted to IEEE International Conference on Robotics and Automation (ICRA) 2022, *Outstanding Paper Award Finalist*

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.15291 2022-07-01 cs.SD eess.AS 57%

Sonification as a Reliable Alternative to Conventional Visual Surgical Navigation

Sasan Matinfar, Mehrdad Salehi, Daniel Suter, Matthias Seibold, Navid Navab, Shervin Dehghani, Florian Wanivenhaus, Philipp Fürnstahl, Mazda Farshad, Nassir Navab

专题命中 多模态Agent :multimodal(abstract);分类 eess.AS

Comments 19 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.10312 2022-06-22 cs.RO cs.AI cs.LG 57%

SAMPLE-HD: Simultaneous Action and Motion Planning Learning Environment

Michal Nazarczuk, Tony Ng, Krystian Mikolajczyk

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments CVPRW, 2 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2206.10028 2022-06-22 cs.RO cs.AI 57%

Intention-Aware Navigation in Crowds with Extended-Space POMDP Planning

Himanshu Gupta, Bradley Hayes, Zachary Sunberg

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.11805 2022-06-06 cs.CG cs.AI cs.CE cs.RO 57%

Hybrid Manufacturing Process Planning for Arbitrary Part and Tool Shapes

George P. Harabin, Morad Behandish

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Special Issue on symposium on Solid and Physical Modeling (SPM'2022)

Journal ref Journal of Computer-Aided Design, 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.10466 2022-05-24 cs.HC cs.AI cs.LG 57%

A Survey on Physiological Signal Based Emotion Recognition

Zeeshan Ahmad, Naimul Khan

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2204.07904 2022-04-19 q-bio.NC cs.AI 57%

Turing's cascade instability supports the coordination of the mind, brain, and behavior

Damian G. Kelty-Stephen, Madhur Mangalam

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 53 pages, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2203.16792 2022-04-01 cs.RO cs.AI 57%

TrajGen: Generating Realistic and Diverse Trajectories with Reactive and Feasible Agent Behaviors for Autonomous Driving

Qichao Zhang, Yinfeng Gao, Yikang Zhang, Youtian Guo, Dawei Ding, Yunpeng Wang, Peng Sun, Dongbin Zhao

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.07342 2022-03-18 cs.CL cs.LG 57%

FILM: Following Instructions in Language with Modular Methods

So Yeon Min, Devendra Singh Chaplot, Pradeep Ravikumar, Yonatan Bisk, Ruslan Salakhutdinov

专题命中 多模态Agent :multimodal(abstract);分类 cs.CL

Comments Published as a conference paper at International Conference on Learning Representations (ICLR) 2022

详情

展开后加载摘要…

URL PDF HTML 收藏
2202.11742 2022-02-25 cs.CV 57%

Think Global, Act Local: Dual-scale Graph Transformer for Vision-and-Language Navigation

Shizhe Chen, Pierre-Louis Guhur, Makarand Tapaswi, Cordelia Schmid, Ivan Laptev

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2106.10544 2022-01-25 cs.AI cs.LG cs.RO 57%

Learning Space Partitions for Path Planning

Kevin Yang, Tianjun Zhang, Chris Cummins, Brandon Cui, Benoit Steiner, Linnan Wang, Joseph E. Gonzalez, Dan Klein, Yuandong Tian

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Journal ref NeurIPS 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.06607 2022-01-24 cs.CV cs.RO 57%

THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling

Thomas Gilles, Stefano Sabatini, Dzmitry Tsishkou, Bogdan Stanciulescu, Fabien Moutarde

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2201.07096 2022-01-19 cs.SE cs.AI 57%

Lifelong Dynamic Optimization for Self-Adaptive Systems: Fact or Fiction?

Tao Chen

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments The paper has been accepted as a full technical paper at the 29th IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER 2022)

详情

展开后加载摘要…

URL PDF HTML 收藏
2112.07263 2021-12-15 cs.LG cs.AI 57%

Quantifying Multimodality in World Models

Andreas Sedlmeier, Michael Kölle, Robert Müller, Leo Baudrexel, Claudia Linnhoff-Popien

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

详情

展开后加载摘要…

URL PDF HTML 收藏
2104.03642 2021-12-08 cs.LG cs.CV 57%

CLIMAT: Clinically-Inspired Multi-Agent Transformers for Knee Osteoarthritis Trajectory Forecasting

Huy Hoang Nguyen, Simo Saarakkala, Matthew B. Blaschko, Aleksei Tiulpin

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 10 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2111.05059 2021-11-10 cs.CV cs.LG eess.IV 57%

MMD-ReID: A Simple but Effective Solution for Visible-Thermal Person ReID

Chaitra Jambigi, Ruchit Rawal, Anirban Chakraborty

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

Comments Accepted in BMVC 2021 (Oral)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.11043 2021-11-10 cs.CV 57%

Integrating Deep Learning and Augmented Reality to Enhance Situational Awareness in Firefighting Environments

Manish Bhattarai

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments PhD Dissertation

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.04027 2021-10-22 cs.CV cs.RO 57%

Learning to Predict Vehicle Trajectories with Model-based Planning

Haoran Song, Di Luan, Wenchao Ding, Michael Yu Wang, Qifeng Chen

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments Accepted by The Conference on Robot Learning (CoRL) 2021. Project page at http://haoran-song.github.io/prime

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.08963 2021-10-19 cs.AI 57%

SS-MAIL: Self-Supervised Multi-Agent Imitation Learning

Akshay Dharmavaram, Tejus Gupta, Jiachen Li, Katia P. Sycara

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Pre-Print

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.11470 2021-10-19 cs.RO cs.AI 57%

NeBula: Quest for Robotic Autonomy in Challenging Environments; TEAM CoSTAR at the DARPA Subterranean Challenge

Ali Agha, Kyohei Otsu, Benjamin Morrell, David D. Fan, Rohan Thakker, Angel Santamaria-Navarro, Sung-Kyun Kim, Amanda Bouman, Xianmei Lei, Jeffrey Edlund, Muhammad Fadhil Ginting, Kamak Ebadi, Matthew Anderson, Torkom Pailevanian, Edward Terry, Michael Wolf, Andrea Tagliabue, Tiago Stegun Vaquero, Matteo Palieri, Scott Tepsuporn, Yun Chang, Arash Kalantari, Fernando Chavez, Brett Lopez, Nobuhiro Funabiki, Gregory Miles, Thomas Touma, Alessandro Buscicchio, Jesus Tordesillas, Nikhilesh Alatur, Jeremy Nash, William Walsh, Sunggoo Jung, Hanseob Lee, Christoforos Kanellakis, John Mayo, Scott Harper, Marcel Kaufmann, Anushri Dixit, Gustavo Correa, Carlyn Lee, Jay Gao, Gene Merewether, Jairo Maldonado-Contreras, Gautam Salhotra, Maira Saboia Da Silva, Benjamin Ramtoula, Yuki Kubo, Seyed Fakoorian, Alexander Hatteland, Taeyeon Kim, Tara Bartlett, Alex Stephens, Leon Kim, Chuck Bergh, Eric Heiden, Thomas Lew, Abhishek Cauligi, Tristan Heywood, Andrew Kramer, Henry A. Leopold, Chris Choi, Shreyansh Daftry, Olivier Toupet, Inhwan Wee, Abhishek Thakur, Micah Feras, Giovanni Beltrame, George Nikolakopoulos, David Shim, Luca Carlone, Joel Burdick

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments For team website, see https://costar.jpl.nasa.gov/. Accepted for publication in the Journal of Field Robotics, 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.04097 2021-10-12 cs.RO cs.CV 57%

Deep Learning for Embodied Vision Navigation: A Survey

Fengda Zhu, Yi Zhu, Vincent CS Lee, Xiaodan Liang, Xiaojun Chang

专题命中 多模态Agent :cross-modal(abstract);分类 cs.CV

Comments 20 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.07561 2021-09-17 cs.RO cs.CV 57%

A Framework for Multisensory Foresight for Embodied Agents

Xiaohui Chen, Ramtin Hosseini, Karen Panetta, Jivko Sinapov

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments ICRA 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2109.03413 2021-09-16 cs.CV 57%

YouRefIt: Embodied Reference Understanding with Language and Gesture

Yixin Chen, Qing Li, Deqian Kong, Yik Lun Kei, Song-Chun Zhu, Tao Gao, Yixin Zhu, Siyuan Huang

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments ICCV 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.15084 2021-09-16 cs.CV cs.LG 57%

Likelihood-Based Diverse Sampling for Trajectory Forecasting

Yecheng Jason Ma, Jeevana Priya Inala, Dinesh Jayaraman, Osbert Bastani

专题命中 多模态Agent :multi-modal(abstract);分类 cs.CV

Comments ICCV 2021

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.06256 2021-08-30 q-bio.QM cs.CV 57%

A registration error estimation framework for correlative imaging

Guillaume Potier, Frédéric Lavancier, Stephan Kunne, Perrine Paul-Gilloteaux

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

Comments 10 pages 2 figures (made of 10 panels in total)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.05894 2021-07-14 cs.CV 57%

Automatic Seizure Detection Using the Pulse Transit Time

Eric Fiege, Salima Houta, Pinar Bisgin, Rainer Surges, Falk Howar

专题命中 多模态Agent :multimodal(abstract);分类 cs.CV

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.00563 2021-05-11 cs.RO cs.AI 57%

Flightmare: A Flexible Quadrotor Simulator

Yunlong Song, Selim Naji, Elia Kaufmann, Antonio Loquercio, Davide Scaramuzza

专题命中 多模态Agent :multi-modal(abstract);分类 cs.AI

Comments Accepted for publication at 4th Conference on Robot Learning (CoRL), Cambridge MA, USA. 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2105.00762 2021-05-04 cs.AI 57%

VECA : A Toolkit for Building Virtual Environments to Train and Test Human-like Agents

Kwanyoung Park, Hyunseok Oh, Youngki Lee

专题命中 多模态Agent :multimodal(abstract);分类 cs.AI

Comments 7 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏