多模态大模型

Bootstrapping Developmental AIs: From Simple Competences to Intelligent Human-Compatible AIs

Mark Stefik, Robert Price

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 112 pages, 28 figures, 4 tables

Variational Dynamic for Self-Supervised Exploration in Deep Reinforcement Learning

Chenjia Bai, Peng Liu, Kaiyu Liu, Lingxiao Wang, Yingnan Zhao, Lei Han

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments IEEE Transactions on Neural Networks and Learning Systems (TNNLS) 2021

ProIn: Learning to Predict Trajectory Based on Progressive Interactions for Autonomous Driving

Yinke Dong, Haifeng Yuan, Hongkun Liu, Wei Jing, Fangzhen Li, Hongmin Liu, Bin Fan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Pioneering SE(2)-Equivariant Trajectory Planning for Automated Driving

Steffen Hagedorn, Marcel Milich, Alexandru P. Condurache

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Hierarchical Auto-Organizing System for Open-Ended Multi-Agent Navigation

Zhonghan Zhao, Kewei Chen, Dongxu Guo, Wenhao Chai, Tian Ye, Yanting Zhang, Gaoang Wang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments ICLR 2024 Workshop on LLM Agents

DiaLoc: An Iterative Approach to Embodied Dialog Localization

Chao Zhang, Mohan Li, Ignas Budvytis, Stephan Liwicki

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 12 pages, 10 figures, to appear in CVPR 2024

MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Querying

Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted by IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI 2024). The winning approaches for the Waymo Motion Prediction Challenge in 2022 and 2023

DNA Family: Boosting Weight-Sharing NAS with Block-Wise Supervisions

Guangrun Wang, Changlin Li, Liuchun Yuan, Jiefeng Peng, Xiaoyu Xian, Xiaodan Liang, Xiaojun Chang, Liang Lin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments T-PAMI

Position Paper: Agent AI Towards a Holistic Intelligence

Qiuyuan Huang, Naoki Wake, Bidipta Sarkar, Zane Durante, Ran Gong, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Noboru Kuno, Ade Famoti, Ashley Llorens, John Langford, Hoi Vo, Li Fei-Fei, Katsu Ikeuchi, Jianfeng Gao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 22 pages, 4 figures. arXiv admin note: substantial text overlap with arXiv:2401.03568

Knowledge Distillation from Language-Oriented to Emergent Communication for Multi-Agent Remote Control

Yongjun Kim, Sejin Seo, Jihong Park, Mehdi Bennis, Seong-Lyun Kim, Junil Choi

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

What Artificial Neural Networks Can Tell Us About Human Language Acquisition

Alex Warstadt, Samuel R. Bowman

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments Please cite the published version with the following information: @incollection{warstadt2022artificial, title={What artificial neural networks can tell us about human language acquisition}, author={Warstadt, Alex and Bowman, Samuel R.}, booktitle={Algebraic Structures in Natural Language}, pages={17--60}, year={2022}, publisher={CRC Press} }

Improving Agent Interactions in Virtual Environments with Language Models

Jack Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

AttentionLego: An Open-Source Building Block For Spatially-Scalable Large Language Model Accelerator With Processing-In-Memory Technology

Rongqing Cong, Wenyang He, Mingxuan Li, Bangning Luo, Zebin Yang, Yuchao Yang, Ru Huang, Bonan Yan

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments for associated source codes, see https://bonany.cc/attentionleg

Large Language Models for Robotics: Opportunities, Challenges, and Perspectives

Jiaqi Wang, Zihao Wu, Yiwei Li, Hanqi Jiang, Peng Shu, Enze Shi, Huawen Hu, Chong Ma, Yiheng Liu, Xuhui Wang, Yincheng Yao, Xuan Liu, Huaqin Zhao, Zhengliang Liu, Haixing Dai, Lin Zhao, Bao Ge, Xiang Li, Tianming Liu, Shu Zhang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Target-Grounded Graph-Aware Transformer for Aerial Vision-and-Dialog Navigation

Yifei Su, Dong An, Yuan Xu, Kehan Chen, Yan Huang

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Comments 1st Place Solution for the AVDN Challenge in ICCV CLVL 2023

Multimodality of AI for Education: Towards Artificial General Intelligence

Gyeong-Geon Lee, Lehong Shi, Ehsan Latif, Yizhu Gao, Arne Bewersdorff, Matthew Nyaaba, Shuchen Guo, Zihao Wu, Zhengliang Liu, Hui Wang, Gengchen Mai, Tiaming Liu, Xiaoming Zhai

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

MTP-GO: Graph-Based Probabilistic Multi-Agent Trajectory Prediction with Neural ODEs

Theodor Westny, Joel Oskarsson, Björn Olofsson, Erik Frisk

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Code: https://github.com/westny/mtp-go

Steve-Eye: Equipping LLM-based Embodied Agents with Visual Perception in Open Worlds

Sipeng Zheng, Jiazheng Liu, Yicheng Feng, Zongqing Lu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 19 pages, 19 figures

Heterogeneous Graph-based Trajectory Prediction using Local Map Context and Social Interactions

Daniel Grimm, Maximilian Zipfl, Felix Hertlein, Alexander Naumann, Jürgen Lüttin, Steffen Thoma, Stefan Schmid, Lavdim Halilaj, Achim Rettinger, J. Marius Zöllner

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted on IEEE ITSC 2023

Categorical Traffic Transformer: Interpretable and Diverse Behavior Prediction with Tokenized Latent

Yuxiao Chen, Sander Tonkens, Marco Pavone

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Agent as Cerebrum, Controller as Cerebellum: Implementing an Embodied LMM-based Agent on Drones

Haoran Zhao, Fengxing Pan, Huqiuyue Ping, Yaoming Zhou

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 17 pages, 12 figures

SiGeo: Sub-One-Shot NAS via Information Theory and Geometry of Loss Landscape

Hua Zheng, Kuang-Hung Liu, Igor Fedorov, Xin Zhang, Wen-Yen Chen, Wei Wen

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 24 pages, 7 figures

Diverse Shape Completion via Style Modulated Generative Adversarial Networks

Wesley Khademi, Li Fuxin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

In Time and Space: Towards Usable Adaptive Control for Assistive Robotic Arms

Max Pascher, Kirill Kronhardt, Felix Ferdinand Goldau, Udo Frese, Jens Gerken

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments RO-MAN'23: 32nd IEEE International Conference on Robot and Human Interactive Communication, Busan, Korea

FastSurfer-HypVINN: Automated sub-segmentation of the hypothalamus and adjacent structures on high-resolutional brain MRI

Santiago Estrada, David Kügler, Emad Bahrami, Peng Xu, Dilshad Mousa, Monique M. B. Breteler, N. Ahmad Aziz, Martin Reuter

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted in Imaging Neuroscience

Conceptual Framework for Autonomous Cognitive Entities

David Shapiro, Wangfan Li, Manuel Delaflor, Carlos Toxtli

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 34 pages, 12 figures

NetHack is Hard to Hack

Ulyana Piterbarg, Lerrel Pinto, Rob Fergus

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments NeurIPS 2023

A Multi-Scale Spatial Transformer U-Net for Simultaneously Automatic Reorientation and Segmentation of 3D Nuclear Cardiac Images

Yangfan Ni, Duo Zhang, Gege Ma, Lijun Lu, Zhongke Huang, Wentao Zhu

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 17 pages, 7 figures

Enhancing Agent Communication and Learning through Action and Language

Hugo Caselles-Dupré, Olivier Sigaud, Mohamed Chetouani

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments IMOL workshop, Paris 2023

The Wizard of Curiosities: Enriching Dialogues with Fun Facts

Frederico Vicente, Rafael Ferreira, David Semedo, João Magalhães

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL