多模态大模型

Pointing out Human Answer Mistakes in a Goal-Oriented Visual Dialogue

Ryosuke Oshima, Seitaro Shinagawa, Hideki Tsunashima, Qi Feng, Shigeo Morishima

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted at ICCVW 2023

Sonicverse: A Multisensory Simulation Platform for Embodied Household Agents that See and Hear

Ruohan Gao, Hao Li, Gokul Dharan, Zhuzhu Wang, Chengshu Li, Fei Xia, Silvio Savarese, Li Fei-Fei, Jiajun Wu

专题命中 多模态Agent ：audio-visual(abstract)；分类 cs.CV

Comments In ICRA 2023. Project page: https://ai.stanford.edu/~rhgao/sonicverse/. Code: https://github.com/StanfordVL/sonicverse. Gao and Li contributed equally to this work and are in alphabetical order

What Is Near?: Room Locality Learning for Enhanced Robot Vision-Language-Navigation in Indoor Living Environments

Muraleekrishna Gopinathan, Jumana Abu-Khalaf, David Suter, Sidike Paheding, Nathir A. Rawashdeh

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Spatial and Visual Perspective-Taking via View Rotation and Relation Reasoning for Embodied Reference Understanding

Cheng Shi, Sibei Yang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments ECCV 2022. Code: http://github.com/ChengShiest/REP-ERU

HARPS: An Online POMDP Framework for Human-Assisted Robotic Planning and Sensing

Luke Burks, Hunter M. Ray, Jamison McGinley, Sousheel Vunnam, Nisar Ahmed

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Accepted to IEEE Transactions on Robotics. 20 pages, 18 figures

PatchCT: Aligning Patch Set and Label Set with Conditional Transport for Multi-Label Image Classification

Miaoge Li, Dongsheng Wang, Xinyang Liu, Zequn Zeng, Ruiying Lu, Bo Chen, Mingyuan Zhou

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Comments accepted by ICCV23

CASPNet++: Joint Multi-Agent Motion Prediction

Maximilian Schäfer, Kun Zhao, Anton Kummert

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments 8 pages, 6 figures

Latent Emission-Augmented Perspective-Taking (LEAPT) for Human-Robot Interaction

Kaiqi Chen, Jing Yu Lim, Kingsley Kuan, Harold Soh

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Alexa, play with robot: Introducing the First Alexa Prize SimBot Challenge on Embodied AI

Hangjie Shi, Leslie Ball, Govind Thattai, Desheng Zhang, Lucy Hu, Qiaozi Gao, Suhaila Shakiah, Xiaofeng Gao, Aishwarya Padmakumar, Bofei Yang, Cadence Chung, Dinakar Guthy, Gaurav Sukhatme, Karthika Arumugam, Matthew Wen, Osman Ipek, Patrick Lange, Rohan Khanna, Shreyas Pansare, Vasu Sharma, Chao Zhang, Cris Flagg, Daniel Pressel, Lavina Vaz, Luke Dai, Prasoon Goyal, Sattvik Sahai, Shaohua Liu, Yao Lu, Anna Gottardi, Shui Hu, Yang Liu, Dilek Hakkani-Tur, Kate Bland, Heather Rocker, James Jeun, Yadunandana Rao, Michael Johnston, Akshaya Iyengar, Arindam Mandal, Prem Natarajan, Reza Ghanadan

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Data Association Aware POMDP Planning with Hypothesis Pruning Performance Guarantees

Moran Barenboim, Idan Lev-Yehudi, Vadim Indelman

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Fundus-Enhanced Disease-Aware Distillation Model for Retinal Disease Classification from OCT Images

Lehan Wang, Weihang Dai, Mei Jin, Chubin Ou, Xiaomeng Li

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments Accepted as a conference paper at MICCAI 2023

On Combining Expert Demonstrations in Imitation Learning via Optimal Transport

Ilana Sebag, Samuel Cohen, Marc Peter Deisenroth

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Journal ref NeurIPS Workshop on Optimal Transport and Machine Learning, 2021

Interactive Image Segmentation with Cross-Modality Vision Transformers

Kun Li, George Vosselman, Michael Ying Yang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments 16 pages

ProphNet: Efficient Agent-Centric Motion Forecasting with Anchor-Informed Proposals

Xishun Wang, Tong Su, Fang Da, Xiaodong Yang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2023 (Highlight)

Solving Dialogue Grounding Embodied Task in a Simulated Environment using Further Masked Language Modeling

Weijie Jack Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

Comments Work in Progress

GATraj: A Graph- and Attention-based Multi-Agent Trajectory Prediction Model

Hao Cheng, Mengmeng Liu, Lin Chen, Hellward Broszio, Monika Sester, Michael Ying Yang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation

Chuhao Jin, Wenhui Tan, Jiange Yang, Bei Liu, Ruihua Song, Limin Wang, Jianlong Fu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

An Abstract Specification of VoxML as an Annotation Language

Kiyong Lee, Nikhil Krishnaswamy, James Pustejovsky

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments 8 pages, 4 figures, Proceedings of 19th Joint ISO-ACL Workshop on Interoperable Semantic Annotation (ISA 2023)

Transforming Human-Centered AI Collaboration: Redefining Embodied Agents Capabilities through Interactive Grounded Language Instructions

Shrestha Mohanty, Negar Arabzadeh, Julia Kiseleva, Artem Zholus, Milagro Teruel, Ahmed Awadallah, Yuxuan Sun, Kavya Srinet, Arthur Szlam

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Deep Reinforcement Learning to Maximize Arterial Usage during Extreme Congestion

Ashutosh Dutta, Milan Jain, Arif Khan, Arun Sathanur

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Monte Carlo Planning in Hybrid Belief POMDPs

Moran Barenboim, Moshe Shienman, Vadim Indelman

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

MGA: Medical generalist agent through text-guided knowledge transformation

Weijian Huang, Hao Yang, Cheng Li, Mingtong Dai, Rui Yang, Shanshan Wang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Foundation Models for Decision Making: Problems, Methods, and Opportunities

Sherry Yang, Ofir Nachum, Yilun Du, Jason Wei, Pieter Abbeel, Dale Schuurmans

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

What A Situated Language-Using Agent Must be Able to Do: A Top-Down Analysis

David Schlangen

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

MyoPS-Net: Myocardial Pathology Segmentation with Flexible Combination of Multi-Sequence CMR Images

Junyi Qiu, Lei Li, Sihan Wang, Ke Zhang, Yinyin Chen, Shan Yang, Xiahai Zhuang

专题命中 多模态Agent ：cross-modal(abstract)；分类 cs.CV

Learning body models: from humans to humanoids

Matej Hoffmann

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 34 pages, 5 figures. Habilitation thesis, Faculty of Electrical Engineering, Czech Technical University in Prague (2021)

Body models in humans, animals, and robots: mechanisms and plasticity

Matej Hoffmann

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 27 pages, 8 figures

Journal ref 2021, Body Schema and Body Image: New Directions, Oxford University Press, pp. 152-180

Evaluating Agent Interactions Through Episodic Knowledge Graphs

Selene Báez Santamaría, Piek Vossen, Thomas Baier

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments Accepted to 1st Workshop on Customized Chat Grounding Persona and Knowledge, at COLING (2022)

Exploring Modulated Detection Transformer as a Tool for Action Recognition in Videos

Tomás Crisol, Joel Ermantraut, Adrián Rostagno, Santiago L. Aggio, Javier Iparraguirre

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Comments 5 pages, 2 figures, 1 results chart

Journal ref JAIIO - JORNADAS ARGENTINAS DE INFORMATICA 2022

Machine Learning Based Radiomics for Glial Tumor Classification and Comparison with Volumetric Analysis

Sevcan Turk, Kaya Oguz, Mehmet Orman, Emre Caliskan, Yesim Ertan, Erkin Ozgiray, Taner Akalin, Ashok Srinivasan, Omer Kitis

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV