多模态大模型

The Importance of Multimodal Emotion Conditioning and Affect Consistency for Embodied Conversational Agents

Che-Jui Chang, Samuel S. Sohn, Sen Zhang, Rajath Jayashankar, Muhammad Usman, Mubbasir Kapadia

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

JARVIS-1: Open-World Multi-task Agents with Memory-Augmented Multimodal Language Models

Zihao Wang, Shaofei Cai, Anji Liu, Yonggang Jin, Jinbing Hou, Bowei Zhang, Haowei Lin, Zhaofeng He, Zilong Zheng, Yaodong Yang, Xiaojian Ma, Yitao Liang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments update project page

Multi-modal Instance Refinement for Cross-domain Action Recognition

Yuan Qing, Naixing Wu, Shaohua Wan, Lixin Duan

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by PRCV 2023

R2H: Building Multimodal Navigation Helpers that Respond to Help Requests

Yue Fan, Jing Gu, Kaizhi Zheng, Xin Eric Wang

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.CL

Comments EMNLP 2023

Project Aria: A New Tool for Egocentric Multi-Modal AI Research

Jakob Engel, Kiran Somasundaram, Michael Goesele, Albert Sun, Alexander Gamino, Andrew Turner, Arjang Talattof, Arnie Yuan, Bilal Souti, Brighid Meredith, Cheng Peng, Chris Sweeney, Cole Wilson, Dan Barnes, Daniel DeTone, David Caruso, Derek Valleroy, Dinesh Ginjupalli, Duncan Frost, Edward Miller, Elias Mueggler, Evgeniy Oleinik, Fan Zhang, Guruprasad Somasundaram, Gustavo Solaira, Harry Lanaras, Henry Howard-Jenkins, Huixuan Tang, Hyo Jin Kim, Jaime Rivera, Ji Luo, Jing Dong, Julian Straub, Kevin Bailey, Kevin Eckenhoff, Lingni Ma, Luis Pesqueira, Mark Schwesinger, Maurizio Monge, Nan Yang, Nick Charron, Nikhil Raina, Omkar Parkhi, Peter Borschowa, Pierre Moulon, Prince Gupta, Raul Mur-Artal, Robbie Pennington, Sachin Kulkarni, Sagar Miglani, Santosh Gondi, Saransh Solanki, Sean Diener, Shangyi Cheng, Simon Green, Steve Saarinen, Suvam Patra, Tassos Mourikis, Thomas Whelan, Tripti Singh, Vasileios Balntas, Vijay Baiyya, Wilson Dreewes, Xiaqing Pan, Yang Lou, Yipu Zhao, Yusuf Mansour, Yuyang Zou, Zhaoyang Lv, Zijian Wang, Mingfei Yan, Carl Ren, Renzo De Nardi, Richard Newcombe

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Clinically-Inspired Multi-Agent Transformers for Disease Trajectory Forecasting from Multimodal Data

Huy Hoang Nguyen, Matthew B. Blaschko, Simo Saarakkala, Aleksei Tiulpin

专题命中 多模态Agent ：multimodal(title)；multi-modal(abstract)；分类 cs.CV

Comments Accepted in IEEE Transactions on Medical Imaging 2023

Generating Personas for Games with Multimodal Adversarial Imitation Learning

William Ahlberg, Alessandro Sestini, Konrad Tollmar, Linus Gisslén

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Published in CoG 2023

Improving Path Planning Performance through Multimodal Generative Models with Local Critics

Jorge Ocampo Jimenez, Wael Suleiman

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Under review

Multi-View Imputation and Cross-Attention Network Based on Incomplete Longitudinal and Multimodal Data for Conversion Prediction of Mild Cognitive Impairment

Tao Wang, Xiumei Chen, Xiaoling Zhang, Shuoling Zhou, Qianjin Feng, Meiyan Huang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Sense, Imagine, Act: Multimodal Perception Improves Model-Based Reinforcement Learning for Head-to-Head Autonomous Racing

Elena Shrestha, Chetan Reddy, Hanxi Wan, Yulun Zhuang, Ram Vasudevan

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Multimodal Procedural Planning via Dual Text-Image Prompting

Yujie Lu, Pan Lu, Zhiyu Chen, Wanrong Zhu, Xin Eric Wang, William Yang Wang

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Learning the Effects of Physical Actions in a Multi-modal Environment

Gautier Dagan, Frank Keller, Alex Lascarides

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CL

MILD: Multimodal Interactive Latent Dynamics for Learning Human-Robot Interaction

Vignesh Prasad, Dorothea Koert, Ruth Stock-Homburg, Jan Peters, Georgia Chalvatzaki

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted at the IEEE-RAS International Conference on Humanoid Robots (Humanoids) 2022

Learning to Act with Affordance-Aware Multimodal Neural SLAM

Zhiwei Jia, Kaixiang Lin, Yizhou Zhao, Qiaozi Gao, Govind Thattai, Gaurav Sukhatme

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Accepted by IROS 2022

The bi-objective multimodal car-sharing problem

Miriam Enzi, Sophie N. Parragh, Jakob Puchinger

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Sequential Bayesian Optimization for Adaptive Informative Path Planning with Multimodal Sensing

Joshua Ott, Edward Balaban, Mykel J. Kochenderfer

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Multi-Modal Unsupervised Pre-Training for Surgical Operating Room Workflow Analysis

Muhammad Abdullah Jamal, Omid Mohareri

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI'22)

A modular architecture for creating multimodal agents

Thomas Baier, Selene Baez Santamaria, Piek Vossen

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Charon: a FrameNet Annotation Tool for Multimodal Corpora

Frederico Belcavello, Marcelo Viridiano, Ely Edison Matos, Tiago Timponi Torrent

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments Accepted submission for the The Sixteenth Linguistic Annotation Workshop (LAW-XVI 2022)

Motron: Multimodal Probabilistic Human Motion Forecasting

Tim Salzmann, Marco Pavone, Markus Ryll

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments CVPR 2022

Jointly Learning Agent and Lane Information for Multimodal Trajectory Prediction

Jie Wang, Caili Guo, Minan Guo, Jiujiu Chen

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

A Machine learning approach for rapid disaster response based on multi-modal data. The case of housing & shelter needs

Karla Saldana Ochoa, Tina Comes

专题命中 多模态Agent ：multi-modal(title)；multimodal(abstract)；分类 cs.AI

XAI4Wind: A Multimodal Knowledge Graph Database for Explainable Decision Support in Operations & Maintenance of Wind Turbines

Joyjit Chatterjee, Nina Dethlefs

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments Updated version of knowledge graph resource paper - updates include additions to the Appendix on more properties in the knowledge graph, corrected typos/grammatical errors etc

Exploiting Multimodal Reinforcement Learning for Simultaneous Machine Translation

Julia Ive, Andy Mingren Li, Yishu Miao, Ozan Caglayan, Pranava Madhyastha, Lucia Specia

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments Long paper accepted to EACL 2021, Camera-ready version

Diverse and Admissible Trajectory Forecasting through Multimodal Context Understanding

Seong Hyeon Park, Gyubok Lee, Manoj Bhat, Jimin Seo, Minseok Kang, Jonathan Francis, Ashwin R. Jadhav, Paul Pu Liang, Louis-Philippe Morency

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Comments ECCV 2020

Explanation Generation for Multi-Modal Multi-Agent Path Finding with Optimal Resource Utilization using Answer Set Programming

Aysu Bogatarkan, Esra Erdem

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.AI

Comments Paper presented at the 36th International Conference on Logic Programming (ICLP 2020), University Of Calabria, Rende (CS), Italy, September 2020, 16 pages, 6 figures

M2Net: Multi-modal Multi-channel Network for Overall Survival Time Prediction of Brain Tumor Patients

Tao Zhou, Huazhu Fu, Yu Zhang, Changqing Zhang, Xiankai Lu, Jianbing Shen, Ling Shao

专题命中 多模态Agent ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by MICCAI'20

Bias in Multimodal AI: Testbed for Fair Automatic Recruitment

Alejandro Peña, Ignacio Serna, Aythami Morales, Julian Fierrez

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CV

Journal ref IEEE CVPR Workshop on Fair, Data Efficient and Trusted Computer Vision, Washington, Seattle, USA, 2020

lamBERT: Language and Action Learning Using Multimodal BERT

Kazuki Miyazawa, Tatsuya Aoki, Takato Horii, Takayuki Nagai

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.CL

Comments 8 pages, 9 figures

Adaptive Informative Path Planning with Multimodal Sensing

Shushman Choudhury, Nate Gruver, Mykel J. Kochenderfer

专题命中 多模态Agent ：multimodal(title,abstract)；分类 cs.AI

Comments First two authors contributed equally; International Conference on Automated Planning and Scheduling (ICAPS) 2020