多模态大模型

Intelligent OPC Engineer Assistant for Semiconductor Manufacturing

Guojin Chen, Haoyu Yang, Bei Yu, Haoxing Ren

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

MEDCO: Medical Education Copilots Based on A Multi-Agent Framework

Hao Wei, Jianing Qiu, Haibao Yu, Wu Yuan

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Journal ref ECCV 2024 Workshop

Imagining from Images with an AI Storytelling Tool

Edirlei Soares de Lima, Marco A. Casanova, Antonio L. Furtado

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Semantic Skill Grounding for Embodied Instruction-Following in Cross-Domain Environments

Sangwoo Shin, Seunghyun Kim, Youngsoo Jang, Moontae Lee, Honguk Woo

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Findings of ACL-2024 Camera Ready Version

Robustness-Aware 3D Object Detection in Autonomous Driving: A Review and Outlook

Ziying Song, Lin Liu, Feiyang Jia, Yadan Luo, Guoxin Zhang, Lei Yang, Li Wang, Caiyan Jia

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Egocentric Vision Language Planning

Zhirui Fang, Ming Yang, Weishuai Zeng, Boyu Li, Junpeng Yue, Ziluo Ding, Xiu Li, Zongqing Lu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CV

Body of Her: A Preliminary Study on End-to-End Humanoid Agent

Tenglong Ao

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Technical Report v1; Project Page: https://aubrey-ao.github.io/BodyOfHer

CarDreamer: Open-Source Learning Platform for World Model based Autonomous Driving

Dechen Gao, Shuangyu Cai, Hanchu Zhou, Hang Wang, Iman Soltani, Junshan Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Dechen Gao, Shuangyu Cai, Hanchu Zhou, Hang Wang contributed equally

PrISM-Observer: Intervention Agent to Help Users Perform Everyday Procedures Sensed using a Smartwatch

Riku Arakawa, Hiromu Yakura, Mayank Goel

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments conditionally accepted to ACM UIST 2024

HAPFI: History-Aware Planning based on Fused Information

Sujin Jeon, Suyeon Shin, Byoung-Tak Zhang

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 7 pages, 3 figures, published to ICRA 2024

Agent-E: From Autonomous Web Navigation to Foundational Design Principles in Agentic Systems

Tamer Abuelsaad, Deepak Akkil, Prasenjit Dey, Ashish Jagmohan, Aditya Vempaty, Ravi Kokku

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Exploring the Robustness of Decision-Level Through Adversarial Attacks on LLM-Based Embodied Models

Shuyuan Liu, Jiawei Chen, Shouwei Ruan, Hang Su, Zhaoxia Yin

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.MM

ShapeLLM: Universal 3D Object Understanding for Embodied Interaction

Zekun Qi, Runpei Dong, Shaochen Zhang, Haoran Geng, Chunrui Han, Zheng Ge, Li Yi, Kaisheng Ma

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments Accepted at ECCV 2024

Jack of All Trades, Master of Some, a Multi-Purpose Transformer Agent

Quentin Gallouédec, Edward Beeching, Clément Romac, Emmanuel Dellandréa

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Journal ref 38th Workshop on Aligning Reinforcement Learning Experimentalists and Theorists (ARLET 2024)

Blending Data-Driven Priors in Dynamic Games

Justin Lidard, Haimin Hu, Asher Hancock, Zixu Zhang, Albert Gimó Contreras, Vikash Modi, Jonathan DeCastro, Deepak Gopinath, Guy Rosman, Naomi Ehrich Leonard, María Santos, Jaime Fernández Fisac

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 20 pages, 12 figures

Optimal Design and Implementation of an Open-source Emulation Platform for User-Centric Shared E-mobility Services

Maqsood Hussain Shah, Yue Ding, Shaoshu Zhu, Yingqi Gu, Mingming Liu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments 15 pages, 5 figures

An Explainable Collaborative Dialogue System using a Theory of Mind

Philip R. Cohen, Lucian Galescu, Maayan Shvo

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Comments 46 pages, 7 figures, 2 appendices

GUI Action Narrator: Where and When Did That Action Take Place?

Qinchen Wu, Difei Gao, Kevin Qinghong Lin, Zhuoyu Wu, Xiangwu Guo, Peiran Li, Weichen Zhang, Hengxu Wang, Mike Zheng Shou

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Improving Multi-Agent Debate with Sparse Communication Topology

Yunxuan Li, Yibing Du, Jiageng Zhang, Le Hou, Peter Grabowski, Yeqing Li, Eugene Ie

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CL

Comments 13 pages, 9 figures

An Interactive Agent Foundation Model

Zane Durante, Bidipta Sarkar, Ran Gong, Rohan Taori, Yusuke Noda, Paul Tang, Ehsan Adeli, Shrinidhi Kowshika Lakshmikanth, Kevin Schulman, Arnold Milstein, Demetri Terzopoulos, Ade Famoti, Noboru Kuno, Ashley Llorens, Hoi Vo, Katsu Ikeuchi, Li Fei-Fei, Jianfeng Gao, Naoki Wake, Qiuyuan Huang

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

LLM-assisted Concept Discovery: Automatically Identifying and Explaining Neuron Functions

Nhat Hoang-Xuan, Minh Vu, My T. Thai

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

World Models with Hints of Large Language Models for Goal Achieving

Zeyuan Liu, Ziyu Huan, Xiyao Wang, Jiafei Lyu, Jian Tao, Xiu Li, Furong Huang, Huazhe Xu

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Nadine: An LLM-driven Intelligent Social Robot with Affective Capabilities and Human-like Memory

Hangyeol Kang, Maher Ben Moussa, Nadia Magnenat-Thalmann

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

AgentScope: A Flexible yet Robust Multi-Agent Platform

Dawei Gao, Zitao Li, Xuchen Pan, Weirui Kuang, Zhijian Ma, Bingchen Qian, Fei Wei, Wenhao Zhang, Yuexiang Xie, Daoyuan Chen, Liuyi Yao, Hongyi Peng, Zeyu Zhang, Lin Zhu, Chen Cheng, Hongzhu Shi, Yaliang Li, Bolin Ding, Jingren Zhou

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments We have released code on https://github.com/modelscope/agentscope

GOPlan: Goal-conditioned Offline Reinforcement Learning by Planning with Learned Models

Mianchu Wang, Rui Yang, Xi Chen, Hao Sun, Meng Fang, Giovanni Montana

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

Comments Spotlight Presentation at Goal-conditioned Reinforcement Learning Workshop at NeurIPS 2023

Journal ref Transactions on Machine Learning Research (05/2024)

A First Step in Using Machine Learning Methods to Enhance Interaction Analysis for Embodied Learning Environments

Joyce Fonteles, Eduardo Davalos, Ashwin T. S., Yike Zhang, Mengxi Zhou, Efrat Ayalon, Alicia Lane, Selena Steinberg, Gabriella Anton, Joshua Danish, Noel Enyedy, Gautam Biswas

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI

Navigating Brain Language Representations: A Comparative Analysis of Neural Language Models and Psychologically Plausible Models

Yunhao Zhang, Shaonan Wang, Xinyi Dong, Jiajun Yu, Chengqing Zong

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.CL

No Transfers Required: Integrating Last Mile with Public Transit Using Opti-Mile

Raashid Altaf, Pravesh Biyani

专题命中 多模态Agent ：multi-modal(abstract)；分类 cs.AI

CLOVA: A Closed-Loop Visual Assistant with Tool Usage and Update

Zhi Gao, Yuntao Du, Xintong Zhang, Xiaojian Ma, Wenjuan Han, Song-Chun Zhu, Qing Li

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2024

AI2Apps: A Visual IDE for Building LLM-based AI Agent Applications

Xin Pang, Zhucong Li, Jiaxiang Chen, Yuan Cheng, Yinghui Xu, Yuan Qi

专题命中 多模态Agent ：multimodal(abstract)；分类 cs.AI