机器人 / 具身智能

SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models

An-Chieh Cheng, Hongxu Yin, Yang Fu, Qiushan Guo, Ruihan Yang, Jan Kautz, Xiaolong Wang, Sifei Liu

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments NeurIPS 2024, Project Page: https://www.anjiecheng.me/SpatialRGPT

EgoChoir: Capturing 3D Human-Object Interaction Regions from Egocentric Views

Yuhang Yang, Wei Zhai, Chengfeng Wang, Chengjun Yu, Yang Cao, Zheng-Jun Zha

专题命中 具身推理 ：embodied AI(abstract)；分类 cs.CV

Comments NeurIPS2024, project: https://yyvhang.github.io/EgoChoir/

Structured Spatial Reasoning with Open Vocabulary Object Detectors

Negar Nejatishahidin, Madhukar Reddy Vongala, Jana Kosecka

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

In-Place Panoptic Radiance Field Segmentation with Perceptual Prior for 3D Scene Understanding

Shenghao Li

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Str-L Pose: Integrating Point and Structured Line for Relative Pose Estimation in Dual-Graph

Zherong Zhang, Chunyu Lin, Shujuan Huang, Shangrong Yang, Yao Zhao

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

You Only Speak Once to See

Wenhao Yang, Jianguo Wei, Wenhuan Lu, Lei Li

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments 7 pages, 4 figures

EPRecon: An Efficient Framework for Real-Time Panoptic 3D Reconstruction from Monocular Video

Zhen Zhou, Yunkai Ma, Junfeng Fan, Shaolin Zhang, Fengshui Jing, Min Tan

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

GauTOAO: Gaussian-based Task-Oriented Affordance of Objects

Jiawen Wang, Dingsheng Luo

专题命中 具身推理 ：manipulation(abstract)；分类 cs.RO

Comments 6 pages

Optimizing 3D Gaussian Splatting for Sparse Viewpoint Scene Reconstruction

Shen Chen, Jiale Zhou, Lei Li

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

BOX3D: Lightweight Camera-LiDAR Fusion for 3D Object Detection and Localization

Mario A. V. Saucedo, Nikolaos Stathoulopoulos, Vidya Sumathy, Christoforos Kanellakis, George Nikolakopoulos

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments Presented in MED 2024

Semantic Gaussians: Open-Vocabulary Scene Understanding with 3D Gaussian Splatting

Jun Guo, Xiaojian Ma, Yue Fan, Huaping Liu, Qing Li

专题命中 具身推理 ：embodied agent(abstract)；分类 cs.CV

Comments Project page: see https://semantic-gaussians.github.io

What Makes and Breaks Safety Fine-tuning? A Mechanistic Study

Samyak Jain, Ekdeep Singh Lubana, Kemal Oksuz, Tom Joy, Philip H. S. Torr, Amartya Sanyal, Puneet K. Dokania

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments Preprint

Shapley Marginal Surplus for Strong Models

Daniel de Marchi, Michael Kosorok, Scott de Marchi

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

OpenIns3D: Snap and Lookup for 3D Open-vocabulary Instance Segmentation

Zhening Huang, Xiaoyang Wu, Xi Chen, Hengshuang Zhao, Lei Zhu, Joan Lasenby

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

Comments ECCV 2024. Project page: https://zheninghuang.github.io/OpenIns3D/

GOI: Find 3D Gaussians of Interest with an Optimizable Open-vocabulary Semantic-space Hyperplane

Yansong Qu, Shaohui Dai, Xinyang Li, Jianghang Lin, Liujuan Cao, Shengchuan Zhang, Rongrong Ji

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments Our project page is available at https://quyans.github.io/GOI-Hyperplane/

Affordance Perception by a Knowledge-Guided Vision-Language Model with Efficient Error Correction

Gertjan Burghouts, Marianne Schaaphok, Michael van Bekkum, Wouter Meijer, Fieke Hillerström, Jelle van Mil

专题命中 具身推理 ：navigation(abstract)；分类 cs.CV

Comments 15 pages

Journal ref International Conference on Pattern Recognition and Artificial Intelligence (ICPRAI) 2024

Disentangled Acoustic Fields For Multimodal Physical Scene Understanding

Jie Yin, Andrew Luo, Yilun Du, Anoop Cherian, Tim K. Marks, Jonathan Le Roux, Chuang Gan

专题命中 具身推理 ：embodied agent(abstract)；分类 cs.RO

Learning from Mistakes: Self-Regularizing Hierarchical Representations in Point Cloud Semantic Segmentation

Elena Camuffo, Umberto Michieli, Simone Milani

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Journal ref IEEE Transactions on Multimedia (TMM), 2023

Towards Guaranteed Safe AI: A Framework for Ensuring Robust and Reliable AI Systems

David "davidad" Dalrymple, Joar Skalse, Yoshua Bengio, Stuart Russell, Max Tegmark, Sanjit Seshia, Steve Omohundro, Christian Szegedy, Ben Goldhaber, Nora Ammann, Alessandro Abate, Joe Halpern, Clark Barrett, Ding Zhao, Tan Zhi-Xuan, Jeannette Wing, Joshua Tenenbaum

专题命中 具身推理 ：world model(abstract)；分类 cs.AI

How Safe Am I Given What I See? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy

Zhenjiang Mao, Carson Sobolewski, Ivan Ruchkin

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments This is supplementary material to the paper: How Safe Am I Given What I See? Calibrated Prediction of Safety Chances for Image-Controlled Autonomy in 6th Annual Learning for Dynamics & Control Conference (L4DC 2024)

Fair GLASSO: Estimating Fair Graphical Models with Unbiased Statistical Behavior

Madeline Navarro, Samuel Rey, Andrei Buciulea, Antonio G. Marques, Santiago Segarra

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Learning to Play Atari in a World of Tokens

Pranav Agarwal, Sheldon Andrews, Samira Ebrahimi Kahou

专题命中 具身推理 ：world model(abstract)；分类 cs.LG

Comments Accepted at ICML 2024

VADER: Visual Affordance Detection and Error Recovery for Multi Robot Human Collaboration

Michael Ahn, Montserrat Gonzalez Arenas, Matthew Bennice, Noah Brown, Christine Chan, Byron David, Anthony Francis, Gavin Gonzalez, Rainer Hessmer, Tomas Jackson, Nikhil J Joshi, Daniel Lam, Tsang-Wei Edward Lee, Alex Luong, Sharath Maddineni, Harsh Patel, Jodilyn Peralta, Jornell Quiambao, Diego Reyes, Rosario M Jauregui Ruano, Dorsa Sadigh, Pannag Sanketi, Leila Takayama, Pavel Vodenski, Fei Xia

专题命中 具身推理 ：robotic(abstract)；分类 cs.RO

Comments 9 pages, 4 figures

Speeding Up Optimization-based Motion Planning through Deep Learning

Johannes Tenhumberg, Darius Burschka, Berthold Bäuml

专题命中 具身推理 ：world model(abstract)；分类 cs.RO

Journal ref 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)

Statler: State-Maintaining Language Models for Embodied Reasoning

Takuma Yoneda, Jiading Fang, Peng Li, Huanyu Zhang, Tianchong Jiang, Shengjie Lin, Ben Picker, David Yunis, Hongyuan Mei, Matthew R. Walter

专题命中 具身推理 ：robotics(abstract)；分类 cs.RO

Comments Accepted at ICRA 2024; Project website: https://statler-lm.github.io/

WorldQA: Multimodal World Knowledge in Videos through Long-Chain Reasoning

Yuanhan Zhang, Kaichen Zhang, Bo Li, Fanyi Pu, Christopher Arif Setiadharma, Jingkang Yang, Ziwei Liu

专题命中 具身推理 ：world model(abstract)；分类 cs.CV

CloudFort: Enhancing Robustness of 3D Point Cloud Classification Against Backdoor Attacks via Spatial Partitioning and Ensemble Prediction

Wenhao Lan, Yijun Yang, Haihua Shen, Shan Li

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

BACS: Background Aware Continual Semantic Segmentation

Mostafa ElAraby, Ali Harakeh, Liam Paull

专题命中 具身推理 ：robotic(abstract)；分类 cs.CV

Comments 8 pages, 4 figures, CRV 2024

Deep Learning for Event-based Vision: A Comprehensive Survey and Benchmarks

Xu Zheng, Yexin Liu, Yunfan Lu, Tongyan Hua, Tianbo Pan, Weiming Zhang, Dacheng Tao, Lin Wang

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Adapting to Length Shift: FlexiLength Network for Trajectory Prediction

Yi Xu, Yun Fu

专题命中 具身推理 ：robotics(abstract)；分类 cs.CV

Comments Accepted by CVPR 2024