机器人 / 具身智能

Towards End-to-End Embodied Decision Making via Multi-modal Large Language Model: Explorations with GPT4-Vision and Beyond

Liang Chen, Yichi Zhang, Shuhuai Ren, Haozhe Zhao, Zefan Cai, Yuchi Wang, Peiyi Wang, Tianyu Liu, Baobao Chang

专题命中 机器人数据与评测 ：embodied agent(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments FMDM@NeurIPS2023, Code and data: https://github.com/pkunlp-icler/PCA-EVAL/

Using Representation Expressiveness and Learnability to Evaluate Self-Supervised Learning Methods

Yuchen Lu, Zhen Liu, Aristide Baratin, Romain Laroche, Aaron Courville, Alessandro Sordoni

专题命中 机器人数据与评测 ：manipulation(abstract)；分类 cs.AI、cs.CV、cs.LG

Journal ref TMLR 2023 -- Transactions of Machine Learning Research, 11/2023

Interaction is all You Need? A Study of Robots Ability to Understand and Execute

Kushal Koshti, Nidhir Bhavsar

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.AI、cs.CV

Guaranteed Conformance of Neurosymbolic Models to Natural Constraints

Kaustubh Sridhar, Souradeep Dutta, James Weimer, Insup Lee

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.AI、cs.LG

Comments Accepted to L4DC 2023 and Neurosymbolic Generative Models workshop, ICLR 2023

STOW: Discrete-Frame Segmentation and Tracking of Unseen Objects for Warehouse Picking Robots

Yi Li, Muru Zhang, Markus Grotz, Kaichun Mo, Dieter Fox

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments CoRL 2023, project page: https://sites.google.com/view/stow-corl23

Learning to See Physical Properties with Active Sensing Motor Policies

Gabriel B. Margolis, Xiang Fu, Yandong Ji, Pulkit Agrawal

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.CV、cs.LG

Comments In CoRL 2023. Website: https://gmargo11.github.io/active-sensing-loco/

Decoding the Enigma: Benchmarking Humans and AIs on the Many Facets of Working Memory

Ankur Sikarwar, Mengmi Zhang

专题命中 机器人数据与评测 ：manipulation(abstract)；分类 cs.AI、cs.CV、cs.LG

Comments Conference on Neural Information Processing Systems (NeurIPS 2023)

Semi-Synthetic Dataset Augmentation for Application-Specific Gaze Estimation

Cedric Leblond-Menard, Gabriel Picard-Krashevski, Sofiane Achiche

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.AI、cs.CV、cs.LG

Comments 5 pages, 5 figures

Neural Foundations of Mental Simulation: Future Prediction of Latent Representations on Dynamic Scenes

Aran Nayebi, Rishi Rajalingham, Mehrdad Jazayeri, Guangyu Robert Yang

专题命中 机器人数据与评测 ：embodied AI(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments 20 pages, 10 figures, NeurIPS 2023 Camera Ready Version (spotlight)

Facial Forgery-based Deepfake Detection using Fine-Grained Features

Aakash Varma Nadimpalli, Ajita Rattani

专题命中 机器人数据与评测 ：manipulation(abstract)；分类 cs.AI、cs.CV、cs.LG

Comments 8 pages, 2 figures

STOPNet: Multiview-based 6-DoF Suction Detection for Transparent Objects on Production Lines

Yuxuan Kuang, Qin Han, Danshi Li, Qiyu Dai, Lian Ding, Dong Sun, Hanlin Zhao, He Wang

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments Under Review. ICRA 2024 submission

Marginalized Importance Sampling for Off-Environment Policy Evaluation

Pulkit Katdare, Nan Jiang, Katherine Driggs-Campbell

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.LG

MoVie: Visual Model-Based Policy Adaptation for View Generalization

Sizhe Yang, Yanjie Ze, Huazhe Xu

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.CV、cs.LG

Comments Accepted in NeurIPS 2023. The first two authors contribute equally

Variational Hierarchical Mixtures for Probabilistic Learning of Inverse Dynamics

Hany Abdulsamad, Peter Nickl, Pascal Klink, Jan Peters

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.AI、cs.LG

Comments arXiv admin note: text overlap with arXiv:2011.05217

Learning Efficient Abstract Planning Models that Choose What to Predict

Nishanth Kumar, Willie McClinton, Rohan Chitnis, Tom Silver, Tomás Lozano-Pérez, Leslie Pack Kaelbling

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.AI、cs.LG

Computation-efficient Deep Learning for Computer Vision: A Survey

Yulin Wang, Yizeng Han, Chaofei Wang, Shiji Song, Qi Tian, Gao Huang

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.AI、cs.CV、cs.LG

GINA-3D: Learning to Generate Implicit Neural Assets in the Wild

Bokui Shen, Xinchen Yan, Charles R. Qi, Mahyar Najibi, Boyang Deng, Leonidas Guibas, Yin Zhou, Dragomir Anguelov

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments Accepted by CVPR 2023; Our WOD-ObjectAsset can be accessed through waymo.com/open

Video OWL-ViT: Temporally-consistent open-world localization in video

Georg Heigold, Matthias Minderer, Alexey Gritsenko, Alex Bewley, Daniel Keysers, Mario Lučić, Fisher Yu, Thomas Kipf

专题命中 机器人数据与评测 ：world model(abstract)；分类 cs.AI、cs.CV、cs.LG

Comments ICCV 2023

ClothesNet: An Information-Rich 3D Garment Model Repository with Simulated Clothes Environment

Bingyang Zhou, Haoyu Zhou, Tianhai Liang, Qiaojun Yu, Siheng Zhao, Yuwei Zeng, Jun Lv, Siyuan Luo, Qiancai Wang, Xinyuan Yu, Haonan Chen, Cewu Lu, Lin Shao

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments IEEE/CVF International Conference on Computer Vision (ICCV) 2023

Beyond Object Recognition: A New Benchmark towards Object Concept Learning

Yong-Lu Li, Yue Xu, Xinyu Xu, Xiaohan Mao, Yuan Yao, Siqi Liu, Cewu Lu

专题命中 机器人数据与评测 ：embodied AI(abstract)；分类 cs.AI、cs.CV、cs.LG

Comments ICCV 2023. Webpage: https://mvig-rhos.com/ocl

Application of Ghost-DeblurGAN to Fiducial Marker Detection

Yibo Liu, Amaldev Haridevan, Hunter Schofield, Jinjun Shan

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.LG

Comments 6 pages, 6 figures

Convolutional Occupancy Models for Dense Packing of Complex, Novel Objects

Nikhil Mishra, Pieter Abbeel, Xi Chen, Maximilian Sieb

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.CV、cs.LG

Comments In IROS 2023. Code and dataset are available at https://sites.google.com/view/fcon-packing/

On Grounded Planning for Embodied Tasks with Language Models

Bill Yuchen Lin, Chengsong Huang, Qian Liu, Wenda Gu, Sam Sommerer, Xiang Ren

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.LG

Comments Accepted to AAAI 2023 Project website: https://yuchenlin.xyz/g-planet/

Embodied Task Planning with Large Language Models

Zhenyu Wu, Ziwei Wang, Xiuwei Xu, Jiwen Lu, Haibin Yan

专题命中 机器人数据与评测 ：embodied agent(abstract)；分类 cs.RO、cs.AI、cs.CV

Comments Project Page: https://gary3410.github.io/TaPA

Active Acquisition for Multimodal Temporal Data: A Challenging Decision-Making Task

Jannik Kossen, Cătălina Cangea, Eszter Vértes, Andrew Jaegle, Viorica Patraucean, Ira Ktena, Nenad Tomasev, Danielle Belgrave

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.AI、cs.CV、cs.LG

Comments Published in Transactions on Machine Learning Research. Previous version accepted to Foundation Models for Decision Making Workshop at NeurIPS 2022

The Drunkard's Odometry: Estimating Camera Motion in Deforming Scenes

David Recasens, Martin R. Oswald, Marc Pollefeys, Javier Civera

专题命中 机器人数据与评测 ：navigation(abstract)；分类 cs.RO、cs.CV、cs.LG

Enhancing Visual Domain Adaptation with Source Preparation

Anirudha Ramesh, Anurag Ghosh, Christoph Mertz, Jeff Schneider

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.CV

CNN-based Methods for Object Recognition with High-Resolution Tactile Sensors

Juan M. Gandarias, Alfonso J. García-Cerezo, Jesús M. Gómez-de-Gabriel

专题命中 机器人数据与评测 ：robotic(abstract)；分类 cs.RO、cs.AI、cs.CV

Probabilistic Symmetry for Multi-Agent Dynamics

Sophia Sun, Robin Walters, Jinxi Li, Rose Yu

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.AI、cs.LG

A Correct-and-Certify Approach to Self-Supervise Object Pose Estimators via Ensemble Self-Training

Jingnan Shi, Rajat Talak, Dominic Maggio, Luca Carlone

专题命中 机器人数据与评测 ：robotics(abstract)；分类 cs.RO、cs.CV、cs.LG