We present the first learning-based visual odometry (VO) model, which generalizes to multiple datasets and real-world scenarios and outperforms geometry-based methods in challenging scenes. We achieve this by leveraging the SLAM dataset TartanAir, which provides a large amount of diverse synthetic data in challenging environments. Furthermore, to make our VO model generalize across datasets, we propose an up-to-scale loss function and incorporate the camera intrinsic parameters into the model. Experiments show that a single model, TartanVO, trained only on synthetic data, without any finetuning, can be generalized to real-world datasets such as KITTI and EuRoC, demonstrating significant advantages over the geometry-based methods on challenging trajectories. Our code is available at https://github.com/castacks/tartanvo.
Generalizable Synthetic Image Detection via Language-guided Contrastive Learning
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);State Key Laboratory of Internet of Things for Smart City(智慧城市物联网国家重点实验室);Department of Computer and Information Science, Faculty of Science and Technology, University of Macau(澳门大学计算机与信息科学系);Faculty of Applied Sciences, Macao Polytechnic University(澳门 polytechnic 大学应用科学系)
Forgery-aware Adaptive Transformer for Generalizable Synthetic Image Detection
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学研究所);Beijing Key Laboratory of Advanced Information Science and Network Technology(北京先进信息科学与网络技术重点实验室);Baidu VIS(百度视觉技术部)
Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning
University of Science and Technology Beijing(北京科技大学);Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Singapore Management University(新加坡管理大学)
Dual Data Alignment Makes AI-Generated Image Detector Easier Generalizable
Tencent YouTu Lab(腾讯优图实验室);East China University of Science and Technology(东华大学);Peking University(北京大学);Renmin University of China(中国人民大学);Shenzhen University(深圳大学);Hong Kong University of Science and Technology(香港科技大学)
Cloning Outfits from Real-World Images to 3D Characters for Generalizable Person Re-Identification
Inception Institute of Artificial Intelligence (IIAI)(Inception人工智能研究院(IIAI));Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
StereoCarla: A High-Fidelity Driving Dataset for Generalizable Stereo
School of Computer Science, Wuhan University(武汉大学计算机学院);IAIR, Xi’an Jiaotong University(西安交通大学IAIR);Waytous;CASIA(中国科学院自动化所);University of Bologna(博洛尼亚大学);University of California, Berkeley(加州大学伯克利分校);AIR, Tsinghua University(清华大学AIR)
FetchBot: Learning Generalizable Object Fetching in Cluttered Scenes via Zero-Shot Sim2Real
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);CFCS, School of Computer Science, Peking University(计算机科学系,北京大学);Galbot;Beijing Academy of Artificial Intelligence(北京人工智能研究院)
REArtGS++: Generalizable Articulation Reconstruction with Temporal Geometry Constraint via Planar Gaussian Splatting
Hefei Institutes of Physical Science, Chinese Academy of Sciences(合肥物理科学研究院,中国科学院);University of Science and Technology of China(中国科学技术大学);Hefei University of Technology(合肥工业大学);RoboticsX, Tencent(腾讯机器人院);Shanghai Jiao Tong University(上海交通大学)
The Evolution of Dataset Distillation: Toward Scalable and Generalizable Solutions
Department of Computer Science and Engineering, University of Nevada, Reno(计算机科学与工程系,内华达大学雷诺分校);Centre for Frontier AI Research (CFAR), and Institute of High Performance Computing (IHPC), A*STAR, Singapore(前沿人工智能研究中心(CFAR)和高性能计算研究所(IHPC),A*STAR,新加坡)
Learning Continuous Source Responses For Generalizable AI-Generated Image Detection
Ant Group(蚂蚁集团);Huazhong University of Science and Technology(华中科技大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Jilin University(吉林大学)
EndoMatcher: Generalizable Endoscopic Image Matcher via Multi-Domain Pre-training for Robot-Assisted Surgery
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学);Department of Pulmonary and Critical Care Medicine, The First Affiliated Hospital of Sun Yat-sen University(中山大学附属第一医院呼吸与危重症医学科);Hong Kong Institute of Science & Innovation(香港创新科技署);Centre of AI and Robotics, Hong Kong Institute of Science & Innovation(人工智能与机器人中心,香港创新科技署)
MIRROR: Manifold Ideal Reference ReconstructOR for Generalizable AI-Generated Image Detection
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Advanced Interdisciplinary Sciences, UCAS(北京大学交叉信息学院);Huazhong University of Science and Technology(华中科技大学);Tencent YouTu Lab(腾讯YouTu实验室);Southwest University(西南大学);Peking University(北京大学);The University of Sydney(悉尼大学);Shenzhen University(深圳大学);Tsinghua University(清华大学)