In this technical report, we review related works and recent trends in visual vocabulary based web image search, object recognition, mobile visual search, and 3D object retrieval. Especial focuses would be also given for the recent trends in supervised/unsupervised vocabulary optimization, compact descriptor for visual search, as well as in multi-view based 3D object representation.
Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding
The Future Network of Intelligence Institute(未来智能网络研究院);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)理工学院);IHPC, A*STAR, Singapore(新加坡科研局智能系统研究所);The University of Hong Kong(香港大学)
End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting
Beijing Institute of Technology(北京理工大学);School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);Shenzhen MSU-BIT University(深圳北理莫斯科大学);University of Rochester(罗切斯特大学)
Open-Vocabulary One-Stage Detection with Hierarchical Visual-Language Knowledge Distillation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Beijing Institute of Basic Medical Sciences(北京基础医学研究所);Nanchang Hangkong University(南昌航空大学);CAS Center for Excellence in Brain Science and Intelligence Technology(中国科学院脑科学与智能技术卓越创新中心)
Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retention
The Hong Kong Polytechnic University(香港理工大学);Centre for Artificial Intelligence and Robotics, HKISI-CAS(香港中文大学(深圳)人工智能与机器人中心(HKISI-CAS));State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所 多模态人工智能系统国家重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学 人工智能学院)
Towards Domain-Generalized Open-Vocabulary Object Detection: A Progressive Domain-invariant Cross-modal Alignment Method
MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所多模态人工智能系统实验室);Institute of Microelectronics, University of Chinese Academy of Sciences(中国科学院大学微电子学院);School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学前沿交叉科学学院)
LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations
The Chinese University of Hong Kong(香港中文大学);City University of Hong Kong(香港城市大学);The University of Hong Kong(香港大学);Dongguan University of Technology(东莞理工学院)
METOR: A Unified Framework for Mutual Enhancement of Objects and Relationships in Open-vocabulary Video Visual Relationship Detection
Beijing Key Laboratory of Intelligent Information Technology, School of Computer Science & Technology, Beijing Institute of Technology, China(北京智能信息科技重点实验室,计算机科学与技术学院,北京理工大学,中国);Guangdong Laboratory of Machine Perception and Intelligent Computing, Shenzhen MSU-BIT University, China(广东机器感知与智能计算实验室,深圳MSU-BIT大学,中国)
Open-Vocabulary vs Supervised Learning Methods for Post-Disaster Visual Scene Understanding
Department of Informatics and Telematics, Harokopio University of Athens(信息与电信学系,雅典哈罗科波斯大学);Department of Networks and Digital Media, Kingston University(网络与数字媒体系,金士顿大学);Department of Electrical and Computer Engineering, University of Western Macedonia(电子与计算机工程系,西马其顿大学);Archimedes, Athena Research Center(阿基米德,雅典研究中心)
Towards Open-World Mobile Manipulation in Homes: Lessons from the Neurips 2023 HomeRobot Open Vocabulary Mobile Manipulation Challenge
Georgia Tech(佐治亚理工学院);Hello Robot Inc(Hello Robot公司);Carnegie Mellon(卡内基梅隆大学);Bielefeld University(比勒费尔德大学);Ukrainian Catholic University(乌克兰天主教大学);Bosch Center for AI(博世AI中心);IIITA(印度信息技术与管理大学阿拉哈巴德分校);IIT ISM Dhanbad(印度理工学院达纳巴德矿业与技术学院);IIITM(印度信息技术与管理大学古瓦哈蒂分校);CNAEIT(国家先进信息技术研究中心)
Enhanced Object Detection: A Study on Vast Vocabulary Object Detection Track for V3Det Challenge 2024
University of Science and Technology of China(中国科学技术大学);Zhejiang University(浙江大学);Northwestern Polytechnical University(西北工业大学);Northwest University(西北大学)
Embodied Multimodal Grounding for Open-Vocabulary Mobile Manipulation via Semantic 3D Gaussian Splatting
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Midea Group(美的集团);The Hong Kong University of Science and Technology(香港科技大学)
From Data to Modeling: Fully Open-vocabulary Scene Graph Generation
Department of Computing, The Hong Kong Polytechnic University(香港理工大学计算机系);CAIR, HKISI-CAS(中国科学院香港创新研究院);MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所马克思主义学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)