Exploring Long Tail Visual Relationship Recognition with Large Vocabulary
King Abdullah University of Science and Technology (KAUST)(阿卜杜拉国王科技大学);IIT Roorkee(印度理工学院鲁尔基分校);Stanford University(斯坦福大学);Baidu(百度);NTU Singapore(新加坡南洋理工大学)
Several approaches have been proposed in recent literature to alleviate the long-tail problem, mainly in object classification tasks. In this paper, we make the first large-scale study concerning the task of Long-Tail Visual Relationship Recognition (LTVRR). LTVRR aims at improving the learning of structured visual relationships that come from the long-tail (e.g., "rabbit grazing on grass"). In this setup, the subject, relation, and object classes each follow a long-tail distribution. To begin our study and make a future benchmark for the community, we introduce two LTVRR-related benchmarks, dubbed VG8K-LT and GQA-LT, built upon the widely used Visual Genome and GQA datasets. We use these benchmarks to study the performance of several state-of-the-art long-tail models on the LTVRR setup. Lastly, we propose a visiolinguistic hubless (VilHub) loss and a Mixup augmentation technique adapted to LTVRR setup, dubbed as RelMix. Both VilHub and RelMix can be easily integrated on top of existing models and despite being simple, our results show that they can remarkably improve the performance, especially on tail classes. Benchmarks, code, and models have been made available at: https://github.com/Vision-CAIR/LTVRR.
Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmax
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);National University of Singapore(新加坡国立大学)
Semantic Library Adaptation: LoRA Retrieval and Fusion for Open-Vocabulary Semantic Segmentation
The Good AI Lab;University of Toronto(多伦多大学);KTH(瑞典皇家理工学院);AMD(超威半导体公司);Silo AI;King;Technical University of Munich(慕尼黑工业大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Google(谷歌公司);ETH Zurich(苏黎世联邦理工学院);University of Bologna(博洛尼亚大学)
Exploring "Many in Few" and "Few in Many" Properties in Long-Tailed, Highly-Imbalanced IC Defect Classification
Institute of Data Science and Information Computing, National Chung Hsing University(数据科学与信息计算研究所,中国台湾 Chung Hsing 大学);Department of Electrical Engineering, National Tsing Hua University(电子工程系,中国台湾 Tsing Hua 大学);Department of Electrical Engineering, National Taiwan University of Science and Technology(电子工程系,中国台湾 Science and Technology 大学);Development of Smart Manufacturing, United Microelectronics Corporation(智能制造发展,联合微电子公司)
VOVTrack: Exploring the Potentiality in Videos for Open-Vocabulary Object Tracking
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);City University of Hong Kong(香港城市大学)
LarvSeg: Exploring Image Classification Data For Large Vocabulary Semantic Segmentation via Category-wise Attentive Classifier
School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);Center of Data Science, Peking University(北京大学数据科学中心);Microsoft Research Asia(微软亚洲研究院)
Exploring Multi-Modal Contextual Knowledge for Open-Vocabulary Object Detection
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of the Chinese Academy of Sciences(中国科学院大学);Peng Cheng Laboratory(鹏城实验室);Tencent Youtu Lab(腾讯优图实验室)
ScaMo: Exploring the Scaling Law in Autoregressive Motion Generation Model
Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Tsinghua University(清华大学);The University of Hong Kong(香港大学);Sun Yat-sen University(中山大学);The Chinese University of Hongkong, Shenzhen(香港中文大学(深圳))
SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Images
School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);School of Information and Communications Engineering, Xi’an Jiaotong University(西安交通大学信息与通信工程学院);Ministry of Education Key Lab of Intelligent Network Security, Xi’an, China(教育部智能网络安全重点实验室);Pazhou Laboratory (Huangpu), Radarweg 29, Guangzhou, China(琶洲实验室(黄埔),雷达路29号,广州,中国)
Visual Programming for Zero-shot Open-Vocabulary 3D Visual Grounding
The Future Network of Intelligence Institute(未来智能网络研究院);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));School of Science and Engineering, The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳)理工学院);IHPC, A*STAR, Singapore(新加坡科研局智能系统研究所);The University of Hong Kong(香港大学)
Revisiting Natural Language Prompts from Large Language Models for Open-Vocabulary Video Recognition
School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院);School of Software Engineering, Beijing Jiaotong University(北京交通大学软件学院)
Exploring the Underwater World Segmentation without Extra Training
Institute of Artificial Intelligence (TeleAI), China Telecom, China(人工智能研究院(TeleAI),中国电信,中国);University of Science and Technology of China, China(中国科学技术大学,中国);Northwestern Polytechnical University, China(西北工业大学,中国)