Low-shot object counting addresses estimating the number of previously unobserved objects in an image using only few or no annotated test-time exemplars. A considerable challenge for modern low-shot counters are dense regions with small objects. While total counts in such situations are typically well addressed by density-based counters, their usefulness is limited by poor localization capabilities. This is better addressed by point-detection-based counters, which are based on query-based detectors. However, due to limited number of pre-trained queries, they underperform on images with very large numbers of objects, and resort to ad-hoc techniques like upsampling and tiling. We propose CoDi, the first latent diffusion-based low-shot counter that produces high-quality density maps on which object locations can be determined by non-maxima suppression. Our core contribution is the new exemplar-based conditioning module that extracts and adjusts the object prototypes to the intermediate layers of the denoising network, leading to accurate object location estimation. On FSC benchmark, CoDi outperforms state-of-the-art by 15% MAE, 13% MAE and 10% MAE in the few-shot, one-shot, and reference-less scenarios, respectively, and sets a new state-of-the-art on MCAC benchmark by outperforming the top method by 38% MAE. The code is available at https://github.com/gsustar/CoDi
Reversible Inversion for Training-Free Exemplar-guided Image Editing
school of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);School of Computing and Artificial Intelligence, Southwest Jiaotong University, China(西南交通大学计算机科学与人工智能学院);School of Computer Science and Technology, Tongji University, China(同济大学计算机科学与技术学院);Department of Computer Science, University of Warwick, United Kingdom(英国沃里克大学计算机科学系)
SQ-GAN: Semantic Image Communications Using Masked Vector Quantization
CNIT - National Inter-University Consortium for Telecommunications(CNIT-国家大学间电信联合体);Sapienza University of Rome(罗马大学);Technical University of Berlin(柏林技术大学)
MoE Key Lab of Artificial Intelligence, AI Institute, School of Computer Science, Shanghai Jiao Tong University(人工智能大模型重点实验室、人工智能学院、计算机科学学院、上海交通大学);Huawei Inc.(华为公司);Huazhong University of Science and Technology(华中科技大学)