OCCAM: Class-Agnostic, Training-Free, Prior-Free and Multi-Class Object Counting
Computer Science Department, University of Crete(塞萨洛尼基大学计算机科学系);Institute of Computer Science (ICS), Foundation for Research & Technology – Hellas (FORTH)(希腊基础研究与技术研究所计算机科学研究所)
类无关的对象计数(CAC)涉及在图像中对任意类别的对象实例进行计数。由于其实际重要性,CAC近年来受到越来越多的关注。大多数现有方法假设每张图像只包含一个对象类别,依赖于对大型深度学习模型的大量训练,并通过引入额外信息(如视觉示例或文本提示)来解决该问题。在本文中,我们提出了OCCAM,这是首个无需训练的CAC方法,无需任何补充信息即可运行。此外,我们的方法解决了多类变体的问题,因为它能够对图像中任意对象类别中的每个类别实例进行计数。我们利用Segment Anything Model 2(SAM2),一个基础模型,以及一种基于阈值的First Integer Neighbor Clustering Hierarchy(FINCH)算法的定制变体,以在广泛使用的基准数据集FSC-147和CARPK上实现具有竞争力的性能。我们提出了一个合成的多类数据集,并提出F1分数作为更合适的评估度量。我们的方法和提出的合成数据集的代码将在https://mikespanak.github.io/OCCAM_counter上公开。
英文摘要:
Class-Agnostic object Counting (CAC) involves counting instances of objects from arbitrary classes within an image. Due to its practical importance, CAC has received increasing attention in recent years. Most existing methods assume a single object class per image, rely on extensive training of large deep learning models and address the problem by incorporating additional information, such as visual exemplars or text prompts. In this paper, we present OCCAM, the first training-free approach to CAC that operates without the need of any supplementary information. Moreover, our approach addresses the multi-class variant of the problem, as it is capable of counting the object instances in each and every class among arbitrary object classes within an image. We leverage Segment Anything Model 2 (SAM2), a foundation model, and a custom threshold-based variant of the First Integer Neighbor Clustering Hierarchy (FINCH) algorithm to achieve competitive performance on widely used benchmark datasets, FSC-147 and CARPK. We propose a synthetic multi-class dataset and F1 score as a more suitable evaluation metric. The code for our method and the proposed synthetic dataset will be made publicly available at https://mikespanak.github.io/OCCAM_counter.
Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting
Institute of Information Science and Technologies of the National Research Council (ISTI-CNR)(意大利国家研究理事会信息科学与技术研究所);University of Pisa - Department of Information Engineering(比萨大学信息工程系)
A Unified Object Counting Network with Object Occupation Prior
Nanjing University of Information Science and Technology(南京信息工程大学);Nanjing Forestry University(南京林业大学);Australian Institute for Machine Learning(澳大利亚机器学习研究所);the University of Adelaide(阿德莱德大学);Nanjing University of Posts and Telecommunications(南京邮电大学)
Department of Computer Science University of Verona(维罗纳大学计算机科学系);University of Verona(维罗纳大学);Department of Computer Science(计算机科学系);Verona(维罗纳(此处为城市名,非机构名,原文本中可能存在格式问题,根据提取规则,仅保留明确机构名,此处正确机构应为University of Verona,原Department of Computer Science University of Verona整体为一个机构,故合并输出))
Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting
College of Electronic and Information Engineering, Tongji University(电子信息工程学院,同济大学);College of Computer Science, Wuhan University(计算机科学学院,武汉大学);College of Computer Science, Tongji University(计算机科学学院,同济大学);State Key Laboratory of Autonomous Intelligent Unmanned Systems(自主智能无人系统国家重点实验室)
OmniCount: Multi-label Object Counting with Semantic-Geometric Priors
University of Surrey(萨里大学);CVSSP(视觉、语音与信号处理中心);Surrey Institute for People-Centred AI(萨里以人为本人工智能研究所);School of Veterinary Medicine(兽医学院);iFlyTek-Surrey Joint Research Center on AI(科大讯飞-萨里人工智能联合研究中心)
本文提出开放词汇多类别目标计数框架 OmniCount,利用预训练模型的语义-几何先验和 Segment Anything Model 实现免训练、多标签高效计数,并构建 OmniCount-191 基准验证其性能优势。
A Recipe for CAC: Mosaic-based Generalized Loss for Improved Class-Agnostic Counting
National Yang Ming Chiao Tung University(国立阳明交通大学);University of Michigan(密歇根大学);Research Center of Information Technology Innovation, Academia Sinica(中央研究院信息技术创新研究中心)
Text-promptable Object Counting via Quantity Awareness Enhancement
College of Electronic and Information Engineering, Tongji University(同济大学电子与信息学院);College of Computer Science, Wuhan University(武汉大学计算机学院);College of Computer Science, Tongji University(同济大学计算机学院);State Key Laboratory of Autonomous Intelligent Unmanned Systems(自主智能无人系统国家重点实验室)
Can SAM Count Anything? An Empirical Study on SAM Counting
Shenzhen Institute of Advanced Technology, Chinese Academy of Science(中国科学院深圳先进技术研究院);Harbin Institute of Technology(哈尔滨工业大学);Peng Cheng Laboratory(鹏城实验室)
本文实证评估 SAM 在少样本目标计数任务上的能力,发现未经微调的 SAM 相比现有方法表现不佳,尤其难以处理小型和拥挤目标。
Rank-Aware Agglomeration of Foundation Models for Immunohistochemistry Image Cell Counting
School of Software Engineering, Xi’an Jiaotong University(西安交通大学软件工程学院);School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院);Department of Gastrointestinal Surgery and the Gastric Cancer Center, Zhongshan Hospital, Fudan University(复旦大学中山医院胃肠外科及胃癌中心);School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);The Comprehensive Breast Care Center, The Second Affiliated Hospital of Xi'an Jiaotong University(西安交通大学第二附属医院综合乳腺护理中心);Department of Pathology, The Second Affiliated Hospital of Xi’an Jiaotong University(西安交通大学第二附属医院病理科);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Department of General Surgery, Zhongshan Hospital (Xiamen), Fudan University(复旦大学中山医院(厦门)外科科)
TasselNetV4: A vision foundation model for cross-scene, cross-scale, and cross-species plant counting
National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation(multispectral information intelligent processing technology, school of artificial intelligence and automation);China-Poland Joint Laboratory on Measurement and Control Technology, School of Artificial Intelligence and Automation;School of Cyber Science and Engineering;School of Computer Science and Engineering;Wuhan Institute of Technology;Graduate School of Agricultural and Life Sciences;Engineering Research Center of Plant Phenotyping, Ministry of Education, Jiangsu Collaborative Innovation Center for Modern Crop Production, Academy for Advanced Interdisciplinary Studies