统一提示计数的定点方法
A Fixed-Point Approach to Unified Prompt-Based Counting
AI总结:
提出统一提示计数框架,将框、点、文本等提示转换为掩码并集成到类无关计数中,通过定点推理和对比训练提升精度与跨数据集适应性。
摘要:
现有的类无关计数模型通常依赖单一类型的提示,例如框标注。本文旨在建立一个全面的基于提示的计数框架,能够为各种提示类型(如框、点和文本)所指示的相关对象生成密度图。为实现这一目标,我们首先将不同模态的提示转换为提示掩码,无需训练。然后将这些掩码集成到类无关计数方法中,以预测密度图。此外,我们引入定点推理及相关的损失函数,以提高计数精度,且不引入新参数。该方法的有效性在理论和实验上均得到证实。另外,实施对比训练方案以缓解当前类无关计数数据集中固有的数据集偏差,该策略的有效性通过我们的消融研究得到确认。我们的模型在突出的类无关数据集上表现出色,并在跨数据集适应任务中展现出优越性能。
英文摘要:
Existing class-agnostic counting models typically rely on a single type of prompt, e.g., box annotations. This paper aims to establish a comprehensive prompt-based counting framework capable of generating density maps for concerned objects indicated by various prompt types, such as box, point, and text. To achieve this goal, we begin by converting prompts from different modalities into prompt masks without requiring training. These masks are then integrated into a class-agnostic counting methodology for predicting density maps. Furthermore, we introduce a fixed-point inference along with an associated loss function to improve counting accuracy, all without introducing new parameters. The effectiveness of this method is substantiated both theoretically and experimentally. Additionally, a contrastive training scheme is implemented to mitigate dataset bias inherent in current class-agnostic counting datasets, a strategy whose effectiveness is confirmed by our ablation study. Our model excels in prominent class-agnostic datasets and exhibits superior performance in cross-dataset adaptation tasks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。