NuNext:将核检测重新表述为下一个点检测
NuNext: Reframing Nucleus Detection as Next-Point Detection
AI总结:
NuNext通过多模态大语言模型直接输出核质心,采用空间感知软监督和强化微调策略提升检测性能,优于现有方法。
摘要:
在病理学中,核检测对于广泛临床应用至关重要。现有方法要么回归需要复杂后处理的核代理地图,要么使用密集锚点或查询,导致严重的前景-背景不平衡。在本工作中,我们将核检测重新表述为下一个点预测,其中开发了多模态大语言模型,直接从输入图像输出前景核质心。模型分两个阶段训练。在监督学习阶段,我们提出空间感知软监督以放松严格的质心匹配,并提出视觉先验的链式视觉思维策略以促进坐标预测。在强化微调阶段,我们设计了分布匹配奖励、低方差组过滤和细粒度优势塑造以进一步提高模型的检测质量。在九个广泛使用的基准测试中进行了大量实验,证明了我们方法的优越性。代码将很快发布。
英文摘要:
Nucleus detection in histopathology is pivotal for a wide range of clinical applications. Existing approaches either regress nuclear proxy maps that require complex post-processing, or employ dense anchors or queries that introduce severe foreground-background imbalance. In this work, we reformulate nucleus detection as next-point prediction, wherein a multimodal large language model is developed to directly output foreground nucleus centroids from the input image. The model is trained in two stages. In the supervised learning stage, we propose spatial-aware soft supervision to relax strict centroid matching and a chain-of-visual-thought strategy to incorporate visual priors that facilitate coordinate prediction. In the reinforcement fine-tuning stage, we design distribution matching reward, low-variance group filtering, and fine-grained advantage shaping to further improve the model's detection quality. Extensive experiments on nine widely used benchmarks demonstrate the superiority of our method. Code will be released soon.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。