arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.16481cs.CV
收藏

使用LLM生成用于Zero-Shot罕见事件医学图像分类的定制化提示

Generating customized prompts for Zero-Shot Rare Event Medical Image Classification using LLM

School of Computing;Augmented Intelligence, \ State University, Tempe, USA

Payal Kamboj, Ayan Banerjee, Bin Xu, Sandeep Gupta

AI总结:

本文提出一种利用领域专家知识为LLM生成定制化提示的零样本方法,无需额外训练即可有效解决罕见事件医学图像分类中数据不足与类间差异低的问题,并超越现有技术。

摘要:

罕见事件由于其发生频率低,缺乏充足的数据,因此深度学习技术无法有效估计此类数据的分布。Open-vocabulary模型代表了一种创新的图像分类方法。与传统模型不同,这些模型在推理过程中将图像分类为由自然语言提示指定的任意类别集合。这些提示通常包含手动制作的模板(例如,'a photo of a {}'),并填入每个类别的名称。本文介绍了一种简单而有效的方法,用于生成包含判别性特征的高准确度且具有上下文描述性的提示。罕见事件检测,尤其是在医学领域,由于类间差异低和类内差异大而更具挑战性。为了解决这些问题,我们提出了一种新颖的方法,利用关于罕见事件的领域特定专家知识来生成定制化且与上下文相关的提示,这些提示随后被大型语言模型用于图像分类。我们的零样本、隐私保护方法无需额外训练即可增强罕见事件分类,优于现有最先进的技术。

英文摘要:

Rare events, due to their infrequent occurrences, do not have much data, and hence deep learning techniques fail in estimating the distribution for such data. Open-vocabulary models represent an innovative approach to image classification. Unlike traditional models, these models classify images into any set of categories specified with natural language prompts during inference. These prompts usually comprise manually crafted templates (e.g., 'a photo of a {}') that are filled in with the names of each category. This paper introduces a simple yet effective method for generating highly accurate and contextually descriptive prompts containing discriminative characteristics. Rare event detection, especially in medicine, is more challenging due to low inter-class and high intra-class variability. To address these, we propose a novel approach that uses domain-specific expert knowledge on rare events to generate customized and contextually relevant prompts, which are then used by large language models for image classification. Our zero-shot, privacy-preserving method enhances rare event classification without additional training, outperforming state-of-the-art techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑