Histo-Miner:基于深度学习的H&E全切片图像皮肤鳞状细胞癌组织特征提取流程
Histo-Miner: Deep learning based tissue features extraction pipeline from H&E whole slide images of cutaneous squamous cell carcinoma
AI总结:
Histo-Miner通过深度学习提取皮肤鳞状细胞癌全切片图像的组织特征,用于预测免疫治疗反应。
摘要:
近年来,数字病理学的进步使得能够对全切片图像(WSI)进行全面分析,利用高分辨率显微镜和计算能力。尽管取得了进展,但缺乏专门针对皮肤组织分析的标注数据集和开源流程。本文提出Histo-Miner,一个基于深度学习的皮肤WSI分析流程,并生成两个带有标注核和肿瘤区域的数据集。我们开发了该流程用于分析皮肤鳞状细胞癌(cSCC)患者样本。利用这两个数据集,包含47,392个标注细胞核和144个肿瘤分割的WSI,分别来自cSCC患者,Histo-Miner使用卷积神经网络和视觉Transformer进行核分割和分类以及肿瘤区域分割。训练模型的性能在多类Panoptic质量(mPQ)方面为0.569,核分类的宏平均F1为0.832,肿瘤区域分割的平均交并比(mIoU)为0-middle。从这些预测中,我们生成一个紧凑的特征向量,总结组织形态和细胞相互作用,可用于各种下游任务。在此,我们使用Histo-Miner根据45名患者术前WSI预测cSCC患者对免疫治疗的反应。Histo-Miner识别出淋巴细胞百分比、肿瘤附近粒细胞与淋巴细胞比值以及肿瘤中粒细胞与浆细胞之间的距离作为预测治疗反应的特征。这突显了Histo-Miner在临床相关场景中的适用性,提供了分类的直接解释和对潜在生物学的洞察。
英文摘要:
Recent advancements in digital pathology have enabled comprehensive analysis of Whole-Slide Images (WSI) from tissue samples, leveraging high-resolution microscopy and computational capabilities. Despite this progress, there is a lack of labeled datasets and open source pipelines specifically tailored for analysis of skin tissue. Here we propose Histo-Miner, a deep learning-based pipeline for analysis of skin WSIs and generate two datasets with labeled nuclei and tumor regions. We develop our pipeline for the analysis of patient samples of cutaneous squamous cell carcinoma (cSCC), a frequent non-melanoma skin cancer. Utilizing the two datasets, comprising 47,392 annotated cell nuclei and 144 tumor-segmented WSIs respectively, both from cSCC patients, Histo-Miner employs convolutional neural networks and vision transformers for nucleus segmentation and classification as well as tumor region segmentation. Performance of trained models positively compares to state of the art with multi-class Panoptic Quality (mPQ) of 0.569 for nucleus segmentation, macro-averaged F1 of 0.832 for nucleus classification and mean Intersection over Union (mIoU) of 0.907 for tumor region segmentation. From these predictions we generate a compact feature vector summarizing tissue morphology and cellular interactions, which can be used for various downstream tasks. Here, we use Histo-Miner to predict cSCC patient response to immunotherapy based on pre-treatment WSIs from 45 patients. Histo-Miner identifies percentages of lymphocytes, the granulocyte to lymphocyte ratio in tumor vicinity and the distances between granulocytes and plasma cells in tumors as predictive features for therapy response. This highlights the applicability of Histo-Miner to clinically relevant scenarios, providing direct interpretation of the classification and insights into the underlying biology.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。