Coarse-to-fine models and cascade segmentation architectures are widely adopted to solve the problem of large scale variations in medical image segmentation. However, those methods have two primary limitations: the first-stage segmentation becomes a performance bottleneck; the lack of overall differentiability makes the training process of two stages asynchronous and inconsistent. In this paper, we propose a differentiable two-stage network architecture to tackle these problems. In the first stage, a localization network (L-Net) locates Regions of Interest (RoIs) in a detection fashion; in the second stage, a segmentation network (S-Net) performs fine segmentation on the recalibrated RoIs; a RoI recalibration module between L-Net and S-Net eliminating the inconsistencies. Experimental results on the public dataset show that our method outperforms state-of-the-art coarse-to-fine models with negligible computation overheads.
M$^{2}$SNet: Multi-scale in Multi-scale Subtraction Network for Medical Image Segmentation
IIAU-Lab, Dalian University of Technology(大连理工大学IIAU-Lab);Zhongshan Hospital of Dalian University(大连大学附属中山医院);Yale University(耶鲁大学);Nanyang Technological University(南洋理工大学)
Peking University(北京大学);Deepwise AI Lab(深睿医疗人工智能实验室);Microsoft Research Asia(微软亚洲研究院);The University of Hong Kong(香港大学)
As an important upstream task for many medical applications, supervised landmark localization still requires non-negligible annotation costs to achieve desirable performance. Besides, due to cumbersome collection procedures, the limited size of medical landmark datasets impacts the effectiveness of large-scale self-supervised pre-training methods. To address these challenges, we propose a two-stage framework for one-shot medical landmark localization, which first infers landmarks by unsupervised registration from the labeled exemplar to unlabeled targets, and then utilizes these noisy pseudo l…
Localization-Infused Vision-Language Semantic Fusion for Text-Guided Medical Image Segmentation
Air Force Engineering University(空军工程大学);Harbin Institute of Technology(哈尔滨工业大学);University of Sydney(悉尼大学);Institute of Translational Medicine, Shanghai Jiao Tong University(上海交通大学转化医学研究院);Zhongguancun Institute of Artificial Intelligence(中关村人工智能研究院)
Landmark Localization plays a very important role in processing medical images as well as in disease identification. However, In medical field, it's a challenging task because of the complexity of medical images and the high requirement of accuracy for disease identification and treatment.There are two dominant ways to regress landmark coordination, one using the full convolutional network to regress the heatmaps of landmarks , which is a complex way and heatmap post-process strategies are needed, and the other way is to regress the coordination using CNN + Full Connective Network directly, wh…
Lister Hill National Center for Biomedical Communications(李斯特·希尔国家生物医学交流中心);National Heart, Lung, and Blood Institute(国家心肺血液研究所)
Accurate segmentation of medical images into anatomically meaningful regions is critical for the extraction of quantitative indices or biomarkers. The common pipeline for segmentation comprises regions of interest detection stage and segmentation stage, which are independent of each other and typically performed using separate deep learning networks. The performance of the segmentation stage highly relies on the extracted set of spatial features and the receptive fields. In this work, we propose an end-to-end network, called Trilateral Attention Network (TaNet), for real-time detection and seg…
Johns Hopkins University(约翰斯·霍普金斯大学);University of Electronic Science and Technology of China(电子科技大学);Stanford University(斯坦福大学);East China Normal University(华东师范大学);PAII Inc.(PAII公司)
Medical image segmentation is an essential prerequisite for developing healthcare systems, especially for disease diagnosis and treatment planning. On various medical image segmentation tasks, the u-shaped architecture, also known as U-Net, has become the de-facto standard and achieved tremendous success. However, due to the intrinsic locality of convolution operations, U-Net generally demonstrates limitations in explicitly modeling long-range dependency. Transformers, designed for sequence-to-sequence prediction, have emerged as alternative architectures with innate global self-attention mech…
Xiamen University(厦门大学);Chinese PLA General Hospital(中国人民解放军总医院);Deepwise AI Laboratory(深度智耀人工智能实验室)
Standard segmentation of medical images based on full-supervised convolutional networks demands accurate dense annotations. Such learning framework is built on laborious manual annotation with restrict demands for expertise, leading to insufficient high-quality labels. To overcome such limitation and exploit massive weakly labeled data, we relaxed the rigid labeling requirement and developed a semi-supervised learning framework based on a teacher-student fashion for organ and lesion segmentation with partial dense-labeled supervision and supplementary loose bounding-box supervision which are e…
Understanding From Human Perspective: A Multi-agent System for Interactive Egocentric Medical Image Segmentation
School of Instrument Science and Engineering, Southeast University(东南大学仪器科学与工程学院);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Sichuan University-Pittsburgh Institute, Sichuan University(四川大学匹兹堡学院);Department of Biomedical Engineering, Case Western Reserve University(凯斯西储大学生物医学工程系)
Devil is in the Queries: Advancing Mask Transformers for Real-world Medical Image Segmentation and Out-of-Distribution Localization
Alibaba Group(阿里巴巴集团);Peking University(北京大学);Shengjing Hospital(盛京医院);Guangdong Province People’s Hospital(广东省人民医院);Peking University Changsha Institute for Computing and Digital Economy(北京大学长沙计算与数字经济研究院)
National Library of Medicine(国家医学图书馆);National Institutes of Health(美国国立卫生研究院);Saint Louis University(圣路易斯大学)
Deep learning (DL) has drawn tremendous attention in object localization and recognition for both natural and medical images. U-Net segmentation models have demonstrated superior performance compared to conventional handcrafted feature-based methods. Medical image modality-specific DL models are better at transferring domain knowledge to a relevant target task than those that are pretrained on stock photography images. This helps improve model adaptation, generalization, and class-specific region of interest (ROI) localization. In this study, we train chest X-ray (CXR) modality-specific U-Nets…
Landmark localization is a challenging problem in computer vision with a multitude of applications. Recent deep learning based methods have shown improved results by regressing likelihood maps instead of regressing the coordinates directly. However, setting the precision of these regression targets during the training is a cumbersome process since it creates a trade-off between trainability vs localization accuracy. Using precise targets introduces a significant sampling bias and hence makes the training more difficult, whereas using imprecise targets results in inaccurate landmark detectors. …
landmarker: a Toolkit for Anatomical Landmark Localization in 2D/3D Images
IDLab;Department of Electronics and Information Systems(电子与信息系统系);Ghent University(根特大学);imec;Biometrics Research Group(生物识别研究组);Department of Morphology, Imaging, Orthopedics, Rehabilitation and Nutrition(解剖学、成像、骨科、康复和营养系)
University of Basel(巴塞尔大学);University Hospital Basel(巴塞尔大学医院);MIAC AG
We present an automated method for localizing an anatomical landmark in three-dimensional medical images. The method combines two recurrent neural networks in a coarse-to-fine approach: The first network determines a candidate neighborhood by analyzing the complete given image volume. The second network localizes the actual landmark precisely and accurately in the candidate neighborhood. Both networks take advantage of multi-dimensional gated recurrent units in their main layers, which allow for high model complexity with a comparatively small set of parameters. We localize the medullopontine …
University of Oulu(奥卢大学);Oulu University Hospital(奥卢大学医院);Aalto University(阿尔托大学)
This paper addresses the challenge of localization of anatomical landmarks in knee X-ray images at different stages of osteoarthritis (OA). Landmark localization can be viewed as regression problem, where the landmark position is directly predicted by using the region of interest or even full-size images leading to large memory footprint, especially in case of high resolution medical images. In this work, we propose an efficient deep neural networks framework with an hourglass architecture utilizing a soft-argmax layer to directly predict normalized coordinates of the landmark points. We provi…
Athinoula A. Martinos Center for Biomedical Imaging(阿西诺拉·A·马丁诺斯生物医学成像中心);Casey Eye Institute, Oregon Health and Science University(俄勒冈健康与科学大学凯西眼科研究所);Oregon Health and Science University(俄勒冈健康与科学大学);Northeastern University(东北大学)
In this paper, we propose a new pre-training scheme for U-net based image segmentation. We first train the encoding arm as a localization network to predict the center of the target, before extending it into a U-net architecture for segmentation. We apply our proposed method to the problem of segmenting the optic disc from fundus photographs. Our work shows that the features learned by encoding arm can be transferred to the segmentation network to reduce the annotation burden. We propose that an approach could have broad utility for medical image segmentation, and alleviate the burden of delin…
Rethinking Medical Landmark Localization with Prototype Learning-based Progressive Offset Correction
Shenzhen University(深圳大学);Centre for Artificial Intelligence and Robotics, Hong Kong Institute of Science & Innovation, Chinese Academy of Sciences(中国科学院香港创新研究院人工智能与机器人中心);Boston Children’s Hospital(波士顿儿童医院);Harvard Medical School(哈佛医学院);School of Artificial Intelligence, Shenzhen University(深圳大学人工智能学院);School of Biomedical Engineering and Informatics, Nanjing Medical University(南京医科大学生物医学工程与信息学院);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(深圳大学大数据系统计算技术国家工程实验室)
Enhancing the Reliability of Segment Anything Model for Auto-Prompting Medical Image Segmentation with Uncertainty Rectification
Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化研究院);Shanghai Academy of Artificial Intelligence for Science(上海科学人工智能研究院)
SemiSAM: Enhancing Semi-Supervised Medical Image Segmentation via SAM-Assisted Consistency Regularization
Artificial Intelligence Innovation and Incubation Institute, Fudan University(复旦大学人工智能创新与孵化研究院);Shanghai Academy of Artificial Intelligence for Science(上海人工智能科学研究院)
The task of localizing and categorizing objects in medical images often remains formulated as a semantic segmentation problem. This approach, however, only indirectly solves the coarse localization task by predicting pixel-level scores, requiring ad-hoc heuristics when mapping back to object-level scores. State-of-the-art object detectors on the other hand, allow for individual object scoring in an end-to-end fashion, while ironically trading in the ability to exploit the full pixel-wise supervision signal. This can be particularly disadvantageous in the setting of medical image analysis, wher…
EEMS: Edge-Prompt Enhanced Medical Image Segmentation Based on Learnable Gating Mechanism
School of Advanced Manufacturing, Guangdong University of Technology(广东技术大学先进制造学院);Department of Cardiology, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University, Guangzhou, China(广东省人民医院心内科(广东省医学科学院));College of Automation, Nanjing University of Posts and Telecommunications, Nanjing, China(南京邮电大学自动化学院)
Graz University of Technology(格拉茨工业大学);Ludwig Boltzmann Institute for Clinical Forensic Imaging(路德维希·玻尔兹曼临床法医成像研究所)
In many medical image analysis applications, often only a limited amount of training data is available, which makes training of convolutional neural networks (CNNs) challenging. In this work on anatomical landmark localization, we propose a CNN architecture that learns to split the localization task into two simpler sub-problems, reducing the need for large training datasets. Our fully convolutional SpatialConfiguration-Net (SCN) dedicates one component to locally accurate but ambiguous candidate predictions, while the other component improves robustness to ambiguities by incorporating the spa…
Diffusion-Based Data Augmentation for Medical Image Segmentation
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Dept. of Engineering for Innovation Medicine, University of Verona(威尼斯大学创新医学工程系)
A Text-Image Fusion Method with Data Augmentation Capabilities for Referring Medical Image Segmentation
College of Information Science and Engineering(信息科学与工程学院);Ritsumeikan University(立命馆大学);Tiwaki Co., Ltd.(Tiwaki公司);Dalian University of Technology(大连理工大学);School of Software(软件学院);Zhejiang University(浙江大学)
STPNet: Scale-aware Text Prompt Network for Medical Image Segmentation
Xiamen University(厦门大学);University of Washington(华盛顿大学);UT Southwestern Medical Center(西南大学医学中心);University of Hull(赫尔大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Univ Lyon(里昂大学);INSA‐Lyon(里昂国立应用科学学院);Université Claude Bernard Lyon 1(里昂第一大学);UJM-Saint Etienne(圣艾蒂安大学);CNRS(法国国家科学研究中心);Inserm(法国国家健康与医学研究院);CREATIS UMR 5220(CREATIS联合研究单位5220);U1206(U1206研究单位)
Semantic segmentation is an established while rapidly evolving field in medical imaging. In this paper we focus on the segmentation of brain Magnetic Resonance Images (MRI) into cerebral structures using convolutional neural networks (CNN). CNNs achieve good performance by finding effective high dimensional image features describing the patch content only. In this work, we propose different ways to introduce spatial constraints into the network to further reduce prediction inconsistencies. A patch based CNN architecture was trained, making use of multiple scales to gather contextual informatio…
In medical imaging, Class-Activation Map (CAM) serves as the main explainability tool by pointing to the region of interest. Since the localization accuracy from CAM is constrained by the resolution of the model's feature map, one may expect that segmentation models, which generally have large feature maps, would produce more accurate CAMs. However, we have found that this is not the case due to task mismatch. While segmentation models are developed for datasets with pixel-level annotation, only image-level annotation is available in most medical imaging datasets. Our experiments suggest that …
School of Electrical & Information Engineering, University of the Witwatersrand(威特沃特斯兰德大学电气与信息工程学院)
This paper presents deformable templates as a tool for segmentation and localization of biological structures in medical images. Structures are represented by a prototype template, combined with a parametric warp mapping used to deform the original shape. The localization procedure is achieved using a multi-stage, multi-resolution algorithm de-signed to reduce computational complexity and time. The algorithm initially identifies regions in the image most likely to contain the desired objects and then examines these regions at progressively increasing resolutions. The final stage of the algorit…
Localization of anatomical structures is a prerequisite for many tasks in medical image analysis. We propose a method for automatic localization of one or more anatomical structures in 3D medical images through detection of their presence in 2D image slices using a convolutional neural network (ConvNet). A single ConvNet is trained to detect presence of the anatomical structure of interest in axial, coronal, and sagittal slices extracted from a 3D image. To allow the ConvNet to analyze slices of different sizes, spatial pyramid pooling is applied. After detection, 3D bounding boxes are created…
Diagnostic imaging often requires the simultaneous identification of a multitude of findings of varied size and appearance. Beyond global indication of said findings, the prediction and display of localization information improves trust in and understanding of results when augmenting clinical workflow. Medical training data rarely includes more than global image-level labels as segmentations are time-consuming and expensive to collect. We introduce an approach to managing these practical constraints by applying a novel architecture which learns at multiple resolutions while generating saliency…
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Weill Cornell Medicine(威尔康奈尔医学院)
Deep neural networks (DNNs) have rapidly become a \textit{de facto} choice for medical image understanding tasks. However, DNNs are notoriously fragile to the class imbalance in image classification. We further point out that such imbalance fragility can be amplified when it comes to more sophisticated tasks such as pathology localization, as imbalances in such problems can have highly complex and often implicit forms of presence. For example, different pathology can have different sizes or colors (w.r.t.the background), different underlying demographic distributions, and in general different …
University of Electronic Science and Technology of China(电子科技大学);SenseTime Research(商汤科技研究院)
Deep learning networks have shown promising performance for accurate object localization in medial images, but require large amount of annotated data for supervised training, which is expensive and expertise burdensome. To address this problem, we present a one-shot framework for organ and landmark localization in volumetric medical images, which does not need any annotation during the training stage and could be employed to locate any landmarks or organs in test images given a support (reference) image during the inference stage. Our main idea comes from that tissues and organs from different…
Technical University of Munich(慕尼黑工业大学);Klinikum rechts der Isar(慕尼黑 Rechts der Isar 医院);University of Zurich(苏黎世大学)
Automatic localization and segmentation of organs-at-risk (OAR) in CT are essential pre-processing steps in medical image analysis tasks, such as radiation therapy planning. For instance, the segmentation of OAR surrounding tumors enables the maximization of radiation to the tumor area without compromising the healthy tissues. However, the current medical workflow requires manual delineation of OAR, which is prone to errors and is annotator-dependent. In this work, we aim to introduce a unified 3D pipeline for OAR localization-segmentation rather than novel localization or segmentation archite…
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);ETH Zurich(苏黎世联邦理工学院);Bogazici University(博阿齐奇大学);Louisiana State University(路易斯安那州立大学);University of Coimbra(科英布拉大学)
A reliable, real-time simultaneous localization and mapping (SLAM) method is crucial for the navigation of actively controlled capsule endoscopy robots. These robots are an emerging, minimally invasive diagnostic and therapeutic technology for use in the gastrointestinal (GI) tract. In this study, we propose a dense, non-rigidly deformable, and real-time map fusion approach for actively controlled endoscopic capsule robot applications. The method combines magnetic and vision based localization, and makes use of frame-to-model fusion and model-to-model loop closure. The performance of the metho…
School of Computing, University of Utah(犹他大学计算机学院);NVIDIA Corporation(英伟达公司);Department of Radiology and Imaging Sciences, National Institutes of Health Clinical Center(美国国立卫生研究院临床中心放射科与影像科学部);National Institutes of Health Clinical Center(美国国立卫生研究院临床中心);National Institutes of Health(美国国立卫生研究院)
Localization and characterization of diseases like pneumonia are primary steps in a clinical pipeline, facilitating detailed clinical diagnosis and subsequent treatment planning. Additionally, such location annotated datasets can provide a pathway for deep learning models to be used for downstream tasks. However, acquiring quality annotations is expensive on human resources and usually requires domain expertise. On the other hand, medical reports contain a plethora of information both about pneumonia characteristics and its location. In this paper, we propose a novel weakly-supervised attentio…
Localization Lens for Improving Medical Vision-Language Models
Lahore University of Management Sciences(拉合尔管理科学大学);The University of Western Australia(西澳大学);Information Technology University of the Punjab(旁遮普信息技术大学)
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Shiv Nadar University(希夫纳达尔大学);Georgia Institute of Technology(佐治亚理工学院);Massachusetts Institute of Technology(麻省理工学院)
Saliency maps have become a widely used method to make deep learning models more interpretable by providing post-hoc explanations of classifiers through identification of the most pertinent areas of the input medical image. They are increasingly being used in medical imaging to provide clinically plausible explanations for the decisions the neural network makes. However, the utility and robustness of these visualization maps has not yet been rigorously examined in the context of medical imaging. We posit that trustworthiness in this context requires 1) localization utility, 2) sensitivity to m…
Deploying the idea of long-term cumulative return, reinforcement learning has shown remarkable performance in various fields. We propose a formulation of the landmark localization in 3D medical images as a reinforcement learning problem. Whereas value-based methods have been widely used to solve similar problems, we adopt an actor-critic based direct policy search method framed in a temporal difference learning approach. Successful behavior learning is challenging in large state and/or action spaces, requiring many trials. We introduce a partial policy-based reinforcement learning to enable so…
Enhancing Medical Visual Grounding via Knowledge-guided Spatial Prompts
School of Computer Science and Engineering, Nanjing University of Science and Technology(南京理工大学计算机科学与工程学院);School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Yong Yoo Lin School of Medicine, National University of Singapore(新加坡国立大学杨潞龄医学院);Institute of High-Performance Computing, Agency for Science, Technology and Research(新加坡科技研究局高性能计算研究所)
Interpretability of deep learning (DL) systems is gaining attention in medical imaging to increase experts' trust in the obtained predictions and facilitate their integration in clinical settings. We propose a deep visualization method to generate interpretability of DL classification tasks in medical imaging by means of visual evidence augmentation. The proposed method iteratively unveils abnormalities based on the prediction of a classifier trained only with image-level labels. For each image, initial visual evidence of the prediction is extracted with a given visual attribution technique. T…
Recent advances of deep learning have achieved remarkable performances in various challenging computer vision tasks. Especially in object localization, deep convolutional neural networks outperform traditional approaches based on extraction of data/task-driven features instead of hand-crafted features. Although location information of region-of-interests (ROIs) gives good prior for object localization, it requires heavy annotation efforts from human resources. Thus a weakly supervised framework for object localization is introduced. The term "weakly" means that this framework only uses image-l…
Denoising Diffusion Models for Anomaly Localization in Medical Images
School of Computation, Information and Technology, Technical University of Munich(慕尼黑技术大学计算、信息与技术学院);Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich, Germany(生物医学影像机器学习研究所,海德堡慕尼黑德国);Department of Biomedical Engineering, University of Basel, Allschwil, Switzerland(巴塞尔大学生物医学工程系,瑞士Allschwil);School of Biomedical Engineering and Imaging Sciences, King’s College London, United Kingdom(伦敦国王学院生物医学工程与影像科学学院,英国);Department of Biomedical Informatics and Data Science, Yale University School of Medicine, New Haven, CT, USA(耶鲁大学医学院生物医学信息学与数据科学系,美国新罕布什尔州新 Haven);Yale Biomedical Imaging Institute, Yale University, New Haven, CT, USA(耶鲁大学生物医学影像研究院,美国新罕布什尔州新 Haven)
Robert Bosch GmbH(罗伯特·博世有限公司);TU Dortmund University(多特蒙德工业大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Convolutional neural networks (CNNs) show impressive performance for image classification and detection, extending heavily to the medical image domain. Nevertheless, medical experts are sceptical in these predictions as the nonlinear multilayer structure resulting in a classification outcome is not directly graspable. Recently, approaches have been shown which help the user to understand the discriminative regions within an image which are decisive for the CNN to conclude to a certain class. Although these approaches could help to build trust in the CNNs predictions, they are only slightly sho…
Athinoula A. Martinos Center for Biomedical Imaging(阿西诺拉·A·马蒂诺斯生物医学成像中心);Massachusetts General Hospital(麻省总医院);Arizona State University-Mayo Clinic Center for Innovative Imaging(亚利桑那州立大学-梅奥诊所创新成像中心);School of Computing, Informatics, and Decision Systems Engineering(计算、信息学与决策系统工程学院)
Saliency maps have become a widely used method to assess which areas of the input image are most pertinent to the prediction of a trained neural network. However, in the context of medical imaging, there is no study to our knowledge that has examined the efficacy of these techniques and quantified them using overlap with ground truth bounding boxes. In this work, we explored the credibility of the various existing saliency map methods on the RSNA Pneumonia dataset. We found that GradCAM was the most sensitive to model parameter and label randomization, and was highly agnostic to model architec…
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院);Weill Cornell Medicine(威尔康奈尔医学院)
Building a highly accurate predictive model for classification and localization of abnormalities in chest X-rays usually requires a large number of manually annotated labels and pixel regions (bounding boxes) of abnormalities. However, it is expensive to acquire such annotations, especially the bounding boxes. Recently, contrastive learning has shown strong promise in leveraging unlabeled natural images to produce highly generalizable and discriminative features. However, extending its power to the medical image domain is under-explored and highly non-trivial, since medical images are much les…
TWLR: Text-Guided Weakly-Supervised Lesion Localization and Severity Regression for Explainable Diabetic Retinopathy Grading
Guangdong Provincial Key Laboratory of Interdisciplinary Research and Application for Data Science(广东省级交叉学科研究与数据科学应用重点实验室);Department of Statistics and Data Science, Beijing Normal-Hong Kong Baptist University(北京师范大学-香港 Baptist大学统计与数据科学系);Faculty of Science, Hong Kong Baptist University(香港 Baptist大学科学学院);Data Science Research Center, Duke Kunshan University(杜克-昆山大学数据科学研究中心);Shanxi Provincial People’s Hospital(山西人民医院);The Fifth Clinical Medical school of Shanxi Medical University(山西医科大学第五临床医学院);Research Center for Mathematics, Beijing Normal University(北京师范大学数学研究中心);Department of Mathematics and Statistics, York University(约克大学数学与统计学系)
The University of Texas at Austin(德克萨斯大学奥斯汀分校);Weill Cornell Medicine(威尔康奈尔医学院)
Chest X-ray becomes one of the most common medical diagnoses due to its noninvasiveness. The number of chest X-ray images has skyrocketed, but reading chest X-rays still have been manually performed by radiologists, which creates huge burnouts and delays. Traditionally, radiomics, as a subfield of radiology that can extract a large number of quantitative features from medical images, demonstrates its potential to facilitate medical imaging diagnosis before the deep learning era. In this paper, we develop an end-to-end framework, ChexRadiNet, that can utilize the radiomics features to improve t…