Medical image analysis suffers from a lack of labeled data due to several challenges including patient privacy and lack of experts. Although some AI models only perform well with large amounts of data, we will move to data augmentation where there is a solution to improve the performance of our models and increase the dataset size through traditional or advanced techniques. In this paper, we evaluate the effectiveness of data augmentation techniques on two different medical image datasets. In the first step, we applied some transformation techniques to the skin cancer dataset containing benign and malignant classes. Then, we trained the convolutional neural network (CNN) on the dataset before and after augmentation, which significantly improved test accuracy from 90.74% to 96.88% and decreased test loss from 0.7921 to 0.1468 after augmentation. In the second step, we used the Mixup technique by mixing two random images and their corresponding masks using the retina and blood vessels dataset, then we trained the U-net model and obtained the Dice coefficient which increased from 0 before augmentation to 0.4163 after augmentation. The result shows the effect of using data augmentation to increase the dataset size on the classification and segmentation performance.
Enhancing Medical Imaging with GANs Synthesizing Realistic Images from Limited Data
Columbia University（哥伦比亚大学）；Texas Tech University（德克萨斯理工大学）；University of California, Davis（加利福尼亚大学戴维斯分校）；Johns Hopkins University（约翰斯·霍普金斯大学）；North Carolina State University（北卡罗来纳州立大学）
Although supervised deep-learning has achieved promising performance in medical image segmentation, many methods cannot generalize well on unseen data, limiting their real-world applicability. To address this problem, we propose a deep learning-based Bayesian framework, which jointly models image and label statistics, utilizing the domain-irrelevant contour of a medical image for segmentation. Specifically, we first decompose an image into components of contour and basis. Then, we model the expected label as a variable only related to the contour. Finally, we develop a variational Bayesian fra…
Enhancing Multimodal Medical Image Classification using Cross-Graph Modal Contrastive Learning
Department of Systems Engineering, Stevens Institute of Technology, Hoboken, New Jersey, USA（系统工程系，史蒂文斯理工学院）；Department of Nuclear Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan（高雄长庚纪念医院核医学部）；Institute of Statistics, National University of Kaohsiung, Kaohsiung, Taiwan（国立高雄大学统计研究所）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China（深圳先进技术研究院，中国科学院）
Enhancing Transfer Learning for Medical Image Classification with SMOTE: A Comparative Study
University of Dhaka（达卡大学）；Utah State University（犹他州立大学）；Noakhali Science and Technology University（诺阿卡利科学技术大学）；Daffodil International University（水仙花国际大学）
The visual analysis of retina and of its vascular characteristics is important in the diagnosis and monitoring of diseases of visual perception. In the related medical diagnoses, the digital processing of the fundus images is used to obtain the segmentation of retinal vessels. However, an image segmentation is often requiring methods based on peculiar or complex algorithms: in this paper we will show some alternative approaches obtained by applying freely available tools to enhance, without a specific segmentation, the images of the fundus of the eye. We will see in particular, that combining …
Enhancing Network Initialization for Medical AI Models Using Large-Scale, Unlabeled Natural Images
University Hospital RWTH Aachen（亚琛工业大学附属医院）；Technische Universität Dresden（德累斯顿工业大学）；University Hospital Carl Gustav Carus Dresden（德累斯顿卡尔·古斯塔夫·卡鲁斯大学医院）；Else Kröner Fresenius Center for Digital Health（Else Kröner Fresenius 数字健康中心）；University Hospital Heidelberg（海德堡大学医院）；National Center for Tumor Diseases（国家肿瘤疾病中心）
Enhancing Global Sensitivity and Uncertainty Quantification in Medical Image Reconstruction with Monte Carlo Arbitrary-Masked Mamba
Imperial College London（帝国理工学院）；Royal Brompton Hospital（皇家布朗普顿医院）；College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics（南京航空航天大学计算机科学与技术学院）；School of Biomedical Engineering, Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区生物医学工程学院）；Human Phenome Institute, Fudan University（复旦大学人类表型组研究院）；Inselspital, University of Bern（伯尔尼大学因塞尔医院）；Technical University of Munich（慕尼黑工业大学）
VinBigData JSC（VinBigData股份公司）；VinUniversity（VinUniversity（温纳大学））；VinUni-Illinois Smart Health Center（VinUni-伊利诺伊智慧健康中心）
Building an accurate computer-aided diagnosis system based on data-driven approaches requires a large amount of high-quality labeled data. In medical imaging analysis, multiple expert annotators often produce subjective estimates about "ground truth labels" during the annotation process, depending on their expertise and experience. As a result, the labeled data may contain a variety of human biases with a high rate of disagreement among annotators, which significantly affect the performance of supervised machine learning algorithms. To tackle this challenge, we propose a simple yet effective a…
the University of Sydney（悉尼大学）；Royal Prince Alfred Hospital（皇家阿尔弗雷德王子医院）；Shanghai Jiao Tong University（上海交通大学）
Deformable image registration is fundamental for many medical image analyses. A key obstacle for accurate image registration lies in image appearance variations such as the variations in texture, intensities, and noise. These variations are readily apparent in medical images, especially in brain images where registration is frequently used. Recently, deep learning-based registration methods (DLRs), using deep neural networks, have shown computational efficiency that is several orders of magnitude faster than traditional optimization-based registration methods (ORs). DLRs rely on a globally opt…
When Eye-Tracking Meets Machine Learning: A Systematic Review on Applications in Medical Image Analysis
Macquarie University（麦考瑞大学）；Macquarie Medical School（麦考瑞医学院）；Faculty of Medicine, Health and Human Sciences（医学与健康科学学院）；School of Computing（计算机学院）；Faculty of Science and Engineering（科学与工程学院）；Centre for Health Informatics（健康信息学中心）；Australian Institute of Health Innovation（澳大利亚健康创新研究院）
Enhancing medical vision-language contrastive learning via inter-matching relation modelling
the University of Sydney（悉尼大学）；Royal Prince Alfred Hospital（皇家阿尔弗雷德王子医院）；Shanghai Jiao Tong University（上海交通大学）；Institute of Translational Medicine（转化医学研究院）
SAM2-SGP: Enhancing SAM2 for Medical Image Segmentation via Support-Set Guided Prompting
J. Crayton Pruitt Family Department of Biomedical Engineering University of Florida；Department of Electrical \& Computer Engineering University of Florida
Modality-Projection Universal Model for Comprehensive Full-Body Medical Imaging Segmentation
the Institute of Medical Technology and National Biomedical Imaging Center, Peking University（北京大学医学技术研究所暨国家生物医学成像中心）；The First Affiliated Hospital of Shandong First Medical University & Shandong Provincial Qianfoshan Hospital（山东第一医科大学第一附属医院暨山东省千佛山医院）；Peking University Third Hospital（北京大学第三医院）；Guangdong Provincial People’s Hospital（广东省人民医院）；Peking University Cancer Hospital & Institute（北京大学肿瘤医院暨肿瘤研究所）
Enhancing Chest X-ray Classification through Knowledge Injection in Cross-Modality Learning
Zhejiang University（浙江大学）；School of Engineering, Westlake University（西湖大学工程学院）；Westlake University Research Center for Industries of the Future（西湖大学未来产业研究中心）；The Second Affiliated Hospital Zhejiang University School of Medicine (SAHZU)（浙江大学医学院附属第二医院）；Google Developer Relations Team（谷歌开发者关系团队）
Jet Propulsion Laboratory, California Institute of Technology（加州理工学院喷气推进实验室）；Carnegie Mellon University（卡内基梅隆大学）
Thermal infrared cameras are increasingly being used in various applications such as robot vision, industrial inspection and medical imaging, thanks to their improved resolution and portability. However, the performance of traditional computer vision techniques developed for electro-optical imagery does not directly translate to the thermal domain due to two major reasons: these algorithms require photometric assumptions to hold, and methods for photometric calibration of RGB cameras cannot be applied to thermal-infrared cameras due to difference in data acquisition and sensor phenomenology. I…
Enhancing Representation in Radiography-Reports Foundation Model: A Granular Alignment Algorithm Using Masked Contrastive Learning
Paul C. Lauterbur Research Center for Biomedical Imaging（保罗·C·劳特伯生物医学成像研究中心）；Shenzhen Institute of Advanced Technology（深圳先进技术研究院）；Pengcheng Laboratory（鹏城实验室）；University of Chinese Academy of Sciences（中国科学院大学）；Harvard University（哈佛大学）；Shanghai AI Lab（上海人工智能实验室）
University of Porto（波尔图大学）；INESC TEC（葡萄牙系统与计算机工程研究所）
The use of Deep Learning in the medical field is hindered by the lack of interpretability. Case-based interpretability strategies can provide intuitive explanations for deep learning models' decisions, thus, enhancing trust. However, the resulting explanations threaten patient privacy, motivating the development of privacy-preserving methods compatible with the specifics of medical data. In this work, we analyze existing privacy-preserving methods and their respective capacity to anonymize medical data while preserving disease-related semantic features. We find that the PPRL-VGAN deep learning…
ETH Zürich（苏黎世联邦理工学院）；University Hospital Zürich（苏黎世大学医院）
Supervised deep learning relies on the assumption that enough training data is available, which presents a problem for its application to several fields, like medical imaging. On the example of a binary image classification task (breast cancer recognition), we show that pretraining a generative model for meaningful image augmentation helps enhance the performance of the resulting classifier. By augmenting the data, performance on downstream classification tasks could be improved even with a relatively small training set. We show that this "adversarial augmentation" yields promising results com…
Object segmentation plays an important role in the modern medical image analysis, which benefits clinical study, disease diagnosis, and surgery planning. Given the various modalities of medical images, the automated or semi-automated segmentation approaches have been used to identify and parse organs, bones, tumors, and other regions-of-interest (ROI). However, these contemporary segmentation approaches tend to fail to predict the boundary areas of ROI, because of the fuzzy appearance contrast caused during the imaging procedure. To further improve the segmentation quality of boundary areas, w…
The shapes and morphology of the organs and tissues are important prior knowledge in medical imaging recognition and segmentation. The morphological operation is a well-known method for morphological feature extraction. As the morphological operation is performed well in hand-crafted image segmentation techniques, it is also promising to design an approach to approximate morphological operation in the convolutional networks. However, using the traditional convolutional neural network as a black-box is usually hard to specify the morphological operation action. Here, we introduced a 3D morpholo…
Instituto de Investigación en Ingeniería de Aragón (I3A)（阿拉贡工程研究所（I3A））；Universidad de Zaragoza（萨拉戈萨大学）
Visual SLAM inside the human body will open the way to computer-assisted navigation in endoscopy. However, due to space limitations, medical endoscopes only provide monocular images, leading to systems lacking true scale. In this paper, we exploit the controlled lighting in colonoscopy to achieve the first in-vivo 3D reconstruction of the human colon using photometric stereo on a calibrated monocular endoscope. Our method works in a real medical environment, providing both a suitable in-place calibration procedure and a depth estimation technique adapted to the colon's tubular geometry. We val…
Enhancing and Adapting in the Clinic: Source-free Unsupervised Domain Adaptation for Medical Image Enhancement
Southern University of Science and Technology（南方科技大学）；Agency for Science, Technology and Research（新加坡科技研究局）；Beijing Information Science and Technology University（北京信息科技大学）；University of Science and Technology Beijing（北京科技大学）
ProjectedEx: Enhancing Generation in Explainable AI for Prostate Cancer
Flinders University（弗林德斯大学）；The University of Adelaide（阿德莱德大学）；The Australian National University（澳大利亚国立大学）；The University of Sydney（悉尼大学）；Zhejiang University of Technology（浙江工业大学）；Guangdong Technion – Israel Institute of Technology（广东以色列理工学院）；University of Chinese Academy of Sciences（中国科学院大学）；Rice University（莱斯大学）；Johns Hopkins University（约翰斯·霍普金斯大学）；The Pennsylvania State University（宾夕法尼亚州立大学）；La Trobe University（拉筹伯大学）
Tree-NET: Enhancing 2D Medical Image Segmentation Through Efficient Low-Level Feature Training
Abdullah Gul University（阿卜杜拉·居尔大学）；Hacettepe University（哈杰泰佩大学）；Gulf University for Science and Technology (GUST)（海湾科技大学）；GUST Engineering and Applied Innovation Research Center (GEAR)（GUST工程与应用创新研究中心）
