Acquiring large quantities of data and annotations is known to be effective for developing high-performing deep learning models, but is difficult and expensive to do in the healthcare context. Adding synthetic training data using generative models offers a low-cost method to deal effectively with the data scarcity challenge, and can also address data imbalance and patient privacy issues. In this study, we propose a comprehensive framework that fits seamlessly into model development workflows for medical image analysis. We demonstrate, with datasets of varying size, (i) the benefits of generative models as a data augmentation method; (ii) how adversarial methods can protect patient privacy via data substitution; (iii) novel performance metrics for these use cases by testing models on real holdout data. We show that training with both synthetic and real data outperforms training with real data alone, and that models trained solely with synthetic data approach their real-only counterparts. Code is available at https://github.com/Global-Health-Labs/US-DCGAN.
Universidad Nacional Mayor de San Marcos（圣马科斯国立大学）；Universidad Nacional de Ingeniería（国立工程大学）
The COVID-19 pandemic started in China in December 2019 and quickly spread to several countries. The consequences of this pandemic are incalculable, causing the death of millions of people and damaging the global economy. To achieve large-scale control of this pandemic, fast tools for detection and treatment of patients are needed. Thus, the demand for alternative tools for the diagnosis of COVID-19 has increased dramatically since accurated and automated tools are not available. In this paper we present the ongoing work on a system for COVID-19 detection using ultrasound imaging and using Dee…
The University of Sydney（悉尼大学）；University of California San Diego（加州大学圣地亚哥分校）
Ultrasound is progressing toward becoming an affordable and versatile solution to medical imaging. With the advent of COVID-19 global pandemic, there is a need to fully automate ultrasound imaging as it requires trained operators in close proximity to patients for a long period of time, therefore increasing risk of infection. In this work, we investigate the important yet seldom-studied problem of scan target localization, under the setting of lung ultrasound imaging. We propose a purely vision-based, data driven method that incorporates learning-based computer vision techniques. We combine a …
Indian Institute of Technology Palakkad（印度理工学院帕拉卡德分校）；Hospital Universitario Puerta de Hierro（普埃尔塔·德·耶罗大学医院）；Sree Chitra Tirunal Institute for Medical Sciences & Technology（斯里·奇特拉·蒂鲁纳尔医学科学与技术研究所）；Government Medical College Thiruvananthapuram（特里凡得琅政府医学院）
Lung ultrasound (LUS) is possibly the only medical imaging modality which could be used for continuous and periodic monitoring of the lung. This is extremely useful in tracking the lung manifestations either during the onset of lung infection or to track the effect of vaccination on lung as in pandemics such as COVID-19. There have been many attempts in automating the classification of severity of lung into various classes or automatic segmentation of various LUS landmarks and manifestations. However, all these approaches are based on training static machine learning models which require a sig…
ETH Zurich（苏黎世联邦理工学院）；Clinique des Grangettes（格兰奇诊所）；Biomedical Research Institute August Pi i Sunyer（奥古斯特·皮·苏涅尔生物医学研究所）；Technische Universität München（慕尼黑工业大学）
With the rapid development of COVID-19 into a global pandemic, there is an ever more urgent need for cheap, fast and reliable tools that can assist physicians in diagnosing COVID-19. Medical imaging such as CT can take a key role in complementing conventional diagnostic tools from molecular biology, and, using deep learning techniques, several automatic systems were demonstrated promising performances using CT or X-ray data. Here, we advocate a more prominent role of point-of-care ultrasound imaging to guide COVID-19 detection. Ultrasound is non-invasive and ubiquitous in medical facilities ar…
Ultrasound-Based AI for COVID-19 Detection: A Comprehensive Review of Public and Private Lung Ultrasound Datasets and Studies
Ahsanullah University of Science and Technology（阿赫桑乌拉科技大学）；Daffodil International University（水仙花国际大学）；Khulna University of Engineering & Technology（库尔纳工程技术大学）；Okinawa Institute of Science and Technology Graduate University（冲绳科学技术大学院大学）；Bangladesh University of Professionals（孟加拉国国防大学）；Comilla University（库米拉大学）；University of Dhaka（达卡大学）；International Islamic University Chittagong（吉大港国际伊斯兰大学）
We propose a three-dimensional (3D) multimodal medical imaging system that combines freehand ultrasound and structured light 3D reconstruction in a single coordinate system without requiring registration. To the best of our knowledge, these techniques have not been combined before as a multimodal imaging technique. The system complements the internal 3D information acquired with ultrasound, with the external surface measured with the structure light technique. Moreover, the ultrasound probe's optical tracking for pose estimation was implemented based on a convolutional neural network. Experime…
Indian Institute of Technology Palakkad（印度理工学院帕拉卡德分校）；University of Alberta（阿尔伯塔大学）；Hospital Universitario Puerta de Hierro（铁门大学医院）；Government Medical College Thiruvananthapuram（特里凡得琅政府医学院）；Sree Chitra Tirunal Institute for Medical Sciences & Technology（斯里奇特拉蒂鲁纳尔医学科学与技术研究所）
Most applications of deep learning techniques in medical imaging are supervised and require a large number of labeled data which is expensive and requires many hours of careful annotation by experts. In this paper, we propose an unsupervised, physics driven domain specific transporter framework with an attention mechanism to identify relevant key points with applications in ultrasound imaging. The proposed framework identifies key points that provide a concise geometric representation highlighting regions with high structural variation in ultrasound videos. We incorporate physics driven domain…
A CT Image Classification Network Framework for Lung Tumors Based on Pre-trained MobileNetV2 Model and Transfer learning, And Its Application and Market Analysis in the Medical field
Indian Institute of Technology（印度理工学院）；University of Alberta（阿尔伯塔大学）；Hospital Universitario Puerta de Hierro（普埃塔德耶罗大学医院）；Government Medical College（政府医学院）；Sree Chitra Tirunal Institute of Medical Sciences and Technology（斯里奇特拉图鲁纳尔医学科学与技术研究所）；Bhagwan Mahaveer Jain Hospital（巴格万马哈维尔耆那医院）
The COVID-19 pandemic has highlighted the need for a tool to speed up triage in ultrasound scans and provide clinicians with fast access to relevant information. The proposed video-summarization technique is a step in this direction that provides clinicians access to relevant key-frames from a given ultrasound scan (such as lung ultrasound) while reducing resource, storage and bandwidth requirements. We propose a new unsupervised reinforcement learning (RL) framework with novel rewards that facilitates unsupervised learning avoiding tedious and impractical manual labelling for summarizing ultr…
Medical Artificial Intelligence for Early Detection of Lung Cancer: A Survey
College of Computer Science and Artificial Intelligence, Southwest Minzu University, Chengdu, 610225, China（计算机科学与人工智能学院，西南民族大学）；The Australian National University, Canberra ACT 2601, Australia（澳大利亚国立大学）；School of Computer Science and Technology, Beijing Jiaotong University, Beijing, China（计算机科学与技术学校，北京交通大学）；Hunan university of technology, Zhuzhou, 410072, China（湖南理工大学）；University of Adelaide, Adelaide, South Australia 5005, Australia（阿德莱德大学）；La Trobe University, Melbourne, Victoria 3086, Australia（拉筹伯大学）
Universidad Nacional Mayor de San Marcos（圣马科斯国立大学）；Universidad Nacional de Ingeniería（国立工程大学）
The new coronavirus 2019 (COVID-2019) has rapidly become a pandemic and has had a devastating effect on both everyday life, public health and the global economy. It is critical to detect positive cases as early as possible to prevent the further spread of this epidemic and to treat affected patients quickly. The need for auxiliary diagnostic tools has increased as accurate automated tool kits are not available. This paper presents a work in progress that proposes the analysis of images of lung ultrasound scans using a convolutional neural network. The trained model will be used on a Raspberry …
In recent years, the prevalence of several pulmonary diseases, especially the coronavirus disease 2019 (COVID-19) pandemic, has attracted worldwide attention. These diseases can be effectively diagnosed and treated with the help of lung imaging. With the development of deep learning technology and the emergence of many public medical image datasets, the diagnosis of lung diseases via medical imaging has been further improved. This article reviews pulmonary CT and X-ray image detection and classification in the last decade. It also provides an overview of the detection of lung nodules, pneumoni…
This paper addresses the problem of high-resolution Doppler blood flow estimation from an ultrafast sequence of ultrasound images. Formulating the separation of clutter and blood components as an inverse problem has been shown in the literature to be a good alternative to spatio-temporal singular value decomposition (SVD)-based clutter filtering. In particular, a deconvolution step has recently been embedded in such a problem to mitigate the influence of the experimentally measured point spread function (PSF) of the imaging system. Deconvolution was shown in this context to improve the accurac…
Classification based deep learning models for lung cancer and disease using medical images
Laboratory for Artificial Intelligence of Personalized Medicine, School of Artificial Intelligence, Guilin University of Electronic Technology（人工智能个性化医学实验室，人工智能学院，桂林电子科技大学）；The Laboratory for Imagery, Vision and Artificial Intelligence, Ecole de Technologie Superieure（影像、视觉与人工智能实验室，蒙特利尔理工学院）
University of Technology Sydney（悉尼科技大学）；University of Sydney（悉尼大学）；Australian Artificial Intelligence Institute（澳大利亚人工智能研究所）
Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied extensively in many real-world applications, including health sectors such as medical image interpretation and disease diagnosis. By combining more modalities that being engaged in the processing of information, multimodal learning can extract better features and improve predictive ability. The conventional methods for lung cancer survival analysis normally utilize c…
ZACH-ViT: A Zero-Token Vision Transformer with ShuffleStrides Data Augmentation for Robust Lung Ultrasound Classification
Amsterdam UMC, University of Amsterdam, The Netherlands（阿姆斯特丹大学医学中心，阿姆斯特丹大学，荷兰）；Data Science Center, University of Amsterdam, The Netherlands（数据科学中心，阿姆斯特丹大学，荷兰）；Department of Intensive Care Medicine, Amsterdam UMC, University of Amsterdam & Vrije Universiteit Amsterdam, The Netherlands（重症医学科，阿姆斯特丹大学医学中心，阿姆斯特丹大学及自由大学，荷兰）
Vision Models for Medical Imaging: A Hybrid Approach for PCOS Detection from Ultrasound Scans
Department of CSE, CCN University of Science & Technology（计算机科学与工程系，CCN科学与技术大学）；Department of EEE,International Islamic University Chittagong（电子工程系，国际伊斯兰大学恰tagong分校）；Faculty of Engineering, Multimedia University（工程学院，多媒体大学）；Department of CSE, Stamford University of Bangladesh（计算机科学与工程系，斯塔福德大学孟加拉国分校）；Department of Biology, Lucknow University（生物学系，拉胡尔大学）；Department of CSE, Bangladesh Army International University of Science & Technology（计算机科学与工程系，孟加拉国军队国际科学与技术大学）
Cochin University of Science and Technology（科钦科技大学）；Indian Institute of Technology Palakkad（帕拉卡德印度理工学院）
In the recent past with the rapid surge of COVID-19 infections, lung ultrasound has emerged as a fast and powerful diagnostic tool particularly for continuous and periodic monitoring of the lung. There have been many attempts towards severity classification, segmentation and detection of key landmarks in the lung. Leveraging the progress, an automated lung ultrasound video analysis package is presented in this work, which can provide summary of key frames in the video, flagging of the key frames with lung infection and options to automatically detect and segment the lung landmarks. The integra…
The Efficacy of Semantics-Preserving Transformations in Self-Supervised Learning for Medical Ultrasound
Cheriton School of Computer Science, University of Waterloo（滑铁卢大学计算机科学学院）；Department of Systems Design Engineering, University of Waterloo（滑铁卢大学系统设计工程系）；Schulich School of Medicine and Dentistry, Western University（西部大学施乐希医学与牙科学校）
James A. Haley Veterans’ Hospital（詹姆斯·A·黑利退伍军人医院）；University of South Florida（南佛罗里达大学）；Moffitt Cancer Center（莫菲特癌症中心）
The field of Machine Learning, a subset of Artificial Intelligence, has led to remarkable advancements in many areas, including medicine. Machine Learning algorithms require large datasets to train computer models successfully. Although there are medical image datasets available, more image datasets are needed from a variety of medical entities, especially cancer pathology. Even more scarce are ML-ready image datasets. To address this need, we created an image dataset (LC25000) with 25,000 color images in 5 classes. Each class contains 5,000 images of the following histologic entities: colon a…
COVIDx-US -- An open-access benchmark dataset of ultrasound imaging data for AI-driven COVID-19 analytics
National Research Council Canada（加拿大国家研究委员会）；University of Waterloo（滑铁卢大学）；Waterloo Artificial Intelligence Institute（滑铁卢人工智能研究所）；Oakville Trafalgar Memorial Hospital（奥克维尔特拉法加纪念医院）；McMaster University（麦克马斯特大学）
Fondazione Bruno Kessler（布鲁诺·凯斯勒基金会）；IBM Research-Almaden（IBM阿尔马登研究中心）
B-mode ultrasound imaging is a popular medical imaging technique. Like other image processing tasks, deep learning has been used for analysis of B-mode ultrasound images in the last few years. However, training deep learning models requires large labeled datasets, which is often unavailable for ultrasound images. The lack of large labeled data is a bottleneck for the use of deep learning in ultrasound image analysis. To overcome this challenge, in this work we exploit Auxiliary Classifier Generative Adversarial Network (ACGAN) that combines the benefits of data augmentation and transfer learni…
University of Oxford（牛津大学）；Tel-Aviv University（特拉维夫大学）
Self-supervised contrastive representation learning offers the advantage of learning meaningful visual representations from unlabeled medical datasets for transfer learning. However, applying current contrastive learning approaches to medical data without considering its domain-specific anatomical characteristics may lead to visual representations that are inconsistent in appearance and semantics. In this paper, we propose to improve visual representations of medical images via anatomy-aware contrastive learning (AWCL), which incorporates anatomy information to augment the positive/negative pa…
IRIT UMR CNRS 5505（法国国家科学研究中心IRIT联合研究单元（UMR 5505））；University of Toulouse（图卢兹大学）
The interest of compressive sampling in ultrasound imaging has been recently extensively evaluated by several research teams. Following the different application setups, it has been shown that the RF data may be reconstructed from a small number of measurements and/or using a reduced number of ultrasound pulse emissions. Nevertheless, RF image spatial resolution, contrast and signal to noise ratio are affected by the limited bandwidth of the imaging transducer and the physical phenomenon related to US wave propagation. To overcome these limitations, several deconvolution-based image processing…
A Labeled Ophthalmic Ultrasound Dataset with Medical Report Generation Based on Cross-modal Deep Learning
School of Electrical and Control Engineering, North China University of Technology（北方工业大学电气与控制工程学院）；School of Automation and Electrical Engineering, Shenyang Ligong University（沈阳理工大学自动化与电气工程学院）；The Fourth Affiliated Hospital of China Medical University（中国医科大学附属第四医院）
Recent advances in deep learning have achieved promising performance for medical image analysis, while in most cases ground-truth annotations from human experts are necessary to train the deep model. In practice, such annotations are expensive to collect and can be scarce for medical imaging applications. Therefore, there is significant interest in learning representations from unlabelled raw data. In this paper, we propose a self-supervised learning approach to learn meaningful and transferable representations from medical imaging video without any type of human annotation. We assume that in …
Universitat Rovira i Virgili（罗维拉-威尔吉利大学）；University of Cagliari（卡利亚里大学）
In this paper, we examine the strength of deep learning technique for diagnosing lung cancer on medical image analysis problem. Convolutional neural networks (CNNs) models become popular among the pattern recognition and computer vision research area because of their promising outcome on generating high-level image representations. We propose a new deep learning architecture for learning high-level image representation to achieve high classification accuracy with low variance in medical image binary classification tasks. We aim to learn discriminant compact features at beginning of our deep co…
Beamforming in ultrasound imaging has significant impact on the quality of the final image, controlling its resolution and contrast. Despite its low spatial resolution and contrast, delay-and-sum is still extensively used nowadays in clinical applications, due to its real-time capabilities. The most common alternatives are minimum variance method and its variants, which overcome the drawbacks of delay-and-sum, at the cost of higher computational complexity that limits its utilization in real-time applications. In this paper, we propose to perform beamforming in ultrasound imaging through a reg…
Using Few-Shot Learning to Classify Primary Lung Cancer and Other Malignancy with Lung Metastasis in Cytological Imaging via Endobronchial Ultrasound Procedures
National Yang Ming Chiao Tung University（阳明交通大学）；National Taiwan University Cancer Center（台湾大学医学院附设癌医中心医院）；National Taiwan University Hospital（台湾大学医学院附设医院）；National Taiwan University Hsin-Chu Hospital（台湾大学医学院附设新竹医院）
Deep learning models with large learning capacities often overfit to medical imaging datasets. This is because training sets are often relatively small due to the significant time and financial costs incurred in medical data acquisition and labelling. Data augmentation is therefore often used to expand the availability of training data and to increase generalization. However, augmentation strategies are often chosen on an ad-hoc basis without justification. In this paper, we present an augmentation policy search method with the goal of improving model classification performance. We include in …
Vanderbilt University（范德堡大学）；Vanderbilt University Medical Center（范德堡大学医学中心）
Features learned from single radiologic images are unable to provide information about whether and how much a lesion may be changing over time. Time-dependent features computed from repeated images can capture those changes and help identify malignant lesions by their temporal behavior. However, longitudinal medical imaging presents the unique challenge of sparse, irregular time intervals in data acquisition. While self-attention has been shown to be a versatile and efficient learning mechanism for time series and natural images, its potential for interpreting temporal distance between sparse,…
Melbourne Data Analytics Platform（墨尔本数据分析平台）；University of Melbourne（墨尔本大学）
Improving automated analysis of medical imaging will provide clinicians more options in providing care for patients. The 2023 AI-enabled Medical Image Analysis Workshop and Covid-19 Diagnosis Competition (AI-MIA-COV19D) provides an opportunity to test and refine machine learning methods for detecting the presence and severity of COVID-19 in patients from CT scans. This paper presents version 2 of Cov3d, a deep learning model submitted in the 2022 competition. The model has been improved through a preprocessing step which segments the lungs in the CT scan and crops the input to this region. It …
In this work we present a method for lung nodules segmentation, their texture classification and subsequent follow-up recommendation from the CT image of lung. Our method consists of neural network model based on popular U-Net architecture family but modified for the joint nodule segmentation and its texture classification tasks and an ensemble-based model for the follow-up recommendation. This solution was evaluated within the LNDb medical imaging challenge and produced the best nodule segmentation result on the final leaderboard.
Though large-scale datasets are essential for training deep learning systems, it is expensive to scale up the collection of medical imaging datasets. Synthesizing the objects of interests, such as lung nodules, in medical images based on the distribution of annotated datasets can be helpful for improving the supervised learning tasks, especially when the datasets are limited by size and class balance. In this paper, we propose the class-aware adversarial synthesis framework to synthesize lung nodules in CT images. The framework is built with a coarse-to-fine patch in-painter (generator) and tw…
Small Lesions-aware Bidirectional Multimodal Multiscale Fusion Network for Lung Disease Classification
Xidian University（西安电子科技大学）；Hangzhou Dianzi University（杭州电子科技大学）；Zhejiang College of Security Technology, School of Artificial Intelligence（浙江安全技术学院人工智能学院）；Shenzhen Polytechnic University（深圳职业技术学院）；Shenzhen University（深圳大学）；Shenzhen Research Institute of Big Data（深圳大数据研究院）
School of Professional Studies（专业研究学院）；Northwestern University（西北大学）
Artificial intelligence (AI) is disrupting the medical field as advances in modern technology allow common household computers to learn anatomical and pathological features that distinguish between healthy and disease with the accuracy of highly specialized, trained physicians. Computer vision AI applications use medical imaging, such as lung chest X-Rays (LCXRs), to facilitate diagnoses by providing second-opinions in addition to a physician's or radiologist's interpretation. Considering the advent of the current Coronavirus disease (COVID-19) pandemic, LCXRs may provide rapid insights to ind…
This review presents a comprehensive study on the role of GANs in addressing the challenges related to COVID-19 data scarcity and diagnosis. It is the first review that summarizes the different GANs methods and the lungs images datasets for COVID-19. It attempts to answer the questions related to applications of GANs, popular GAN architectures, frequently used image modalities, and the availability of source code. This review included 57 full-text studies that reported the use of GANs for different applications in COVID-19 lungs images data. Most of the studies (n=42) used GANs for data augmen…
Robotics Institute and Department of ECE, Carnegie Mellon University（卡内基梅隆大学机器人研究所与电子与计算机工程系）；Dept. of Pulmonary and Critical Care Medicine, Louisiana State University（路易斯安那州立大学肺病与危重症医学科）；Cosmeticsurg.net, LLC（Cosmeticsurg.net有限责任公司）
In this paper, we study the significance of the pleura and adipose tissue in lung ultrasound AI analysis. We highlight their more prominent appearance when using high-frequency linear (HFL) instead of curvilinear ultrasound probes, showing HFL reveals better pleura detail. We compare the diagnostic utility of the pleura and adipose tissue using an HFL ultrasound probe. Masking the adipose tissue during training and inference (while retaining the pleural line and Merlin's space artifacts such as A-lines and B-lines) improved the AI model's diagnostic accuracy.
Video is an essential imaging modality for diagnostics, e.g. in ultrasound imaging, for endoscopy, or movement assessment. However, video hasn't received a lot of attention in the medical image analysis community. In the clinical practice, it is challenging to utilise raw diagnostic video data efficiently as video data takes a long time to process, annotate or audit. In this paper we introduce a novel, fully automatic video summarization method that is tailored to the needs of medical video data. Our approach is framed as reinforcement learning problem and produces agents focusing on the prese…
King’s College London（伦敦国王学院）；Oxford University Clinical Research Unit（牛津大学临床研究组）；Mahidol Oxford Research Unit（玛希隆牛津研究组）
Lung ultrasound (LUS) imaging is becoming popular in the intensive care units (ICU) for assessing lung abnormalities such as the appearance of B-line artefacts as a result of severe dengue. These artefacts appear in the LUS images and disappear quickly, making their manual detection very challenging. They also extend radially following the propagation of the sound waves. As a result, we hypothesize that a polar representation may be more adequate for automatic image analysis of these images. This paper presents an attention-based Convolutional+LSTM model to automatically detect B-lines in LUS …
Southern Methodist University（南卫理公会大学）；University of Texas at Dallas（德克萨斯大学达拉斯分校）；University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心）
Tumor shape is a key factor that affects tumor growth and metastasis. This paper proposes a topological feature computed by persistent homology to characterize tumor progression from digital pathology and radiology images and examines its effect on the time-to-event data. The proposed topological features are invariant to scale-preserving transformation and can summarize various tumor shape patterns. The topological features are represented in functional space and used as functional predictors in a functional Cox proportional hazards model. The proposed model enables interpretable inference ab…
Columbia University（哥伦比亚大学）；Columbia University Medical Center（哥伦比亚大学医学中心）；University of Iowa（爱荷华大学）
Unsupervised learning-based medical image registration approaches have witnessed rapid development in recent years. We propose to revisit a commonly ignored while simple and well-established principle: recursive refinement of deformation vector fields across scales. We introduce a recursive refinement network (RRN) for unsupervised medical image registration, to extract multi-scale features, construct normalized local cost correlation volume and recursively refine volumetric deformation vector fields. RRN achieves state of the art performance for 3D registration of expiratory-inspiratory pairs…
The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；Institute of Information Engineering, Chinese Academy of Sciences（中国科学院信息工程研究所）；Shenzhen Research Institute of Big Data（深圳大数据研究院）
Well-annotated medical datasets enable deep neural networks (DNNs) to gain strong power in extracting lesion-related features. Building such large and well-designed medical datasets is costly due to the need for high-level expertise. Model pre-training based on ImageNet is a common practice to gain better generalization when the data amount is limited. However, it suffers from the domain gap between natural and medical images. In this work, we pre-train DNNs on ultrasound (US) domains instead of ImageNet to reduce the domain gap in medical US applications. To learn US image representations bas…
Microsoft Research（微软研究院）；TuSimple（图森未来）；Baidu Research（百度研究院）；Tencent Medical AI Labs（腾讯医疗AI实验室）；PingAn Tech（平安科技）
Medical imaging is an essential tool in many areas of medical applications, used for both diagnosis and treatment. However, reading medical images and making diagnosis or treatment recommendations require specially trained medical specialists. The current practice of reading medical images is labor-intensive, time-consuming, costly, and error-prone. It would be more desirable to have a computer-aided system that can automatically make diagnosis and treatment recommendations. Recent advances in deep learning enable us to rethink the ways of clinician diagnosis based on medical images. In this t…
Deformable registration continues to be one of the key challenges in medical image analysis. While iconic registration methods have started to benefit from the recent advances in medical deep learning, the same does not yet apply for the registration of point sets, e.g. registration based on surfaces, keypoints or landmarks. This is mainly due to the restriction of the convolution operator in modern CNNs to densely gridded input. However, with the newly developed methods from the field of geometric deep learning suitable tools are now emerging, which enable powerful analysis of medical data on…
Indian Institute of Technology Palakkad（帕拉卡德印度理工学院）；La Paz Hospital（拉巴斯医院）；Government Medical College Thiruvananthapuram（特里凡得琅医学院）
Lung ultrasound (LUS) is an increasingly popular diagnostic imaging modality for continuous and periodic monitoring of lung infection, given its advantages of non-invasiveness, non-ionizing nature, portability and easy disinfection. The major landmarks assessed by clinicians for triaging using LUS are pleura, A and B lines. There have been many efforts for the automatic detection of these landmarks. However, restricting to a few pre-defined landmarks may not reveal the actual imaging biomarkers particularly in case of new pathologies like COVID-19. Rather, the identification of key landmarks s…
Carnegie Mellon University（卡内基梅隆大学）；University of Pittsburgh Medical Center（匹兹堡大学医学中心）；Louisiana State University（路易斯安那州立大学）；Cosmeticsurg.net, LLC（Cosmeticsurg.net有限责任公司）
We propose using a pre-trained segmentation model to perform diagnostic classification in order to achieve better generalization and interpretability, terming the technique reverse-transfer learning. We present an architecture to convert segmentation models to classification models. We compare and contrast dense vs sparse segmentation labeling and study its impact on diagnostic classification. We compare the performance of U-Net trained with dense and sparse labels to segment A-lines, B-lines, and Pleural lines on a custom dataset of lung ultrasound scans from 4 patients. Our experiments show …
