Spectral-Spatial Recurrent-Convolutional Networks for In-Vivo Hyperspectral Tumor Type Classification
Hamburg University of Technology（汉堡工业大学）；Carl von Ossietzky University Oldenburg（奥尔登堡大学）；University Medical Center Hamburg-Eppendorf（汉堡-埃彭多夫大学医学中心）；University of Bonn（波恩大学）；Klinikum Braunschweig（不伦瑞克医院）
Marcel Bengs, Nils Gessert, Wiebke Laffers, Dennis Eggert, Stephan Westermann, Nina A. Mueller, Andreas O. H. Gerstner, Christian Betz, Alexander Schlaefer
Early detection of cancerous tissue is crucial for long-term patient survival. In the head and neck region, a typical diagnostic procedure is an endoscopic intervention where a medical expert manually assesses tissue using RGB camera images. While healthy and tumor regions are generally easier to distinguish, differentiating benign and malignant tumors is very challenging. This requires an invasive biopsy, followed by histological evaluation for diagnosis. Also, during tumor resection, tumor margins need to be verified by histological analysis. To avoid unnecessary tissue resection, a non-invasive, image-based diagnostic tool would be very valuable. Recently, hyperspectral imaging paired with deep learning has been proposed for this task, demonstrating promising results on ex-vivo specimens. In this work, we demonstrate the feasibility of in-vivo tumor type classification using hyperspectral imaging and deep learning. We analyze the value of using multiple hyperspectral bands compared to conventional RGB images and we study several machine learning models' ability to make use of the additional spectral information. Based on our insights, we address spectral and spatial processing using recurrent-convolutional models for effective spectral aggregating and spatial feature learning. Our best model achieves an AUC of 76.3%, significantly outperforming previous conventional and deep learning methods.
Hamburg University of Technology（汉堡工业大学）；University of Bonn（波恩大学）；Klinikum Braunschweig（布伦瑞克医院）；University Medical Center Hamburg-Eppendorf（汉堡-埃彭多夫大学医学中心）
Early detection of head and neck tumors is crucial for patient survival. Often, diagnoses are made based on endoscopic examination of the larynx followed by biopsy and histological analysis, leading to a high inter-observer variability due to subjective assessment. In this regard, early non-invasive diagnostics independent of the clinician would be a valuable tool. A recent study has shown that hyperspectral imaging (HSI) can be used for non-invasive detection of head and neck tumors, as precancerous or cancerous lesions show specific spectral signatures that distinguish them from healthy tiss…
In-Vivo Hyperspectral Human Brain Image Database for Brain Cancer Detection
University of Las Palmas de Gran Canaria（大加那利岛拉斯帕尔马斯大学）；University Hospital Doctor Negrin（内格林大学医院）；University Hospital Southampton（南安普顿大学医院）；Addenbrookes Hospital（阿登布鲁克医院）；University of Cambridge（剑桥大学）；AKKA Technologies（AKKA Technologies公司）；Imperial College London（伦敦帝国理工学院）；Universidad Politécnica de Madrid（马德里理工大学）；Ecole Nationale Supérieure des Mines de Paris（巴黎高等矿业学校）；MINES ParisTech（巴黎矿业学院）
Spatio-spectral classification of hyperspectral images for brain cancer detection during surgical operations
University of Las Palmas de Gran Canaria（大加那利岛拉斯帕尔马斯大学）；Imperial College London（伦敦帝国理工学院）；University Hospital Doctor Negrin（内格林大学医院）；University Hospital Southampton（南安普顿大学医院）；University of Cambridge（剑桥大学）；Universidad Politecnica de Madrid（马德里理工大学）
Towards Machine Learning-based Quantitative Hyperspectral Image Guidance for Brain Tumor Resection
University of British Columbia（不列颠哥伦比亚大学）；University Hospital of Münster（明斯特大学医院）；Macquarie University（麦考瑞大学）；Hokkaido Medical Center, National Hospital Organization（国立医院机构北海道医疗中心）
Carl Zeiss AG（卡尔蔡司股份公司）；University of Padua（帕多瓦大学）；University of Applied Sciences Western Switzerland (HES-SO Valais)（瑞士西部应用科学大学（瓦莱州高等专业学院））；Carl Zeiss Meditec AG（卡尔蔡司医疗科技股份公司）；IMEC（比利时微电子研究中心）；University Hospitals Leuven（鲁汶大学医院）；KU Leuven（鲁汶大学）
Surgery for gliomas (intrinsic brain tumors), especially when low-grade, is challenging due to the infiltrative nature of the lesion. Currently, no real-time, intra-operative, label-free and wide-field tool is available to assist and guide the surgeon to find the relevant demarcations for these tumors. While marker-based methods exist for the high-grade glioma case, there is no convenient solution available for the low-grade case; thus, marker-free optical techniques represent an attractive option. Although RGB imaging is a standard tool in surgical microscopes, it does not contain sufficient …
Angiogenesis, the formation of new vessels, is one of the key mechanisms in tumor development and an appealing target for therapy. Non-invasive, high-resolution, high sensitivity, quantitative 3D imaging techniques are required to correctly depict tumor heterogeneous vasculature over time. Ultrafast Doppler was recently introduced and provides an unprecedented combination of resolution, penetration depth and sensitivity without requiring any contrast agents. The technique was further extended to 3D with Ultrafast Doppler Tomography (UFD-T). In this work, UFD-T was applied to the monitoring of …
Interstitial fluid pressure (IFP), interstitial fluid velocity (IFV), interstitial permeability (IP) and vascular permeability (VP) are cancer mechanopathological parameters of great clinical significance. To date, there is a lack of non-invasive techniques that can be used to estimate these parameters in vivo. In this study, we designed and tested new ultrasound poroelastography methods capable of estimating the magnitude and spatial distribution of fluid pressure, fluid velocity and fluid flow inside tumors. We theoretically proved that fluid pressure, velocity and flow estimated using poroe…
Objective: Alterations of Young's modulus (YM) and Poisson's ratio (PR) in biological tissues are often early indicators of the onset of pathological conditions. Knowledge of these parameters has been proven to be of great clinical significance for the diagnosis, prognosis and treatment of cancers. Currently, however, there are no non-invasive modalities that can be used to image and quantify these parameters in vivo without assuming incompressibility of the tissue, an assumption that is rarely justified in human tissues. Methods: In this paper, we develop a new method to simultaneously recons…
Imperial College London（伦敦帝国学院）；University College London（伦敦大学学院）
Purpose: Intra-operative measurement of tissue oxygen saturation (StO2) is important in the detection of ischemia, monitoring perfusion and identifying disease. Hyperspectral imaging (HSI) measures the optical reflectance spectrum of the tissue and uses this information to quantify its composition, including StO2. However, real-time monitoring is difficult due to the capture rate and data processing time. Methods: An endoscopic system based on a multi-fiber probe was previously developed to sparsely capture HSI data (sHSI). These were combined with RGB images, via a deep neural network, to gen…
Here we apply hyperspectral bright field imaging to collect computed tomographic images with excellent energy resolution (800 eV), applying it for the first time to map the distribution of stain in a fixed biological sample through its characteristic K-edge. Conventionally, because the photons detected at each pixel are distributed across as many as 200 energy channels, energy-selective images are characterised by low count-rates and poor signal-to-noise ratio. This means high X-ray exposures, long scan times and high doses are required to image unique spectral markers. Here, we achieve high q…
A Hyperspectral Imaging Dataset and Methodology for Intraoperative Pixel-Wise Classification of Metastatic Colon Cancer in the Liver
Ruđer Bošković Institute（鲁杰尔·博什科维奇研究所）；Technical University Munich（慕尼黑工业大学）；University of Montreal（蒙特利尔大学）；Photon etc.（Photon etc.公司）；Clinical Hospital Center Zagreb（萨格勒布临床医院中心）；University of Zagreb（萨格勒布大学）；Clinical Hospital Dubrava（杜布拉瓦临床医院）
Fast and reliable monitoring of volumetric heat distribution during MRI-guided tumor ablation is an urgent clinical need. In this work, we introduce a method for generating 2.5D thermometry maps from uniformly distributed 2D MRI phase images rotated around the applicator's main axis. The images can be fetched directly from the MR device, reducing the delay between image acquisition and visualization. For reconstruction, we use a weighted interpolation on a cylindric coordinate representation to calculate the heat value of voxels in a region of interest. A pilot study on 13 ex vivo bio protein …
McLean Hospital（麦克莱恩医院）；Harvard Medical School（哈佛医学院）；Xiamen University（厦门大学）；Philips（飞利浦）
Magnetic Resonance Spectroscopy (MRS) is a noninvasive tool to reveal metabolic information. One challenge of 1H-MRS is the low Signal-Noise Ratio (SNR). To improve the SNR, a typical approach is to perform Signal Averaging (SA) with M repeated samples. The data acquisition time, however, is increased by M times accordingly, and a complete clinical MRS scan takes approximately 10 minutes at a common setting M=128. Recently, deep learning has been introduced to improve the SNR but most of them use the simulated data as the training set. This may hinder the MRS applications since some potential …
