用于血流动力学瞬时空间光谱成像的移动健康高光谱学习
mHealth hyperspectral learning for instantaneous spatiospectral imaging of hemodynamics
AI总结:
提出高光谱学习方法,利用智能手机RGB图像与小子区域高光谱采样恢复超立方体,实现毫秒级血流动力学快照成像,消除空间光谱权衡。
摘要:
高光谱成像在空间和频率域中获取数据,以提供丰富的物理或生物信息。然而,传统高光谱成像存在仪器体积庞大、数据采集速率慢以及空间光谱权衡等固有局限性。在此,我们引入用于快照高光谱成像的高光谱学习,其中将小子区域中采样的高光谱数据纳入学习算法以恢复超立方体。高光谱学习利用了照片不仅仅是一张图片且包含详细光谱信息的理念。少量高光谱数据采样使光谱信息学习能够从RGB图像中恢复超立方体。高光谱学习能够在超立方体中恢复完整的光谱分辨率,可与科学光谱仪的高光谱分辨率相媲美。鉴于视频由多个RGB图像的时间序列组成,高光谱学习还利用现成智能手机中的超慢速视频录制,实现超快动态成像。为了展示其多功能性,使用血管发育的实验模型通过统计和深度学习方法提取血流动力学参数。随后,使用传统智能手机相机以高达毫秒级的超快时间分辨率评估外周微循环的血流动力学。这种光谱信息学习方法类似于压缩感知;然而,它进一步允许通过透明的学习算法进行可靠的超立方体恢复和关键特征提取。这种由学习驱动的快照高光谱成像方法产生高光谱和时间分辨率,消除了空间光谱权衡,提供了简单的硬件要求和各种机器学习技术的潜在应用。
英文摘要:
Hyperspectral imaging acquires data in both the spatial and frequency domains to offer abundant physical or biological information. However, conventional hyperspectral imaging has intrinsic limitations of bulky instruments, slow data acquisition rate, and spatiospectral tradeoff. Here we introduce hyperspectral learning for snapshot hyperspectral imaging in which sampled hyperspectral data in a small subarea are incorporated into a learning algorithm to recover the hypercube. Hyperspectral learning exploits the idea that a photograph is more than merely a picture and contains detailed spectral information. A small sampling of hyperspectral data enables spectrally informed learning to recover a hypercube from an RGB image. Hyperspectral learning is capable of recovering full spectroscopic resolution in the hypercube, comparable to high spectral resolutions of scientific spectrometers. Hyperspectral learning also enables ultrafast dynamic imaging, leveraging ultraslow video recording in an off-the-shelf smartphone, given that a video comprises a time series of multiple RGB images. To demonstrate its versatility, an experimental model of vascular development is used to extract hemodynamic parameters via statistical and deep-learning approaches. Subsequently, the hemodynamics of peripheral microcirculation is assessed at an ultrafast temporal resolution up to a millisecond, using a conventional smartphone camera. This spectrally informed learning method is analogous to compressed sensing; however, it further allows for reliable hypercube recovery and key feature extractions with a transparent learning algorithm. This learning-powered snapshot hyperspectral imaging method yields high spectral and temporal resolutions and eliminates the spatiospectral tradeoff, offering simple hardware requirements and potential applications of various machine-learning techniques.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。