OCT2Confocal：基于3D CycleGAN的视网膜OCT图像到共聚焦显微镜图像的转换
OCT2Confocal: 3D CycleGAN based Translation of Retinal OCT Images to Confocal Microscopy
AI总结：
针对视网膜OCT与共聚焦显微镜两种成像模态的优劣势互补需求，提出基于3D CycleGAN的无监督转换框架，在自建OCT2Confocal数据集上实现高精度转换，性能优于现有方法，有望提升眼科诊疗能力。
摘要：
光学相干断层扫描（OCT）和共聚焦显微镜是视网膜成像领域的关键技术，二者各有独特优势与局限。活体OCT可实现快速无创成像，但易受清晰度问题和运动伪影的影响。离体共聚焦显微镜能提供高分辨率、具备细胞级细节的彩色图像，但属于有创技术，存在伦理争议且可能造成组织损伤。为打通这两种成像模态，我们开发了一套3D CycleGAN（循环生成对抗网络）框架，用于将活体OCT图像无监督转换为离体共聚焦显微镜图像。该框架应用于我们构建的OCT2Confocal数据集，可有效实现3D医学数据域间的转换，精准捕捉血管、纹理及细胞层面的细节。这是首次尝试利用OCT的固有3D信息，将其转换至信息丰富、细节详实的共聚焦显微镜彩色域。经定量与定性评估验证，尽管存在数据量有限的约束，该3D CycleGAN框架仍展现出优异的图像保真度与质量，性能优于现有方法。这种无创生成视网膜共聚焦图像的技术有望进一步提升眼科疾病的诊断与监测能力。我们的源代码和OCT2Confocal数据集已公开于https://github.com/xintian-99/OCT2Confocal。
英文摘要：
Optical coherence tomography (OCT) and confocal microscopy are pivotal in retinal imaging, each presenting unique benefits and limitations. In-vivo OCT offers rapid, non-invasive imaging but can be hampered by clarity issues and motion artifacts. Ex-vivo confocal microscopy provides high-resolution, cellular detailed color images but is invasive and poses ethical concerns and potential tissue damage. To bridge these modalities, we developed a 3D CycleGAN framework for unsupervised translation of in-vivo OCT to ex-vivo confocal microscopy images. Applied to our OCT2Confocal dataset, this framework effectively translates between 3D medical data domains, capturing vascular, textural, and cellular details with precision. This marks the first attempt to exploit the inherent 3D information of OCT and translate it into the rich, detailed color domain of confocal microscopy. Assessed through quantitative and qualitative evaluations, the 3D CycleGAN framework demonstrates commendable image fidelity and quality, outperforming existing methods despite the constraints of limited data. This non-invasive generation of retinal confocal images has the potential to further enhance diagnostic and monitoring capabilities in ophthalmology. Our source code and OCT2Confocal dataset are available at https://github.com/xintian-99/OCT2Confocal.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
