2D组织学与3D拓扑学的结合:使用图神经网络的细胞结构脑映射
2D histology meets 3D topology: Cytoarchitectonic brain mapping with Graph Neural Networks
摘要:
细胞结构描述了脑中神经元细胞的空间组织,包括它们相对于细胞密度、方向或某些细胞类型的存在的层和列的排列。它允许将大脑分为皮层区域和皮层下核,将结构与连接性和功能联系起来,并为人脑图谱提供微观结构参考。绘制区域之间的边界需要以显微镜分辨率扫描组织切片。虽然最近的高通量扫描仪可以在一年内扫描一个完整的人脑,但实际上不可能使用已建立的金标准方法以相同的速度描绘区域。研究人员最近利用深度神经网络解决了皮质区域的细胞结构映射,依赖于来自单个2D切片的图像块进行分类。然而,3D上下文,这是需要消除歧义的复杂或斜切的大脑区域,没有考虑在内。在这项工作中,我们结合2D组织学与3D拓扑结构,重新制定的映射任务作为一个节点分类问题的近似3D midsurface网格通过isocortex。我们从描述细胞结构的2D组织切片中的皮质斑块中提取深层特征,并将其分配到3D网格上的相应节点以构建大的属性图。通过使用图神经网络解决这个图上的大脑映射问题,我们获得了显着改善的分类结果。所提出的框架本身很好地整合额外的神经解剖学先验映射。
英文摘要:
Cytoarchitecture describes the spatial organization of neuronal cells in the brain, including their arrangement into layers and columns with respect to cell density, orientation, or presence of certain cell types. It allows to segregate the brain into cortical areas and subcortical nuclei, links structure with connectivity and function, and provides a microstructural reference for human brain atlases. Mapping boundaries between areas requires to scan histological sections at microscopic resolution. While recent high-throughput scanners allow to scan a complete human brain in the order of a year, it is practically impossible to delineate regions at the same pace using the established gold standard method. Researchers have recently addressed cytoarchitectonic mapping of cortical regions with deep neural networks, relying on image patches from individual 2D sections for classification. However, the 3D context, which is needed to disambiguate complex or obliquely cut brain regions, is not taken into account. In this work, we combine 2D histology with 3D topology by reformulating the mapping task as a node classification problem on an approximate 3D midsurface mesh through the isocortex. We extract deep features from cortical patches in 2D histological sections which are descriptive of cytoarchitecture, and assign them to the corresponding nodes on the 3D mesh to construct a large attributed graph. By solving the brain mapping problem on this graph using graph neural networks, we obtain significantly improved classification results. The proposed framework lends itself nicely to integration of additional neuroanatomical priors for mapping.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。