首页/论文/2011.03353

arXiv 2011.033532020-11cs.CVcs.LG

Self-Supervised Learning for Biological Sample Localization in 3D Tomographic Images

Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Heidelberg University（海德堡大学）

Yaroslav Zharov, Alexey Ershov, Tilo Baumbach, Vincent Heuveline

英文摘要：

In synchrotron-based Computed Tomography (CT) there is a trade-off between spatial resolution, field of view and speed of positioning and alignment of samples. The problem is even more prominent for high-throughput tomography--an automated setup, capable of scanning large batches of samples without human interaction. As a result, in many applications, only 20-30% of the reconstructed volume contains the actual sample. Such data redundancy clutters the storage and increases processing time. Hence, an automated sample localization becomes an important practical problem. In this work, we describe two self-supervised losses designed for biological CT. We further demonstrate how to employ the uncertainty estimation for sample localization. This approach shows the ability to localize a sample with less than 1.5\% relative error and reduce the used storage by a factor of four. We also show that one of the proposed losses works reasonably well as a pre-training task for the semantic segmentation.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Learning multi-scale functional representations of proteins from single-cell microscopy data

Vector Institute for AI Research（向量人工智能研究所）；University of Toronto（多伦多大学）

Protein function is inherently linked to its localization within the cell, and fluorescent microscopy data is an indispensable resource for learning representations of proteins. Despite major developments in molecular representation learning, extracting functional information from biological images remains a non-trivial computational task. Current state-of-the-art approaches use autoencoder models to learn high-quality features by reconstructing images. However, such methods are prone to capturing noise and imaging artifacts. In this work, we revisit deep learning models used for classifying m…

2022-05-24cs.CVcs.LGq-bio.MN

SegET: Deep Neural Network with Rich Contextual Features for Cellular Structures Segmentation in Electron Tomography Image

Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；University of Chinese Academy of Sciences（中国科学院大学）

Electron tomography (ET) allows high-resolution reconstructions of macromolecular complexes at nearnative state. Cellular structures segmentation in the reconstruction data from electron tomographic images is often required for analyzing and visualizing biological structures, making it a powerful tool for quantitative descriptions of whole cell structures and understanding biological functions. However, these cellular structures are rather difficult to automatically separate or quantify from view owing to complex molecular environment and the limitations of reconstruction data of ET. In this p…

2018-11-28cs.CV

Adversarial Learning of Structure-Aware Fully Convolutional Networks for Landmark Localization

Nanjing University of Science and Technology（南京理工大学）；The University of Adelaide（阿德莱德大学）；Australian Centre for Robotic Vision（澳大利亚机器人视觉中心）；Nanjing University（南京大学）

Landmark/pose estimation in single monocular images have received much effort in computer vision due to its important applications. It remains a challenging task when input images severe occlusions caused by, e.g., adverse camera views. Under such circumstances, biologically implausible pose predictions may be produced. In contrast, human vision is able to predict poses by exploiting geometric constraints of landmark point inter-connectivity. To address the problem, by incorporating priors about the structure of pose components, we propose a novel structure-aware fully convolutional network to…

2019-02-24cs.CV

Fast and robust multiplane single molecule localization microscopy using deep neural network

Single molecule localization microscopy is widely used in biological research for measuring the nanostructures of samples smaller than the diffraction limit. This study uses multifocal plane microscopy and addresses the 3D single molecule localization problem, where lateral and axial locations of molecules are estimated. However, when we multifocal plane microscopy is used, the estimation accuracy of 3D localization is easily deteriorated by the small lateral drifts of camera positions. We formulate a 3D molecule localization problem along with the estimation of the lateral drifts as a compres…

2020-01-07cs.CVcs.LGeess.IV

Medical Image Segmentation and Localization using Deformable Templates

School of Electrical & Information Engineering, University of the Witwatersrand（威特沃特斯兰德大学电气与信息工程学院）

This paper presents deformable templates as a tool for segmentation and localization of biological structures in medical images. Structures are represented by a prototype template, combined with a parametric warp mapping used to deform the original shape. The localization procedure is achieved using a multi-stage, multi-resolution algorithm de-signed to reduce computational complexity and time. The algorithm initially identifies regions in the image most likely to contain the desired objects and then examines these regions at progressively increasing resolutions. The final stage of the algorit…

2007-05-06cs.CV

GANs for Biological Image Synthesis

École normale supérieure（巴黎高等师范学院）；CNRS（法国国家科学研究中心）；PSL Research University（巴黎文理研究大学）；National Research University Higher School of Economics（俄罗斯国立高等经济学院）；LOB, École Polytechnique（光学与生物科学实验室，巴黎综合理工学院）；INSERM（法国国家健康与医学研究院）；Université Paris-Saclay（巴黎萨克雷大学）；INRIA（法国国家信息与自动化研究所）；ENS（巴黎高等师范学院）；HSE（俄罗斯国立高等经济学院）；University of Bristol（布里斯托大学）；Amazon（亚马逊）

In this paper, we propose a novel application of Generative Adversarial Networks (GAN) to the synthesis of cells imaged by fluorescence microscopy. Compared to natural images, cells tend to have a simpler and more geometric global structure that facilitates image generation. However, the correlation between the spatial pattern of different fluorescent proteins reflects important biological functions, and synthesized images have to capture these relationships to be relevant for biological applications. We adapt GANs to the task at hand and propose new models with casual dependencies between ima…

2017-09-12cs.CVcs.LGstat.ML

更多相关论文收起更多论文

SIMILARnet: Simultaneous Intelligent Localization and Recognition Network

McGill University（麦吉尔大学）；University of Southern California（南加州大学）；Indian Institute of Technology（印度理工学院）

Global Average Pooling (GAP) [4] has been used previously to generate class activation for image classification tasks. The motivation behind SIMILARnet comes from the fact that the convolutional filters possess position information of the essential features and hence, combination of the feature maps could help us locate the class instances in an image. We propose a biologically inspired model that is free of differential connections and doesn't require separate training thereby reducing computation overhead. Our novel architecture generates promising results and unlike existing methods, the mo…

2017-11-08cs.AIcs.CV

用于纳米级轴向定位与追踪的模型无关机器学习方法

Model-Independent Machine Learning Approach for Nanometric Axial Localization and Tracking

European Organization for Nuclear Research (CERN)（欧洲核子研究中心）；National University of Science and Technology MISIS（俄罗斯科学与技术国家大学）

本文提出一种基于卷积神经网络的模型无关方法，利用双焦平面图像实现纳米级轴向定位，精度达40纳米，较传统单焦平面技术提升六倍，适用于暗物质探测、质子治疗等场景。

2025-08-04astro-ph.IMcs.CVcs.LG

Puzzle Imaging: Using Large-scale Dimensionality Reduction Algorithms for Localization

Harvard Medical School（哈佛医学院）；Northwestern University（西北大学）；Rehabilitation Institute of Chicago（芝加哥康复研究所）

Current high-resolution imaging techniques require an intact sample that preserves spatial relationships. We here present a novel approach, "puzzle imaging," that allows imaging a spatially scrambled sample. This technique takes many spatially disordered samples, and then pieces them back together using local properties embedded within the sample. We show that puzzle imaging can efficiently produce high-resolution images using dimensionality reduction algorithms. We demonstrate the theoretical capabilities of puzzle imaging in three biological scenarios, showing that (1) relatively precise 3-d…

2015-06-21cs.CEcs.CVq-bio.NC

光学投影断层成像中的机械伪影：分类与自动校准

Mechanical Artifacts in Optical Projection Tomography: Classification and Automatic Calibration

École polytechnique fédérale de Lausanne（洛桑联邦理工学院）；Idiap Research Institute（Idiap研究所）

针对光学投影断层成像中多类机械伪影缺乏统一处理的问题，本文建立伪影分类目录，并提出可自动恢复角度与平移参数的校准及三维迭代重建方法，仿真与实验均验证其能有效消除伪影。

2023-07-19cs.CV

Western Blot图像中合成篡改的定位

Localization of Synthetic Manipulations in Western Blot Images

Politecnico di Milano（米兰理工大学）；Loyola University Chicago（芝加哥洛约拉大学）

本文提出一种基于小块的合成检测器，通过聚合小块贡献生成篡改热图，实现Western Blot图像中合成篡改的定位，并在多个数据集上验证了其有效性和鲁棒性。

2024-08-25cs.AIcs.CVcs.MM