arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.03153cs.CVphysics.data-an
收藏

SAM-EM:用于自动化液相电子显微镜的实时分割

SAM-EM: Real-Time Segmentation for Automated Liquid Phase Transmission Electron Microscopy

Georgia Institute of Technology(佐治亚理工学院);Northwestern University(西北大学)

Alexander Wang, Max Xu, Risha Goel, Zain Shabeeb, Isabel Panicker, Vida Jamali

AI总结:

提出SAM-EM模型,基于SAM 2全微调统一LPTEM视频分割、跟踪与统计分析,在低信噪比下保持鲁棒,将LPTEM转化为定量单粒子跟踪平台以加速材料发现。

摘要:

缺乏针对噪声液相透射电子显微镜(LPTEM)视频的鲁棒分割框架,阻碍了粒子轨迹的可靠提取,构成了定量分析以及将观察到的动力学与材料表征和设计相关联的主要障碍。为应对这一挑战,我们提出了用于电子显微镜的 Segment Anything Model(SAM-EM),这是一个领域适配的基础模型,统一了 LPTEM 数据的分割、跟踪和统计分析。SAM-EM 基于 Segment Anything Model 2(SAM 2)构建,通过对 46,600 帧精选的 LPTEM 合成视频帧进行全模型微调而得,与零样本 SAM 2 和现有基线相比,显著提升了掩码质量和时间身份稳定性。除分割外,SAM-EM 还将粒子跟踪与统计工具集成,包括均方位移和粒子位移分布分析,为提取和解释纳米尺度动力学提供了端到端框架。至关重要的是,全微调使 SAM-EM 在低信噪比条件下(如 LPTEM 实验中液体样品厚度增加所引起的条件)仍能保持鲁棒性。通过建立可靠的分析流程,SAM-EM 将 LPTEM 转化为定量单粒子跟踪平台,并加速了其在数据驱动的材料发现与设计中的整合。项目页面:github.com/JamaliLab/SAM-EM。

英文摘要:

The absence of robust segmentation frameworks for noisy liquid phase transmission electron microscopy (LPTEM) videos prevents reliable extraction of particle trajectories, creating a major barrier to quantitative analysis and to connecting observed dynamics with materials characterization and design. To address this challenge, we present Segment Anything Model for Electron Microscopy (SAM-EM), a domain-adapted foundation model that unifies segmentation, tracking, and statistical analysis for LPTEM data. Built on Segment Anything Model 2 (SAM~2), SAM-EM is derived through full-model fine-tuning on 46,600 curated LPTEM synthetic video frames, substantially improving mask quality and temporal identity stability compared to zero-shot SAM~2 and existing baselines. Beyond segmentation, SAM-EM integrates particle tracking with statistical tools, including mean-squared displacement and particle displacement distribution analysis, providing an end-to-end framework for extracting and interpreting nanoscale dynamics. Crucially, full fine-tuning allows SAM-EM to remain robust under low signal-to-noise conditions, such as those caused by increased liquid sample thickness in LPTEM experiments. By establishing a reliable analysis pipeline, SAM-EM transforms LPTEM into a quantitative single-particle tracking platform and accelerates its integration into data-driven materials discovery and design. Project page: \href{https://github.com/JamaliLab/SAM-EM}{github.com/JamaliLab/SAM-EM}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑