去中心化普通计算机集群上的十亿像素图像高效金字塔分析
Efficient Pyramidal Analysis of Gigapixel Images on a Decentralized Modest Computer Cluster
AI总结:
针对十亿像素图像计算成本高的问题,提出PyramidAI渐进式分析技术,通过自适应分辨率选择减少2.65倍处理数据量,结合并行策略在12台普通计算机上将分析时间从超1小时缩至几分钟。
摘要:
十亿像素图像分析被公认为计算需求极高。本文提出PyramidAI,这是一种可降低计算成本的十亿像素图像分析技术。该方法采用渐进式图像分析策略,从较低分辨率开始,逐步聚焦于感兴趣区域,以更高分辨率进行详细检查。我们研究了两种在实现自适应分辨率选择时调节精度与计算性能权衡的策略,并在生物医学图像数据集Camelyon16上进行了验证。结果表明,在单台计算机上,PyramidAI在保持相关区域识别精度的同时,可将分析所需处理的数据量最多减少2.65倍。为推动十亿像素图像分析的普及化,我们评估了利用主流计算机、通过挖掘该方法的并行潜力来执行计算的可行性。我们使用模拟器根据工作节点数量估算了最优的数据分布和负载均衡算法,并将选定的算法落地实现,在真实场景中验证了一致的结论。使用12台普通工作节点时,分析时间从超过1小时缩短至几分钟,为高效的大规模图像分析提供了实用解决方案。
英文摘要:
Analyzing gigapixel images is recognized as computationally demanding. In this paper, we introduce PyramidAI, a technique for analyzing gigapixel images with reduced computational cost. The proposed approach adopts a gradual analysis of the image, beginning with lower resolutions and progressively concentrating on regions of interest for detailed examination at higher resolutions. We investigated two strategies for tuning the accuracy-computation performance trade-off when implementing the adaptive resolution selection, validated against the Camelyon16 dataset of biomedical images. Our results demonstrate that PyramidAI substantially decreases the amount of processed data required for analysis by up to 2.65x, while preserving the accuracy in identifying relevant sections on a single computer. To ensure democratization of gigapixel image analysis, we evaluated the potential to use mainstream computers to perform the computation by exploiting the parallelism potential of the approach. Using a simulator, we estimated the best data distribution and load balancing algorithm according to the number of workers. The selected algorithms were implemented and highlighted the same conclusions in a real-world setting. Analysis time is reduced from more than an hour to a few minutes using 12 modest workers, offering a practical solution for efficient large-scale image analysis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。