arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1809.05956cs.DC
收藏

一种面向科学成像问题的分布式学习体系结构

A Distributed Learning Architecture for Scientific Imaging Problems

A. Panousopoulou, S. Farrens, K. Fotiadou, A. Woiselle, G. Tsagkatakis, J-L. Starck, P. Tsakalides

摘要:

科学成像的当前趋势受到将复杂的机器学习与大数据分析平台集成的新兴需求的挑战。这项工作提出了一个内存中的分布式学习架构,使复杂的学习和优化技术的科学成像问题,其特征是来自不同来源的变异信息的组合。我们将得到的Spark兼容架构应用于科学成像领域的两个新兴用例,即:(a)星系成像调查的空间变量反卷积(天体物理学),(b)基于耦合字典训练的超分辨率(遥感)。我们进行评估研究,考虑相关的数据集,结果报告至少60%的时间响应比传统的计算解决方案的改善。最终,所提供的讨论提供了有关关键Spark调优参数对所实现的加速比和内存/磁盘占用的影响的有用实用见解。

英文摘要:

Current trends in scientific imaging are challenged by the emerging need of integrating sophisticated machine learning with Big Data analytics platforms. This work proposes an in-memory distributed learning architecture for enabling sophisticated learning and optimization techniques on scientific imaging problems, which are characterized by the combination of variant information from different origins. We apply the resulting, Spark-compliant, architecture on two emerging use cases from the scientific imaging domain, namely: (a) the space variant deconvolution of galaxy imaging surveys (astrophysics), (b) the super-resolution based on coupled dictionary training (remote sensing). We conduct evaluation studies considering relevant datasets, and the results report at least 60\% improvement in time response against the conventional computing solutions. Ultimately, the offered discussion provides useful practical insights on the impact of key Spark tuning parameters on the speedup achieved, and the memory/disk footprint.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑