大规模并行数值计算技术研讨会白皮书(LSPANC 2020):面向最小精度计算的HPC和计算机算术
White Paper from Workshop on Large-scale Parallel Numerical Computing Technology (LSPANC 2020): HPC and Computer Arithmetic toward Minimal-Precision Computing
摘要:
在数值计算中,浮点计算的精度是决定性能(速度和能量效率)以及可靠性(准确性和再现性)的关键因素。然而,精确度通常对两者起相反的作用。因此,同时最大化两者的最终概念是通过精度调整的最小精度计算,它为每个操作和数据调整最佳精度。到目前为止,已经进行了几项研究(例如Precimoniuos和Verrou),但这些研究的范围仅限于精确调谐。因此,我们的目标是提出一个更广泛的概念,最小精度计算系统的精度调整,涉及硬件和软件栈。2019年,我们启动了最低精度计算项目,提出了一个更广泛的概念,即具有精度调整的最低精度计算系统,涉及硬件和软件堆栈。具体而言,我们的系统结合了(1)基于离散随机算法(DSA)的精度调整方法,(2)任意精度算术库,(3)快速准确的数值库,以及(4)现场可编程门阵列(FPGA)与高级综合(HLS)。在本白皮书中,我们的目标是概述与最小精度和混合精度相关的各种技术,概述项目的未来方向,并与我们的项目成员和LSPANC 2020研讨会的嘉宾演讲者一起讨论当前的挑战。https://www.r-ccs.riken.jp/labs/lpnctrt/lspanc2020jan/
英文摘要:
In numerical computations, precision of floating-point computations is a key factor to determine the performance (speed and energy-efficiency) as well as the reliability (accuracy and reproducibility). However, precision generally plays a contrary role for both. Therefore, the ultimate concept for maximizing both at the same time is the minimal-precision computing through precision-tuning, which adjusts the optimal precision for each operation and data. Several studies have been already conducted for it so far (e.g. Precimoniuos and Verrou), but the scope of those studies is limited to the precision-tuning alone. Hence, we aim to propose a broader concept of the minimal-precision computing system with precision-tuning, involving both hardware and software stack. In 2019, we have started the Minimal-Precision Computing project to propose a more broad concept of the minimal-precision computing system with precision-tuning, involving both hardware and software stack. Specifically, our system combines (1) a precision-tuning method based on Discrete Stochastic Arithmetic (DSA), (2) arbitrary-precision arithmetic libraries, (3) fast and accurate numerical libraries, and (4) Field-Programmable Gate Array (FPGA) with High-Level Synthesis (HLS). In this white paper, we aim to provide an overview of various technologies related to minimal- and mixed-precision, to outline the future direction of the project, as well as to discuss current challenges together with our project members and guest speakers at the LSPANC 2020 workshop; https://www.r-ccs.riken.jp/labs/lpnctrt/lspanc2020jan/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。