arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.18728cs.DBcs.SE
收藏

为 SIMD 抽象库设计并实现一个生成器框架

Designing and Implementing a Generator Framework for a SIMD Abstraction Library

Johannes Pietrzyk, Alexander Krause, Dirk Habich, Wolfgang Lehner

AI总结:

针对现有SIMD抽象库难维护、难扩展且缺乏表达能力的问题,提出端到端框架TSLGen用于生成Template SIMD Library (TSL),在保持同等性能与编程效率的同时提升了可维护性、可扩展性及接口灵活性。

摘要:

单指令多数据(SIMD)并行范式是一种成熟且广泛使用的硬件驱动技术,用于提高数据库或机器学习等不同系统领域的单线程性能。根据硬件供应商和特定的处理器代次/版本,SIMD 能力在寄存器大小和支持的 SIMD 指令方面呈现出不同的形态。由于这种异构性以及缺乏标准化的调用约定,构建高性能且可移植的系统是一项具有挑战性的任务。为了应对这一挑战,学术界和工业界投入了大量精力创建 SIMD 抽象库,以提供对不同 SIMD 硬件能力的统一访问。然而,那些一刀切的库方法本质上很复杂,这阻碍了可维护性和可扩展性。此外,它们假设了相似的 SIMD 硬件设计,这可能会因 ARM SVE 的出现而失效。另外,虽然现有的 SIMD 抽象库在隐藏底层硬件细节方面做得很好,但它们缺乏表达能力,阻碍了系统开发人员做出关键的算法设计决策。为了克服这些限制,我们在本文中提出了 TSLGen,一种用于生成 SIMD 抽象库的新型端到端框架方法。我们实现了 TSLGen 框架,并使用生成的 Template SIMD Library (TSL) 对来自不同领域的各种系统组件进行了编程。正如我们将展示的,其编程工作量与现有库相当,并且取得了相同的性能结果。然而,我们的框架易于维护和扩展,同时通过设计支持对接口进行破坏性更改,并为评估所提供的功能暴露了有价值的见解。

英文摘要:

The Single Instruction Multiple Data (SIMD) parallel paradigm is a well-established and heavily-used hardware-driven technique to increase the single-thread performance in different system domains such as database or machine learning. Depending on the hardware vendor and the specific processor generation/version, SIMD capabilities come in different flavors concerning the register size and the supported SIMD instructions. Due to this heterogeneity and the lack of standardized calling conventions, building high-performance and portable systems is a challenging task. To address this challenge, academia and industry have invested a remarkable effort into creating SIMD abstraction libraries that provide unified access to different SIMD hardware capabilities. However, those one-size-fits-all library approaches are inherently complex, which hampers maintainability and extensibility. Furthermore, they assume similar SIMD hardware designs, which may be invalidated through ARM SVE's emergence. Additionally, while existing SIMD abstraction libraries do a great job of hiding away the specifics of the underlying hardware, their lack of expressiveness impedes crucial algorithm design decisions for system developers. To overcome these limitations, we present TSLGen, a novel end-to-end framework approach for generating an SIMD abstraction library in this paper. We have implemented our TSLGen framework and used our generated Template SIMD Library (TSL) to program various system components from different domains. As we will show, the programming effort is comparable to existing libraries, and we achieve the same performance results. However, our framework is easy to maintain and to extend, which simultaneously supports disruptive changes to the interface by design and exposes valuable insights for assessing provided functionality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑