Tornado:一个实用高效的托管语言异构编程框架
Tornado: A Practical And Efficient Heterogeneous Programming Framework For Managed Languages
摘要:
本文介绍了我们创建Tornado的经验:一个实用而高效的托管语言异构编程框架。Tornado的新颖之处在于,它将异构系统的编程从主要基于先验知识的活动转变为基于后验知识的活动。换句话说,它只是意味着开发人员不需要通过迎合所有可能发生的事情来过度复杂化他们的代码。相反,Tornado提供了为特定系统专门化每个应用程序的能力,从而避免了开发人员对其进行预配置的需要。为了实现这一点,Tornado采用了一个复杂的运行时系统,可以动态配置应用程序的各个方面-从选择应用哪个并行化方案到指定使用哪个加速器。通过使用这种能力,最终用户而不是开发人员可以透明地使用任何可用的多核/众核处理器或硬件加速器。为了展示Tornado的影响,我们实现了一个真实的计算机视觉应用程序,并将其部署在九个加速器上,而无需修改源代码,甚至无需显式地重新编译应用程序。使用动态配置,我们表明,我们的实现可以实现高达124帧每秒(FPS)-高达166倍的参考实现加速。最后,我们的实现总是在手写OpenCL版本的21%以内,但避免了许多编程的繁琐。
英文摘要:
This paper describes our experiences creating Tornado: a practical and efficient heterogeneous programming framework for managed languages. The novel aspect of Tornado is that it turns the programming of heterogeneous systems from an activity predominantly based on a priori knowledge into one based on a posteriori knowledge. Alternatively put, it simply means developers do not need to overcomplicate their code by catering for all possible eventualities. Instead, Tornado provides the ability to specialize each application for a specific system in situ which avoids the need for it to be pre-configured by the developer. To enable this, Tornado employs a sophisticated runtime system that can dynamically configure all aspects of the application - from selecting which parallelization scheme to apply to specifying which accelerators to use. By using this ability, the end-user, and not the developer, can transparently make use of any available multi-/many-core processor or hardware accelerator. To showcase the impact of Tornado, we implement a real-world computer vision application and deploy it across nine accelerators without having to modify the source code or even explicitly re-compile the application. Using dynamic configuration, we show that our implementation can achieve up to 124 frames per second (FPS) - up to 166x speedup over the reference implementation. Finally, our implementation is always within 21% of a hand-written OpenCL version but avoids much of the programming tedium.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。