arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.12465cs.LGcs.AIcs.DC
收藏

Flashlight:推动机器学习工具的创新

Flashlight: Enabling Innovation in Tools for Machine Learning

Facebook AI Research(脸书人工智能研究院);Zoom AI(Zoom人工智能部门);Facebook(脸书公司)
Jacob Kahn, Vineel Pratap, Tatiana Likhomanenko, Qiantong Xu, Awni Hannun, Jeff Cai, Paden Tomasello, Ann Lee, Edouard Grave, Gilad Avidov, Benoit Steiner, Vita… 展开作者

Jacob Kahn, Vineel Pratap, Tatiana Likhomanenko, Qiantong Xu, Awni Hannun, Jeff Cai, Paden Tomasello, Ann Lee, Edouard Grave, Gilad Avidov, Benoit Steiner, Vitaliy Liptchinsky, Gabriel Synnaeve, Ronan Collobert

摘要:

随着机器学习系统的计算需求以及机器学习框架的规模和复杂性的增加,基本框架创新已经变得具有挑战性。虽然计算需求推动了最近的编译器、网络和硬件的进步,但机器学习工具对这些进步的利用速度较慢。这在一定程度上是由于在现有的框架原型新的计算范式所涉及的困难。大型框架优先考虑机器学习研究人员和实践者作为最终用户,而相对较少关注能够推动框架发展的系统研究人员-我们认为两者都是同等重要的利益相关者。我们介绍Flashlight,这是一个开源库,旨在通过优先考虑开放,模块化,可定制的内部和最先进的,研究就绪的模型以及跨各种领域的培训设置来刺激机器学习工具和系统的创新。Flashlight允许系统研究人员在机器学习计算中快速原型化和实验新的想法,并且开销很低,与其他流行的机器学习框架竞争并经常优于其他框架。我们将Flashlight视为一种工具,可以使下游广泛使用的库受益,并使机器学习和系统研究人员更紧密地联系在一起。手电筒可在https://github.com/flashlight/flashlight上购买。

英文摘要:

As the computational requirements for machine learning systems and the size and complexity of machine learning frameworks increases, essential framework innovation has become challenging. While computational needs have driven recent compiler, networking, and hardware advancements, utilization of those advancements by machine learning tools is occurring at a slower pace. This is in part due to the difficulties involved in prototyping new computational paradigms with existing frameworks. Large frameworks prioritize machine learning researchers and practitioners as end users and pay comparatively little attention to systems researchers who can push frameworks forward -- we argue that both are equally important stakeholders. We introduce Flashlight, an open-source library built to spur innovation in machine learning tools and systems by prioritizing open, modular, customizable internals and state-of-the-art, research-ready models and training setups across a variety of domains. Flashlight allows systems researchers to rapidly prototype and experiment with novel ideas in machine learning computation and has low overhead, competing with and often outperforming other popular machine learning frameworks. We see Flashlight as a tool enabling research that can benefit widely used libraries downstream and bring machine learning and systems researchers closer together. Flashlight is available at https://github.com/flashlight/flashlight .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑