走向ML工程:TensorFlow扩展(TFX)简史
Towards ML Engineering: A Brief History Of TensorFlow Extended (TFX)
摘要:
软件工程作为一门学科,在过去的5年多时间里已经成熟。现代世界在很大程度上依赖于它,因此软件工程的日益成熟是一种可能性。像测试和可靠技术这样的实践有助于使软件工程足够可靠,以建立行业。与此同时,机器学习(ML)也在过去的20多年里不断发展。ML越来越多地用于研究、实验和生产工作负载。ML现在通常为我们生活中不可或缺的广泛使用的产品提供动力。但是ML工程作为一门学科,并没有像它的软件工程祖先那样广泛成熟。我们能否利用我们所学到的知识,帮助新兴的应用机器学习领域发展成为机器学习工程,就像编程发展成为软件工程一样[1]?在这篇文章中,我们将快速浏览一下Siphabet [2]和TensorFlow Extended(TFX)[3],这是Alphabet的两个连续的端到端(E2E)ML平台。我们将分享在这些平台上构建的十多年应用机器学习的经验教训,解释它们的相似性和差异,并扩展帮助我们完成旅程的转变(包括精神和技术)。此外,我们将重点介绍TFX的一些功能,这些功能有助于实现ML工程的几个方面。我们认为,为了释放ML可以带来的收益,组织应该通过投资强大的ML基础设施和促进ML工程教育来提高其ML团队的成熟度。我们还建议,在专注于尖端的ML建模技术之前,产品领导者应该投入更多的时间来为他们的组织采用可互操作的ML平台。最后,我们还将分享TFX的未来。
英文摘要:
Software Engineering, as a discipline, has matured over the past 5+ decades. The modern world heavily depends on it, so the increased maturity of Software Engineering was an eventuality. Practices like testing and reliable technologies help make Software Engineering reliable enough to build industries upon. Meanwhile, Machine Learning (ML) has also grown over the past 2+ decades. ML is used more and more for research, experimentation and production workloads. ML now commonly powers widely-used products integral to our lives. But ML Engineering, as a discipline, has not widely matured as much as its Software Engineering ancestor. Can we take what we have learned and help the nascent field of applied ML evolve into ML Engineering the way Programming evolved into Software Engineering [1]? In this article we will give a whirlwind tour of Sibyl [2] and TensorFlow Extended (TFX) [3], two successive end-to-end (E2E) ML platforms at Alphabet. We will share the lessons learned from over a decade of applied ML built on these platforms, explain both their similarities and their differences, and expand on the shifts (both mental and technical) that helped us on our journey. In addition, we will highlight some of the capabilities of TFX that help realize several aspects of ML Engineering. We argue that in order to unlock the gains ML can bring, organizations should advance the maturity of their ML teams by investing in robust ML infrastructure and promoting ML Engineering education. We also recommend that before focusing on cutting-edge ML modeling techniques, product leaders should invest more time in adopting interoperable ML platforms for their organizations. In closing, we will also share a glimpse into the future of TFX.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。