SmartChoices:用学习得到的实现增强软件
SmartChoices: Augmenting Software with Learned Implementations
AI总结:
针对生产系统中用机器学习替换启发式决策成本过高的问题,提出SmartChoices框架,分离问题定义与ML实现细节,让非专家也能快速部署上下文老虎机类ML方案,已在多类软件中取得性能提升。
摘要:
在许多软件系统中,启发式算法被用于制定决策——例如缓存淘汰、任务调度和信息展示——这些决策对系统整体行为有显著影响。虽然机器学习的表现可能优于这些启发式算法,但在生产系统中安全可靠地替换现有启发式算法的成本可能高得令人望而却步。我们提出了SmartChoices,这是一种新颖的方法,可降低为上下文老虎机问题部署可投入生产的机器学习解决方案的成本。SmartChoices的接口将问题公式化与实现细节清晰分离:工程师通过定义传递给SmartChoices API的上下文、臂和反馈的数据类型来描述他们的用例,而SmartChoices负责数据编码与记录,以及策略的训练、评估与部署。我们的实现将最佳实践编入法典,效率足以在底层应用中使用,并通过共享库现成提供有价值的生产功能。总体而言,SmartChoices消除了机器学习系统中常见的许多技术债务来源,使非专家能够快速部署可投入生产的机器学习解决方案。工程师们已独立使用SmartChoices改进了包括缓存、批处理工作负载和UI布局在内的广泛软件,从而改善了延迟、吞吐量和点击率。
英文摘要:
In many software systems, heuristics are used to make decisions - such as cache eviction, task scheduling, and information presentation - that have a significant impact on overall system behavior. While machine learning may outperform these heuristics, replacing existing heuristics in a production system safely and reliably can be prohibitively costly. We present SmartChoices, a novel approach that reduces the cost to deploy production-ready ML solutions for contextual bandits problems. SmartChoices' interface cleanly separates problem formulation from implementation details: engineers describe their use case by defining datatypes for the context, arms, and feedback that are passed to SmartChoices APIs, while SmartChoices manages encoding & logging data and training, evaluating & deploying policies. Our implementation codifies best practices, is efficient enough for use in low-level applications, and provides valuable production features off the shelf via a shared library. Overall, SmartChoices enables non-experts to rapidly deploy production-ready ML solutions by eliminating many sources of technical debt common to ML systems. Engineers have independently used SmartChoices to improve a wide range of software including caches, batch processing workloads, and UI layouts, resulting in better latency, throughput, and click-through rates.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。