arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.09558cs.LGstat.ML
收藏

一种有效的多变量实时优化Bandit算法

An Efficient Bandit Algorithm for Realtime Multivariate Optimization

Amazon.com, Inc.(亚马逊公司);UC Santa Cruz(加州大学圣克鲁兹分校)

Daniel N Hill, Houssam Nassif, Yi Liu, Anand Iyer, S V N Vishwanathan

摘要:

优化通常用于确定网页的内容,例如最大化着陆页上的转化或搜索引擎结果页上的点击率。通常,这些页面的布局可以分离为几个单独的决策。例如,着陆页的组成可能涉及决定显示哪个图像,使用哪个措辞,显示什么颜色的背景等。这种优化是指数级大决策空间上的组合问题。随机实验不能很好地扩展到这种设置,因此,在实践中,人们通常仅限于一次优化网页的单个方面。这意味着在实验速度和利用布局决策之间可能的相互作用方面错失了机会。在这里,我们专注于交互式网页的多变量优化。我们制定了一种方法,其中页面的不同组件之间的可能的相互作用明确建模。我们应用强盗方法有效地探索布局空间,并使用爬山法实时选择最佳内容。我们的算法还扩展到上下文和个性化的布局选择。仿真结果表明,我们的方法适用于大的决策空间与内容之间的强相互作用。我们进一步应用我们的算法来优化促进亚马逊服务采用的消息。经过一周的在线优化,我们看到与中位数布局相比,转化率增加了21%。我们的技术目前正在部署,以优化Amazon.com多个位置的内容。

英文摘要:

Optimization is commonly employed to determine the content of web pages, such as to maximize conversions on landing pages or click-through rates on search engine result pages. Often the layout of these pages can be decoupled into several separate decisions. For example, the composition of a landing page may involve deciding which image to show, which wording to use, what color background to display, etc. Such optimization is a combinatorial problem over an exponentially large decision space. Randomized experiments do not scale well to this setting, and therefore, in practice, one is typically limited to optimizing a single aspect of a web page at a time. This represents a missed opportunity in both the speed of experimentation and the exploitation of possible interactions between layout decisions. Here we focus on multivariate optimization of interactive web pages. We formulate an approach where the possible interactions between different components of the page are modeled explicitly. We apply bandit methodology to explore the layout space efficiently and use hill-climbing to select optimal content in realtime. Our algorithm also extends to contextualization and personalization of layout selection. Simulation results show the suitability of our approach to large decision spaces with strong interactions between content. We further apply our algorithm to optimize a message that promotes adoption of an Amazon service. After only a single week of online optimization, we saw a 21% conversion increase compared to the median layout. Our technique is currently being deployed to optimize content across several locations at Amazon.com.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑