arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.08108cs.GTcs.LG
收藏

广告拍卖中的用户响应:长期收益优化的MDP建模

User Response in Ad Auctions: An MDP Formulation of Long-Term Revenue Optimization

Yale University(耶鲁大学);Google Research(谷歌研究院)

Yang Cai, Zhe Feng, Christopher Liaw, Aranyak Mehta, Grigoris Velegkas

AI总结:

本文提出广告拍卖的MDP模型以刻画用户对广告质量的响应,将最优机制刻画为带修正虚拟价值的Myerson拍卖,并设计样本高效算法及基于个性化保留价的第二价格拍卖近似机制,实现长期折现收益优化。

摘要:

我们提出一种新的用于广告拍卖的马尔可夫决策过程(MDP)模型,以刻画用户对广告质量的响应,目标是最大化长期折现收益。通过引入用户响应,我们的模型同时考虑了拍卖中涉及的三方(广告主、拍卖方和用户)。用户状态被建模为用户特定的点击率(CTR),且该CTR在下一轮会根据当前轮向用户展示的广告集合而变化。我们将该MDP的最优机制刻画为一种带修正虚拟价值概念的Myerson拍卖,该修正虚拟价值依赖于广告主的价值分布、当前用户状态以及向用户展示该广告的未来影响。利用这一刻画,我们设计了一种样本高效且计算高效的算法,该算法输出一个近似最优策略,只需要对真实MDP和竞拍者价值分布的样本访问。最后,我们提出一种建立在带个性化保留价的第二价格拍卖之上的简单机制,并证明其能够对最优长期折现收益实现常数因子近似。

英文摘要:

We propose a new Markov Decision Process (MDP) model for ad auctions to capture the user response to the quality of ads, with the objective of maximizing the long-term discounted revenue. By incorporating user response, our model takes into consideration all three parties involved in the auction (advertiser, auctioneer, and user). The state of the user is modeled as a user-specific click-through rate (CTR) with the CTR changing in the next round according to the set of ads shown to the user in the current round. We characterize the optimal mechanism for this MDP as a Myerson's auction with a notion of modified virtual value, which relies on the value distribution of the advertiser, the current user state, and the future impact of showing the ad to the user. Leveraging this characterization, we design a sample-efficient and computationally-efficient algorithm which outputs an approximately optimal policy that requires only sample access to the true MDP and the value distributions of the bidders. Finally, we propose a simple mechanism built upon second price auctions with personalized reserve prices and show it can achieve a constant-factor approximation to the optimal long term discounted revenue.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑