A More Accurate Algorithm Comparison through A/B Testing using Offline Evaluation Methods
通过离线评估方法的A/B测试实现更准确的算法比较
机构 * Hakuhodo DY Holdings Inc.(博报堂DY控股公司) ; Cornell University(康奈尔大学)
AI总结 揭示A/B测试可能比离线评估产生更高算法选择错误率的反直觉现象,提出通过引入假设中间算法并逐步估计性能差异来诱导正相关,从而减少关键选择错误。
Comments 13 pages, 10 figures. Accepted at KDD 2026; this version extends the camera-ready with additional experiments in Appendix B