We consider the problem of sequential evaluation, in which an evaluator observes candidates in a sequence and assigns scores to these candidates in an online, irrevocable fashion. Motivated by the psychology literature that has studied sequential bias in such settings -- namely, dependencies between the evaluation outcome and the order in which the candidates appear -- we propose a natural model for the evaluator's rating process that captures the lack of calibration inherent to such a task. We conduct crowdsourcing experiments to demonstrate various facets of our model. We then proceed to study how to correct sequential bias under our model by posing this as a statistical inference problem. We propose a near-linear time, online algorithm for this task and prove guarantees in terms of two canonical ranking metrics. We also prove that our algorithm is information theoretically optimal, by establishing matching lower bounds in both metrics. Finally, we perform a host of numerical experiments to show that our algorithm often outperforms the de facto method of using the rankings induced by the reported scores, both in simulation and on the crowdsourcing data that we collected.
UCB Momentum Q-learning: Correcting the bias without forgetting
Otto von Guericke University(奥托·冯·格里克大学);Inria(法国国家信息与自动化研究所);Université de Lille(里尔大学);DeepMind(深度思维)
我们提出了UCBMQ,上置信界动量Q-学习,一种新的算法,用于表格和可能的阶段依赖性,情节马尔可夫决策过程的强化学习。UCBMQ是基于Q学习的,我们在Q学习中加入了动量项,并依靠乐观原则来应对不确定性。UCBMQ的新技术成分是使用动量来纠正Q学习所遭受的偏见,同时限制它对后悔的二阶项的影响。对于UCBMQ,我们能够保证最多$O(\sqrt{H^3SAT}+ H^4 S A )$的遗憾,其中$H$是事件的长度,$S$是状态的数量,$A$是动作的数量,$T$是事件的数量,并且忽略poly- $\log(SAHT)$中的项。值得注意的是,UCBMQ是第一个同时匹配$Ω(\sqrt{H^3SAT})$的下限的算法,对于足够大的$T$,并且具有仅与状态数$S$线性缩放的二阶项(相对于水平$T$)。
The effect of winning an Oscar Award on survival: Correcting for healthy performer survivor bias with a rank preserving structural accelerated failure time model
Correcting heterogeneous diagnostic bias when developing clinical prediction models using causal hidden Markov models
Division of Informatics, Imaging & Data Sciences, University of Manchester(曼彻斯特大学信息学、影像与数据科学系);Department of Statistical Science, UCL(伦敦大学学院统计科学系);Division of Population Health, Health Services Research & Primary Care, University of Manchester(曼彻斯特大学人口健康、卫生服务研究与初级保健系)
Correcting Model Bias with Sparse Implicit Processes
Institute of Mathematical Sciences (ICMAT-CSIC)(数学科学研究所(ICMAT-CSIC));Escuela Politécnica Superior, Universidad Autónoma de Madrid(马德里自治大学高等理工学院);Institute of Corpuscular Physics, University of Valencia and CSIC(瓦伦西亚大学与西班牙国家研究委员会粒子物理研究所)
Correcting Boundary Bias and Observation Independence in Bayesian Experimental Design
Department of Information Technology, Uppsala University, Uppsala, Sweden(信息科技系,乌普萨拉大学);Department of Solar Cell Technology, Uppsala University, Uppsala, Sweden(太阳能电池技术系,乌普萨拉大学);Department of Computer Science, RISE Research Institute of Sweden, Stockholm, Sweden(计算机科学系,瑞典RISE研究所)