Active Learning for Contextual Search with Binary Feedbacks
Leonard N. Stern School of Business, New York University（纽约大学伦纳德·N·斯特恩商学院）；Naveen Jindal School of Management, University of Texas at Dallas（德克萨斯大学达拉斯分校纳文·金达尔管理学院）
In this paper, we study the learning problem in contextual search, which is motivated by applications such as first-price auction, personalized medicine experiments, and feature-based pricing experiments. In particular, for a sequence of arriving context vectors, with each context associated with an underlying value, the decision-maker either makes a query at a certain point or skips the context. The decision-maker will only observe the binary feedback on the relationship between the query point and the value associated with the context. We study a PAC learning setting, where the goal is to learn the underlying mean value function in context with a minimum number of queries. To address this challenge, we propose a tri-section search approach combined with a margin-based active learning method. We show that the algorithm only needs to make $O(1/\varepsilon^2)$ queries to achieve an $ε$-estimation accuracy. This sample complexity significantly reduces the required sample complexity in the passive setting, at least $Ω(1/\varepsilon^4)$.
Department of EECS, University of Michigan, Ann Arbor, MI, USA（密歇根大学电气工程与计算机科学系）；Department of Aerospace Engineering, University of Michigan, Ann Arbor, MI, USA（密歇根大学航空航天工程系）；Climate and Space Engineering, University of Michigan, Ann Arbor, MI, USA（密歇根大学气候与空间工程系）
Algorithmic Chaining and the Role of Partial Feedback in Online Nonparametric Learning
Università degli Studi di Milano（米兰大学）；INRIA（法国国家信息与自动化研究所）；École Normale Supérieure（巴黎高等师范学院）；Università degli Studi dell’Insubria（因苏布里亚大学）；Université Toulouse III - Paul Sabatier（图卢兹第三大学（保罗·萨巴蒂埃大学））
Neural Dueling Bandits: Preference-Based Optimization with Human Feedback
Singapore-MIT Alliance for Research and Technology（新加坡-麻省理工学院研究与技术联盟）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；National University of Singapore（新加坡国立大学）；Massachusetts Institute of Technology（麻省理工学院）
Low-Rank Contextual Reinforcement Learning from Heterogeneous Human Feedback
Department of Statistics and Operations Research, University of North Carolina, Chapel Hill（统计与运筹学系，北卡罗来纳大学 Chapel Hill 分校）；Daniels School of Business, Purdue University（商务学院，普渡大学）；Department of Statistics and Operations Research, Department of Genetics, Department of Biostatistics, The University of North Carolina at Chapel Hill（统计与运筹学系，遗传学系，生物统计学系，北卡罗来纳大学 Chapel Hill 分校）
Contextual Online Uncertainty-Aware Preference Learning for Human Feedback
Department of Biostatistics, Harvard T.H. Chan School of Public Health（哈佛大学T.H.陈公共卫生学院生物统计学系）；Department of Biostatistics & Bioinformatics, Duke University（杜克大学生物统计学与生物信息学系）
INRAE（法国国家农业食品与环境研究院）；Institut Agro（法国国家农业、食品与环境学院）；Univ Montpellier（蒙彼利埃大学）；Université Paris-Saclay（巴黎萨克雷大学）；Institut für Mathematik, Universität Potsdam（波茨坦大学数学研究所）
Bayesian Active Learning With Abstention Feedbacks
Amazon Web Services（亚马逊云科技）；Dalhousie University（达尔豪斯大学）；Alibaba Inc.（阿里巴巴集团）；University of Delaware（特拉华大学）；AISIA Research Lab（AISIA研究实验室）；University of Science（理学院）；Vietnam National University, Ho Chi Minh City（胡志明市越南国家大学）
