We provide a unifying framework for the design and analysis of multicalibrated predictors. By placing the multicalibration problem in the general setting of multi-objective learning -- where learning guarantees must hold simultaneously over a set of distributions and loss functions -- we exploit connections to game dynamics to achieve state-of-the-art guarantees for a diverse set of multicalibration learning problems. In addition to shedding light on existing multicalibration guarantees and greatly simplifying their analysis, our approach also yields improved guarantees, such as obtaining stronger multicalibration conditions that scale with the square-root of group size and improving the complexity of $k$-class multicalibration by an exponential factor of $k$. Beyond multicalibration, we use these game dynamics to address emerging considerations in the study of group fairness and multi-distribution learning.
IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models
University College London(伦敦大学学院);Shanghai Jiao Tong University(上海交通大学);Alibaba Group(阿里巴巴集团);Tianjin University(天津大学);Birkbeck, University of London(伦敦大学伯贝克学院)
Unifying Behavioral and Response Diversity for Open-ended Learning in Zero-sum Games
Shanghai Jiao Tong University(上海交通大学);Netease Fuxi AI Lab(网易伏羲人工智能实验室);University College London(伦敦大学学院)
衡量和促进政策多样性对于解决存在战略周期且没有一致赢家的具有强非传递动态的游戏至关重要(例如,石头剪刀布)。考虑到这一点,通过开放式学习来维护一个多样化的政策库是一个有吸引力的解决方案,它可以生成自动课程,以避免被利用。然而,在传统的开放式学习算法,有没有广泛接受的定义的多样性,这使得它很难构建和评估的多样性政策。在这项工作中,我们总结了以前的多样性的概念,并致力于提供一个统一的多样性措施,在多智能体开放式学习,包括马尔可夫游戏中的所有元素,基于行为多样性(BD)和响应多样性(RD)。在轨迹分布层次上,我们将状态-动作空间中的BD重新定义为占有测度的差异。对于奖励动力学,我们提出RD通过政策在遇到不同对手时的反应来表征多样性。我们还表明,目前的许多多样性措施属于BD或RD的类别之一,但不是两者兼而有之。利用这种统一的多样性测度,设计了开放式学习中寻求最佳对策时相应的多样性促进目标和种群有效性。我们验证我们的方法在两个相对简单的游戏,如矩阵游戏,非传递混合模型,和复杂的\textit{Google Research Football}环境。在矩阵博弈和非传递混合模型中,我们发现的种群具有最低的可利用性和最高的种群有效性;在\textit{Google Research Football}中,我们发现的种群在与不同水平的对手进行交互时具有最大的目标差。
Neural Parameter Calibration for Finite-State Mean Field Games
Radboud University(拉德堡德大学);New York University(纽约大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Tel Aviv University(特拉维夫大学);New York University Shanghai(纽约大学上海)