arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1911.10073cs.LGcs.AIstat.ML
收藏

通过功能抽样建立负责任的评分机制

Responsible Scoring Mechanisms Through Function Sampling

University of Illinois at Chicago(伊利诺伊大学芝加哥分校);University of Michigan(密歇根大学)

Abolfazl Asudeh, H. V. Jagadish

摘要:

人类决策者经常从数据驱动的算法系统中获得帮助,这些系统为评估对象(包括个人)提供分数。分数是由一个函数(机制)生成的,该函数将一组特征作为输入并生成分数。评分函数可以是机器学习的,也可以是人工设计的,可以用于不同的决策目的,如排名或分类。考虑到这些评分机制对个人生活和社会的潜在影响,确保这些分数的计算是负责任的是很重要的。因此,我们需要负责任的评分机制设计的工具。在本文中,专注于线性评分函数,我们强调的重要性,无偏函数采样和扰动的功能空间设计这样的工具。我们为整个函数空间提供无偏采样器,以及给定函数周围的$θ$ -邻域。然后,我们说明了这些采样器对于在排名背景下的三个不同问题场景中设计有效算法的价值。最后,作为设计负责任的评分机制的基本方法,我们提出了一种新的方法来近似超平面的安排的建设。尽管在维度的数量的安排的指数复杂性,使用函数采样,我们的算法是线性的样本和超平面的数量,和独立的维度的数量。

英文摘要:

Human decision-makers often receive assistance from data-driven algorithmic systems that provide a score for evaluating objects, including individuals. The scores are generated by a function (mechanism) that takes a set of features as input and generates a score.The scoring functions are either machine-learned or human-designed and can be used for different decision purposes such as ranking or classification. Given the potential impact of these scoring mechanisms on individuals' lives and on society, it is important to make sure these scores are computed responsibly. Hence we need tools for responsible scoring mechanism design. In this paper, focusing on linear scoring functions, we highlight the importance of unbiased function sampling and perturbation in the function space for devising such tools. We provide unbiased samplers for the entire function space, as well as a $θ$-vicinity around a given function. We then illustrate the value of these samplers for designing effective algorithms in three diverse problem scenarios in the context of ranking. Finally, as a fundamental method for designing responsible scoring mechanisms, we propose a novel approach for approximating the construction of the arrangement of hyperplanes. Despite the exponential complexity of an arrangement in the number of dimensions, using function sampling, our algorithm is linear in the number of samples and hyperplanes, and independent of the number of dimensions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑