信息流能否为神经回路的干预靶点提供提示?
Can Information Flows Suggest Targets for Interventions in Neural Circuits?
AI总结:
本研究在机器学习公平性场景下验证M-信息流可提示神经网络干预靶点,剪枝高受保护属性信息流的边能更有效降偏差,并分析了偏差-准确率权衡以指导保精度降偏差的干预。
摘要:
受神经科学与临床应用的启发,我们通过实证研究检验信息流的观测度量是否能为干预提供提示。我们在机器学习公平性场景下的人工神经网络上开展实验,该场景的目标是通过干预使系统具备公平性。\n利用我们近期提出的M-信息流框架,我们分别在已训练神经网络的边上测量真实标签相关的信息流(对应准确率,因此是期望的),以及受保护属性相关的信息流(对应偏差,因此是不期望的)。随后我们将这些流的大小与通过剪枝干预对应边的效果进行比较。\n研究表明,剪枝承载更大受保护属性信息流的边,能更大程度降低输出端的偏差。这证明M-信息流可以有效提示干预靶点,对标题中的问题给出了肯定答案。我们还评估了不同干预策略的偏差-准确率权衡,以分析如何利用期望与非期望信息流(此处为准确率流和偏差流)的估计来指导干预,在减少后者的同时保留前者。
英文摘要:
Motivated by neuroscientific and clinical applications, we empirically examine whether observational measures of information flow can suggest interventions. We do so by performing experiments on artificial neural networks in the context of fairness in machine learning, where the goal is to induce fairness in the system through interventions. Using our recently developed $M$-information flow framework, we measure the flow of information about the true label (responsible for accuracy, and hence desirable), and separately, the flow of information about a protected attribute (responsible for bias, and hence undesirable) on the edges of a trained neural network. We then compare the flow magnitudes against the effect of intervening on those edges by pruning. We show that pruning edges that carry larger information flows about the protected attribute reduces bias at the output to a greater extent. This demonstrates that $M$-information flow can meaningfully suggest targets for interventions, answering the title's question in the affirmative. We also evaluate bias-accuracy tradeoffs for different intervention strategies, to analyze how one might use estimates of desirable and undesirable information flows (here, accuracy and bias flows) to inform interventions that preserve the former while reducing the latter.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。