arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1904.02547cs.CLcs.AIcs.LG
收藏

脑-脑编码实验的鲁棒性评价

Robust Evaluation of Language-Brain Encoding Experiments

University of Amsterdam(阿姆斯特丹大学)

Lisa Beinborn, Samira Abnar, Rochelle Choenni

摘要:

记忆-大脑编码实验评估语言模型预测由语言刺激引起的大脑反应的能力。这项任务的评价方案尚未标准化,因此难以比较和解释结果。我们进行了一系列的评价实验与一致的编码设置和计算多个fMRI数据集的结果。此外,我们测试的敏感性的评价措施,随机数据和体素选择方法的效果进行了分析。我们的实验框架是公开的,使建模决策更加透明,并支持未来比较的可重复性。

英文摘要:

Language-brain encoding experiments evaluate the ability of language models to predict brain responses elicited by language stimuli. The evaluation scenarios for this task have not yet been standardized which makes it difficult to compare and interpret results. We perform a series of evaluation experiments with a consistent encoding setup and compute the results for multiple fMRI datasets. In addition, we test the sensitivity of the evaluation measures to randomized data and analyze the effect of voxel selection methods. Our experimental framework is publicly available to make modelling decisions more transparent and support reproducibility for future comparisons.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑