饮食网络:脂肪基因组学的瘦参数
Diet Networks: Thin Parameters for Fat Genomics
摘要:
诸如涉及基因组数据的学习任务通常构成严重的挑战:输入特征的数量可能比训练样本的数量大几个数量级,使得即使使用已知的正则化技术也难以避免过拟合。在这里,我们专注于任务中的输入是一个特定于病人的遗传变异的描述,单核苷酸多态性(SNP),产生数百万的三元输入。提高深度学习处理此类数据集的能力可能会对精准医学产生重要影响,在精准医学中,有关特定患者的高维数据用于进行感兴趣的预测。尽管此类任务的数据量正在增加,但示例数量和输入数量之间的不匹配仍然是一个令人担忧的问题。分类器神经网络的简单实现在其第一层中涉及大量的自由参数:每个输入特征与隐藏单元一样多的参数相关联。我们提出了一种新的神经网络参数化,大大减少了自由参数的数量。它基于这样的想法,即我们可以首先学习或为每个输入特征提供分布式表示(例如对于观察到变异的基因组中的每个位置),然后学习(与另一个称为参数预测网络的神经网络)如何将特征的分布式表示映射到分类器神经网络中特定于该特征的参数向量(将特征的值链接到每个隐藏单元的权重)。我们的人口分层任务的医学研究的兴趣,所提出的方法可以显着减少参数的数量和分类器的出错率的实验。
英文摘要:
Learning tasks such as those involving genomic data often poses a serious challenge: the number of input features can be orders of magnitude larger than the number of training examples, making it difficult to avoid overfitting, even when using the known regularization techniques. We focus here on tasks in which the input is a description of the genetic variation specific to a patient, the single nucleotide polymorphisms (SNPs), yielding millions of ternary inputs. Improving the ability of deep learning to handle such datasets could have an important impact in precision medicine, where high-dimensional data regarding a particular patient is used to make predictions of interest. Even though the amount of data for such tasks is increasing, this mismatch between the number of examples and the number of inputs remains a concern. Naive implementations of classifier neural networks involve a huge number of free parameters in their first layer: each input feature is associated with as many parameters as there are hidden units. We propose a novel neural network parametrization which considerably reduces the number of free parameters. It is based on the idea that we can first learn or provide a distributed representation for each input feature (e.g. for each position in the genome where variations are observed), and then learn (with another neural network called the parameter prediction network) how to map a feature's distributed representation to the vector of parameters specific to that feature in the classifier neural network (the weights which link the value of the feature to each of the hidden units). We show experimentally on a population stratification task of interest to medical studies that the proposed approach can significantly reduce both the number of parameters and the error rate of the classifier.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。