LogGENE:一种用于深度医疗推理任务的check损失平滑替代方案
LogGENE: A smooth alternative to check loss for Deep Healthcare Inference Tasks
AI总结:
针对分位数回归中check损失不可微的问题,提出用log-cosh作为平滑替代的LogGENE方法,在医疗及非医疗的回归、分类任务中实现了高精度,还兼具可解释性与不确定性估计能力。
摘要:
挖掘大规模数据集并从中获得校准的预测结果,在可靠深度学习领域具有直接的现实意义与实用价值。在本研究中,我们针对基因表达这类数据集,开发了基于深度神经网络的推理方法。但与典型的深度学习方法不同,我们的推理技术在准确率上达到当前最优(SOTA)性能的同时,还能提供可解释性,并输出不确定性估计。我们采用分位数回归(Quantile Regression)框架,针对给定的一组管家基因表达量预测完整的条件分位数。条件分位数除了能为预测结果提供丰富的解读维度外,还对测量噪声具有鲁棒性。我们的技术在高通量基因组学领域尤为重要,该领域正引领个性化医疗、靶向药物设计与递送的新时代。然而,分位数回归中用于驱动估计过程的check损失是不可微的。我们提出将log-cosh作为check损失的平滑替代方案。我们在GEO微阵列数据集上应用了所提方法,还将该方法拓展至二分类场景。此外,我们探究了损失函数平滑性在加快收敛方面的其他作用。我们进一步将该分类框架应用于其他医疗推理任务,如心脏病、乳腺癌、糖尿病等。为测试框架的泛化能力,我们还在其他非医疗类的回归与分类任务数据集上进行了评估。
英文摘要:
Mining large datasets and obtaining calibrated predictions from tem is of immediate relevance and utility in reliable deep learning. In our work, we develop methods for Deep neural networks based inferences in such datasets like the Gene Expression. However, unlike typical Deep learning methods, our inferential technique, while achieving state-of-the-art performance in terms of accuracy, can also provide explanations, and report uncertainty estimates. We adopt the Quantile Regression framework to predict full conditional quantiles for a given set of housekeeping gene expressions. Conditional quantiles, in addition to being useful in providing rich interpretations of the predictions, are also robust to measurement noise. Our technique is particularly consequential in High-throughput Genomics, an area which is ushering a new era in personalized health care, and targeted drug design and delivery. However, check loss, used in quantile regression to drive the estimation process is not differentiable. We propose log-cosh as a smooth-alternative to the check loss. We apply our methods on GEO microarray dataset. We also extend the method to binary classification setting. Furthermore, we investigate other consequences of the smoothness of the loss in faster convergence. We further apply the classification framework to other healthcare inference tasks such as heart disease, breast cancer, diabetes etc. As a test of generalization ability of our framework, other non-healthcare related data sets for regression and classification tasks are also evaluated.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。