一种用于生物医学二元分类的严格机器学习分析管道:在胰腺癌巢式病例对照研究中的应用及偏倚评估
A Rigorous Machine Learning Analysis Pipeline for Biomedical Binary Classification: Application in Pancreatic Cancer Nested Case-control Studies with Implications for Bias Assessments
摘要:
机器学习(ML)提供了一系列强大的方法来检测和建模关联,通常应用于具有大量特征和/或复杂关联的数据。目前,有许多工具可以帮助实现自定义ML分析(例如scikit-learn)。人们对自动化ML包的兴趣也在增加,这可以使非专家更容易应用ML,并有可能提高模型性能。ML渗透到生物医学研究的大多数子领域,具有不同程度的严格性和正确使用。ML提供的巨大机会经常被组装综合分析管道的挑战以及ML滥用的容易性所抵消。在这项工作中,我们设计并组装了一个完整的、严格的ML分析管道,专注于二进制分类(即病例/对照预测),并将该管道应用于模拟和真实世界的数据。在高层次上,这种“自动化”但可定制的管道包括a)探索性分析,b)数据清理和转换,c)特征选择,d)使用9种已建立的ML算法进行模型训练,每个算法都具有超参数优化,以及e)全面评估,包括适当的度量,统计分析和新颖的可视化。这个管道组织了ML管道组装的许多微妙的复杂性,以说明避免偏见和确保可重复性的最佳实践。此外,该管道是第一个将已建立的ML算法与“ExSTraCS”进行比较的管道,ExSTraCS是一种基于规则的ML算法,具有可解释地建模异构关联模式的独特能力。虽然被设计为广泛适用,但我们将此管道应用于对胰腺癌已确定和新确定的风险因素的流行病学调查,以评估ML算法如何处理不同来源的偏倚。
英文摘要:
Machine learning (ML) offers a collection of powerful approaches for detecting and modeling associations, often applied to data having a large number of features and/or complex associations. Currently, there are many tools to facilitate implementing custom ML analyses (e.g. scikit-learn). Interest is also increasing in automated ML packages, which can make it easier for non-experts to apply ML and have the potential to improve model performance. ML permeates most subfields of biomedical research with varying levels of rigor and correct usage. Tremendous opportunities offered by ML are frequently offset by the challenge of assembling comprehensive analysis pipelines, and the ease of ML misuse. In this work we have laid out and assembled a complete, rigorous ML analysis pipeline focused on binary classification (i.e. case/control prediction), and applied this pipeline to both simulated and real world data. At a high level, this 'automated' but customizable pipeline includes a) exploratory analysis, b) data cleaning and transformation, c) feature selection, d) model training with 9 established ML algorithms, each with hyperparameter optimization, and e) thorough evaluation, including appropriate metrics, statistical analyses, and novel visualizations. This pipeline organizes the many subtle complexities of ML pipeline assembly to illustrate best practices to avoid bias and ensure reproducibility. Additionally, this pipeline is the first to compare established ML algorithms to 'ExSTraCS', a rule-based ML algorithm with the unique capability of interpretably modeling heterogeneous patterns of association. While designed to be widely applicable we apply this pipeline to an epidemiological investigation of established and newly identified risk factors for pancreatic cancer to evaluate how different sources of bias might be handled by ML algorithms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。