VECT-GAN:一种用于克服制药科学中数据稀缺问题的变分编码生成模型
VECT-GAN: A variationally encoded generative model for overcoming data scarcity in pharmaceutical science
AI总结:
针对制药领域数据稀缺问题,提出新型VECT-GAN模型用于增强小型含噪表格数据集,结合ChEMBL预训练与知识蒸馏提升泛化性,在6个数据集上性能优于前沿模型,已开源为pip包。
摘要:
制药研究中的数据稀缺问题导致研发依赖劳动密集型的试错方法,而非数据驱动的方法。尽管机器学习提供了一种解决方案,但现有数据集通常规模小且含噪声,限制了其效用。为解决这一问题,我们开发了变分编码条件表格生成对抗网络(Variationally Encoded Conditional Tabular Generative Adversarial Network,VECT-GAN),这是一种专门为增强小型含噪声数据集而设计的新型生成模型。我们提出了一套流程:在回归模型开发前先进行数据增强,并证明该方法相比其他前沿表格生成模型,能持续且显著地提升性能。我们将这套流程应用于6个制药数据集,并通过研发具备医学所需黏膜粘附特性的新型聚合物(我们已制备并进行实验表征),彰显了其实际应用价值。此外,我们在类药分子数据库ChEMBL上预训练该模型,利用知识蒸馏增强其泛化能力,使其可直接用于含小分子的制药数据集——这是一类极为常见的制药任务。我们证明了合成数据对小型表格数据集的正则化作用,指出其有望成为制药模型开发的标准流程,并将我们的方法(包括在ChEMBL上预训练的VECT-GAN)作为pip包开源提供。
英文摘要:
Data scarcity in pharmaceutical research has led to reliance on labour-intensive trial-and-error approaches for development rather than data-driven methods. While Machine Learning offers a solution, existing datasets are often small and noisy, limiting their utility. To address this, we developed a Variationally Encoded Conditional Tabular Generative Adversarial Network (VECT-GAN), a novel generative model specifically designed for augmenting small, noisy datasets. We introduce a pipeline where data is augmented before regression model development and demonstrate that this consistently and significantly improves performance over other state-of-the-art tabular generative models. We apply this pipeline across six pharmaceutical datasets, and highlight its real-world applicability by developing novel polymers with medically desirable mucoadhesive properties, which we made and experimentally characterised. Additionally, we pre-train the model on the ChEMBL database of drug-like molecules, leveraging knowledge distillation to enhance its generalisability, making it readily available for use on pharmaceutical datasets containing small molecules, an extremely common pharmaceutical task. We demonstrate the power of synthetic data for regularising small tabular datasets, highlighting its potential to become standard practice in pharmaceutical model development, and make our method, including VECT-GAN pre-trained on ChEMBL available as a pip package.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。