arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.04259cs.LGq-bio.BM
收藏

深管汇取样器的多段保样

Multi-segment preserving sampling for deep manifold sampler

Genentech(基因泰克);New York University(纽约大学)

Daniel Berenberg, Jae Hyeon Lee, Simon Kelow, Ji Won Park, Andrew Watkins, Vladimir Gligorijević, Richard Bonneau, Stephen Ra, Kyunghyun Cho

摘要:

生物序列的深度生成建模在协调明确的生物洞察力和模型灵活性之间的偏差-方差权衡方面提出了独特的挑战。深流形采样器最近被提出作为一种手段,迭代采样可变长度的蛋白质序列,利用梯度从函数预测。我们介绍了一种替代方法,这种指导采样过程,多段保留采样,使特定领域的知识,通过指定保存和非保存段沿输入序列,从而限制变化,只有选择区域的直接列入。我们通过训练两个模型来展示其在抗体设计中的有效性:一个深歧管采样器和一个GPT-2语言模型,该模型基于近600万个用IGHV 1 -18基因注释的重链序列。在采样过程中,我们将变异限制在输入的互补决定区3(CDR 3)。我们从GPT-2模型中获得每个采样的CDR 3的对数概率分数,并证明多片段保留采样生成合理的设计,同时保持所需的保留区域。

英文摘要:

Deep generative modeling for biological sequences presents a unique challenge in reconciling the bias-variance trade-off between explicit biological insight and model flexibility. The deep manifold sampler was recently proposed as a means to iteratively sample variable-length protein sequences by exploiting the gradients from a function predictor. We introduce an alternative approach to this guided sampling procedure, multi-segment preserving sampling, that enables the direct inclusion of domain-specific knowledge by designating preserved and non-preserved segments along the input sequence, thereby restricting variation to only select regions. We present its effectiveness in the context of antibody design by training two models: a deep manifold sampler and a GPT-2 language model on nearly six million heavy chain sequences annotated with the IGHV1-18 gene. During sampling, we restrict variation to only the complementarity-determining region 3 (CDR3) of the input. We obtain log probability scores from a GPT-2 model for each sampled CDR3 and demonstrate that multi-segment preserving sampling generates reasonable designs while maintaining the desired, preserved regions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑