论文标题

药物发现的抗体表示学习

Antibody Representation Learning for Drug Discovery

论文作者

Li, Lin, Gupta, Esther, Spaeth, John, Shing, Leslie, Bepler, Tristan, Caceres, Rajmonda Sulo

论文摘要

治疗性抗体的开发已成为药物开发越来越流行的方法。迄今为止,使用包含数亿种抗体序列的抗体文库的大规模实验筛选在很大程度上开发了抗体疗法。开发治疗抗体的高成本和困难产生了对预测抗体特性并创建定制设计的计算方法的紧迫需求。但是,抗体序列和活性之间的关系是一个复杂的物理过程,传统的迭代设计方法依赖于大规模测定和随机诱变。深度学习方法已成为学习抗体属性预测因子的一种有前途的方法,但是预测抗体属性和目标特异性活动在很大程度上取决于抗体表示的选择和数据链接到属性的选择。现有作品尚未调查这些方法在基于抗体的药物发现中的价值,局限性和机会。在本文中,我们介绍了一种新型的SARS-COV-2抗体结合数据集和其他基准数据集的结果。我们比较了三类模型:常规统计序列模型,独立对每个数据集的监督学习,以及对抗体特定于特定的预训练的语言模型。实验结果表明,对特征表示的预处理预处理一致地比以前的方法可显着改善。我们还研究了数据大小对模型性能的影响,并讨论了机器学习社区可以解决的挑战和机遇,以促进硅工程和治疗抗体设计。

Therapeutic antibody development has become an increasingly popular approach for drug development. To date, antibody therapeutics are largely developed using large scale experimental screens of antibody libraries containing hundreds of millions of antibody sequences. The high cost and difficulty of developing therapeutic antibodies create a pressing need for computational methods to predict antibody properties and create bespoke designs. However, the relationship between antibody sequence and activity is a complex physical process and traditional iterative design approaches rely on large scale assays and random mutagenesis. Deep learning methods have emerged as a promising way to learn antibody property predictors, but predicting antibody properties and target-specific activities depends critically on the choice of antibody representations and data linking sequences to properties is often limited. Existing works have not yet investigated the value, limitations and opportunities of these methods in application to antibody-based drug discovery. In this paper, we present results on a novel SARS-CoV-2 antibody binding dataset and an additional benchmark dataset. We compare three classes of models: conventional statistical sequence models, supervised learning on each dataset independently, and fine-tuning an antibody specific pre-trained language model. Experimental results suggest that self-supervised pretraining of feature representation consistently offers significant improvement in over previous approaches. We also investigate the impact of data size on the model performance, and discuss challenges and opportunities that the machine learning community can address to advance in silico engineering and design of therapeutic antibodies.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源