EPS Dashboard

Authors: Justin Sanders, Luca Giancardo, Lan Guo et al.

Summary

The authors tackle antibody design using a modified diffusion model that avoids simply memorizing germline (inherited template) sequences. Standard protein language models trained on antibody data tend to just reproduce germline sequences rather than learning the biologically meaningful mutations that happen during immune response. Their "germline-absorbing diffusion" uses the germline sequence as the starting/ending point of the diffusion process (instead of random noise), forcing the model to learn only the trajectory of somatic mutations. This dramatically improves the model's ability to predict non-germline mutations (from 26% to 46% accuracy) and enables better conditional generation of antibodies with desired properties like reduced hydrophobicity.

Main takeaways:

Standard protein language models memorize germline (inherited) antibody sequences rather than learning the somatic mutations that create useful antibodies
Germline-absorbing diffusion modifies the noise process so the model learns the trajectory from germline to mutated sequence, excluding genetic recombination statistics
This biological inductive bias improves non-germline residue prediction from 26% to 46%, approaching the theoretical limit set by natural biological variability
The model supports classifier-guided generation: you can condition antibody design on any property predicted by an off-the-shelf classifier
Demonstrates improved trade-offs between target properties (hydrophobicity, binding affinity) and sample quality compared to baselines

Relevance

Tangentially relevant to my work on behavioral installation and inductive biases. The core idea—that diffusion models can memorize a "default" state (germlines) rather than learning the interesting variation—parallels my finding that models might default to certain personas or behaviors. The method of biasing the noise process toward a meaningful anchor point could conceptually relate to installation-path methods.

Abstract

arXiv:2605.06720v1 Announce Type: new Abstract: Antibody therapeutics are among the most successful modern medicines, yet computationally designing antibodies with desirable binding and developability properties remains challenging. While protein language models (pLMs) have emerged as powerful tools for antibody sequence design, existing approaches largely suffer from two key limitations: they predominantly memorize germline sequences rather than modeling biologically meaningful somatic variation, and they offer limited support for flexible classifier-guided conditional generation. We address these challenges through two primary contributions. First, we demonstrate that discrete diffusion fine-tuning achieves strong language modeling performance on antibody sequences while allowing for generation conditioned on any off-the-shelf classifier. Second, we introduce germline absorbing diffusion, a novel modification of the discrete diffusion noise process in which the germline sequence - rather than a masked sequence - serves as the absorbing state. This biologically motivated inductive bias restricts the model to learning the trajectory from germline to observed sequence, effectively excluding genetic variation and V(D)J recombination statistics from the learned distribution and dramatically mitigating germline bias. We show that germline diffusion improves non-germline residue prediction accuracy from 26 percent to 46 percent, approaching the theoretical upper bound set by true biological variability. We then demonstrate the utility of our germline diffusion model on the conditional generation tasks of sampling antibodies with improved hydrophobicity and predicted binding affinity. On both tasks our model shows an improved tradeoff between class adherence and sample quality, significantly outperforming EvoProtGrad, a popular strategy to sample from pLMs with gradient-based discrete Markov Chain Monte Carlo.