Probing and steering biology across Boltz-1s trunk-diffusion boundary
Piotr Jedryszek, Tongmeng Xie, Adam Winnifrith, Alexander Hasson, Weronika Ślesak, George Wicks, Toby Winnifrith, Oliver M. Crook
原文摘要
AlphaFold3-class structure predictors pair a representational trunk, which processes sequence and context, with a diffusion module, which generates atomic coordinates. How biological information changes as it crosses this architectural boundary remains poorly understood. We analyze per-residue activations from the Pairformer trunk and diffusion module of Boltz-1 using linear probes, sparse autoencoders (SAEs), and causal interventions. From the trunk, both geometry (secondary structure, disorder) and sequence chemistry (amino-acid identity, signal peptides, disulfide-bond annotations) are linearly decodable. In the diffusion module, the two diverge. Secondary structure remains equally decodable, whereas sequence chemistry becomes much less linearly accessible. We then test whether decodable directions can steer the model by editing the trunk's single representation. Helix and coil directions change predicted structure dose-dependently, but a beta-strand direction that is highly predictive on the same proteins (held-out F1 =0.78) produces no measurable increase in strand content at any of the steered layers. Removing helix or coil directions does not remove that structure. Linear decodability therefore did not imply causal influence at the sites we tested. The same probes also score markedly lower against SwissProt annotations than against DSSP labels, because unannotated residues that the model gets right are charged as false positives; such scores are therefore lower bounds. Finally, supervised probes outscore single SAE features wherever a label already exists.
q-bio.QM · cs.LG