跳到正文
研踪PaperTrail
← 研踪 PaperTrail

arXiv:2608.27754 · v2

Towards Efficient Auto-Interpretability of Boltz-1 Sparse Autoencoders

首次提交 2026-08-28 06:32
版本更新 2026-11-17 05:33
雷达观测 2026-11-18 19:43
arXiv ↗PDF ↗

摘要

Sparse autoencoders (SAEs) could turn AI models in Biology and other fields into engines of scientific discovery by explaining the superhuman capabilities of those models. We postulate that a latent is useful if we know three things: whether it is coherent, whether it can be described, and whether that description has predictive power. These questions are routinely conflated. We assemble them into a single pipeline and report some practical innovations. First, cross-seed dictionary stability prioritises which latents are worth spending resources to investigate. Second, an intruder-detection task asks whether a latent's activating examples share a recognizable pattern. Third, a separate pass proposes a candidate biological description which we convert into falsifiable predictions which can be tested in silico. Deployed on the Boltz-1 Pairformer trunk, stability prioritisation finds interpretable latents using about 4.4 times fewer latent evaluations each, and at 5.2 times lower measured LLM cost, while recovering over half of them. However, we notice that in our setup the LLM judge is heavily biased towards consistent residue identity and a simple filter that selects for features with high amino-acid identity precision outperforms the stability thresholding. This simpler method has the added benefit of requiring no extra SAE seeds but it remains uncertain if it reflects a genuinely useful heuristic or an limitation of the LLM judge.

AI 论文解读

基于摘要 · 非全文审阅

此版本尚未生成 AI 解读。解读由后台任务生成并按论文版本保存,登录后共享已有结果。

版本差异

本站首次收录为 v2,暂无更早版本可对照。

观测到的版本

相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。

v2 · 2026-11-17 05:33 · 最新观测版本

Towards Efficient Auto-Interpretability of Boltz-1 Sparse Autoencoders

Sparse autoencoders (SAEs) could turn AI models in Biology and other fields into engines of scientific discovery by explaining the superhuman capabilities of those models. We postulate that a latent is useful if we know three things: whether it is coherent, whether it can be described, and whether that description has predictive power. These questions are routinely conflated. We assemble them into a single pipeline and report some practical innovations. First, cross-seed dictionary stability prioritises which latents are worth spending resources to investigate. Second, an intruder-detection task asks whether a latent's activating examples share a recognizable pattern. Third, a separate pass proposes a candidate biological description which we convert into falsifiable predictions which can be tested in silico. Deployed on the Boltz-1 Pairformer trunk, stability prioritisation finds interpretable latents using about 4.4 times fewer latent evaluations each, and at 5.2 times lower measured LLM cost, while recovering over half of them. However, we notice that in our setup the LLM judge is heavily biased towards consistent residue identity and a simple filter that selects for features with high amino-acid identity precision outperforms the stability thresholding. This simpler method has the added benefit of requiring no extra SAE seeds but it remains uncertain if it reflects a genuinely useful heuristic or an limitation of the LLM judge.

查看此版本解读 →查看此版本原文 ↗