← 研踪 PaperTrailarXiv:2611.24364 · v1
CHORUS: Cross-Subject Harmonization via Population Relay for Unseen Subjects in Brain Visual Decoding
首次提交 2026-11-18 20:58
版本更新 2026-11-18 20:58
雷达观测 2026-11-19 15:04
摘要
EEG-based image retrieval performs well on training subjects but generalizes poorly to unseen individuals. Existing calibration methods address this gap by aligning a new subject directly with image embeddings. We find that the training population is a better alignment target: an unseen subject's embeddings are closer to the stimulus-matched population average than to the image embeddings, and the remaining gap to the population is largely a shift and a rotation. Motivated by this finding, we propose CHORUS. At training, stimulus-matched cross-subject averaging (SCA) teaches the encoder to match responses to the same image across subjects; at deployment, a two-stage calibration first aligns an unseen subject to population anchors predicted from the decoder's visual features, and then to the image embeddings. On leave-one-subject-out THINGS-EEG2 with two backbones, CHORUS improves over direct calibration by 10.92 and 6.63 points on unlabeled test batches and by 4.2-6.9 points with 10-200 labeled pairs; even without the population stage, SCA and direct calibration each outperform prior training and calibration schemes. The complete system reaches 78.37% and 73.40% 200-way Top-1 accuracy, 36.32 and 20.93 points above SCORE.
观测到的版本
相邻记录可能跳过中间版本;首次发现 v2 及以上也会标为版本更新。
v1 · 2026-11-18 20:58 · 最新观测版本
CHORUS: Cross-Subject Harmonization via Population Relay for Unseen Subjects in Brain Visual Decoding
EEG-based image retrieval performs well on training subjects but generalizes poorly to unseen individuals. Existing calibration methods address this gap by aligning a new subject directly with image embeddings. We find that the training population is a better alignment target: an unseen subject's embeddings are closer to the stimulus-matched population average than to the image embeddings, and the remaining gap to the population is largely a shift and a rotation. Motivated by this finding, we propose CHORUS. At training, stimulus-matched cross-subject averaging (SCA) teaches the encoder to match responses to the same image across subjects; at deployment, a two-stage calibration first aligns an unseen subject to population anchors predicted from the decoder's visual features, and then to the image embeddings. On leave-one-subject-out THINGS-EEG2 with two backbones, CHORUS improves over direct calibration by 10.92 and 6.63 points on unlabeled test batches and by 4.2-6.9 points with 10-200 labeled pairs; even without the population stage, SCA and direct calibration each outperform prior training and calibration schemes. The complete system reaches 78.37% and 73.40% 200-way Top-1 accuracy, 36.32 and 20.93 points above SCORE.
查看此版本解读 →查看此版本原文 ↗