← 研踪 PaperTrailCVF · CVPR 2026:cvf:7f2b54d92339aa75d4f2bca1ae898b71 · 记录 #1
Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
来源日期(仅到年份) 2026
来源记录日期 2026
雷达观测 2026-11-05 03:12
摘要
Brain visual decoding aims to recognize and reconstruct perceptual visual content from brain activity, providing a promising potential for the development of brain-computer interfaces and brain-inspired intelligence. However, this task faces a fundamental challenge of information asymmetry: while natural images contain complex visual scenes with objects and backgrounds, the corresponding brain signals reflect focused attention on central objects while being contaminated by various neural noise. Previous methods that directly align visual and brain representations often overlook this inherent asymmetry, resulting in suboptimal decoding performance. To address this, we propose linguistic-prior-guided visual decoupling method, which introduces object-oriented textual descriptions as semantic guidance to explicitly decouple foreground objects from complex backgrounds in natural images. This design enables the model to automatically focus on task-relevant visual concepts while effectively filtering out irrelevant neural noise in brain signals, achieving a transition from asymmetric vision-brain alignment to semantic symmetric alignment. Extensive experiments on the THINGS-EEG and THINGS-MEG datasets demonstrate that our method achieves new state-of-the-art performance in the zero-shot brain-to-image retrieval task. The source code is available at https://github.com/TKQXX/BVSA.
论文发现出处
这些页面提供论文线索,不代表同行评审或质量认证。
观测到的版本
平台记录号代表本站观测到的元数据变化,不是作者修订号。来源日期仅到月份或年份时,按该月或该年首日存档。
记录 #1 · 2026 · 最新观测版本
Linguistic Priors for Visual Decoupling: Towards Symmetric Vision-Brain Alignment
Brain visual decoding aims to recognize and reconstruct perceptual visual content from brain activity, providing a promising potential for the development of brain-computer interfaces and brain-inspired intelligence. However, this task faces a fundamental challenge of information asymmetry: while natural images contain complex visual scenes with objects and backgrounds, the corresponding brain signals reflect focused attention on central objects while being contaminated by various neural noise. Previous methods that directly align visual and brain representations often overlook this inherent asymmetry, resulting in suboptimal decoding performance. To address this, we propose linguistic-prior-guided visual decoupling method, which introduces object-oriented textual descriptions as semantic guidance to explicitly decouple foreground objects from complex backgrounds in natural images. This design enables the model to automatically focus on task-relevant visual concepts while effectively filtering out irrelevant neural noise in brain signals, achieving a transition from asymmetric vision-brain alignment to semantic symmetric alignment. Extensive experiments on the THINGS-EEG and THINGS-MEG datasets demonstrate that our method achieves new state-of-the-art performance in the zero-shot brain-to-image retrieval task. The source code is available at https://github.com/TKQXX/BVSA.
查看此版本解读 →查看此版本原文 ↗