CAMEL-CLIP: Channel-aware Multimodal Electroencephalography-text Alignment for Generalizable Brain Foundation Models
Hanseul Choi, Jinyeong Park, Seongwon Jin, Sungho Park, Jibum Kim
Electroencephalography (EEG) foundation models have shown promise for learning generalizable representations, yet they remain sensitive to channel heterogeneity, such as changes in channel composition or ordering. We propose channel-aware multimodal EEG-text alignment contrastive language image pretraining (CAMEL-CLIP), a contrastive EEG-text multimodal foundation model designed to be robust to heterogeneous channel configurations and widely applicable to diverse downstream tasks. CAMEL-CLIP combines three components: (1) channel attribute-based positional encoding, which identifies channels using their anatomical attributes and reference type; (2) dynamic channel projection, which preserves channel-specific information across varying numbers of EEG channels and combines textual reports with channel information to support channel-wise EEG-text matching; and (3) dual-level contrastive learning, which aligns EEG signals with text at both the individual-channel and whole-sample levels. Experimental results show that CAMEL-CLIP achieves the highest mean balanced accuracy among the evaluated baselines across multiple datasets under linear probing. CAMEL-CLIP also shows high classification performance when transferred between different channel configurations without classifier retraining.
尚无 AI 解读，展示原文摘要