arXiv:2606.01264 · v2
A 1000-hour EEG-EMG-audio dataset of Japanese speech production
摘要
We present a multimodal dataset of 1020 hours of simultaneously recorded scalp electroencephalography (EEG), facial electromyography (EMG), and speech audio from three healthy native Japanese speakers during open-vocabulary overt speech, covert repetition and speech listening. Recordings were acquired in many sessions over several months with three EEG systems of 61-128 channels, an ultra-high-density system (g.Pangolin) and two cap-type systems (g.SCARABEO and eego sports). Each session provides time-synchronized EEG, facial EMG, and audio, together with speech-event annotations and transcriptions. Although collected with speech decoding as a primary motivation, the dataset also supports work on multimodal signal processing, artifact modeling, longitudinal and cross-device adaptation, and EEG representation learning. Technical validation used power spectral density and event-related potential analyses to characterise spectral profiles and time-locked responses across participants, devices, and tasks. The dataset is available in Brain Imaging Data Structure (BIDS) format from Harvard Dataverse under controlled access for research use. Its speech audio is voice-masked.
作者备注:22 pages, 4 figures. This version describes controlled access, voice-masked audio, and expanded technical validation. Dataset: https://doi.org/10.7910/DVN/5RM3OT