Work

Protocol to perform offline ECoG brain-to-text decoding for natural tonal sentences

Year: 2025
Type: article
Abstract: Here, we present a protocol to decode Mandarin sentences from invasive neural recordings using a brain-to-text framework. We describe steps for preparing materials, including designing the sentence corpus and setting up electrocorticography (ECoG) recording systems. We then detail procedures for decoding, such as data preprocessing, selection of speech-responsive electrodes, speech detection, syllable and tone decoding, and language modeling. We also outline performance evaluation metrics. For complete details on the use and execution of this protocol, please refer to Zhang et al. 1 • Instructions for designing appropriate language tasks for training • Steps for constructing a language model converting tonal syllables into sentences • Guidance on identifying speech-responsive and discriminative electrodes • Procedures for implementing multi-stream neural decoders to form a decoding pipeline Publisher’s note: Undertaking any experimental protocol requires adherence to local institutional guidelines for laboratory safety and ethics. Here, we present a protocol to decode Mandarin sentences from invasive neural recordings using a brain-to-text framework. We describe steps for preparing materials, including designing the sentence corpus and setting up electrocorticography (ECoG) recording systems. We then detail procedures for decoding, such as data preprocessing, selection of speech-responsive electrodes, speech detection, syllable and tone decoding, and language modeling. We also outline performance evaluation metrics.
Language: English
Open Access status: gold
Estimated APC paid: $1,550
OpenAlex ID: W4407839463
FWCI: 1.099
Cites: 14
Cited by: 2
Related to: 10