Protocol to perform offline ECoG brain-to-text decoding for natural tonal sentences
Year: 2025
Type: article
Abstract: Here, we present a protocol to decode Mandarin sentences from invasive neural recordings using a brain-to-text framework. We describe steps for preparing materials, including designing the sentence corpus and setting up electrocorticography (ECoG) recording systems. We then detail procedures for decoding, such as data preprocessing, selection of speech-responsive electrodes, speech detection, syllable and tone decoding, and language modeling. We also outline performance evaluation metrics. For complete details on the use and execution of this protocol, please refer to Zhang et al. 1 • Instructions for designing appropriate language tasks for training • Steps for constructing a language model converting tonal syllables into sentences • Guidance on identifying speech-responsive and discriminative electrodes • Procedures for implementing multi-stream neural decoders to form a decoding pipeline Publisher’s note: Undertaking any experimental protocol requires adherence to local institutional guidelines for laboratory safety and ethics. Here, we present a protocol to decode Mandarin sentences from invasive neural recordings using a brain-to-text framework. We describe steps for preparing materials, including designing the sentence corpus and setting up electrocorticography (ECoG) recording systems. We then detail procedures for decoding, such as data preprocessing, selection of speech-responsive electrodes, speech detection, syllable and tone decoding, and language modeling. We also outline performance evaluation metrics.
Source: STAR Protocols
Authors: Daohan Zhang, Zhenjie Wang, Youkun Qian, Zehao Zhao, Yan Liu, Junfeng Lu, Yuanning Li
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: gold
Estimated APC paid: $1,550
Funders: Swiss Tumor Institute, National Natural Science Foundation of China, Ministry of Science and Technology of the People's Republic of China, Fudan University, Shanghai Municipal Education Commission, Science and Technology Commission of Shanghai Municipality, ShanghaiTech University, Shanghai Rising-Star Program
OpenAlex ID: W4407839463
