Reinforcement learning for adaptive threshold control of restorative brain-computer interfaces: a Bayesian simulation
Year: 2015
Type: article
Abstract: Restorative brain-computer interfaces (BCI) are increasingly used to provide feedback of neuronal states in a bid to normalize pathological brain activity and achieve behavioral gains. However, patients and healthy subjects alike often show a large variability, or even inability, of brain self-regulation for BCI control, known as BCI illiteracy. Although current co-adaptive algorithms are powerful for assistive BCIs, their inherent class switching clashes with the operant conditioning goal of restorative BCIs. Moreover, due to the treatment rationale, the classifier of restorative BCIs usually has a constrained feature space, thus limiting the possibility of classifier adaptation. In this context, we applied a Bayesian model of neurofeedback and reinforcement learning for different threshold selection strategies to study the impact of threshold adaptation of a linear classifier on optimizing restorative BCIs. For each feedback iteration, we first determined the thresholds that result in minimal action entropy and maximal instructional efficiency. We then used the resulting vector for the simulation of continuous threshold adaptation. We could thus show that threshold adaptation can improve reinforcement learning, particularly in cases of BCI illiteracy. Finally, on the basis of information-theory, we provided an explanation for the achieved benefits of adaptive threshold setting.
Source: Frontiers in Neuroscience
Authors: Robert Bauer, Alireza Gharabaghi
Institution: University of Tübingen
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: gold
Estimated APC paid: $1,231
Awards: G2665996721, Verbundprojekt Bernstein Partner: Bewegungsassoziierte Aktivierung, Teilprojekt 1: Dekodierung bewegungsassoziierter Gehirnsignale, G4040957754, G4100741552, G4336306089, G493475660, G5135628020, Verbundprojekt: Entwicklung von mikrosystemtechnischen Komponenten und Aufbau eines multifunktionalen intrakraniellen Implantats -incrimp-, Teilvorhaben: Implantationsverfahren und in vivo Funktionsüberprüfung, G5970307284, G6002772749, G6306594225, G6851757991, G7141377270, G7611762986, G7822080342, G8354023138
OpenAlex ID: W1988869481
