Dopamine-Mediated Learning and Switching in Cortico-Striatal Circuit Explain Behavioral Changes in Reinforcement Learning
Year: 2011
Type: article
Abstract: The basal ganglia are thought to play a crucial role in reinforcement learning. Central to the learning mechanism are dopamine (DA) D1 and D2 receptors located in the cortico-striatal synapses. However, it is still unclear how this DA-mediated synaptic plasticity is deployed and coordinated during reward-contingent behavioral changes. Here we propose a computational model of reinforcement learning that uses different thresholds of D1- and D2-mediated synaptic plasticity which are antagonized by DA-independent synaptic plasticity. A phasic increase in DA release caused by a larger-than-expected reward induces long-term potentiation (LTP) in the direct pathway, whereas a phasic decrease in DA release caused by a smaller-than-expected reward induces a cessation of long-term depression, leading to LTP in the indirect pathway. This learning mechanism can explain the robust behavioral adaptation observed in a location-reward-value-association task where the animal makes shorter latency saccades to reward locations. The changes in saccade latency become quicker as the monkey becomes more experienced. This behavior can be explained by a switching mechanism which activates the cortico-striatal circuit selectively. Our model also shows how D1- or D2-receptor blocking experiments affect selectively either reward or no-reward trials. The proposed mechanisms also explain the behavioral changes in Parkinson's disease.
Authors: Simon Hong, Okihide Hikosaka
Institutions: National Institutes of Health, National Eye Institute
Language: English
Subfield: Cellular and Molecular Neuroscience
Field: Neuroscience
Domain: Life Sciences
Keywords: dopamine, reinforcement learning, corticostriatal circuits, basal ganglia, dopamine D1 receptor, dopamine D2 receptor, synaptic plasticity, long-term potentiation, long-term depression, direct and indirect pathways, reward prediction, saccade latency, switching behavior, computational model, Parkinson's disease, receptor antagonism
Open Access status: gold
Estimated APC paid: $3,801
Funder: National Eye Institute
OpenAlex ID: W2013314169
