Year: 2026
Type: preprint
Abstract: Dopamine neurons are thought to signal reward prediction errors phasically and the opportunity cost of time tonically, while also displaying ramping activity during goal approach, and coupling with movement. These are often treated as distinct modes of dopamine function, each requiring its own computational explanation. Here we show that all can be unified by considering temporal difference learning within the context of continuous time, combined with the assumption that the brain computes value changes through a fast model-based process while maintaining a slower model-free cache. Together, the inclusion of these two ingredients explains phasic responses, tonic modulation between reward contexts, navigation ramps, speed scaling, and the fading of ramps with learning, without invoking separate mechanisms. We confirm these predictions across two independent datasets of dopamine recordings in rodents spanning freely-moving and head-fixed paradigms. Continuous temporal difference learning may thus provide a unified theory of dopamine function.
Authors: Sankalp Garud, Laurel Morris
Language: English
Subfield: Cellular and Molecular Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: green
Funder: Wellcome Trust
OpenAlex ID: W7152470037