Work

Evidence Accumulation Drives Policy Change in Decision-Making.

Year: 2017
Type: dissertation
Abstract: Adaptive decision-making requires constant updating of relevant information and if needed switching to a new course of action. While much is known in regards to how reward is processed in the brain and how discrepancies in reward prediction may drive learning in reward-based decision making, much less is known about how the brain supports switching to a new course of action (changes in policy). One possibility is that it is accomplished through evidence accumulation, such that under normal circumstances an agent will prefer to continue its current course of action until enough evidence has been accumulated to indicate a potential benefit of adopting a new policy. Proactive preparatory neural signals may reflect evidence accumulation as they may be integrated in the brain in order to elicit a change in course of action (or policy) and guide decision-making. Using multimodal-neuroimaging methods from cognitive neuroscience and computational modeling techniques from reinforcement learning, the current research investigates whether proactive preparatory brain activation underlies decisions to switch courses of action. Specifically, three studies were conducted. For study 1, functional Magnetic Brain Imaging (fMRI) activity was collected while participants performed the Iowa Gambling task. Study 2, combines fMRI and computational modeling to test whether preparatory signals are present in the four-arm bandit gambling task. Study 3 investigates the temporospatial dynamics using EEG and the four-armed bandit task. Multilevel models were implemented to test the effect of pre-trial neural activity on subsequent choice behavior. fMRI analyses from studies 1 and 2 provide support for preparatory signals in frontal regions, particularly in dorsolateral prefrontal cortex, driving change in future courses of action. Consistent with these results, frequency analysis of EEG data in dorsolateral frontal regions revealed a significant effect of alpha power predicting a switch in action in future trials. Taken together, these results provide support for proactive preparatory brain activation as a neural mechanism supporting changes in action in decision-making, and more generally provide a much-needed consideration of the temporospatial dynamics of choice behavior in humans and in particular in policy implementation.
Author: Hans Melo
Language: English
Open Access status: green
OpenAlex ID: W2811486148
Cites: 84
Cited by:
Related to: 10