Confirmation bias in human reinforcement learning: Evidence from counterfactual feedback processing
Year: 2017
Type: article
Abstract: Previous studies suggest that factual learning, that is, learning from obtained outcomes, is biased, such that participants preferentially take into account positive, as compared to negative, prediction errors. However, whether or not the prediction error valence also affects counterfactual learning, that is, learning from forgone outcomes, is unknown. To address this question, we analysed the performance of two groups of participants on reinforcement learning tasks using a computational model that was adapted to test if prediction error valence influences learning. We carried out two experiments: in the factual learning experiment, participants learned from partial feedback (i.e., the outcome of the chosen option only); in the counterfactual learning experiment, participants learned from complete feedback information (i.e., the outcomes of both the chosen and unchosen option were displayed). In the factual learning experiment, we replicated previous findings of a valence-induced bias, whereby participants learned preferentially from positive, relative to negative, prediction errors. In contrast, for counterfactual learning, we found the opposite valence-induced bias: negative prediction errors were preferentially taken into account, relative to positive ones. When considering valence-induced bias in the context of both factual and counterfactual learning, it appears that people tend to preferentially take into account information that confirms their current choice.
Source: PLoS Computational Biology
Authors: Stefano Palminteri(Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing), Germain Lefebvre(Conceptualization, Data curation, Formal analysis, Software, Validation, Visualization, Writing – original draft), Emma J. Kilford(Conceptualization, Validation, Visualization, Writing – review & editing), Sarah-Jayne Blakemore(Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Validation, Writing – review & editing)
Language: English
Subfield: Cognitive Neuroscience
Field: Neuroscience
Domain: Life Sciences
Open Access status: gold
Estimated APC paid: $3,043
Awards: Paris Sciences et Lettres, G4190806336, Developmental trajectories for model-free and model-based reinforcement learning: computational and neural bases, Institute of Cognitive Studies of Ecole normale superieure, G5420063140, Neurocomputational substrates of the monetary exchange: An interdisciplinary investigation, G6759105742, G7376787254, G782245399
OpenAlex ID: W2558439382
