Do not Bet on the Unknown Versus Try to Find Out More: Estimation Uncertainty and “Unexpected Uncertainty” Both Modulate Exploration
Year: 2012
Type: article
Abstract: Little is known about how humans solve the exploitation/exploration trade-off. In particular, the evidence for uncertainty-driven exploration is mixed. The current study proposes a novel hypothesis of exploration that helps reconcile prior findings that may seem contradictory at first. According to this hypothesis, uncertainty-driven exploration involves a dilemma between two motives: (i) to speed up learning about the unknown, which may beget novel reward opportunities; (ii) to avoid the unknown because it is potentially dangerous. We provide evidence for our hypothesis using both behavioral and simulated data, and briefly point to recent evidence that the brain differentiates between these two motives.
Source: Frontiers in Neuroscience
Authors: Élise Payzan-LeNestour, Peter Bossaerts
Institutions: California Institute of Technology, UNSW Sydney
Language: English
Subfield: General Decision Sciences
Field: Decision Sciences
Domain: Social Sciences
Open Access status: gold
Estimated APC paid: $3,801
OpenAlex ID: W2060762691
