How glitter relates to gold: Similarity-dependent reward prediction errors in the human striatum

Thorsten Kahnt, Soyoung Q. Park, Christopher J. Burke, Philippe N. Tobler

Research output: Contribution to journalArticlepeer-review

33 Scopus citations


Optimal choices benefit from previous learning. However, it is not clear how previously learned stimuli influence behavior to novel but similar stimuli. One possibility is to generalize based on the similarity between learned and current stimuli. Here, we use neuroscientific methods and a novel computational model to inform the question of how stimulus generalization is implemented in the human brain. Behavioral responses during an intradimensional discrimination task showed similarity-dependent generalization. Moreover, a peak shift occurred, i.e., the peak of the behavioral generalization gradient was displaced from the rewarded conditioned stimulus in the direction away from the unrewarded conditioned stimulus. To account for the behavioral responses, we designed a similarity-based reinforcement learning model wherein prediction errors generalize across similar stimuli and update their value. We show that this model predicts a similarity-dependent neural generalization gradient in the striatum as well as changes in responding during extinction. Moreover, across subjects, the width of generalization was negatively correlated with functional connectivity between the striatum and the hippocampus. This result suggests that hippocampus-striatal connections contribute to stimulus-specific value updating by controlling the width of generalization. In summary, our results shed light onto the neurobiology of a fundamental, similarity-dependent learning principle that allows learning the value of stimuli that have never been encountered.

Original languageEnglish (US)
Pages (from-to)16521-16529
Number of pages9
JournalJournal of Neuroscience
Issue number46
StatePublished - Nov 14 2012

ASJC Scopus subject areas

  • General Neuroscience


Dive into the research topics of 'How glitter relates to gold: Similarity-dependent reward prediction errors in the human striatum'. Together they form a unique fingerprint.

Cite this