2011年2月2日水曜日

Dopamine-Mediated Reinforcement Learning Signals in the Striatum and Ventromedial Prefrontal Cortex Underlie Value-Based Choices

Gerhard Jocham, Tilmann A. Klein, and Markus Ullsperger
The Journal of Neuroscience, February 2, 2011, 31(5):1606-1613; doi:10.1523/JNEUROSCI.3904-10.2011

A large body of evidence exists on the role of dopamine in reinforcement learning. Less is known about how dopamine shapes the relative impact of positive and negative outcomes to guide value-based choices. We combined administration of the dopamine D2 receptor antagonist amisulpride with functional magnetic resonance imaging in healthy human volunteers. Amisulpride did not affect initial reinforcement learning. However, in a later transfer phase that involved novel choice situations requiring decisions between two symbols based on their previously learned values, amisulpride improved participants' ability to select the better of two highly rewarding options, while it had no effect on choices between two very poor options. During the learning phase, activity in the striatum encoded a reward prediction error. In the transfer phase, in the absence of any outcome, ventromedial prefrontal cortex (vmPFC) continually tracked the learned value of the available options on each trial. Both striatal prediction error coding and tracking of learned value in the vmPFC were predictive of subjects' choice performance in the transfer phase, and both were enhanced under amisulpride. These findings show that dopamine-dependent mechanisms enhance reinforcement learning signals in the striatum and sharpen representations of associative values in prefrontal cortex that are used to guide reinforcement-based decisions. 

強化学習とドーパミン。D2 antagonistを投与すると、学習に影響はないけど、学習結果を使った行動選択が一部改善される。また、予測誤差や価値関連のfMRI信号も増大する。データはきれいだけど、解釈はすっきりしない感じ。議論がムズい…

今日から来週火曜にかけて、行動実験×15人。がんばろう。

0 件のコメント:

コメントを投稿