話題のVoodoo論文。前作もそうだったけど「Circular Analysis」と「多重比較」の話が混ざっていて読みにくい。社会神経科学における「神経活動と行動指標の被験者間相関」が槍玉に挙げられているけど… http://www.sciencedirect.com/science/article/pii/S1053811912000444
Dissociable neural representations of reinforcement and belief prediction errors underlie strategic learning
Lusha Zhu, Kyle E. Mathewson, and Ming Hsu
PNAS January 31, 2012 vol. 109 no. 5 1419-1424
Decision-making in the presence of other competitive intelligent agents is fundamental for social and economic behavior. Such decisions require agents to behave strategically, where in addition to learning about the rewards and punishments available in the environment, they also need to anticipate and respond to actions of others competing for the same rewards. However, whereas we know much about strategic learning at both theoretical and behavioral levels, we know relatively little about the underlying neural mechanisms. Here, we show using a multi-strategy competitive learning paradigm that strategic choices can be characterized by extending the reinforcement learning (RL) framework to incorporate agents’ beliefs about the actions of their opponents. Furthermore, using this characterization to generate putative internal values, we used model-based functional magnetic resonance imaging to investigate neural computations underlying strategic learning. We found that the distinct notions of prediction errors derived from our computational model are processed in a partially overlapping but distinct set of brain regions. Specifically, we found that the RL prediction error was correlated with activity in the ventral striatum. In contrast, activity in the ventral striatum, as well as the rostral anterior cingulate (rACC), was correlated with a previously uncharacterized belief-based prediction error. Furthermore, activity in rACC reflected individual differences in degree of engagement in belief learning. These results suggest a model of strategic behavior where learning arises from interaction of dissociable reinforcement and belief-based inputs.
Coren L. Apicella, Frank W. Marlowe, James H. Fowler & Nicholas A. Christakis
Nature 481, 497–501 (26 January 2012)
Social networks show striking structural regularities1, 2, and both theory and evidence suggest that networks may have facilitated the development of large-scale cooperation in humans3, 4, 5, 6, 7. Here, we characterize the social networks of the Hadza, a population of hunter-gatherers in Tanzania8. We show that Hadza networks have important properties also seen in modernized social networks, including a skewed degree distribution, degree assortativity, transitivity, reciprocity, geographic decay and homophily. We demonstrate that Hadza camps exhibit high between-group and low within-group variation in public goods game donations. Network ties are also more likely between people who give the same amount, and the similarity in cooperative behaviour extends up to two degrees of separation. Social distance appears to be as important as genetic relatedness and physical proximity in explaining assortativity in cooperation. Our results suggest that certain elements of social network structure may have been present at an early point in human history. Also, early humans may have formed ties with both kin and non-kin, based in part on their tendency to cooperate. Social networks may thus have contributed to the emergence of cooperation.
Stephen D. Mayhew, Sheng Li, and Zoe Kourtzi
The Journal of Neuroscience, 18 January 2012, 32(3):775-786;
Learning is known to facilitate our ability to detect targets in clutter and optimize brain processes for successful visual recognition. Previous brain-imaging studies have focused on identifying spatial patterns (i.e., brain areas) that change with learning, implicating occipitotemporal and frontoparietal areas. However, little is known about the interactions within this network that mediate learning-dependent improvement in complex perceptual tasks (i.e., discrimination of visual forms in clutter). Here we take advantage of the complementary high spatial and temporal resolution of simultaneous EEG-fMRI to identify the learning-dependent changes in spatiotemporal brain patterns that mediate enhanced behavioral sensitivity in the discrimination of global forms after training. We measured the observers' choices when discriminating between concentric and radial patterns presented in noise before and after training. Similarly, we measured the choices of a pattern classifier when predicting each stimulus from EEG-fMRI signals. By comparing the performance of human observers and classifiers, we demonstrated that learning alters sensitivity to visual forms and EEG-fMRI activation patterns related to distinct visual recognition processes. In particular, behavioral improvement after training was associated with changes in (1) early processes involved in the integration of global forms in higher occipitotemporal and parietal areas, and (2) later processes related to categorical judgments in frontal circuits. Thus, our findings provide evidence that learning acts on distinct visual recognition processes and shapes feedforward interactions across brain areas to support performance in complex perceptual tasks.
Nura W. Lingawi and Bernard W. Balleine
The Journal of Neuroscience, 18 January 2012, 32(3):1073-1081;
The role of the amygdala central nucleus (CeN) in habit learning was assessed in two experiments. First, we examined the effects of bilateral lesions of the anterior CeN on an overtraining-induced lever press habit evaluated using an outcome devaluation protocol. Overtraining generated habitual performance and rendered sham lesioned rats insensitive to outcome devaluation, an effect that was also found in rats given control lesions of the posterior CeN. In contrast, rats with lesions of the anterior CeN did not show normal habit acquisition and their performance remained goal-directed and sensitive to outcome devaluation. Nevertheless, lesions of either the posterior or the anterior CeN abolished the general excitatory influence of a Pavlovian conditioned stimulus on instrumental performance. Second, we assessed the functional interaction between the CeN and dorsolateral striatum (DLS), a region previously implicated in the acquisition of habits, using asymmetrical lesions to disconnect these structures. Rats were given a unilateral lesion of anterior CeN and a unilateral lesion of the DLS, made either ipsilateral (control) or contralateral (disconnection) to the CeN lesion, and given overtraining followed by outcome devaluation. Although the ipsilateral lesioned rats were insensitive to devaluation, the contralateral CeN–DLS lesion impaired habit acquisition, rendering performance sensitive to the devaluation treatment. These results are the first to implicate the CeN and its connection with a circuit involving DLS in habit learning. They imply that, in instrumental conditioning, regions of amygdala parse the instrumental outcome into the reward and reinforcement signals mediating goal-directed and habitual actions, respectively.
Inhaled oxytocin amplifies both vicarious reinforcement and self reinforcement in rhesus macaques (Macaca mulatta)
Steve W C Chang, Joseph W Barter, R Becket Ebitz, Karli K Watson, and Michael L Platt
January 17, 2012
vol. 109, no. 3, 959–964
People attend not only to their own experiences, but also to the experiences of those around them. Such social awareness profoundly influences human behavior by enabling observational learning, as well as by motivating cooperation, charity, empathy, and spite. Oxytocin (OT), a neurosecretory hormone synthesized by hypothalamic neurons in the mammalian brain, can enhance affiliation or boost exclusion in different species in distinct contexts, belying any simple mechanistic neural model. Here we show that inhaled OT penetrates the CNS and subsequently enhances the sensitivity of rhesus macaques to rewards occurring to others as well as themselves. Roughly 2 h after inhaling OT, monkeys increased the frequency of prosocial choices associated with reward to another monkey when the alternative was to reward no one. OT also increased attention to the recipient monkey as well as the time it took to render such a decision. In contrast, within the first 2 h following inhalation, OT increased selfish choices associated with delivery of reward to self over a reward to the other monkey, without affecting attention or decision latency. Despite the differences in species typical social behavior, exogenous, inhaled OT causally promotes social donation behavior in rhesus monkeys, as it does in more egalitarian and monogamous ones, like prairie voles and humans, when there is no perceived cost to self. These findings potentially implicate shared neural mechanisms.
Yael Niv, Jeffrey A. Edlund, Peter Dayan, and John P. O'Doherty
J. Neurosci. 2012;32 551-562
Humans and animals are exquisitely, though idiosyncratically, sensitive to risk or variance in the outcomes of their actions. Economic, psychological, and neural aspects of this are well studied when information about risk is provided explicitly. However, we must normally learn about outcomes from experience, through trial and error. Traditional models of such reinforcement learning focus on learning about the mean reward value of cues and ignore higher order moments such as variance. We used fMRI to test whether the neural correlates of human reinforcement learning are sensitive to experienced risk. Our analysis focused on anatomically delineated regions of a priori interest in the nucleus accumbens, where blood oxygenation level-dependent (BOLD) signals have been suggested as correlating with quantities derived from reinforcement learning. We first provide unbiased evidence that the raw BOLD signal in these regions corresponds closely to a reward prediction error. We then derive from this signal the learned values of cues that predict rewards of equal mean but different variance and show that these values are indeed modulated by experienced risk. Moreover, a close neurometric–psychometric coupling exists between the fluctuations of the experience-based evaluations of risky options that we measured neurally and the fluctuations in behavioral risk aversion. This suggests that risk sensitivity is integral to human learning, illuminating economic models of choice, neuroscientific models of affective learning, and the workings of the underlying neural mechanisms.
Zeynep M Saygin, David E Osher, Kami Koldewyn, Gretchen Reynolds, John D E Gabrieli & Rebecca R Saxe
Nature Neuroscience (2011)
A fundamental assumption in neuroscience is that brain structure determines function. Accordingly, functionally distinct regions of cortex should be structurally distinct in their connections to other areas. We tested this hypothesis in relation to face selectivity in the fusiform gyrus. By using only structural connectivity, as measured through diffusion-weighted imaging, we were able to predict functional activation to faces in the fusiform gyrus. These predictions outperformed two control models and a standard group-average benchmark. The structure–function relationship discovered from the initial participants was highly robust in predicting activation in a second group of participants, despite differences in acquisition parameters and stimuli. This approach can thus reliably estimate activation in participants who cannot perform functional imaging tasks and is an alternative to group-activation maps. Additionally, we identified cortical regions whose connectivity was highly influential in predicting face selectivity within the fusiform, suggesting a possible mechanistic architecture underlying face processing in humans.