CiteULike: Group: Glimcher_Lab - with tag striatum

Tonically active neurons in the striatum encode motivational contexts of action.

M Kimura — 2008-01-02T16:32:00-00:00

Brain Dev, Vol. 25 Suppl 1 (December 2003)

In order to achieve a goal, one procures immediately available rewards, escape from aversive events or endures absence of rewards. The neuronal substrate for these goal-directed actions includes the limbic system and the basal ganglia. In the basal ganglia, classes of projection neurons in the striatum show activity with motivational as well as sensorimotor properties, such as expectation of reward and task schedule for obtaining reward. Tonically active neurons (TANs), presumed cholinergic interneurons in the striatum, respond to reward-associated stimuli, evolve their activity through learning and respond also to aversive event-associated stimuli such as airpuff on the face. A recent study showed that responses to visual cues are less selective to whether the cue instructs reward or no reward. To address this paradox, we asked macaque monkeys to perform a set of visual reaction time tasks while expecting the reward, aversive event or absence of reward. We found that TANs respond to instruction stimuli associated with motivational outcomes but not to unassociated ones, and that they mostly differentiate associated instructions. We also found that the higher percentage of TANs in the caudate nucleus respond to stimuli associated with motivational outcomes than in the putamen, whereas the higher percentage of TANs in the putamen respond to GO signals than in the caudate nucleus especially for an action anticipating a reward. These findings suggest a distinct, pivotal role played by TANs in the caudate nucleus and putamen in encoding instructed motivational contexts for goal-directed action selection and learning in the striatum.

Neural bases of food-seeking: affect, arousal and reward in corticostriatolimbic circuits.

BW Balleine — 2007-06-01T14:52:28-00:00

Physiol Behav, Vol. 86, No. 5. (15 December 2005), pp. 717-730.

Recent studies suggest that there are multiple 'reward' or 'reward-like' systems that control food seeking; evidence points to two distinct learning processes and four modulatory processes that contribute to the performance of food-related instrumental actions. The learning processes subserve the acquisition of goal-directed and habitual actions and involve the dorsomedial and dorsolateral striatum, respectively. Access to food can function both to reinforce habits and as a reward or goal for actions. Encoding and retrieving the value of a goal appears to be mediated by distinct processes that, contrary to the somatic marker hypothesis, do not appear to depend on a common mechanism but on emotional and more abstract evaluative processes, respectively. The anticipation of reward on the basis of environmental events exerts a further modulatory influence on food seeking that can be dissociated from that of reward itself; earning a reward and anticipating a reward appear to be distinct processes and have been doubly dissociated at the level of the nucleus accumbens. Furthermore, the excitatory influence of reward-related cues can be both quite specific, based on the identity of the reward anticipated, or more general based on its motivational significance. The influence of these two processes on instrumental actions has also been doubly dissociated at the level of the amygdala. Although the complexity of food seeking provides a hurdle for the treatment of eating disorders, the suggestion that these apparently disparate determinants are functionally integrated within larger neural systems may provide novel approaches to these problems.

The influence of Pavlovian cues on instrumental performance is mediated by CaMKII activity in the striatum

Wiltgen — 2007-04-17T09:25:14-00:00

European Journal of Neuroscience, Vol. 25, No. 8. (April 2007), pp. 2491-2497.

Dissociable Neural Responses in Human Reward Systems

Rebecca Elliott — 2007-05-24T17:50:00-00:00

J. Neurosci., Vol. 20, No. 16. (15 August 2000), pp. 6159-6165.

Reward is one of the most important influences shaping behavior. Single-unit recording and lesion studies in experimental animals have implicated a number of regions in response to reinforcing stimuli, in particular regions of the extended limbic system and the ventral striatum. In this experiment, functional neuroimaging was used to assess neural response within human reward systems under different psychological contexts. Nine healthy volunteers were scanned using functional magnetic resonance imaging during the performance of a gambling task with financial rewards and penalties. We demonstrated neural sensitivity of midbrain and ventral striatal regions to financial rewards and hippocampal sensitivity to financial penalties. Furthermore, we show that neural responses in globus pallidus, thalamus, and subgenual cingulate were specific to high reward levels occurring in the context of increasing reward. Responses to both reward level in the context of increasing reward and penalty level in the context of increasing penalty were seen in caudate, insula, and ventral prefrontal cortex. These results demonstrate dissociable neural responses to rewards and penalties that are dependent on the psychological context in which they are experienced.

Striatal Vs Extrastriatal Dopamine D2 Receptors in Antipsychotic Response—A Double-Blind PET Study in Schizophrenia

Ofer Agid — 2006-11-01T06:57:52-00:00

Neuropsychopharmacology, Vol. aop, No. current.

The Human Striatum is Necessary for Responding to Changes in Stimulus Relevance

R Cools — 2007-05-16T17:26:58-00:00

J. Cogn. Neurosci., Vol. 18, No. 12. (1 December 2006), pp. 1973-1983.

Various lines of evidence suggest that the striatum is implicated in cognitive flexibility. The neuropsychological evidence has, for the most part, been based on research with patients with Parkinson's disease, which is accompanied by chemical disruption of both the striatum and the prefrontal cortex. The present study examined this issue by testing patients with focal lesions of the striatum on a task measuring two forms of cognitive switching. Patients with striatal, but not frontal lobe lesions, were impaired in switching between concrete sensory stimuli. By contrast, both patient groups were unimpaired when switching between abstract task rules relative to baseline nonswitch trials. These results reveal a dissociation between two distinct forms of cognitive flexibility, providing converging evidence for a role of the striatum in flexible control functions associated with the selection of behaviorally relevant stimuli.

The Role of the Striatum in Processing Language Rules: Evidence from Word Perception in Huntington's Disease

Marc Teichmann — 2007-05-16T17:25:36-00:00

J. Cogn. Neurosci., Vol. 18, No. 9. (1 September 2006), pp. 1555-1569.

On the assumption that linguistic faculties reflect both lexical storage in the temporal cortex and combinatorial rules in the striatal circuits, several authors have shown that striatal-damaged patients are impaired with conjugation rules while retaining lexical knowledge of irregular verbs [Teichmann, M., Dupoux, E., Kouider, S., Brugieres, P., Boisse, M. F., Baudic, S., Cesaro, P., Peschanski, M., & Bachoud-Levi, A. C. (2005). The role of the striatum in rule application. The model of Huntington's disease at early stage. Brain, 128, 1155-1167; Ullman, M. T., Corkin, S., Coppola, M., Hickok, G., Growdon, J. H., Koroshetz, W. J., & Pinker, S. (1997). A neural dissociation within language: Evidence that the mental dictionary is part of declarative memory, and that grammatical rules are processed by the procedural system. Journal of Cognitive Neuroscience, 9, 266-276]. Yet, such impairment was documented only with explicit conjugation tasks in the production domain. Little is known about whether it generalizes to other language modalities such as perception and whether it refers to implicit language processing or rather to intentional rule operations through executive functions. We investigated these issues by assessing perceptive processing of conjugated verb forms in a model of striatal dysfunction, namely, in Huntington's Disease (HD) at early stages. Rule application and lexical processes were evaluated in an explicit task (acceptability judgments on verb and nonword forms) and in an implicit task (lexical decision on frequency-manipulated verb forms). HD patients were also assessed in executive functions, and striatal atrophy was evaluated with magnetic resonance imaging (bicaudate ratio). Results from both tasks showed that HD patients were selectively impaired for rule application but lexical abilities were spared. Bicaudate ratios correlated with rule scores on both tasks, whereas executive parameters only correlated with scores on the explicit task. We argue that the striatum has a core function in linguistic rule application generalizing to perceptive aspects of morphological operations and pertaining to implicit language processes. In addition, we suggest that the striatum may enclose computational circuits that underpin explicit manipulation of regularities.

Performance Feedback Drives Caudate Activation in a Phonological Learning Task

Elizabeth Tricomi — 2007-05-16T17:24:38-00:00

J. Cogn. Neurosci., Vol. 18, No. 6. (1 June 2006), pp. 1029-1043.

Adults have difficulty discriminating nonnative phonetic contrasts, but under certain circumstances training can lead to improvement in this ability. Despite the ubiquitous use of performance feedback in training paradigms in this and many other domains, the mechanisms by which feedback affects learning are not well understood. In this event-related functional magnetic resonance imaging study, we examined how performance feedback is processed during perceptual learning. Thirteen Japanese speakers for whom the English phonemes [r] and [l] were nondistinct performed an identification task of the words "road" and "load" that has been shown to be effective in inducing learning only when performance feedback is present. Each subject performed alternating runs of training with and without feedback, followed by performance of a card-guessing task with monetary reward and punishment outcomes. We found that the caudate nucleus was more robustly activated bilaterally when performing the perceptual identification task with feedback than without feedback, and the right caudate nucleus also showed a differential response to positive and negative feedback. Moreover, using a within-subjects design, we found that the caudate nucleus also showed a similar activation pattern to monetary reward and punishment outcomes in the card-guessing task. These results demonstrate that the caudate responds to positive and negative feedback during learning in a manner analogous to its processing of extrinsic affective reinforcers and indicate that this region may be a critical moderator of the influence of feedback on learning. These findings impact our broader understanding of the mechanisms underlying nondeclarative learning and language acquisition.

Dissociation between Striatal Regions while Learning to Categorize via Feedback and via Observation

Corinna Cincotta — 2007-05-16T15:42:45-00:00

J. Cogn. Neurosci., Vol. 19, No. 2. (1 February 2007), pp. 249-265.

Convergent evidence from functional imaging and from neuropsychological studies of basal ganglia disorders indicates that the striatum is involved in learning to categorize visual stimuli with feedback. However, it is unclear which cognitive process or processes involved in categorization is or are responsible for striatal recruitment; different regions of the striatum have been linked to feedback processing and to acquisition of stimulus-category associations. We examined the effect of the presence of feedback during learning on striatal recruitment by comparing feedback learning with observational learning of an information integration task. In the feedback task, participants were shown a stimulus, made a button press response, and then received feedback as to whether they had made the correct response. In the observational task, participants were given the category label before the stimulus appeared and then made a button press indicating the correct category membership. A region-of-interest analysis was used to examine activity in three regions of the striatum: the head of the caudate, body and tail of the caudate, and the putamen. Activity in the left head of the caudate was modulated by the presence of feedback: The magnitude of activation change was greater during feedback learning than during observational learning. In contrast, the bilateral body and tail of the caudate and the putamen were active to a similar degree in both feedback and observational learning. This pattern of results supports a functional dissociation between regions of the striatum, such that the head of the caudate is involved in feedback processing, whereas the body and tail of the caudate and the putamen are involved in learning stimulus-category associations. The hippocampus was active bilaterally during both feedback and observational learning, indicating potential parallel involvement with the striatum in information integration category learning.

Tracking the hemodynamic responses to reward and punishment in the striatum.

MR Delgado — 2007-04-20T16:35:12-00:00

J Neurophysiol, Vol. 84, No. 6. (December 2000), pp. 3072-3077.

Research suggests that the basal ganglia complex is a major component of the neural circuitry that mediates reward-related processing. However, human studies have not yet characterized the response of the basal ganglia to an isolated reward, as has been done in animals. We developed an event-related functional magnetic resonance imaging paradigm to identify brain areas that are activated after presentation of a reward. Subjects guessed whether the value of a card was higher or lower than the number 5, with monetary rewards as an incentive for correct guesses. They received reward, punishment, or neutral feedback on different trials. Regions in the dorsal and ventral striatum were activated by the paradigm, showing differential responses to reward and punishment. Activation was sustained following a reward feedback, but decreased below baseline following a punishment feedback.

The Neural Basis of Loss Aversion in Decision-Making Under Risk

Sabrina Tom — 2007-01-30T10:47:34-00:00

Science, Vol. 315, No. 5811. (26 January 2007), pp. 515-518.

People typically exhibit greater sensitivity to losses than to equivalent gains when making decisions. We investigated neural correlates of loss aversion while individuals decided whether to accept or reject gambles that offered a 50/50 chance of gaining or losing money. A broad set of areas (including midbrain dopaminergic regions and their targets) showed increasing activity as potential gains increased. Potential losses were represented by decreasing activity in several of these same gain-sensitive areas. Finally, individual differences in behavioral loss aversion were predicted by a measure of neural loss aversion in several regions, including the ventral striatum and prefrontal cortex. 10.1126/science.1134239

Neural Encoding in Ventral Striatum during Olfactory Discrimination Learning

Barry Setlow — 2007-04-02T13:37:40-00:00

Neuron, Vol. 38, No. 4. (22 May 2003), pp. 625-636.

A growing body of evidence implicates the ventral striatum in using information acquired through associative learning. The present study examined the activity of ventral striatal neurons in awake, behaving rats during go/no-go odor discrimination learning and reversal. Many neurons fired selectively to odor cues predictive of either appetitive (sucrose) or aversive (quinine) outcomes. Few neurons were selective when first exposed to the odors, but many acquired this differential activity as rats learned the significance of the cues. A substantial proportion of these neurons encoded the cues' learned motivational significance, and these neurons tended to reverse their firing selectivity after reversal of odor-outcome contingencies. Other neurons that became selectively activated during learning did not reverse, but instead appeared to encode specific combinations of cues and associated motor responses. The results support a role for ventral striatum in using the learned significance, both appetitive and aversive, of predictive cues to guide behavior.

Interactive memory systems in the human brain

RA Poldrack — 2007-04-02T13:20:35-00:00

Nature, Vol. 414, No. 6863. (29 November 2001), pp. 546-550.

Reward or reinforcement: what's the difference?

NM White — 2007-02-23T20:17:02-00:00

Neurosci Biobehav Rev, Vol. 13, No. 2-3. (l 1989), pp. 181-186.

The histories of the terms "reward" and "reinforcement" are reviewed to show the difference in their origins. Reward refers to the fact that certain environmental stimuli have the property of eliciting approach responses. Evidence suggests that the ventral striatum (nucleus accumbens area) is central to the mediation of this behavior. Reinforcement refers to the tendency of certain stimuli to strengthen learned stimulus-response tendencies. The dorsolateral striatum appears to be central to the mediation of this behavior. Neuroanatomical and neurochemical data are adduced suggesting that reward may be mediated by a neural circuit including the neostriatal patch system, together with the hippocampus, limbic system (amygdala, prefrontal cortex) and ventral pallidum. The evidence also suggests that reinforcement, in the form of dopamine release in the striatal matrix, acts to promote the consolidation of sensori-motor associations. Thus, the matrix may mediate stimulus-response memory as part of a circuit including the cerebral cortex, substantia nigra pars reticulata and its projections to thalamic and brainstem motor areas.

Decoding the neural substrates of reward-related decision making with functional MRI.

AN Hampton — 2007-02-21T01:36:17-00:00

Proc Natl Acad Sci U S A, Vol. 104, No. 4. (23 January 2007), pp. 1377-1382.

Although previous studies have implicated a diverse set of brain regions in reward-related decision making, it is not yet known which of these regions contain information that directly reflects a decision. Here, we measured brain activity using functional MRI in a group of subjects while they performed a simple reward-based decision-making task: probabilistic reversal-learning. We recorded brain activity from nine distinct regions of interest previously implicated in decision making and separated out local spatially distributed signals in each region from global differences in signal. Using a multivariate analysis approach, we determined the extent to which global and local signals could be used to decode subjects' subsequent behavioral choice, based on their brain activity on the preceding trial. We found that subjects' decisions could be decoded to a high level of accuracy on the basis of both local and global signals even before they were required to make a choice, and even before they knew which physical action would be required. Furthermore, the combined signals from three specific brain areas (anterior cingulate cortex, medial prefrontal cortex, and ventral striatum) were found to provide all of the information sufficient to decode subjects' decisions out of all of the regions we studied. These findings implicate a specific network of regions in encoding information relevant to subsequent behavioral choice.

Habit and Skill Learning in Schizophrenia: Evidence of Normal Striatal Processing With Abnormal Cortical Input

Thomas Weickert — 2007-02-13T23:55:34-00:00

Learn. Mem., Vol. 9, No. 6. (1 November 2002), pp. 430-442.

Different forms of nondeclarative learning involve regionally specific striatal circuits. The motor circuit (involving the putamen) has been associated with motor-skill learning and the dorsolateral prefrontal cortex (DLPFC) circuit (involving the caudate) has been associated with cognitive-habit learning. Efforts to differentiate functional striatal circuits within patient samples have been limited. Previous studies have provided mixed results regarding striatal-dependent nondeclarative learning deficits in patients with schizophrenia. In this study, a cognitive-habit learning task (probabilistic weather prediction) was used to assess the DLPFC circuit and a motor-skill learning task (pursuit rotor) was used to assess the motor circuit in 35 patients with schizophrenia and 35 normal controls. Patients with schizophrenia displayed significant performance differences from controls on both nondeclarative tasks; however, cognitive-habit learning rate in patients did not differ from controls. There were performance and learning-rate differences on the motor-skill learning task between the whole sample of patients and controls, however, analysis of a subset of patients and controls matched on general intellectual level eliminated learning rate differences between groups. The abnormal performance offset between patients with schizophrenia and controls in the absence of learning rate differences suggests that abnormal cortical processing provides altered input to normal striatal circuitry. 10.1101/lm.49102

Input-output organization of the sensorimotor striatum in the squirrel monkey.

AW Flaherty — 2006-09-19T21:47:54-00:00

J Neurosci, Vol. 14, No. 2. (February 1994), pp. 599-610.

The basal ganglia receive massive inputs from the neocortex and send outputs that exert both inhibitory and disinhibitory control over parts of the frontal cortex and brainstem. Between these basal ganglia inputs and outputs lies the striatum, which receives most of the cortical afferents and projects to the basal ganglia output nuclei--the globus pallidus and substantia nigra. To analyze this system we conjointly labeled, in squirrel monkeys, sensorimotor cortical inputs to the striatum and striatal outputs to the globus pallidus. Anterograde tracers were injected into the motor (MI) and somatosensory (SI) cortical body maps, at sites determined by electrophysiological stimulation and recording. Retrograde tracers were stereotaxically injected into the external and internal pallidal segments (GPe and GPi). We found that multiple dispersed modules ("matrisomes") in the putamen that all received inputs from single body-part representations in sensorimotor cortex could, in turn, send convergent outputs to single sites in the pallidum. This divergence-reconvergence pattern was found for both GPe and GPi sites, and for inputs from both SI and MI cortex. Thus, information from a single functional region in the cortex can be split up at the striatal stage only to be brought back together in the pallidum. The temporary divergence may increase lateral interactions between sensorimotor matrisomes, as well as between matrisomes and striosomes. One function of striatal modularity may thus be to set up an associative network in the striatum, which might contribute to sensorimotor learning. We also found that some sets of matrisomes did not receive strong sensorimotor inputs, even though they projected to regions of GPe and GPi that are near the sensorimotor-recipient zones described above. Thus, the matrisomal system may sort MI/SI inputs and other inputs before transfer to paired regions of GPe and GPi.

The basal ganglia in human learning.

CA Seger — 2006-08-16T21:58:22-00:00

Neuroscientist, Vol. 12, No. 4. (August 2006), pp. 285-290.

For many years, the basal ganglia were described in anatomy courses as strictly motor structures. Certainly, some of the most obvious and debilitating symptoms shown by persons with basal ganglia disorders are problems in motor control. However, the basal ganglia are not limited to motoric aspects of behavior: recent research shows that they are involved in most areas of cognitive and emotional functioning, consistent with their anatomical connections with all areas of the cortex. This review will focus on the roles of the basal ganglia in human learning, particularly sequence learning and category learning. Current areas of research that are discussed include the differing roles of different basal ganglia regions, patterns of interaction between the cortex and basal ganglia, differences in positive and negative association learning, effects of dopaminergic medication on learning, whether basal ganglia-mediated learning is implicit or explicit, and how the basal ganglia learning systems interact with other learning systems, particularly within the medial temporal lobe.

Dissociable roles of ventral and dorsal striatum in instrumental conditioning.

J O'Doherty — 2006-02-01T20:02:54-00:00

Science, Vol. 304, No. 5669. (16 April 2004), pp. 452-454.

Instrumental conditioning studies how animals and humans choose actions appropriate to the affective structure of an environment. According to recent reinforcement learning models, two distinct components are involved: a "critic," which learns to predict future reward, and an "actor," which maintains information about the rewarding outcomes of actions to enable better ones to be chosen more frequently. We scanned human participants with functional magnetic resonance imaging while they engaged in instrumental conditioning. Our results suggest partly dissociable contributions of the ventral and dorsal striatum, with the former corresponding to the critic and the latter corresponding to the actor.

Representation of action-specific reward values in the striatum.

K Samejima — 2005-11-30T17:36:20-00:00

Science, Vol. 310, No. 5752. (25 November 2005), pp. 1337-1340.

The estimation of the reward an action will yield is critical in decision-making. To elucidate the role of the basal ganglia in this process, we recorded striatal neurons of monkeys who chose between left and right handle turns, based on the estimated reward probabilities of the actions. During a delay period before the choices, the activity of more than one-third of striatal projection neurons was selective to the values of one of the two actions. Fewer neurons were tuned to relative values or action choice. These results suggest representation of action values in the striatum, which can guide action selection in the basal ganglia circuit.

Prediction of immediate and future rewards differentially recruits cortico-basal ganglia loops.

SC Tanaka — 2005-03-09T19:40:59-00:00

Nat Neurosci, Vol. 7, No. 8. (August 2004), pp. 887-893.

Evaluation of both immediate and future outcomes of one's actions is a critical requirement for intelligent behavior. Using functional magnetic resonance imaging (fMRI), we investigated brain mechanisms for reward prediction at different time scales in a Markov decision task. When human subjects learned actions on the basis of immediate rewards, significant activity was seen in the lateral orbitofrontal cortex and the striatum. When subjects learned to act in order to obtain large future rewards while incurring small immediate losses, the dorsolateral prefrontal cortex, inferior parietal cortex, dorsal raphe nucleus and cerebellum were also activated. Computational model-based regression analysis using the predicted future rewards and prediction errors estimated from subjects' performance data revealed graded maps of time scale within the insula and the striatum: ventroanterior regions were involved in predicting immediate rewards and dorsoposterior regions were involved in predicting future rewards. These results suggest differential involvement of the cortico-basal ganglia loops in reward prediction at different time scales.

Reward processing in primate orbitofrontal cortex and basal ganglia.

W Schultz — 2005-03-09T17:01:10-00:00

Cereb Cortex, Vol. 10, No. 3. (March 2000), pp. 272-284.

This article reviews and interprets neuronal activities related to the expectation and delivery of reward in the primate orbitofrontal cortex, in comparison with slowly discharging neurons in the striatum (caudate, putamen and ventral striatum, including nucleus accumbens) and midbrain dopamine neurons. Orbitofrontal neurons showed three principal forms of reward-related activity during the performance of delayed response tasks, namely responses to reward-predicting instructions, activations during the expectation period immediately preceding reward and responses following reward. These activations discriminated between different rewards, often on the basis of the animals' preferences. Neurons in the striatum were also activated in relation to the expectation and detection of reward but in addition showed activities related to the preparation, initiation and execution of movements which reflected the expected reward. Dopamine neurons responded to rewards and reward-predicting stimuli, and coded an error in the prediction of reward. Thus, the investigated cortical and basal ganglia structures showed multiple, heterogeneous, partly simultaneous activations which were related to specific aspects of rewards. These activations may represent the neuronal substrates of rewards during learning and established behavioral performance. The processing of reward expectations suggests an access to central representations of rewards which may be used for the neuronal control of goaldirected behavior.

Different time courses of learning-related activity in the prefrontal cortex and striatum

Anitha Pasupathy — 2005-02-23T20:24:42-00:00

Nature, Vol. 433, No. 7028. (24 February 2005), pp. 873-876.