Abstract
The ability to learn new skills and perfect them with practice applies not only to physical skills but also to abstract skills1, like motor planning or neuroprosthetic actions. Although plasticity in corticostriatal circuits has been implicated in learning physical skills2,3,4, it remains unclear if similar circuits or processes are required for abstract skill learning. Here we use a novel behavioural task in rodents to investigate the role of corticostriatal plasticity in abstract skill learning. Rodents learned to control the pitch of an auditory cursor to reach one of two targets by modulating activity in primary motor cortex irrespective of physical movement. Degradation of the relation between action and outcome, as well as sensory-specific devaluation and omission tests, demonstrate that these learned neuroprosthetic actions are intentional and goal-directed, rather than habitual. Striatal neurons change their activity with learning, with more neurons modulating their activity in relation to target-reaching as learning progresses. Concomitantly, strong relations between the activity of neurons in motor cortex and the striatum emerge. Specific deletion of striatal NMDA receptors impairs the development of this corticostriatal plasticity, and disrupts the ability to learn neuroprosthetic skills. These results suggest that corticostriatal plasticity is necessary for abstract skill learning, and that neuroprosthetic movements capitalize on the neural circuitry involved in natural motor learning.
This is a preview of subscription content, access via your institution
Access options
Subscribe to this journal
Receive 51 print issues and online access
$199.00 per year
only $3.90 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Similar content being viewed by others
References
VanLehn, K. Cognitive skill acquisition. Annu. Rev. Neurosci. 47, 513–539 (1996)
Yin, H. H. et al. Dynamic reorganization of striatal circuits during the acquisition and consolidation of a skill. Nature Neurosci. 12, 333–341 (2009)
Barnes, T. D., Kubota, Y., Hu, D., Jin, D. Z. & Graybiel, A. M. Activity of striatal neurons reflects dynamic encoding and recoding of procedural memories. Nature 437, 1158–1161 (2005)
Kimchi, E. Y. & Laubach, M. Dynamic encoding of action selection by the medial striatum. J. Neurosci. 29, 3148–3159 (2009)
Brashers-Krug, T., Shadmehr, R. & Bizzi, E. Consolidation in human motor memory. Nature 382, 252–255 (1996)
Fetz, E. E. Volitional control of neural activity: implications for brain–computer interfaces. J. Physiol. (Lond.) 579, 571–579 (2007)
Hikosaka, O. et al. Parallel neural networks for learning sequential procedures. Trends Neurosci. 22, 464–471 (1999)
Brasted, P. J. & Wise, S. P. Comparison of learning-related neuronal activity in the dorsal premotor cortex and striatum. Eur. J. Neurosci. 19, 721–740 (2004)
Rioult-Pedotti, M. S., Friedman, D. & Donghue, J. P. Learning-induced LTP in neocortex. Science 290, 533–536 (2000)
Georgopoulos, A. P., Taira, M. & Lukashin, A. Cognitive neurophysiology of the motor cortex. Science 260, 47–52 (1993)
Gandolfo, F., Li, C., Benda, B. J., Schioppa, C. P. & Bizzi, E. Cortical correlates of learning in monkeys adapting to a new dynamical environment. Proc. Natl Acad. Sci. USA 97, 2259–2263 (2000)
Fincham, J. M. & Anderson, J. R. Distinct roles of the anterior cingulate and prefrontal cortex in the acquisition and performance of a cognitive skill. Proc. Natl Acad. Sci. USA 103, 12941–12946 (2006)
Badre, D., Kayser, A. S. & D’Esposito, M. Frontal cortex and the discovery of abstract action rules. Neuron 66, 315–326 (2010)
Taylor, D. M., Tillery, S. I. & Schwartz, A. B. Direct cortical control of 3D neuroprosthetic devices. Science 296, 1829–1832 (2002)
Carmena, J. M. et al. Learning to control a brain-machine interface for reaching and grasping by primates. PLoS Biol. 1, 193–208 (2003)
Ganguly, K. & Carmena, J. M. Emergence of a stable cortical map for neuroprosthetic control. PLoS Biol. 7, e1000153 (2009)
Ganguly, K., Dimitrov, D. F., Wallis, J. D. & Carmena, J. M. Reversible large-scale modification of cortical networks during neuroprosthetic control. Nature Neurosci. 14, 662–667 (2011)
Beauchamp, M. H., Dagher, A., Aston, J. A. & Doyon, J. Dynamic functional changes associated with cognitive skill learning of an adapted version of the Tower of London task. Neuroimage 20, 1649–1660 (2003)
Poldrack, R. A., Prabhakaran, V., Seger, C. A. & Gabrieli, J. D. Striatal activation during acquisition of a cognitive skill. Neuropsychology 13, 564–574 (1999)
Pasupathy, A. & Miller, E. K. Different time courses of learning-related activity in the prefrontal cortex and striatum. Nature 433, 873–876 (2005)
Karni, A. et al. The acquisition of skilled motor performance: fast and slow experience-driven changes in primary motor cortex. Proc. Natl Acad. Sci. USA 95, 861–868 (1998)
Venkatraman, S., Jin, X., Costa, R. M. & Carmena, J. M. Investigating neural correlates of behavior in freely behaving rodents using inertial sensors. J. Neurophysiol. 104, 569–575 (2010)
Balleine, B. W. & Dickinson, A. Goal-directed instrumental action: contingency and incentive learning and their cortical substrates. Neuropharmacology 37, 407–419 (1998)
Yin, H. H., Knowlton, B. J. & Balleine, B. W. Inactivation of dorsolateral striatum enhances sensitivity to changes in the action-outcome contingency in instrumental conditioning. Behav. Brain Res. 166, 189–196 (2006)
Hilario, M. R., Clouse, E., Yin, H. H. & Costa, R. M. Endocannabinoid signaling is critical for habit formation. Front. Integr. Neurosci. 1, 1–12 (2007)
Costa, R. M., Cohen, D. & Nicolelis, M. A. Differential corticostriatal plasticity during fast and slow motor skill learning in mice. Curr. Biol. 14, 1124–1134 (2004)
Jin, X. & Costa, R. M. Start/stop signals emerge in nigrostriatal circuits during sequence learning. Nature 466, 457–462 (2010)
Miyachi, S., Hikosaka, O. & Lu, X. Differential activation of monkey striatal neurons in the early and late stages of procedural learning. Exp. Brain Res. 146, 122–126 (2002)
Calabresi, P., Pisani, A., Mercuri, N. B. & Bernardi, G. Long-term potentiation in the striatum is unmasked by removing the voltage-dependent magnesium block of NMDA receptor channels. Eur. J. Neurosci. 4, 929–935 (1992)
Dang, M. T. et al. Disrupted motor learning and long-term synaptic plasticity in mice lacking NMDAR1 in the striatum. Proc. Natl Acad. Sci. USA 103, 15254–15259 (2006)
Acknowledgements
We thank S. Venkatraman for the three-axis accelerometer, Y. Li for the RGS9L-Cre mice, K. Nakazawa for the NMDAR1-loxP mice, G. Luo for genotyping, M. Davis for advice on staining and G. Martins for performing immunohistochemistry. This work was supported by National Science Foundation CAREER Award 0954243, the Multiscale Systems Research Center and the Defense Advanced Research Projects Agency contract N66001-10-C-2008 to J.M.C., and the Division of Intramural Clinical and Basic Research of the National Institute on Alcohol Abuse and Alcoholism, Marie Curie International Reintegration Grant 239527 and European Research Council STG 243393 to R.M.C.
Author information
Authors and Affiliations
Contributions
A.C.K., X.J., J.D.L., R.M.C. and J.M.C. designed experiments. A.C.K., X.J. and J.D.L. conducted experiments. A.C.K., X.J., R.M.C. and J.M.C. analysed data and wrote the paper.
Corresponding authors
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Supplementary information
Supplementary Information
This file contains Supplementary Methods, Supplementary References and Supplementary Figures 1-13. (PDF 1335 kb)
Supplementary Movie 1
This file shows an example of locomotor activity for a control mouse with electrode implantation and used in the BMI experiments. (MOV 5295 kb)
Supplementary Movie 2
This file shows an example of locomotor activity for a RGS9L-Cre/Nr1f/fmouse with electrode implantation and used in the BMI experiments. (MOV 5462 kb)
Rights and permissions
About this article
Cite this article
Koralek, A., Jin, X., Long II, J. et al. Corticostriatal plasticity is necessary for learning intentional neuroprosthetic skills. Nature 483, 331–335 (2012). https://doi.org/10.1038/nature10845
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1038/nature10845
This article is cited by
-
Selective modulation of cortical population dynamics during neuroprosthetic skill learning
Scientific Reports (2022)
-
Basal ganglia-cortical connectivity underlies self-regulation of brain oscillations in humans
Communications Biology (2022)
-
Networking brainstem and basal ganglia circuits for movement
Nature Reviews Neuroscience (2022)
-
Existing function in primary visual cortex is not perturbed by new skill acquisition of a non-matched sensory task
Nature Communications (2022)
-
Pyramidal cell subtype-dependent cortical oscillatory activity regulates motor learning
Communications Biology (2021)
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.