image: This image is an artistic interpretation of the authors’ work. Within a myriad of many pixel-like neurons, an obvious pattern emerges from more active red pixels and from parallel, less-active blue pixels: the letters corresponding to the word reward. view more
Credit: Gil Gosta
In a scientific first, researchers have observed in mice how the brain learns to repeat patterns of neural activity that elicit the all-important feel-good sensation. Until today, the brain mechanisms that guide this type of learning had not been measured directly.
This research offers key insights into how brain activity is shaped and refined as animals learn to repeat behaviors that evoke a feeling of pleasure. The findings also point to new strategies for targeting disorders characterized by abnormal repetitive behaviors, such as addiction and obsessive-compulsive disorder, or OCD.
The study, led by researchers at Columbia University's Zuckerman Institute, the Champalimaud Centre for the Unknown and the University of California at Berkeley, was published today in Science.
"It's no secret that we derive pleasure from doing things we enjoy, such as playing our favorite video game," said Rui Costa, DVM, PhD, the paper's senior author and the associate director and CEO of Columbia's Zuckerman Institute. "Today's results reveal that the brain learns which activity patterns lead to feel-good sensations, and reshapes itself to more efficiently reproduce those patterns."
"This discovery can help explain how we learn by repetition, and can also inform studies of disorders such as addiction and OCD, in which the feedback loop that links an action to a reward gets thrown out of whack," he added.
Normally, doing something enjoyable triggers neurons, a type of brain cell, to release a chemical called dopamine. This release causes that feel-good sensation, evoking the desire to repeat an action again and again. A prime example of this are video games.
"When you move the game controller in exactly the right way to earn that high score, your brain remembers how it executed that action -- which neurons get switched on, and in what pattern -- so your brain can recreate that same move the next time you play," said Dr. Costa, who also a professor of neuroscience and neurology at Columbia University Irving Medical Center. "After repeated attempts, your brain gets better at recreating that pattern of neural activity, and you get better at the game."
To the team, this fact then begged the question: Could the brain be trained to learn the right pattern of neural activity normally involved in experiencing something enjoyable, and then replay that pattern at will to trigger a dopamine release?
In a series of experiments in mice, the researchers developed a computer program that connected the neural activity in the animals' brains to musical notes, so that when one group of neurons switched on, a corresponding musical note played. Different patterns of neural activity yielded different combinations of notes. And when neural-activity patterns triggered the right arrangement of musical notes (arbitrarily determined by a computer), the scientists manually released dopamine in the animals' brains.
The mice quickly learned which musical arrangement that, when played, caused a dopamine release and the feel-good sensation. Their brains then began to rewire themselves to play that song more often, thereby triggering the pleasure hit of dopamine.
"In essence, the mice learned to repeat the same pattern of brain activity that had been evoked previously by hearing those musical notes," said Vivek Athalye, a doctoral candidate at Champalimaud and the paper's co-first author.
The researchers noted that these findings are a striking example of Thorndike's Law -- a long-held principle of psychology stating that actions that lead to positive reinforcement are repeated more frequently. However, these findings likely represent the first time that this principle has been directly observed in the brain.
"In some ways, these results are entirely expected," said Dr. Costa. "It makes sense that the brain would mimic the feeling of reward it gets from an enjoyable experience by producing the corresponding pattern of neural activity. But it had never been tested."
This research also has important implications for addiction and OCD.
"If the brain's neural-activity patterns are in overdrive, as is often the case for people with addiction or OCD, could we create a computer program that can help to retrain their brains and downshift this activity?" asked Dr. Costa. "This is something we're actively exploring."
###
This paper is titled: "Evidence for a neural law of effect." Additional contributors include co-first author Ferndando Santos, and co-senior author Jose Carmena, PhD.
This research was supported by National Science Foundation (Graduate Research Fellowship, CBET-0954243, EFRI-M3C 1137267), Office of Naval Research (N00014-15-1-2312, ERA-NET, European Research Council (COG 617142) and the Howard Hughes Medical Institute (IEC 55007415).
The authors report no financial or other conflicts of interest.
Columbia University's Mortimer B. Zuckerman Mind Brain Behavior Institute brings together an group of world-class scientists and scholars to pursue the most urgent and exciting challenge of our time: understanding the brain and mind. A deeper understanding of the brain promises to transform human health and society. From effective treatments for disorders like Alzheimer's, Parkinson's, depression and autism to advances in fields as fundamental as computer science, economics, law, the arts and social policy, the potential for humanity is staggering. To learn more, visit: .
Champalimaud Research (CR) started with the Champalimaud Neuroscience Programme (CNP), created in 2007. It is a basic research team with the broad aim of understanding brain function through integrative biological approaches. The team is composed of 17 main research groups and 2 associated labs who study diverse topics in neuroscience using advanced, cutting edge techniques. Research groups apply advanced molecular, physiological and imaging tools to elucidate the function of neural circuits and systems in animal models that include Drosophila, mouse, rat and zebrafish.
Journal
Science