The curious case of dopaminergic prediction errors and learning associative information beyond value
Related Articles
Dopaminergic modulation and dosage effects on brain state dynamics and working memory component processes in Parkinson’s disease
Parkinson’s disease (PD) is primarily diagnosed through its characteristic motor deficits, yet it also encompasses progressive cognitive impairments that profoundly affect quality of life. While dopaminergic medications are routinely prescribed to manage motor symptoms in PD, their influence extends to cognitive functions as well. Here we investigate how dopaminergic medication influences aberrant brain circuit dynamics associated with encoding, maintenance and retrieval working memory (WM) task-phases processes. PD participants, both on and off dopaminergic medication, and healthy controls, performed a Sternberg WM task during fMRI scanning. We employ a Bayesian state-space computational model to delineate brain state dynamics related to different task phases. Importantly, a within-subject design allows us to examine individual differences in the effects of dopaminergic medication on brain circuit dynamics and task performance. We find that dopaminergic medication alters connectivity within prefrontal-basal ganglia-thalamic circuits, with changes correlating with enhanced task performance. Dopaminergic medication also restores engagement of task-phase-specific brain states, enhancing task performance. Critically, we identify an “inverted-U-shaped” relationship between medication dosage, brain state dynamics, and task performance. Our study provides valuable insights into the dynamic neural mechanisms underlying individual differences in dopamine treatment response in PD, paving the way for more personalized therapeutic strategies.
Two types of motifs enhance human recall and generalization of long sequences
Whether it is listening to a piece of music, learning a new language, or solving a mathematical equation, people often acquire abstract notions in the sense of motifs and variables—manifested in musical themes, grammatical categories, or mathematical symbols. How do we create abstract representations of sequences? Are these abstract representations useful for memory recall? In addition to learning transition probabilities, chunking, and tracking ordinal positions, we propose that humans also use abstractions to arrive at efficient representations of sequences. We propose and study two abstraction categories: projectional motifs and variable motifs. Projectional motifs find a common theme underlying distinct sequence instances. Variable motifs contain symbols representing sequence entities that can change. In two sequence recall experiments, we train participants to remember sequences with projectional and variable motifs, respectively, and examine whether motif training benefits the recall of novel sequences sharing the same motif. Our result suggests that training projectional and variables motifs improve transfer recall accuracy, relative to control groups. We show that a model that chunks sequences in an abstract motif space may learn and transfer more efficiently, compared to models that learn chunks or associations on a superficial level. Our study suggests that humans construct efficient sequential memory representations according to the two types of abstraction we propose, and creating these abstractions benefits learning and out-of-distribution generalization. Our study paves the way for a deeper understanding of human abstraction learning and generalization.
Predictive learning as the basis of the testing effect
A prominent learning phenomenon is the testing effect, meaning that testing enhances retention more than studying. Emergent frameworks propose fundamental (Hebbian and predictive) learning principles as its basis. Predictive learning posits that learning occurs based on the contrast (error) between a prediction and the feedback on that prediction (prediction error). Here, we propose that in testing (but not studying) scenarios, participants predict potential answers, and its contrast with the subsequent feedback yields a prediction error, which facilitates testing-based learning. To investigate this, we developed an associative memory network incorporating Hebbian and/or predictive learning, together with an experimental design where human participants studied or tested English-Swahili word pairs followed by recognition. Three behavioral experiments (N = 80, 81, 62) showed robust testing effects when feedback was provided. Model fitting (of 10 different models) suggested that only models incorporating predictive learning can account for the breadth of data associated with the testing effect. Our data and model suggest that predictive learning underlies the testing effect.
The dopaminergic effects of esketamine are mediated by a dual mechanism involving glutamate and opioid receptors
Esketamine represents a new class of drugs for treating mood disorders. Unlike traditional monoaminergic-based therapies, esketamine primarily targets N-methyl-D-aspartate receptors (NMDAR). However, esketamine is a complex drug with low affinity for NMDAR and can also bind to other targets, such as opioid receptors. Its precise mechanism of action for its antidepressant properties remains debated, as does its potential for misuse. A key component at the intersection of mood and reward processing is the dopaminergic system. In this study, we evaluated the effects of esketamine in locomotion, anxiety tests and operant responding and we used in vivo fiber photometry to explore the neurochemical effects of esketamine in the nucleus accumbens of mice. Our findings demonstrated multifaceted effects of esketamine on neurotransmitter dynamics. In freely behaving mice, esketamine increased locomotion and increased extracellular dopamine tone -by impairing dopamine clearance rather than promoting dopamine release- while decreasing glutamatergic activity. However, it decreased dopamine spontaneous release event frequency and impaired reward-evoked dopamine release, leading to a reduction in operant responding rates. These dopaminergic effects were partially, and conditionally, blocked by the opioid antagonist naloxone and required glutamatergic input. In summary, our study reveals a complex interaction between neurotransmitter systems, suggesting that the neurochemical effects of esketamine are both circuit- and state-dependent.
Understanding learning through uncertainty and bias
Learning allows humans and other animals to make predictions about the environment that facilitate adaptive behavior. Casting learning as predictive inference can shed light on normative cognitive mechanisms that improve predictions under uncertainty. Drawing on normative learning models, we illustrate how learning should be adjusted to different sources of uncertainty, including perceptual uncertainty, risk, and uncertainty due to environmental changes. Such models explain many hallmarks of human learning in terms of specific statistical considerations that come into play when updating predictions under uncertainty. However, humans also display systematic learning biases that deviate from normative models, as studied in computational psychiatry. Some biases can be explained as normative inference conditioned on inaccurate prior assumptions about the environment, while others reflect approximations to Bayesian inference aimed at reducing cognitive demands. These biases offer insights into cognitive mechanisms underlying learning and how they might go awry in psychiatric illness.
Responses