The collective posts display strong agreement and interest by praising the paper’s innovative idea that dopamine encodes a reward distribution, with discussions referencing neural experiments and AI parallels. The tone is enthusiastic and highlights the research's potential to redefine reward prediction mechanisms, demonstrating deep engagement and acknowledgment of its broad significance.
AgreementModerate agreement
Most discussions recognize the significance of the research and agree that it advances understanding of dopamine's role in reward processing.
InterestHigh interest
The majority of social discussions show high curiosity and enthusiasm, often referencing the potential implications for neuroscience and artificial intelligence.
EngagementHigh engagement
Participants actively cite examples, such as neural activity studies and future applications, indicating deep engagement with the research details.
ImpactHigh impact
Many posts emphasize how this work could transform models of learning, brain function, and brain-inspired AI, indicating perceived high impact.
Abstract in brief
The paper discusses how dopamine in the brain is thought to encode reward predictions, traditionally seen as a single number representing the expected reward, but the authors propose that it might actually represent a whole distribution of possible future rewards.
Inspired by recent AI research, the authors suggest that the brain might process multiple potential outcomes at once, rather than just the average, which could explain more complex reward learning.
Their experiments with mice support this idea, showing neural activity consistent with the brain representing a distribution of future rewards, giving us a new way to understand how dopamine helps with learning and decision-making.]
Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here: https://t.co/d37sHm879r
Shout out to the amazing artists/designers at @DeepMind who make this possible, while we get to focus on the research. https://t.co/5FvyxMPkWn
Jan 29, 2020 · 134 likes · 25 shares · 1,455 followersView post →
TS
Trends in Cognitive Sciences
@TrendsCognSci · X
Beyond the Average View of Dopamine
Angela Langdon & Nathaniel Daw discuss "A distributional code for value in dopamine-based reinforcement learning", https://t.co/nD2GdPVL5L
@nathanieldaw, @wwdabney, @zebkDotCom, @naoshigeuchida, @demishassabis
https://t.co/aiA4aJtKYp
May 18, 2020 · 25 likes · 2 shares · 30,647 followersView post →
CM
Christopher McElveen
@chrisamcelveen · X
@judegomila Also, seems rather obvious in hind sight but this breakthrough could enable machines to have a reason to teach themselves: https://t.co/NpRDD0osdO
"A distributional code for value in dopamine-based reinforcement learning" https://t.co/oGbWNQPCX7
Jan 21, 2020 · 2 likes · 18,523 followersView post →
F
fj
@gecko39 · X
@KenCaldeira map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/XL1IHHUkxx
how the brain keeps track of everything that might happen next
https://t.co/ENqTnaXnbU https://t.co/BmwSzmAG6S
Les Agoras du MFRB présente un cycle sur le revenu de base. Dans cette vidéo, Fabien Furfaro discute des conséquences de l'intelligence artificielle sur le travail et la nécessité d'un revenu de base en tant que…
This video explores how dopamine encodes reward predictions, suggesting the brain represents a distribution of possible future rewards, inspired by AI research, with supporting experiments in mice.
This video explores how dopamine encodes reward predictions, possibly representing a distribution of potential future rewards. It discusses recent research on neural activity in mice supporting this expanded view of…
RT @gecko39: Amazing how biological science in 30JAN2020 Nature describes "foreseeing AND (potentially) enabling"
A distributional code f…
Jun 7, 2025 · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
RT @gecko39: Amazing how biological science in 30JAN2020 Nature describes "foreseeing AND (potentially) enabling"...
A distributional cod…
Jun 7, 2025 · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
RT @gecko39: Amazing how biological science in 30JAN2020 Nature describes "foreseeing AND (potentially) enabling"
A distributional code f…
May 14, 2025 · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
RT @gecko39: Amazing how biological science in 30JAN2020 Nature describes "foreseeing AND (potentially) enabling"...
A distributional cod…
May 14, 2025 · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
Amazing how biological science in 30JAN2020 Nature describes "foreseeing AND (potentially) enabling"...
A distributional code for value in dopamine-based reinforcement learning
https://t.co/HQLTLmQicd
...as being pleasurable; which may more accurately describe what we do &
May 14, 2025 · 1 like · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
Amazing how biological science in 30JAN2020 Nature describes "foreseeing AND (potentially) enabling"
A distributional code for value in dopamine-based reinforcement learning
https://t.co/HQLTLmQicd
as being pleasurable; which may more accurately describe what we do & should be https://t.co/70ZvZdseur
May 14, 2025 · 1 like · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
RT @gecko39: https://t.co/HQLTLmQicd
A distributional code for value in dopamine-based reinforcement learning 15JAN2020
May 19, 2024 · 1 share · 2,140 followersView post →
F
fj
@gecko39 · X
https://t.co/HQLTLmQicd
A distributional code for value in dopamine-based reinforcement learning 15JAN2020
May 19, 2024 · 1 like · 1 share · 2,140 followersView post →
AL
Adam Lowet
@Adam_Lowet · X
Later work from @wwdabney and colleagues (https://t.co/3Yl9lCUKoW) suggested that the heterogeneity observed in VTA dopamine neurons had the right structure to serve as a distributional RL teaching signal in the brain. 3/n
Previous work by @wwdabney and colleagues (https://t.co/kXwmAqsBvt) showed that VTA dopamine activity appears to provide signals for learning whole reward distributions rather than just their means. 3/6
Previous work by @wwdabney and colleagues (https://doi.org/10.1038/s41586-019-1924-6) showed that VTA dopamine activity appears to provide signals for learning whole reward distributions rather than just their means. 3/6
【論文サーベイメモ】
Dabney, W., Kurth-Nelson, Z., Uchida, N., Starkweather, C. K., Hassabis, D., Munos, R., & Botvinick, M. (2020). A distributional code for value in dopamine-based reinforcement learning. Nature, 577(7792), Article 7792. https://t.co/fVlL2OtpTu(1/n)
map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/XL1IHHUkxx
how the brain keeps track of everything that might happen next
https://t.co/ENqTnaXnbU https://t.co/BmwSzmAG6S
@KenCaldeira https://t.co/tnxJgGFWRf
Sep 28, 2021 · 1 like · 2,140 followersView post →
F
fj
@gecko39 · X
@KenCaldeira map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/XL1IHHUkxx
how the brain keeps track of everything that might happen next
https://t.co/ENqTnaXnbU https://t.co/BmwSzmAG6S
A new paper has been registered in CPSYMAP.
"A distributional code for value in dopamine-based reinforcement learning"
Will Dabney, Zeb Kurth-Nelson, Naoshige Uchida, Clara Kwon Starkweather, Demis Hassabis, Rémi Mun...
https://t.co/PN3yr36H7x
A distributional code for value in dopamine-based reinforcement learning https://t.co/bqENRzLh9N
Jul 25, 2020 · 1 like · 3,573 followersView post →
CM
Christopher McElveen
@chrisamcelveen · X
@judegomila Also, seems rather obvious in hind sight but this breakthrough could enable machines to have a reason to teach themselves: https://t.co/NpRDD0osdO
map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/XL1IHHUkxx
how the brain keeps track of everything that might happen next
https://t.co/ENqTnaXnbU
Jul 8, 2020 · 1 like · 5 shares · 2,140 followersView post →
F
fj
@gecko39 · X
map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/XL1IHHUkxx
how the brain keeps track of everything that might happen next
https://t.co/ENqTnaXnbU https://t.co/wKuQ9NCpUx
Jul 8, 2020 · 1 like · 5 shares · 2,140 followersView post →
F
fj
@gecko39 · X
map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/XL1IHHUkxx
how the brain keeps track of everything that might happen next
https://t.co/ENqTnaXnbU https://t.co/BmwSzmAG6S https://t.co/NPCpJnY3Nt
Jul 8, 2020 · 1 like · 9 shares · 2,140 followersView post →
F
fj
@gecko39 · X
RT @gecko39: map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020…
map the future for social tipping points
A distributional code for value in dopamine-based reinforcement learning
15JAN2020
https://t.co/HQLTLmQicd
how the brain keeps track of everything that might happen next https://t.co/ySnPI2kOXV
Jul 8, 2020 · 1 like · 2 shares · 2,140 followersView post →
F
fj
@gecko39 · X
RT @gecko39: A distributional code for value in dopamine-based reinforcement learning
15JAN20
https://t.co/HQLTLmQicd
RT @gecko39: A distributional code for value in dopamine-based reinforcement learning
15JAN20
https://t.co/HQLTLmQicd
Jun 19, 2020 · 7 shares · 2,140 followersView post →
F
fj
@gecko39 · X
A distributional code for value in dopamine-based reinforcement learning
15JAN20
https://t.co/HQLTLmQicd
Jun 17, 2020 · 1 like · 7 shares · 2,140 followersView post →
MO
mark orloff
@orloffma · X
a report from lab meeting today—we talked about the distributional code for RL (https://t.co/YOG7qAqwBv) paper which came out earlier this year. Had an interesting discussion about if these neurons are spatially organized somehow (possibly like orientation sensitive cells in V1?)
May 31, 2020 · 1 share · 1,781 followersView post →
?
♟
@IngridVasiliu · X
How humans learn...
May 31, 2020 · 2 likes · 1 share · 1,781 followersView post →
ND
Nathaniel Daw
@nathanieldaw · X
RT @TrendsCognSci: Beyond the Average View of Dopamine
Angela Langdon & Nathaniel Daw discuss "A distributional code for value in dopamine…
May 18, 2020 · 2 shares · 6,981 followersView post →
TS
Trends in Cognitive Sciences
@TrendsCognSci · X
Beyond the Average View of Dopamine
Angela Langdon & Nathaniel Daw discuss "A distributional code for value in dopamine-based reinforcement learning", https://t.co/nD2GdPVL5L
@nathanieldaw, @wwdabney, @zebkDotCom, @naoshigeuchida, @demishassabis
https://t.co/aiA4aJtKYp
May 18, 2020 · 25 likes · 2 shares · 30,647 followersView post →
?
1876
@a1876o · X
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 569 followersView post →
CM
Caroline Chung, MD
@ca_chung · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 2,024 followersView post →
JS
Joab Santana
@job_santana · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 812 followersView post →
NS
Nikolay Savinov
@SavinovNikolay · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 2,758 followersView post →
S
Sergio (
@sguada · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 2,468 followersView post →
MJ
Max Jaderberg
@maxjaderberg · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 16,458 followersView post →
HG
Han Guo
@HanGuo97 · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 3,609 followersView post →
FL
Florian Laurent
@MasterScrat · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 2,581 followersView post →
TB
Trevor Back
@TrevorBack · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 884 followersView post →
PS
Piotr Mirowski @bsky.social
@MirowskiPiotr · X
RT @wwdabney: Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here:…
Jan 29, 2020 · 25 shares · 6,040 followersView post →
WD
Will Dabney
@wwdabney · X
Our paper 'A distributional code for value in dopamine-based reinforcement learning' on the cover of @nature!
Read it here: https://t.co/d37sHm879r
Shout out to the amazing artists/designers at @DeepMind who make this possible, while we get to focus on the research. https://t.co/5FvyxMPkWn
Jan 29, 2020 · 134 likes · 25 shares · 1,455 followersView post →
M
mshingote
@mayur_shingote · X
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
Jan 24, 2020 · 70 shares · 948 followersView post →
DE
Dani Elmi
@danielaelmi · X
A distributional code for value in dopamine-based reinforcement learning https://t.co/6bcP7AxH8T
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
Jan 23, 2020 · 70 shares · 948 followersView post →
M
mshingote
@mayur_shingote · X
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
Jan 23, 2020 · 70 shares · 948 followersView post →
TP
Truett Preslar
@Preslart · X
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
Jan 22, 2020 · 70 shares · 78 followersView post →
AI
aggregate intellect
@AISC_TO · X
[In human brains, reward might be a distribution instead of a single value] A distributional code for value in dopamine-based reinforcement learning https://t.co/SDe86NeaZn https://t.co/AQqzPphE8X
Jan 22, 2020 · 1 like · 1,440 followersView post →
M
mshingote
@mayur_shingote · X
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
Jan 22, 2020 · 70 shares · 948 followersView post →
M
mshingote
@mayur_shingote · X
RT @DeepMind: Read our @nature paper "A distributional code for value in dopamine-based reinforcement learning" online here: https://t.co/Y…
Jan 21, 2020 · 70 shares · 948 followersView post →
MH
Mity HQ
@MityHQ · X
"A distributional code for value in dopamine-based reinforcement learning" https://t.co/BGgfSbpoj2
"A distributional code for value in dopamine-based reinforcement learning" https://t.co/oGbWNQPCX7
Jan 21, 2020 · 2 likes · 18,523 followersView post →
N
The Role of Executive Function in Shaping Reinforcement Learning ...
News
10.1038/s41586-019-1924-6 [PubMed: 31942076] 19. Daniel R, Radulescu A, & Niv Y (2020). Intact Reinforcement Learning But Impaired Attentional Control ...
Stella Collins - Neuroscience For Learning and Development - How ...
News
https://doi.org/10.1038/s41586-019-1924-6 (archived at https://perma.cc/CP2G- Q46W) Exceptional Leaders Lab (2022) It's time to give Noel Burch some credit ...