Search

Home > Astral Codex Ten Podcast > Highlights From The Comments On Unpredictable Reward
Podcast: Astral Codex Ten Podcast
Episode:

Highlights From The Comments On Unpredictable Reward

Category: Technology
Duration: 00:37:40
Publish Date: 2022-10-01 14:25:00
Description:

https://astralcodexten.substack.com/p/highlights-from-the-comments-on-unpredictable

[Original post: Unpredictable Reward, Predictable Happiness]

1: Okay, I mostly wanted to highlight this one by Grognoscente:

I think really digging into the neural nitty gritty may prove illuminative here. Dopamine release in nucleus accumbens (which is what drives reward learning and thus the updating of our predictions) is influenced by at least three independent factors:

1. A "state prediction error" or general surprise signal from PFC (either directly or via pedunculopontine nucleus and related structures). This provokes phasic bursting of dopamine neurons in the Ventral Tegmental Area.

2. The amount and pattern of GABAergic inhibition of VTA dopamine neurons from NAc, ventral pallidum, and local GABA interneurons. At rest, only a small % of VTA DA neurons will be firing at a given time, and the aforementioned surprise signal alone can't do much to increase this. What CAN change this is the hedonic value of the surprising stimulus. An unexpected reward causes not just a surprise signal, but a release of endorphins from "hedonic hotspots" in NAc and VP, and these endorphins inhibit the inhibitory GABA neurons, thereby releasing the "brake" on VTA DA neurons and allowing more of them to phasically fire.

Total Play: 0