Neural Annealing: Toward a Neural Theory of Everything (crosspost)

post by Michael Edward Johnson (michael-edward-johnson) · 2019-11-29T17:31:12.730Z · LW · GW · 29 comments

Contents

  0. Introduction
  I. Annealing metaphors for the brain
  Interlude: FEP, CSHW, and EBH/REBUS
  II. How meditation works: semantically-neutral annealing
  III. Depression as a disorder of annealing; bipolar depression doubly so
  The ‘dead neuron’ model of neuroticism and depression:
  IV. The nature of trauma and the implementation of the Bayesian Brain
  V. On psychedelics:
  VI. Love and other types of Neural Annealing
  Conclusion:
  Endnotes:
  Citation
  Acknowledgements
None
29 comments

The following is QRI's unified theory of music, meditation, psychedelics, depression, trauma, and emotional processing. Implications for how the brain implements Bayesian updating, and future directions for neuroscience. Crossposted from http://opentheory.net

-----------------

Context: follow-up to The Neuroscience of Meditation and A Future For Neuroscience; a unification of (1) the Entropic Brain & REBUS (Carhart-Harris et al. 2014; 2018; 2019), (2) the Free Energy Principle (Friston 2010), (3) Connectome-Specific Harmonic Waves (Atasoy et al. 2016; 2017), and (4) QRI’s Symmetry Theory of Valence (Johnson 2016; Gomez Emilsson 2017).

0. Introduction

Why is neuroscience so hard?

Part of the problem is that the brain is complicated. But we’ve also mostly been doing it wrong, trying to explain the brain using methods that couldn’t possibly generate insight about the things we care about.

On QRI’s lineages page, we suggest there’s a distinction between ‘old’ and ‘new’ neuroscience:

Traditionally, neuroscience has been concerned with cataloguing the brain, e.g. collecting discrete observations about anatomy, observed cyclic patterns (EEG frequencies), and cell types and neurotransmitters, and trying to match these facts with functional stories. However, it’s increasingly clear that these sorts of neat stories about localized function are artifacts of the tools we’re using to look at the brain, not of the brain’s underlying computational structure.
What’s the alternative? Instead of centering our exploration on the sorts of raw data our tools are able to gather, we can approach the brain as a self-organizing system, something which uses a few core principles to both build and regulate itself. As such, if we can reverse-engineer these core principles and use what tools we have to validate these bottom-up models, we can both understand the internal logic of the brain’s algorithms — the how and why the brain does what it does — as well as find more elegant intervention points for altering it.

That’s a big check to try to cash. What might this look like?

I. Annealing metaphors for the brain

In my post about the neuroscience of meditation, I talked about simulated annealing, a natural implication of Robin Carhart-Harris’s work on entropic disintegration in the brain:

Annealing involves heating a metal above its recrystallization temperature, keeping it there for long enough for the microstructure of the metal to reach equilibrium, then slowly cooling it down, letting new patterns crystallize. This releases the internal stresses of the material, and is often used to restore ductility (plasticity and toughness) on metals that have been ‘cold-worked’ and have become very hard and brittle— in a sense, annealing is a ‘reset switch’ which allows metals to go back to a more pristine, natural state after being bent or stressed. I suspect this is a useful metaphor for brains, in that they can become hard and brittle over time with a build-up of internal stresses, and these stresses can be released by periodically entering high-energy states where a more natural neural microstructure can reemerge.

In his work on the entropic brain, Carhart-Harris studies how psychedelics like LSD and psilocybin add enough energy (neural activity) to the brain that existing neural patterns are disrupted, much like how heating a metal disrupts its existing molecular bonds. Recently, Carhart-Harris and Friston have unified their frameworks under the REBUS (RElaxed Beliefs Under pSychedelics) model, which also imports the annealing metaphor for brains:

The hypothesized flattening of the brain’s (variational free) energy landscape under psychedelics can be seen as analogous to the phenomenon of simulated annealing in computer science—which itself is analogous to annealing in metallurgy, whereby a system is heated (i.e., instantiated by increased neural excitability), such that it attains a state of heightened plasticity, in which the discovery of new energy minima (relatively stable places/trajectories for the system to visit/reside in for a period of time) is accelerated (Wang and Smith, 1998). Subsequently, as the drug is metabolized and the system cools, its dynamics begin to stabilize—and attractor basins begin to steepen again (Carhart-Harris et al., 2017). This process may result in the emergence of a new energy landscape with revised properties.

It’s a powerful metaphor since it ties together and recontextualizes so many core neuroscience concepts: free energy landscapes, Bayesian modeling, the ‘handshake’ between bottom-up sense-data and top-down priors. For a general overview of the math, see Wikipedia on simulated annealing, Metropolis-Hastings algorithm, Parallel tempering; for more on Carhart-Harris’s and Friston’s work, see Scott Alexander’s and Milan Griffes’ commentary. There seems to be some convergence on this metaphor: as Scott Alexander noted,

F&CH aren’t the first people to discuss this theory of psychedelics. It’s been in the air for a couple of years now – and props to local bloggers at the Qualia Research Institute and Mad.Science.Blog for getting good explanations up before the parts had even all come together in journal articles. I’m especially interested in QRI’s theory that meditation has the same kind of annealing effect, which I think would explain a lot.

The basics: how does annealing work?

Carhart-Harris’s and Friston’s model does many very clever things and is a substantial addition to the literature; I start from a similar frame but describe the process slightly differently. The following is QRI’s model (based on my talk on the Neuroscience of Meditation in Thailand):

Any ‘emotionally intense’ experience that you need time to process most likely involves this entropic disintegration->search->annealing mechanism— this is what emotional processing is.

And I’d suggest that this is the core dynamic of how the brain updates its structure, the mechanism the brain uses to pay down its ‘technical debt’. In other words, entering high-energy states (i.e., intense emotional states which take some time to ‘process’) is how the brain releases structural stress and adapts to new developments. This process needs to happen on a regular basis to support healthy function, and if it doesn’t, psychological health degrades— In particular, mental flexibility & emotional vibrancy go down — analogous to a drop in a metal’s ‘ductility’. People seem to have a strong subconscious drive toward entering these states and if they haven’t experienced a high-energy brain state in some time, they actively seek one out, even sometimes in destructive ways.

However, the brain spends most of its time in low-energy states, because they’re safer: systems in noisy environments need to limit their rate of updating. There are often spikes of energy in the brain, but these don’t tend to snowball into full high-energy states because the brain has many ‘energy sinks’ (inhibitory top-down predictive models) which soak up excess energy before entropic disintegration can occur.

But the brain can enter high-energy states if these energy sinks are:

(1) De-activated, if certain evolved trigger conditions are present- e.g., death of a loved one, falling in love, good sex, social rejection, getting bitten by a weird animal, failing some important prediction. In these cases there seems to be some sort of adaptive gating mechanism that disables the typical energy sinks in order to allow entropic disintegration->search->annealing to happen.

(2) Overwhelmed, if there’s an enormous magnitude of energy coming in, faster than the energy sinks can mop it up- e.g., watching a horror movie, direct brain stimulation, first day of school, being sleep deprived, military boot camp, cult indoctrinations, your wedding day.

(3) Avoided, if semantically-neutral energy is applied to the system. Essentially, coherent energy which isn’t strongly linked to any cognitive, emotional, or sensory process will be partially illegible to most existing energy sinks, and so it can persist long enough to build up – basically ‘hacking’ the brain’s activity normalization system. (Hold that thought – this is the most interesting one. We’ll return to it later.)

This is the ‘view from 30,000 feet’ for how simulated annealing in the brain works. If you stopped reading here, you’d walk away with a reasonable toy model of QRI’s “Neural Annealing” framework.

But there’s a lot more to the model! The rest of this writeup is an iterative tour using Neural Annealing to explain meditation, trauma, love, depression, psychedelics, and effective therapy, with each section adding a variation on the core theme.

Interlude: FEP, CSHW, and EBH/REBUS

QRI’s “Neural Annealing” framework is essentially a unification of Karl Friston’s Free Energy Principle (FEP), Selen Atasoy’s Connectome-Specific Harmonic Waves (CSHW), Robin Carhart-Harris’s Entropic Brain Hypothesis (EBH), and QRI’s own Symmetry Theory of Valence (STV). Recently, Friston and Carhart-Harris have unified their respective paradigms with the Relaxed Beliefs Under pSychedelics (REBUS) model. I believe combining all three is exponentially more powerful, not only giving the computational-level story of REBUS, but also giving us a model for how the brain may be physically implementing REBUS, and Bayesian updating in general, with a correspondingly richer set of predictions. 

First, here’s a quick recap: to paraphrase what I wrote elsewhere,

Karl Friston’s Free Energy Principle (FEP) is the leading theory of self-organizing system dynamics, one which has (in various guises) pretty much taken neuroscience by storm. It argues that any self-organizing system which effectively resists disorder must (as its core organizing principle) minimize its free energy, that free energy is equivalent to surprise (in a Bayesian sense), and that this surprise-minimization drives basically all human behavior. This minimization of surprise revolves around Bayesian-type reasoning: the brain is always getting bottom-up sense data flowing in, more than it can handle. So it relies on top-down predictive models that attempt to sort through all this data so we can focus on the surprising stuff, the stuff that can’t be effortlessly predicted. The core of the FEP is the details of how this ‘handshake’ between bottom-up and top-down happens, and what can influence it. See Friston’s primary work; Scott Alexander’s attempt to distill it. Related to (and sometimes used synonymously with) Active Inference, the Bayesian Brain, and Predictive Processing / Predictive Coding.

Robin Carhart-Harris’s Entropic Brain Hypothesis (EBH) is essentially an attempt to import key concepts such as entropy and self-organized criticality from statistical physics into neuroscience, in order to explain psychedelic phenomena. As I noted above, it suggests that certain conditions such as psychedelics can add enough energy to brain networks that they undergo ‘entropic disintegration’, and then self-organize into new equilibria. See Carhart-Harris 2018. 

Selen Atasoy’s Connectome-Specific Harmonic Waves (CSHW) is a method for applying harmonic analysis to the brain: basically, it uses various forms of brain imaging to infer what the brain’s natural resonant frequencies (eigenmodes) are, and how much energy each of these frequencies have. The core workflow is three steps: first combine MRI and DTI to approximate a brain’s connectome, then with an empirically-derived wave propagation equation calculate what the natural harmonics are of this connectome, then estimate which power distribution between these harmonics would most accurately reconstruct the observed fMRI activity. This framework offers several notable things: (a) these connectome-specific harmonic waves (CSHWs) are natural Schelling points that the brain has probably self-organized around (and so are worth talking about); (b) a plausible mid-level bridge connecting bottom-up neural dynamics and high-level psychological phenomena, (c) something we can actually measure. CSHW is an empirical paradigm, which is very uncommon in theoretical neuroscience. Here’s a transcript of Atasoy’s explanation; I also wrote extensively about CSHW in A Future for Neuroscience.

In short: each of these three paradigms is a description of how the brain self-organizes. Friston’s work understands the self-organization from a computational lens; Carhart-Harris an energetic lens; Atasoy a physical lens.

Finally, I’d offer two further pieces of background context: 

QRI’s own Symmetry Theory of Valence (STV), which hypothesizes that given a mathematical representation of an experience, the symmetry of this representation will encode how pleasant the experience is (Johnson 2016). We further hypothesize that consonance between a brain’s connectome-specific harmonic waves (CSHWs) will be a reasonable proxy for this symmetry (Gomez Emilsson 2017).

Marr’s Three Levels: as explained on our lineages page, 

David Marr is most famous for Marr’s Three Levels (along with Tomaso Poggio), which describe ”the three levels at which any machine carrying out an information-processing task must be understood:”
>Computational theory: What is the goal of the computation, why is it appropriate, and what is the logic of the strategy by which it can be carried out?
>Representation and algorithm: How can this computational theory be implemented? In particular, what is the representation for the input and output, and what is the algorithm for the transformation?
>Hardware implementation: How can the representation and algorithm be realized physically? [Marr (1982), p. 25]
This framework sounds simple, but is remarkably important since arguably most of the confusion in neuroscience (and phenomenology research) comes from starting a sentence on one Marr-Poggio level and finishing it on another, and this framework lets people debug that confusion.

Back to annealing –

As noted, Carhart-Harris and Friston have unified their paradigms under REBUS by understanding prediction errors as the ‘energy’ parameter which drives disruption (entropic disintegration) in the brain’s networks. Over time, this drives an evolutionary search function which attempts to minimize these prediction errors. I think this is a very beautiful description of a very clever system, and one which allows us an opportunity to cross-validate each model, and jump between levels of description if we get ‘stuck’. But it’s still missing a story about physical implementation. What is this ‘energy’, physically speaking?

II. How meditation works: semantically-neutral annealing

I believe that almost all techniques that intentionally ‘hack’ the brain’s annealing process share a common mechanism: a build-up of semantically neutral energy. “Semantically neutral energy” refers to neural activity which is not strongly associated with any specific cognitive or emotional process. As I note above, usually energy build-up is limited: once a perturbation of the system neatly falls into a pattern recognized by the brain’s predictive hierarchy, the neural activity propagating this pattern is dissipated. But if a pattern never quite matches anything, or takes advance of implementation-level structure to persist, and especially if it’s getting continually reinforced by some external or internal dynamic it can persist long enough to build up. I think meditation is a perfect example of a process which adds semantically-neutral energy to the brain: effortful attention on excitatory bottom-up sense-data and attenuation of inhibitory top-down predictive models will naturally lead to a build-up of this ‘non-semantic’ energy in the brain. From The Neuroscience of Meditation:

Furthermore, from what I gather from experienced meditators, successfully entering meditative flow may be one of the most reliable ways to reach these high-energy brain states. I.e., it’s very common for meditation to produce feelings of high intensity, at least in people able to actually enter meditative flow. Meditation also produces more ‘pure’ or ‘neutral’ high-energy states, ones that are free of the intentional content usually associated with intense experiences which may distort or limit the scope of the annealing process. So we can think of intermediate-to-advanced (‘successful flow-state’) meditation as a reheating process, whereby the brain enters a more plastic and neutral state, releases pent-up structural stresses, and recrystallizes into a more balanced, neutral configuration as it cools. Iterated many times, this will drive an evolutionary process and will produce a very different brain, one which is more unified & anti-fragile, less distorted toward intentionality, and in general structurally optimized against stress.
An open question is how or why meditation produces high-energy brain states. There isn’t any consensus on this, but with a nod to the predictive coding framework, I’d offer that bottom-up sense-data is generally excitatory, adding energy to the system, whereas top-down predictive Bayesian models are generally inhibitory, functioning as ‘energy sinks’. And so by ‘noting and knowing’ our sensations before our top-down models activate, in a sense we’re diverting the ‘energy’ of our sensations away from its usual counterbalancing force. If we do this long enough and skillfully enough, this energy can build up and lead to ‘entropic disintegration’, essentially pushing enough energy into the system that existing attractors are disrupted and annealing can occur. 

A natural question here is what *is* this ‘semantically neutral energy’ exactly? – an abstract answer here is “semantically neutral energy” can be thought of as an increase in brain activity which is (1) illegible to Marr’s semantic/computational level, but (2) coherent with regard to Marr’s algorithmic or implementational levels (another term for this might be ‘semantically-illegible energy’). But my concrete answer is that semantically neutral energy is a build-up of energy in the brain’s natural resonances — energy accumulating in CSHWs. And so it’s this that builds up during meditation, and this that starts a semantically-neutral annealing process which has a unique effect profile.

I think semantically-neutral annealing is the best kind of annealing for psychological health, because: 

(1) By mostly avoiding energy sinks, the same entropic disintegration->search->annealing process can happen using less total energy, which is less disruptive to the fine details of the system;

(2) Since this energy is semantically-neutral, it doesn’t depend on or trigger as many semantic processes in the brain (which can have unpredictable effects), and likewise it doesn’t necessarily rely on anti-inductive ‘hacks’ to trick the predictive processing system, and these factors make it a more reliable and repeatable source of annealing; 

(3) Very very importantly: similarly to how vibratory energy applied to a tuning fork quickly collapses to the natural resonant frequency of the tuning fork, I’m speculating that coherent, semantically-neutral energy added to the brain will naturally cluster in the brain’s natural connectome harmonics, which will thus drive an annealing process which strengthens a consonant subset of the brain’s natural harmonic resonances in the long-term— essentially ‘retuning the brain’ toward more resonant/flow states. For more details, see The Neuroscience of Meditation;

(4) Finally, this process should feel really really good and in the long-term, retune the mind to be more pleasant to inhabit. QRI’s work on the Symmetry Theory of Valence (STV) and our method of applying this to the brain (CDNS) suggests that harmony in the brain is literally synonymous with pleasure, and so processes which ‘deepen the grooves’ of core harmonic resonances will tend to boost the mind’s default hedonic level (likely helping significantly with neuroticism and emotional resilience).

I.e., Meditation is a remarkably clever technique which piggybacks on several of the brain’s core principles of self-organization: first, effortful attention on (excitatory) sense-data and inhibiting (inhibitory) predictive storytelling naturally pushes the brain into a high-energy state and makes it more malleable; this excess energy disproportionately collects in natural brain harmonics, and as the brain ‘cools’ from its high-energy state, these energized harmonics become ‘deeper’, leading to more psychological robustness. Less neuroticism and more flow. I think this is where a large portion of the benefits of advanced meditation comes from.

Meditation isn’t the only method to induce build-up of semantically-neutral energy; the “Big Three” are:

– Meditation, which seems to work by both increasing excitatory sense-data and decreasing inhibitory top-down predictive models (energy sinks);

– Psychedelics, which intuitively may function by disabling existing energy sinks (or perhaps overloading them by increasing baseline firing rates or increasing the branching factor of neural activity).

– Music, a sensory input which seems to exist on the knife’s edge between exhibiting highly ordered patterns (some of which will hit natural connectome harmonics and so allow accumulation of energy through resonance) on one hand, and on the other hand not being too predictable (thus dodging most inhibitory top-down predictive models);

Hybrid approaches also exist: e.g. exercise, dance, sex, tantric practices, EMDR, and breath work are essentially combinations of the rhythmic portion of music and the sensory portion of meditation. The fact that psychedelics reliably enhance the potency of each and every one of these practices is not a coincidence, but due to shared mechanism.[1]

III. Depression as a disorder of annealing; bipolar depression doubly so

To describe depression in one sentence: “Depression is a self-reinforcing perturbation from the natural annealing cycle.” There are two related aspects to this: (1) an inability to anneal normally, and (2) annealing abnormally (more specifically, annealing new attractor basins which are high in dissonance, or annealing a pathological change in energy parameter dynamics).

Most people have a simple model of depression as “being sad all the time” – but I think a two-factor model looking at energy parameter and valence offers a lot of clarity and predictive utility. Roughly speaking, this suggests parametrizing depression into three core types:

I. Depression with no high energy states, characterized by a lack of annealing (emotional clarity and dynamism) in general;

II. Depression with high-energy negative states, which over time anneals minds toward suffering and hopelessness;

III. Bipolar depression with high-energy positive & negative states, which over time anneals minds toward the dramatic.

These categories aren’t exclusive or static; too much time in one will increase the probability one may also fall into the others. 

Not annealing frequently enough may be the most important ‘non-obvious’ cause of depression. Brains – especially younger ones, since they’re changing so much – really do need to anneal regularly to pay down their ‘technical debt’, and if they don’t, they grow brittle and neurotic. (Technical debt in the brain builds up as we twist our existing brain networks to accommodate new facts; this debt is ‘paid down’ when we enter high-energy states and let new brain networks which fit these constraints self-organize) The ‘annealing pressure’ also increases over time, and if a wholesome annealing opportunity fails to present itself, the brain will progressively lower its standards looking for any opportunity for annealing. Especially if done repeatedly, this can cause long-term damage to the brain’s attractor basin landscape. (We see this in negative coping strategies such as cutting, drama-seeking, and so on – if someone is engaging in such, they’ve probably annealed poorly, and also likely have few realistic opportunities for healthy annealing.) Many forms of entertainment we think of as palliatives in today’s society (e.g. movies, video games) may be weak-and-incomplete-but-still-nonzero drivers of annealing. Not as good as the real thing, but better than nothing if that’s your only option.

At the high-energy extreme, it seems likely and tragic that depression compounds itself by repeatedly causing intense negative emotion (high-energy states) which anneals the brain toward these patterns, and toward assigning salience on the set of problems and types of thoughts (attractor landscape) facing a depressed person — many of which are their own cause and would weaken if ignored. Relatedly, I suspect some CSHW- and music-theory-related math could be found describing how depression anneals what I would call a brain’s ‘connectome key signature’ (CKS) toward a ‘minor key’, an internal logic which feels tragic/hopeless (has fewer harmonious arrangements and progressions), which the brain then uses as building blocks for its reality. 

Bipolar depression seems a little more strange; the extreme highs and lows may in aggregate produce crazier annealing patterns than just one or the other — essentially there’s a ‘tug of war’ between patterns annealed during each extreme, which prioritizes the survival of the class of patterns that exist during both extremely positive and extremely negative states. In practice, over time this anneals a mind’s stories toward the dramatic, and toward reducing the activation energy needed to flip the brain between major and minor keys (the psych literature calls this ‘kindling’). Each of these ‘key signature flips’ would itself release a great deal of pent-up energy, further driving the annealing process. As I note in A Future for Neuroscience:

This is not to say our key signatures are completely static, however: an interesting thread to pull here may be that some brains seem to flip between a major key and a minor key, with these keys being local maximas of harmony. I suspect each is better at certain kinds of processing, and although parts of each can be compatible with the other, each has elements that present as defection to the internal logic of the other and so these attractors can be ‘sticky’. But there can also be a buildup of tension as one gathers information that is incompatible with one’s key signature, which gets progressively more difficult to maintain, and can lead to the sort of intensity of experience that drives an annealing-like process when the key signature flips. And in the case of repeated flips, the patterns which are compatible with both key signatures will be the most strongly reinforced.

In some ways a bipolar brain may result in significant cognitive and creative advantages: perhaps the biggest is more access to high-energy states, which in the short term helps creativity by allowing more exploration and also steeper valence gradients to follow, and iterated over the long term allows significantly more optimization pressure on the subsystems that are repeatedly annealed. However this has corresponding epistemological downsides as noted above; fueling creative work with valence deltas is likely to ‘warp the engine’ over time, to paraphrase Shinzen. Friston’s notion that ‘systems maximizing long-term stability spend most of their time in a small number of states’ seems particularly relevant to mood disorders. (My colleague Andrés suggests this ‘bipolar effect profile’ may be replicated by valence-enhancing drugs with a short duration and hangover, such as cocaine- this at least fits stereotypes.)

I find myself wondering if neuroticism can be thought of as ancient neural technology intended to reduce annealing frequency in the ancestral environment — essentially if we look into the brains of highly neurotic people, we might find strong energy sinks located around natural connectome harmonics which prevent semantically-neutral energy build-up. This likely contributes to certain forms of depression (and leads to pernicious feedback cycles — the less one anneals, the more neurotic one gets, the less able to reach high-energy states one becomes), but might also help prevent seizures or inappropriate updating/annealing, and may have frequency-dependent benefits. E.g., a group with 19 carefree annealers and 1 neurotic guardian will act more wisely than one with 20 carefree annealers or 20 neurotic guardians. The ‘neuroticism=energy sinks’ frame seems to suggest how to reduce neuroticism (anneal more often, especially semantically-neutral annealing), and also offer clues as to how neuroticism is implemented in the brain: we might look into the mathematics of Anderson localization in the connectome: topological features that can ‘eat’ waves.

Is sleep a natural annealing process? If so, this could cleanly explain the connection between depression and chronic sleep disturbances — poor sleep as both a cause and effect of infrequent annealing. And it would indicate a treatment path: a restoration of normal annealing patterns may help improve both mood and sleep. I hold the following lightly, but we might model nREM as the heating-up phase (undampened harmonics) and REM as the neural search & cooling process. From a review drawing parallels between sleep and jhana (intense meditative) states: 

This paper is a preliminary report on the first detailed EEG study of jhana meditation, with findings radically different to studies of more familiar, less focused forms of meditation. While remaining highly alert and “present” in their subjective experience, a high proportion of subjects display “spindle” activity in their EEG, superficially similar to sleep spindles of stage 2 nREM sleep, while more-experienced subjects display high voltage slow-waves reminiscent, but significantly different, to the slow waves of deeper stage 4 nREM sleep, or even high-voltage delta coma. Some others show brief posterior spike-wave bursts, again similar, but with significant differences, to absence epilepsy. Some subjects also develop the ability to consciously evoke clonic seizure-like activity at will, under full control. (Dennison 2019)

It seems plausible that broad rhythmic brain activity helps with certain ‘physical housekeeping’ tasks in the brain as well, and if one anneals regularly they may need somewhat less sleep (see recent research on Alzheimer’s, sleep, and rhythmic stimulation helping break up brain plaques).

The ‘dead neuron’ model of neuroticism and depression:

Deep learning models can exhibit ‘dead neurons’: neurons whose activation function gets ‘stuck’ on the on or off position, for instance when a sigmoid function gets too high or too low and its slope drops to almost zero. These ‘dead’ neurons can be nigh-impossible to ‘revive’ within the model, since it can be the case that their gradient (implicit sensitivity to input) is so shallow that there simply aren’t inputs that will nudge it in one or another direction.

Graphic: sigmoidal function. This loses sensitivity when values get too high or too low. Different activation functions can lose sensitivity (lead to ‘dead neurons’) under different scenarios- ReLU is notorious for this.

These ‘dead’ neurons tend to cause lots of problems, since their “always-on” or “always off” signal tends to propagate through the network very strongly, causing later neurons in the chain to also exhibit less sensitivity to input. (Sometimes this process will cascade, sometimes not, much like malignant vs benign tumors.) 

I suspect this might be a strong frame for understanding the ‘psychological cruft’ which builds up in brains, and how and why regular annealing is so healthy: over time, sensitive neurons can slide into this broken state, shifting from conditional values to the neurological equivalent of static 0s and 1s. In this case I would expect more neuroticism, less flexible thinking, lower emotional resilience, and worse epistemology from people who haven’t annealed recently: lots of all-or-nothing thinking. But by injecting lots of energy into the system, enough of the internal and external context of these neurons is shifted such that some of them may get ‘reset’ and regain their conditional processing state. At the very least, this self-reorganization process can allow these neurons to move to less-critical points in processing networks. 

An idea related to this frame is that a core function of neural annealing is to maintain a smooth gradient of harmony in the brain (and mind) – to make it possible to “follow your joy” toward better outcomes. If this breaks down and you can’t “follow your joy”, consider putting yourself in a situation which could plausibly kickstart an annealing process (even if you don’t feel emotionally motivated to do so). 

IV. The nature of trauma and the implementation of the Bayesian Brain

Trauma is one of the worst elements of the human condition. It’s easy enough to accumulate that we all have some, and it’s hard to get rid of. But what is it?

Scott Alexander recently reviewed a core work in the PTSD literature, The Body Keeps The Score, and offers some context:

The book stressed the variety of responses to PTSD. Some people get anxious. Some people get angry. But a lot of people, whatever their other symptoms, also go completely numb. They are probably still “having” “emotions” “under” “the” “surface”, but they have no perception of them. Sometimes this mental deficit is accompanied by equally surprising bodily deficits. Van der Kolk describes a study on stereoagnosia in PTSD patients: if blindfolded and given a small object (like a key), they are unable to recognize it by feel, even though this task is easy for healthy people. Sometimes this gets even more extreme, like the case of a massage therapy patient who did not realize they were being massaged until the therapist verbally acknowledged she had started.
The book is called The Body Keeps The Score, and it returns again and again to the idea of PTSD patients as disconnected from their bodies. The body sends a rich flow of information to the brain, which is part of what we mean when we say we “feel alive” or “feel like I’m in my body”. In PTSD, this flow gets interrupted. People feel “like nothing”. …
There’s some discussion of the neurobiology of all this, but it never really connects with the vividness of the anecdotes. A lot of stuff about how trauma causes the lizard brain to inappropriately activate in ways the rational brain can’t control, how your “smoke detector” can be set to overdrive, all backed up with the proper set of big words like “dorsolateral prefrontal cortex” – but none of it seemed to reach the point where I felt like I was making progress to a gears-level explanation. I felt like the level on which I wanted an explanation of PTSD, and the level at which van der Kolk was explaining PTSD, never really connected; I can’t put it any better than that. …
There are a lot of alternative treatments for PTSD. Neurofeedback, where you attach yourself to a machine that reads your brain waves and try to explore the effect your thoughts have on brain wave production until you are consciously able to manipulate your neural states. Internal family systems, where a therapist guides you through discovering “parts” of yourself (think a weak version of multiple personalities), and you talk to them, and figure out what they want, and make bargains with them where they get what they want and so stop causing mental illness. Eye movement directed reprocessing (alternative when the book was written, now basically establishment) where you move your eyes back and forth while talking about your trauma, and this seems to somehow help you process it better. Acupuncture. Massage. Yoga. …
Maybe the most consistent lesson from this book’s tour of successful alternative therapies – keeping with the theme of the title – is that it’s important for PTSD patients to get back in touch with their bodies. Massage therapy, yoga, and acupuncture addressed this directly, usually creating gentle, comfortable sensations that patients could take note of to gradually relax the absolute firewall between bodily sensation and conscious processing.

The simple Neural Annealing take on trauma is that significant negative events can push the brain into a high-energy state filled with ‘trauma patterns’, and as the brain cools, some of these trauma patterns crystallize/anneal in a very durable form, which present as PTSD.

I think this is a more useful answer than what’s out there currently, offering straightforward intuitive answers for (1) what kinds of things are most likely to cause PTSD, (2) why PTSD is so ‘sticky’, and (3) an intuitive solution to PTSD: anneal over the bad patterns with better patterns.

But Scott’s description seems to point at something further: that there’s a disconnection happening with trauma. To address this, I propose the Neural Annealing model for how CSHW could implement the Bayesian Brain model of cognition. We’ll then circle back and discuss what might be going wrong during trauma.

Last year in A Future for Neuroscience, I shared the frame that we could split CSHWs into high-frequency and low-frequency types, and perhaps say something about how they might serve different purposes in the Bayesian brain:

The mathematics of signal propagation and the nature of emotions
High frequency harmonics will tend to stop at the boundaries of brain regions, and thus will be used more for fine-grained and very local information processing; low frequency harmonics will tend to travel longer distances, much as low frequency sounds travel better through walls. This paints a possible, and I think useful, picture of what emotions fundamentally are: semi-discrete conditional bundles of low(ish) frequency brain harmonics that essentially act as Bayesian priors for our limbic system. Change the harmonics, change the priors and thus the behavior. Panksepp’s seven core drives (play, panic/grief, fear, rage, seeking, lust, care) might be a decent first-pass approximation for the attractors in this system. 

I would now add this roughly implies a continuum of CSHWs, with scale-free functional roles:

These waves shade into each other – a ‘low-frequency thought’ shades into a ‘high-frequency emotion’, a ‘low-frequency emotion’ shades into somatic information. As we go further up in frequencies, these waves become more localized.

An interesting implication here is we may essentially get Bayesian updating to naturally emerge from this typology, through interactions between these various waves: essentially, I think it’s ‘injection-locking all the way down’. (Injection-locking is when harmonic oscillators (like CSHWs) essentially ‘sync up’ their periods and phases.) Specifically:

Low-frequency CSHWs carry priors, higher frequency RSHWs deal with particulars. Lower frequencies span the brain; higher frequencies resonate within more local regions of the brain — the higher the frequency of the wave, the smaller the region it tends to resonate in. The RSHWs in different regions can’t talk to each other directly, since (definitionally) these waves can’t travel across regional boundaries. But they can talk to each other indirectly, through interacting with low-frequency CSHWs. More specifically, I speculate that regions and CSHW-encoded priors interact through a power-weighted averaging between CSHWs and RSHWs, as mediated by the math of injection-locking and injection-pulling. This allows both functional partitioning and also global updating: regions get some isolation in order to perform their specialized computations, but they also get exposure to data about the overall Bayesian prior situation, aka what we call ‘emotional information’. I.e. Region A syncs up with CSHWs, which carry the information to Region B and sync up with the RSHWs there, and so on. Of note, there’s a delicate, power-weighted handshake between CSHWs and RSHWs: low-frequency harmonics (emotions / Bayesian priors) carry more power per harmonic (lower due to frequency, much higher due to amplitude) but there are many more high-frequency harmonics (sensory+cognitive particulars). Strong emotions like anger likely pump huge amounts of energy into CSHWs and upend this balance, forcing RSHWs to synchronize with CSHWs. We can think of this as sacrificing the delicate epistemology-harmonization handshake in favor of unity of processing and clarity of action — or put simply, forcing perception to match top-down expectations.

On entropic disintegration, search, and annealing in evolved harmonic systems:

The noisy, stochastic nature of brain activity, along with practical requirements for homeostasis, will lead to a strong optimization of the CSHW+RSHW configuration for local minima which are resistant to change. However, a large enough perturbation will push the system out of this basin (entropic disintegration step). The neural search step is essentially the system stochastically testing different harmonic configurations; the neural annealing step is the system ‘settling into’ a configuration as its top-down predictive models get sufficiently good at sopping up the excess energy in the system, essentially forming a new basin it will again take a large amount of perturbation to get out of. The strength of annealing can be thought of as the steepness of this basin, and also the Hebbian reinforcement of system attractors (“neurons that fire together, wire together”). Insofar as partitioning is possible in a broadly-coupled harmonic system, these perturbations will tend to be ‘local’ as the brain has strong incentives to preserve structure that doesn’t need updating. 

Toward a generalized definition of trauma: a breakdown of information-propagation-via-injection-locking

I propose that sometimes the brain needs to rapidly halt information propagation across regions to prevent cascading system failure (a metaphor that comes to mind is an uncontrolled prion-like change in the local key signature that ripples out from a traumatized region, progressively breaking cybernetic calibrations). I believe the brain uses two interlinked mechanisms to do this: (1) weakening CSHWs, thus weakening information propagation throughout the brain, and (2) arranging different brain regions into frequency regimes which make information transfer difficult between them (the golden mean is the mathematically-optimal ratio for non-interaction). Once this happens, it can be very hard to reverse, since it forms a self-sustaining cycle: (1) causes (2) and (2) causes (1). We call this ‘trauma’.

Some predictions from this – I’d expect to see substantially less energy in low-frequency CSHWs after trauma, and substantially more energy in low-frequency CSHWs during both therapeutic psychedelic use (e.g. MDMA therapy) and during psychological integration work. Stretching a little, perhaps we could also apply Atasoy’s CSHW algorithm to individual brain regions and compare their spectrums (and those of CSHWs), to quantify the expected frequency-coupling between each region.[4] Possibly these two measures could be developed into a causal quantitative metric for trauma.

This generalized ‘breakdown of communication’ definition of trauma neatly fits with the story Scott tells about PTSD, where people 

[A]re probably still “having” “emotions” “under” “the” “surface”, but they have no perception of them … PTSD patients as disconnected from their bodies. The body sends a rich flow of information to the brain, which is part of what we mean when we say we “feel alive” or “feel like I’m in my body”. In PTSD, this flow gets interrupted. People feel “like nothing”.

It also fits with the therapies that seem to work: EMDR, neurofeedback, Internal Family Systems (IFS), yoga, massage — the consistent thread that connects these is they all plausibly help restart and strengthen communication within the brain (which I hold is strongly mediated by CSHWs). Scott doesn’t mention music, but I’d expect it to be surprisingly effective at boosting emotional integration — and I’d expect the most effective music will have strong low-frequency rhythms.

This shades into novel types of therapeutic approaches: perhaps we could simply pump energy into lower-frequency bands (perhaps harmonic stimulation centered at ~3-6hz) to kickstart emotional integration.[5]

Sidenote on music: The simple description I gave of music was 

[A] sensory input which seems to exist on the knife’s edge between exhibiting highly ordered patterns (some of which will hit natural connectome harmonics and so allow accumulation of energy through resonance) on one hand, and on the other hand not being toopredictable (thus dodging most inhibitory top-down predictive models).

Armed with the CSHW/RSHW distinction, we can give this a second pass. In short, I expect the above story to be true, but in a fractal way: music will be hitting both CSHWs and RSHWs. Naturally, different regions will have different sets of harmonics, which means simple tones are unlikely to produce much cross-regional resonance. Instead, the music which is the most effective at increasing the brain’s energy parameter will tie together and layer a diverse set of motifs, with two goals: (1) hitting as many connectome-specific *and* region-specific resonances as possible, and (2) entraining disparate regions and pulling them into sync – essentially using injection-locking to pull RKSs (Regional Key Signatures) into sync with each other and the CKS (Connectome Key Signature).

Could we quantify what the ‘perfect song’ would be, for a given connectome? Not exactly, since so much of music’s effects rely on getting through the brain’s predictive processing gauntlet and the state of this gauntlet isn’t well-captured by a static connectome, but we could possibly use this framework to design (potentially much) more evocative songs.

It’s also worth noting that better music – and better ways to listen to music – shade quickly into potential therapies for trauma under this model. 

V. On psychedelics:

As noted above, Neural Annealing suggests a very simple model for understanding the effects of psychedelics: as substances which “may function by disabling existing energy sinks (or perhaps overloading them by increasing baseline firing rates or increasing the branching factor of neural activity),” dramatically increasing semantically-neutral energy. Psychedelics share a ‘characteristic feeling’ (and characteristic emotional aftereffects) with each other and with activities such as meditation, listening to music, EMDR, breath work, and so on, because all of these things increase the energy parameter of the brain. Psychedelics are particularly interesting because they do this so powerfully, effortlessly, and noisily (with the effects bleeding over into sensory modalities, not just accumulating in harmonics).

A full Neural Annealing model of psychedelics will have to wait a few more months as internal QRI discussion settles on a unified story. But a few preliminary notes:

First, we could define ‘psychedelics’ in a principled way, as any substance, pattern, or process that produces semantically-neutral energy accumulation – anything that disables, overloads, or avoids the brain’s energy normalization system. The implication here is interesting, that anything that adds semantically neutral energy into the brain should produce psychedelic effects, regardless of how this is done. E.g., even things like modern art may be classifiable as a psychedelic, insofar as it generates semantically-neutral energy (see Gomez Emilsson 2019). But we should also note that current psychedelics are not necessarily perfect sources of ‘clean semantically-neutral energy’; they’re substances that happen to massively increase the energy parameter of the brain, with no guarantees about how ‘balanced’ this boost is. There may be better and more targeted methods to do this in the future. In the meantime, I would recommend modest caution with substances which involve a hangover after use, as negative valence or affective blunting during a critical window could ‘sour’ the annealing process with subtle long-term mood effects.[6]

As mentioned above, I’ve been thinking more and more that the core psychological changes driven by psychedelics are best understood in terms of the amount and ‘statistical flavor’ of the semantically-neutral energy they add to the system. Or, as an alternate framing, psychedelics may be best understood as temporary disrupters of the brain’s natural energy sinks, each with a specific target or ‘flavor’ of disruption (or psychedelics may add to neural activity’s ‘branching factor’, which in turn will add a specific flavor to the energy). I also find myself wondering, all else being equal, whether psychedelic visuals actually are inversely correlated with annealing effects, since by diverting energy into the visual system (which plausibly has very effective energy sinks), there is less energy available to drive entropic disintegration.[7]

As I noted in A Future for Neuroscience, another starting point for sorting through psychoactive drugs would be 

[T]o parametrize the effects (and ‘phenomenological texture’) of all psychoactive drugs in terms of their effects on the consonance, dissonance, and noise of a brain, both in overall terms and within different frequency bands (Gomez Emilsson 2017).
In the long term, we’ll want to move upstream and predict connectome-specific effects of drugs – treating psychoactive substances as operators on neuroacoustic properties, which produce region-by-region changes in how waves propagate in the brain (and thus different people will respond differently to a drug, because these sorts of changes will generate different types of results across different connectomes). Essentially, this would involve evaluating how various drugs change the internal parameters of the CSHW model, instead of just the outputs. Moving upstream like this might be necessary to predict why e.g. some people respond well to a given SSRI, while others don’t (nobody has a clue how this works right now).

Possibly this would allow us to generate a principled typology of psychoactives, and also check for missing quadrants: psychoactives and psychedelics we haven’t discovered or created yet. (See also Andrés’s notion of parametrizing the ‘information vs energy trajectory’ of a trip.) We can also think of anti-psychotic drugs as anti-psychedelics: substances that rapidly decrease the energy parameter of the brain (Gomez Emilsson 2019). We at QRI strongly believe this makes anti-psychotics more dangerous than commonly realized: the neural search process is complex and delicate, and an externally-forced, uneven rapid cooling process may warp the internal landscape of the brain in subtle but deleterious ways.  In theory, we could test this indirectly by evaluating the effects of anti-psychotics on sensory integration tasks in healthy controls – but as noted above, this may be an unethical experiment.

Another frame would be ‘psychedelics as full-spectrum resonance agents’ – CSHWs are meant to substantially resonate during normal human operation (falling in love, orgasm, etc) – RSHWs are not. The perceptual and epistemological changes we sometimes see during psychedelics could be due to the fine logical machinery that usually deals with high-context sensory particulars (facts and logical inferences) starting to malfunction as its natural eigenmodes are activated. Like linking and rhythmically flipping all the bits in a memory register, ignoring what that register is “supposed to” compute. If psychedelic visuals are an example of RSHW resonance, HPPD may be an example of this RSHW resonance annealing into durable patterns. 

On MDMA’s strangely powerful therapeutic effects, I’d suggest MDMA shares the ‘basic psychedelic package’ with substances like LSD and psilocybin (albeit a little weaker at common doses). Anything with this ‘baseline’ package significantly increases the energy parameter of the brain, which both allows escape from bad local minima and canalizes the brain’s core CSHWs, which both should be highly therapeutic. My intuition is MDMA may also have a particular effect on stochastic firing frequencies of neurons, and that this effect essentially acts as an emergent metronome – and this metronome will drive synchronicity between diverse brain regions. Given the presence of such a region-spanning ‘clean’ metronomic signal, brain regions that have partially ‘stopped talking to each other’ will re-establish integration, and some of this integration will persist while sober (or rather, some of the reasons for the lack of integration will have been negotiated away during the MDMA-driven integration). Plausibly this ‘emergent metronome’ effect may also underlie the particular phenomenological effects of 5-MeO-DMT as well, particularly in terms of sense of unity, high valence, and therapeutic potential.[8] 

Somewhat poetic sidenote: on taking psychedelics:

In the abstract – I think psychedelics are more powerful, more dangerous, and more healing than commonly assumed.

But we don’t live in the abstract. The natural question for any given person is thus: should I take them?

There’s no one-size-fits-all answer, and I recommend checking with local laws. But I can share a simple heuristic for who shouldn’t worry too much about the downsides of psychedelics and who should be very careful: do you trust your own aesthetic?

Psychedelics massively increase the ‘energy parameter’ of the brain, so naturally there’s a large amount of very-high-dimensional exploration going on. There are countless ‘micro-choices’ your brain makes as to how to anneal after this exploration: we can think of a person’s ‘aesthetic’ as individual variance in these annealing choices. What the self-organizing system which is the brain’s subconscious finds beautiful in the moment and implicitly strives to save.

Sometimes, and in some people, we want the right things, we find the right things beautiful. Things that have a deep elegance and fit with everything about us and fit with how reality works. We just need enough energy parameter to get there. Psychedelics are a great way to get there.

Other times, we might not want the right things. Evolution is kind of a jerk, epistemologically speaking: it cares much more about genetic reproduction than it does about deep coherence and calibration with reality and such. Sometimes we’re at a functional local maxima, but we’re not pointed in the right direction globally, and frankly speaking our lack of a high energy parameter is our saving grace – our inability to directly muck up our emotional landscape. Insofar as this is true – and it will be more true at certain times than others, and in certain people than others, and perhaps in certain combinations of people than others – using psychedelics to crank the energy parameter is not good for a person. Our ‘Psychedelic Extrapolated Volition’ (PEV) is not a healthy vector.[9]

The natural follow-up is, how do you know whether your PEV is positive or not? 

Hard question, but probably good to ask your friends – group epistemology seems healthy in these cases. And in general it seems strongly preferable to err on the side of caution. You can always take that LSD tomorrow, or next week, or next year.

(But, don’t be too paranoid about one trip permanently breaking your brain, either. My guess is the annealing that tends to ‘stick’ is that which actually finds better local minima (thankfully) – if it’s an unsuccessful exploration I suspect the system can usually climb back to where it was (with some caveats).)

A separate factor is your current energy parameter and how psychedelics may increase this baseline: if you’re dragging on the bottom of your energetic attractor basins, maybe a little kick could be healthy. But if you’re already ‘high on life’ –  consider skipping the LSD and MDMA. Increasing a high baseline can redline the system into exquisitely unbearable intensity.

VI. Love and other types of Neural Annealing

It’s important to note that most annealing doesn’t happen in a vacuum: just as “set and setting” matter quite a lot for psychedelics, and for emotional updating in general, the importance of context in the annealing model is hard to overstate. Much as holding a magnet close to iron as it cools can magnetize the metal, the intentional content present when entropic disintegration->annealing happens provides important constraints for which new patterns form. I propose there are four general types of neural annealing:

A. Annealing to an object or event. Annealing which is ‘pointed at’ something is by far the most common type. Some object, or event, or new insight makes itself known in a surprising or otherwise intensely salient way, and this pushes the brain into a high-energy state, kickstarting a self-organization process for accommodating the presence and significance of this new thing. This can involve intense positive emotion — a new romantic partner, the birth of your child, your wedding day. This sort of annealing can also be caused by trauma— getting bitten by a weird animal, social rejection, losing a close one. As I suggested in The Neuroscience of Meditation, neural annealing may offer a rather pithy description of love:

Finally, to speculate a little about one of the deep mysteries of life, perhaps we can describe love as the result of a strong annealing process while under the influence of some pattern. I.e., evolution has primed us such that certain intentional objects (e.g. romantic partners) can trigger high-energy states where the brain smooths out its discontinuities/dissonances, such that given the presence of that pattern our brains are in harmony. This is obviously a two-edged sword: on one hand it heals and renews our ‘cold-worked’ brain circuits and unifies our minds, but also makes us dependent: the felt-sense of this intentional object becomes the key which unlocks this state. (I believe we can also anneal to archetypes instead of specific people.)
Annealing can produce durable patterns, but isn’t permanent; over time, discontinuities creep back in as the system gets ‘cold-worked’. To stay in love over the long-term, a couple will need to re-anneal in the felt-presence of each other on a regular basis. From my experience, some people have a natural psychological drive toward reflexive stability here: they see their partner as the source of goodness in their lives, so naturally they work hard to keep their mind aligned on valuing them. (It’s circular, but it works.) Whereas others are more self-reliant, exploratory, and restless, less prone toward these self-stable loops or annealing around external intentional objects in general. Whether or not, and within which precise contexts, someone’s annealing habits fall into this ‘reflexive stability attractor’ might explain much about e.g. attachment style, hedonic strategy, and aesthetic trajectory.

Perhaps we can go further now, and hypothesize that ‘falling in love’ is a specific algorithm the brain runs, which is triggered by when the ‘felt sense’ of another person (a pattern distributed across RSHWs, CSHWs, and SSHWs) produces substantial systemic resonance. When this happens, and in the absence of warning signs (dissonance), a person will actively seek to fill their sensorium with this signal, which amplifies the systemic resonance (potentially to extreme levels) and further synchronizes priors and other regions into harmony with the original pattern. As you fall in love, you literally anneal to your felt-sense of that person – you take their rhythm as yours, because your body judged it to be so. A key which fit your connectome’s lock. This will naturally do two things: (1) fuzz boundaries between lovers, as patterns progressively synchronize, and (2) add a harmonic echo, or ‘warm consonant glow’ to all thoughts about the person. This latter phenomenon will feel nice, but also keep itself stable: the presence of this bundle of synchronized frequencies will stabilize (via injection-locking) many forms of drift – effectively preventing certain thoughts/perceptions. This may fade over time if not refreshed, but perhaps to completely ‘fall out of love’ the brain has to build a competing key signature elsewhere, e.g. in a golden mean ratio to this harmonic echo, and these rivalrous key signatures (implicitly Bayesian priors about what is real and what is good) battle it out. (Thanks to Andrés for discussion on competing key signatures.) This ‘de-annealing’ process – literally erasing someone’s patterns and rhythms from your body – can follow several trajectories, few of them pleasant, as the system renegotiates new (or old) equilibria.

B. Annealing to an ontology. A much more general type of annealing is when the entropic disintegration->annealing process is pointed toward an ontology, and the brain reorganizes its internal structure (‘ontological contours’) to accommodate this new typology. This can happen implicitly and weakly, over the course of entropic disintegration->annealing to multiple separate ideas, or explicitly and strongly, for instance reading some book in college which completely reshapes one’s view of reality.

Any craftsman, any intellectual, any philosopher worth their salt is strongly annealed toward at least one nuanced ontology, and in fact much of the influence of the Great Philosophers can be found in how they’ve laid out their thoughts in a way that others can use as a coherent annealing target. What makes something a good annealing target? I’d offer it’s the presence of clear archetypes arranged in both a novel but ultimately cognitively efficient way. These archetypes can be thought of as a combination of nature (innate Jungian-type limbic resonances) and nurture (prior annealed patterns & cultural reifications).

An important point here is that peoples’ conception of where goodness comes from is dependent upon their ontology; change the ontology, change the perceived nature of goodness itself! See e.g. John Lily’s discussion of the supra-self-metaprogrammer (SSMP). This frame-shift can also manifest at the extreme end of falling in love, where all the world’s goodness seems to come from your special person (a dangerous thing).

C. Social annealing. A special hybrid of annealing to an ontology and to other people is social annealing, wherein a group of people undergoes the ‘entropic disintegration -> neural search -> annealing’ process together, within some shared context- a religious service, a sporting event, a retreat. This seems like the natural mechanism by which tribes are formed (loosely speaking, group synchronization of connectome-specific harmonic wave dynamics) and underlies many of our most sacred experiences. The power of social annealing is such that a religious experience that lacks it no longer feels like a religious experience- merely the mouthing of dogma. On the other hand, any group experience that does increase the group’s energy parameter and trigger annealing starts to take on a pseudo-religious frame- e.g. ecstatic dance, festivals, protest marches, even concerts. 

D. Semantically-neutral annealing. Almost all neural annealing is semantic annealing, or annealing toward some intentional object. This process is pointed at something, often the thing that caused the entropic disintegration process in the first place, be it a person, an event, an idea, an ontology. But there’s nothing in the laws of neuroscience that implies annealing has to have an intentional object as a focus. As per Section II, I believe this is a particularly healthy form of annealing.

Toward a new psychology & sociology?

Speculatively, we may be able to re-derive much of psychology and sociology from just the energy-parameter view of the brain: e.g.,

Gopnik 2017 suggests that different developmental windows may involve different implicit ‘heat parameters’ for simulated annealing, with young people having higher parameters. Speculatively, this may correspond to different ‘lived intensity of experience’ at different ages- young brains (and lifelong learners) might not only be more plastic than average, but actually having experience that is objectively more visceral. One way to frame this is that being young is like microdosing on LSD all the time. This could have interesting implications for ethics.

Most likely, there’s been significant recent sexual selection for a higher energy parameter, for several reasons:

Psychology has various personality metrics, with the most widely used being the Big 5, also known as OCEAN (Openness, Conscientiousness, Extroversion, Agreeableness, Neuroticism). One of the most interesting subfindings here is that we can still get reasonable predictive utility if we collapse these into a one-variable model: the ‘Big One’ personality factor. Scoring high in this factor is ”associated with social desirability, emotionality, motivation, well-being, satisfaction with life, and self-esteem.” Scoring low is associated with depression, frailty, lack of emotionality, and so on. I wouldn’t be surprised if the ‘Big One’ simply tracks how frequently and deeply someone anneals.

Continuing the thread on Social Annealing, I think we can push into sociology with the Neural Annealing model too; to understand a society, we need to understand how and when annealing happens in that society. To gauge the wisdom of a society, look at how its decision-makers anneal; to gauge the cultural direction of a society, look at how its young people anneal. To understand the strongest social bonds of a society, look at the contexts in which group annealing happens.

This also suggests why drugs like alcohol and certain psychedelics are ritualistically celebrated in so many cultures: they allow social-annealing-on-demand, a key technology in building and maintaining social cohesion and coordination.

Likewise, we could envision a field of ‘social archeology’ evaluating annealing patterns in the past: how often did peasants and nobles in the Middle Ages anneal? In what contexts did the annealing happen, and which institutions controlled them? Perhaps most political conflicts could be reinterpreted as conflicts over annealing.[10] And so on. My colleague Andrés has suggested that a good rule of thumb for identifying annealing (and making good movies) is that intuitively, annealing defines where you should actually point the camera if you were making a movie of a historical period, since where annealing is happening is where changes that ‘matter’ are taking place: cognitive updates, decisions about how to feel, and so on.

On the effect of profession on emotional vibrancy: It would be somewhat surprising if certain repeated computational tasks didn’t tend to push regions’ key signatures into being highly coupled (=intense emotions), whereas other classes of tasks push regions’ key signatures into fairly orthogonal configurations (=‘white noise’ as emotional state). A lifetime of dance or poetry might literally make you feel emotions more strongly; a lifetime of doing accounting might literally produce a segmented brain and affective blunting. From Darwin’s autobiography:

I have said that in one respect my mind has changed during the last twenty or thirty years. Up to the age of thirty, or beyond it, poetry of many kinds, such as the works of Milton, Gray, Byron, Wordsworth, Coleridge, and Shelley, gave me great pleasure, and even as a schoolboy I took intense delight in Shakespeare, especially in the historical plays. I have also said that formerly pictures gave me considerable, and music very great delight. But now for many years I cannot endure to read a line of poetry: I have tried lately to read Shakespeare, and found it so intolerably dull that it nauseated me. I have also almost lost my taste for pictures or music. … I retain some taste for fine scenery, but it does not cause me the exquisite delight which it formerly did. …
This curious and lamentable loss of the higher aesthetic tastes is all the odder, as books on history, biographies, and travels (independently of any scientific facts which they may contain), and essays on all sorts of subjects interest me as much as ever they did. My mind seems to have become a kind of machine for grinding general laws out of large collections of facts, but why this should have caused the atrophy of that part of the brain alone, on which the higher tastes depend, I cannot conceive. 

Reading this account, I find it plausible that Darwin repeatedly pushed (and annealed) his mind toward RSHW-driven ‘clockwork piecemeal integration’ interactions rather than CSHW/SSHW-driven global symmetry gradients, although Darwin’s age, sickness, and depression may have also contributed. A warning sign for us theorists and systematizers.

Conclusion:

Neural Annealing is a neuroscience paradigm which aims to find the optimal tradeoff between elegance and detail. It does this by identifying a level of abstraction which supports parallel description under three core principles of self-organization: physical self-organization (around connectome resonances), computational self-organization (around minimization of surprise), and energetic self-organization (around conditional entropic disintegration).

There is yet much work to be done: in particular, there are huge bodies of literature around receptor affinities, network topologies, regional anatomies and cell types, and so on. The promise of Neural Annealing is it’s not only a predictive and generative theory in its own right, but it provides a level of description by which to connect these disparate maps, and an extensible context to build on as we add more and more detail to the model.

Finally, we can ask: why does good neuroscience matter? I would offer the following.

The future could be much better than the present. Much better.

Material conditions are only very loosely coupled with well-being. If life is to be radically better in the future, it will be due to better neuroscience pointing out how we can be kinder to ourselves and others, and future neurotechnology changing the hedonic calculus of the human condition.

A unified theory of emotional updating, depression, trauma, meditation, and psychedelics may give us the tools to build a future that’s substantially better than the present. This has been my hope while writing this.

–Michael Edward Johnson, Executive Director, Qualia Research Institute

Endnotes:

[1] The ‘semantically neutral energy’ model also suggests why transcranial magnetic stimulation (TMS) seems to help treat depression – essentially, TMS injects a large amount of energy into the brain, and this energy (1) triggers some entropic disintegration, allowing escape from bad local minima, and (2) may slightly collect in the brain’s natural harmonics, which may help pull the brain out of dissonant equilibria. Note that this could be done much more effectively: instead of the present strategy of using a quick flash of unpatterned, pulsed TMS (e.g., 5 seconds @ 100hz) which overpowers the brain but quickly dissipates and likely doesn’t lead to a significant build-up in harmonics, we could instead try an entrainment approach via lower-power, rhythmic, continuous TMS, applied for longer durations (keeping the brain above its ‘recrystallization temperature’ for longer, allowing a fuller self-organization process), perhaps paired with music.

[2] Thanks to Andrés for the idea about somatic information, and the suggestion of sensorium as the label.

[3] I suspect that muscle tension could be a core mechanism for regulating SSHWs and perhaps CSHWs. Tensing muscles will strongly influence body resonance, and one’s body resonance configuration will likely have ripple effects on what sorts of frequencies persist in the brain. This suggests that traditions such as yoga are basically right when they posit a link between problems in muscles and problems in the mind: we may hold tension in one system in order to compensate for a problem in the other. Speculatively, this compensatory regulation may also be found across humans, especially in pair bonds: that tension in your back might in some literal way be an attempt to help your partner with their emotional regulation. This would suggest muscle tension should change significantly after a break-up. (Thanks to Emily Crotteau, Lena Selesneva, and Ivanna Evtukhova for pieces of the puzzle here.)

[4] My colleague Andrés suggests that “[A] more direct method, though perhaps more difficult, would be to look directly for the spectral signatures of injection locking — we’d predict you will see a seriously diminished degree of injection locking signatures on people who are heavily traumatized, and see it come back after MDMA therapy.”

[5] Perhaps we could model Persistent Non-Symbolic Experience (PNSE) as persistent partial injection locking of key regions by low frequency CSHWs: essentially this would involve entraining (and effectively partially disabling) the machinery that usually handles interpretation of certain particulars / cognitive interpretations. Perhaps highly neurotic or traumatized individuals with strong top-down control exhibit the opposite: essentially trying to entrain CSHWs to a specific region (with predictably poor results).

[6] My colleague Andres also recommends against “psychedelic substances that have as part of their activity profile a high level of body-load, such as nausea and cramps as these patterns might themselves become annealing targets (cf. compounds notorious for this, according to PsychonautWiki such as 2C-E, 2C-T-2, and 2C-P, are probably best avoided as therapeutic aids).”

[7] On psychedelic tolerance: if the semantically-neutral energy model of psychedelics proves out, we should also be open to subtle corollaries: e.g., to what extent is the temporary tolerance effect of psychedelics biochemical (depletion of some neurotransmitters, per the current story) and to what extent is it information-theoretic —associated with the release and depletion of systemic sources of Free Energy? I.e., there is potential energy of a sort liberated when the system finds a better local minima, and if the system has undergone strong annealing recently, there are fewer such ‘energetic free lunches’ around to help power the psychedelic effects. (Hypothesis held weakly, as my colleague Andrés points out there are psychedelics which do not trigger tolerance, such as N,N-DMT and 5-MeO-DMT.)

[8] HT to Steve Lehar for pointing at this ’nystagmus’ phenomenon as being somehow linked to MDMA’s mood-lifting effect, and to Andrés for calling my attention to Lehar’s work and suggesting 5-MeO-DMT may also share this mechanism.

[9] This is a reference to Eliezer Yudkowsky’s “Coherent Extrapolated Volition” (CEV) concept, which is an attempt to sketch a heuristic for how to use a radically-powerful optimization process (such as an AGI) safely. Essentially, CEV suggests we could aggregate all human preferences (volitions), find some way to merge them (make them ‘cohere’), then repeat (extrapolate), until we get to a self-stable loop. A ‘psychedelic extrapolated volition’ is a variation of this: if it becomes easier to change yourself on psychedelics, and then that person you turn into can change themselves into someone else, and so on, where do you end up? What generates a ‘positive vector’ here?

[10] This naturally and unfortunately makes the access to and contexts of social annealing an axis of cultural conflict: those who control these events control the emotional tone and contours of coordination of a society. Taking away healthy annealing contexts from your opponents and giving more social annealing opportunities to your people is a key (but also very dirty) way to ‘win’ the culture war. (Perhaps the opioid crisis, and the crack-cocaine crisis before it, could in some sense be exacerbated by a lack of healthier annealing opportunities.)

Citation

For attribution in academic contexts, please cite this work as:

Michael Edward Johnson, “Neural Annealing: Toward a Neural Theory of Everything”, https://opentheory.net/2019/11/neural-annealing-toward-a-neural-theory-of-everything/ , San Francisco (2019).

Acknowledgements

I’d like to thank Andrés Gómez Emilsson for many great conversations on annealing (and first calling my attention to the term), energy sinks, and countless other topics, and offering careful feedback on a draft of this work; Robin Carhart-Harris and Karl Friston for a beautiful description of simulated annealing; Romeo Stevens for wide discussion about annealing & ontologies; Adam Safron for introducing me to the depth of explanation afforded by predictive coding, pointing me toward injection locking, and many great conversations in general; Quintin Frerichs for his hard work toward making therapeutic applications of this theory real, and the rest of the QRI team for support and inspiration; Milan Griffes for careful feedback on a draft of this work; Alex Alekseyenko and James Dama for discussions about simulated annealing; Anthony Markwell for sharing the Buddhist Dhamma with me in such a thoughtful and generous way; Justin Mares for his constant curiosity and encouragement; my parents, for their endless love and patience; Lena Zaitseva and Lena Selesneva for their warmth and support; and especially Ivanna Evtukhova, who has made my life radically better and whose love, energy, and obsession with Buddhist enlightenment was why this work happened.

To gratitude.

Timeline: most of this document written ~Feb-April 2019, as a continuation of The Neuroscience of Meditation and this talk, and shared internally and with select reviewers; section dealing with trauma written July 2019. Document reordered for flow and polished in Oct-Nov and posted Thanksgiving 2019.

29 comments

Comments sorted by top scores.

comment by Zvi · 2021-01-14T19:02:04.330Z · LW(p) · GW(p)

This post is hard enough to get through that the original person who nominated it didn't make it, and also I tried and gave up in order to look at more other things instead. I agree that it's possible there is something here, but we didn't build upon it, and if we put it in the book people are going to be confused as to what the hell is going on. I don't think we should include. 

Replies from: gworley, michael-edward-johnson
↑ comment by Gordon Seidoh Worley (gworley) · 2021-01-15T21:52:29.664Z · LW(p) · GW(p)

On the other hand this post for me exemplifies something I think LessWrong is really good at, which is creating a place where people can find an audience of bleeding-edge research that is not obviously off the rails. Something like the kind of stuff you would otherwise only hear about because you work at a university and happen to go to a talk a person working on that research gave internally to solicit feedback.

Like with many posts the audience may be small for this one, but this is the same problem with many AI alignment posts and I don't think we should hold it against this post in voting unless we plan to also vote against inclusion of most technical AI posts that were nominated.

↑ comment by Michael Edward Johnson (michael-edward-johnson) · 2021-01-15T10:55:22.349Z · LW(p) · GW(p)

Fair enough; the TL;DR pull-quote for this piece would be:

Annealing involves heating a metal above its recrystallization temperature, keeping it there for long enough for the microstructure of the metal to reach equilibrium, then slowly cooling it down, letting new patterns crystallize. This releases the internal stresses of the material, and is often used to restore ductility (plasticity and toughness) on metals that have been ‘cold-worked’ and have become very hard and brittle— in a sense, annealing is a ‘reset switch’ which allows metals to go back to a more pristine, natural state after being bent or stressed. I suspect this is a useful metaphor for brains, in that they can become hard and brittle over time with a build-up of internal stresses, and these stresses can be released by periodically entering high-energy states where a more natural neural microstructure can reemerge.

Furthermore: meditation, music, and psychedelics (and sex and perhaps sleep) 'heat' the brain up in this metaphorical sense. Lots of things follow from this -- most usefully, if you feel stressed and depressed, make sure you're "annealing" enough, both in terms of frequency and 'annealing temperature' (really intense emotional experiences are crucial for the emotional updating process). 

Possibly the most LW-relevant part of this is the comment left by lsusr, which I've appended to the bottom of the version on opentheory.net, i.e. the comment that starts out "This makes sense to me because I work full-time on the bleeding edge of applied AI, meditate, and have degree in physics where I taught the acoustical and energy-based models this theory is based upon. Without a solid foundation in all three of these fields this theory might seem less self-evident." -- he said some things clearly that were only tacit in my writeup.

Currently working on a follow-up piece.

comment by habryka (habryka4) · 2020-12-15T06:48:46.392Z · LW(p) · GW(p)

I think this post is 90% likely to make very little sense, but, ever since reading it I can't get rid of the spark of doubt that maybe this post is saying something really important and valuable and all study of rationality that does not understand it is doomed from the start.

I do think even without this post being anywhere close to right I got some useful things out of it, but by far the strongest reason for why I am nominating this post is because I want people to review it and engage with it critically.

comment by Thrasymachus · 2019-11-30T18:41:21.836Z · LW(p) · GW(p)

I'm afraid I couldn't follow most of this, but do you actually mean 'high energy' brain states in terms of aggregate neural activity (i.e. the parentheticals which equate energy to 'firing rates' or 'neural activity')? If so, this seems relatively easy to assess for proposed 'annealing prompts' - whether psychedelics/meditation/music/etc. tend to provoke greater aggregate activity than not seems open to direct calorimetry, leave alone proxy indicators.

Yet the steers on this tend very equivocal (e.g. the evidence on psychedelics looks facially 'right', things look a lot more uncertain for meditation and music, and identifying sleep as a possible 'natural annealing process' looks discordant with a 'high energy state' account, as brains seem to consume less energy when asleep than awake). Moreover, natural 'positive controls' don't seem supportive: cognitively demanding tasks (e.g. learning an instrument, playing chess) seem to increase brain energy consumption, yet presumably aren't promising candidates for this hypothesised neural annealing.

My guess from the rest of the document is the proviso about semantically-neutral energy would rule out a lot of these supposed positive controls: the elevation needs to be general rather than well-localized. Yet this is a lot harder to use as an instrument with predictive power: meditation/music/etc. have foci too in the neural activity it provokes.

Replies from: lsusr
↑ comment by lsusr · 2019-12-04T21:26:33.919Z · LW(p) · GW(p)

I think this post is referring to "high energy" not in terms of electrochemical neural activity but instead as a metaphor for optimization in machine learning.

Machine learning is the process of minimizing an error function. We can conceptualize this error function as a potential gradient such as a gravity well or electrostatic potential. Minimizing the energy of a particle in this potential gradient is mathematically equivalent to minimizing the error function. The advantage of referring to this as "energy" instead of "error" is it lets you borrow other terms like kinetic energy (in both the classical and quantum sense) which makes search algorithms intuitively easy to understand. The post is referring to this kind of entropic energy.

comment by Gordon Seidoh Worley (gworley) · 2020-12-30T23:48:02.616Z · LW(p) · GW(p)

I found this post important to developing what's proved to be a useful model for me of thinking about neural annealing as a metaphor for how the brain operates in a variety of situations. In particular, I think it makes a lot of sense when thinking about what it is that meditation and psychedelics do to the brain, and consequently helps me think about how to use them as part of Zen practice.

One thing I like about this post is that it makes claims that should be verifiable via brain studies in that we should see things like brain wave patterns that correspond with annealing activity and then can follow up with people to see if after annealing they are changed. There's plenty of anecdotal evidence that this is true, but it points towards being able to construct an RCT to test the theory.

comment by Gordon Seidoh Worley (gworley) · 2019-12-03T01:44:19.939Z · LW(p) · GW(p)
Sometimes we’re at a functional local maxima, but we’re not pointed in the right direction globally, and frankly speaking our lack of a high energy parameter is our saving grace – our inability to directly muck up our emotional landscape.

I've heard a similar story in meditation circles about why integration work is important: greater awakening enables greater agency/freedom-of-action, and without integration, virtue, and ethics (these are traditionally combined via the paramita of sila) that can be dangerous because it can let a person run off in personally dangerous or socially bad directions that they were previously only managing not to because they weren't more capable, essentially protecting themselves from themselves with their own failure.

Replies from: michael-edward-johnson
↑ comment by Michael Edward Johnson (michael-edward-johnson) · 2019-12-03T05:00:00.798Z · LW(p) · GW(p)

Right-- one question that Milan Griffes asked me was, "how can you tell if you should trust your aesthetic?"

Presumably integration practices should make it more trustworthy, but would be nice to have a good heuristic for when it's trustworthy (and when pushing with meditation/psychedelics might be safe) vs untrustworthy (and they would be a bad idea).

comment by lsusr · 2019-11-29T22:50:08.388Z · LW(p) · GW(p)

CSHW seems blindingly obvious in hindsight. Why is it a new theory? Why wasn't it invented decades ago? Is CSHW new because the technology necessary to test it didn't exist until recently?

Replies from: steve2152, michael-edward-johnson, algekalipso
↑ comment by Steven Byrnes (steve2152) · 2019-11-30T03:11:32.200Z · LW(p) · GW(p)

Really? I don't get it at all. When I read cognitive neuroscience I'm looking for a coalescing between (1) Some story about the brain doing biologically-useful computations, in a way that matches (2) The things we know neurons and evolution are capable of, and (3) The things we know about what the human brain does (e.g. from introspection and scientific studies). I'm not seeing this in the CSHW material—particularly the connection to biologically-useful computations. The power distribution among harmonics carries very little information—dozens of bits, not the billions or trillions of bits that are needed for human-level understanding of the world. So what's the relation between CSHW and biologically-useful computations? Again, I don't get it. (Note: This is an initial impression based on cursory reading.)

Replies from: lsusr, algekalipso, michael-edward-johnson
↑ comment by lsusr · 2019-11-30T09:31:30.373Z · LW(p) · GW(p)

This makes sense to me because I work full-time on the bleeding edge of applied AI, meditate, and have degree in physics where I taught the acoustical and energy-based models this theory is based upon. Without a solid foundation in all three of these fields this theory might seem less self-evident.

Hopefully this explanation can help you understand the theory behind the theory. First I'll address points (1), (2) and (3). Then I'll explain the bandwidth issue in more detail.

(1) While it's true that these harmonic frequencies have less information bandwidth then synapses that doesn't mean they don't perform biologically-useful computations. High-bandwidth pattern matching is trivially easy to do with neural networks. The hardest part about neural networks is time series data. (I know this because I am a specialist in the application of machine learning algorithms to handle time-series inputs.) To simplify the situation right now, we [1] don't know how to use neural networks to handle time series data [2] don't know how to get different machine learning systems of any kind to work together--especially with regard to time series data. If CSHW can make any progress in this direction then that would be useful.

(1.1) You are correct that we need a traditional mass of neurons tuned via gradient descent in order to handle high-bandwidth information like our many nerves and to handle complex actions like muscle control. CSHW does not get in the way of these things. Rather CSHW is a simple, elegant way to coordinate many different sub-networks into a human brain. It's not about "how" do you throw a baseball. It's "when" do you throw a baseball. When different networks are out of phase with each other the inputs of one turn into static for the other, which is literally equivalent to tuning out a radio. In short, the purpose of CSHW is not to replace the massive information processing solved by neural networks. Instead, it's purpose is to combine and separate neural networks, as applicable, in response to time-series inputs. It does this fractally, which is the only way to simplify a design to handle massive complexity in a biological system.

(1.2) All CSHW needs to do is to tell which networks should receive information from which other networks. High-frequency waves both propagate shorter distances and oscillate faster (have higher bandwidth) than low-frequency waves, so the information density and response speed gets higher where it needs to be higher (on smaller scales). Remember: the oscillations don't have to transfer information. That's performed by the traditionally-understood neuronal connections. The oscillations can bring different systems in and out of sync in a coordinated manner. This happens at a lower frequency than individual neuron firings and involves larger masses than individual neurons so the necessary bandwidth is much lower. Frequency space might just be a dozen bits long, but there's three spacial dimensions based on actual physical space too.

(1.3) The low bandwidth of the harmonic frequencies explains an important puzzle about consciousness. You know how you can only keep 3-9 concepts in working memory at once? This could be a reflection of the low bandwidth of the low frequency waves.

(2) We have known neurons and evolution are capable of producing waves like this (especially the low frequency ones) for ages. The question neuroscience has been struggling with isn't "can" neurons produce waves like this. It's "why".

(2.1) This theory describes observed behavior especially well once you compare the theory's predictions to the observed brainwaves in advanced meditators. The brain scans of Tibetan yogis and the traditional subjective descriptions written by Zen masters match descriptions of the low frequency brain resonance predicted by this theory. So does a modern Vipassana manual, though it focuses on the high frequency end of the spectrum. This is 3/3 major Buddhist lineages.

(3) As Michael Edward Johnson (OP) mentioned in another comment, recent advancements in fMRIs have let us observe some of the phenomena described in CSHW.

Replies from: Korz
↑ comment by Mart_Korz (Korz) · 2019-11-30T17:38:38.741Z · LW(p) · GW(p)

Thank you for this explanation.

While reading the OP and trying to match the ideas with my previous models/introspection, I was somewhat confused: on the one hand, the ideas seemed to usefully describe processes that seem familiar using a gears-level model , on the other hand I was unable to fit it with my previous models (I finally settled with sth along the lines of 'this seems like an intriguing model of top/high-level coordination (=~conscious processes?) in the mind/brain, although it does not seem to address the structure that minds have?')

[...] the purpose of CSHW is not to replace the massive information processing solved by neural networks.

Your comment really helped me put this into perspective

Replies from: lsusr
↑ comment by lsusr · 2020-06-22T19:01:22.178Z · LW(p) · GW(p)

Are your previous models single or multi-agent? These ideas match multiagent models of the mind [? · GW]. If you start by assuming the mind to be a single agent then CSHW will not fit in with your previous models of the mind's structure.

Replies from: Korz
↑ comment by Mart_Korz (Korz) · 2020-06-24T23:01:19.921Z · LW(p) · GW(p)

Now reading the post for the second time, I again find it fascinating – and I think I can pinpoint my confusion more clearly now:


One aspect that sparks confusion when matched against my (mostly introspection + lesswrong-reading generated) model, is the directedness of annealing:
On the one hand, I do not see how the mechanism of free energy creates such a strong directedness as the OP describes with 'aesthetics',
on the other hand if in my mind I replace the term "high-energy-state" with "currently-active-goal-function(s)", this becomes a shockingly strong model describing my introspective experiences (matching large parts of what I would usually think of roughly as 'System 1-thinking'). Also the aspects of 'dissonance' and 'consonance' directly being unpleasant and pleasant feel more natural to me if I treat them as (possibly contradicting) goal functions, that also synchronize the perception-, memorizing-, modelling- and execution-parts of the mind. A highly consonant goal function will allow for vibrant and detailed states of mind.

Is there some mechanism that would allow for evolution to somewhat define the 'landscape' of harmonics? Is reframing the harmonics as goals compatible with the model? Something like this seems to be pointed at in the quote


Panksepp’s seven core drives (play, panic/grief, fear, rage, seeking, lust, care) might be a decent first-pass approximation for the attractors in this system.



---

Another aspect where my current model differs is that I do not identify consciousness (at least the part that creates the feeling of pleasure/suffering and the explicit feeling of 'self') as part of this goal-setting mechanism. In my model, the part of the mind that generates the feeling of pleasure or suffering is more of a local system (plus complications*) that takes the global state as model- and goal-input and tries to derive strategies from this. In my model, this part of the mind is what usually identifies as 'self' and it is this that is most relevant for depression or schizophrenia. But as what I describe as 'model- and goal-input' really defines the world and goals that the 'self' sees and pursues at each moment (sudden changes can be very disconcerting experiences), the implications of annealing for health would stay similar.

---

After writing all of this I can finally address the question of the parent comment:


Are your previous models single or multi-agent?


I very much like the multiagent-model sequence although I am not sure how well my "Another aspect [...]"-description matches: On the one hand, my model does have a privileged 'self'-system that is much less fragmented than the goal-function-landscape. On the other hand, the goal-function-landscape seems best described by "shards of desire" (which is a formulation used in the sequences if I remember correctly) and they can direct and override the self easily. This part fits well with the multiagent-model


---

*) A complication is that the 'self' can also endorse/reject goals and redirect 'active goal-energy' (it feels like a kind of delegable voting power that the self as strategy-expert can use if it gained the trust and thus voting-power of goal-setting parts) onto the goal-setting parts themselves in order to shape them.

Replies from: michael-edward-johnson
↑ comment by Michael Edward Johnson (michael-edward-johnson) · 2020-12-17T16:02:54.779Z · LW(p) · GW(p)

This will be a terribly late and very incomplete reply, but regarding your question,

>Is there some mechanism that would allow for evolution to somewhat define the 'landscape' of harmonics? Is reframing the harmonics as goals compatible with the model? Something like this seems to be pointed at in the quote
>>Panksepp’s seven core drives (play, panic/grief, fear, rage, seeking, lust, care) might be a decent first-pass approximation for the attractors in this system.

A metaphor that I like to use here is that I see any given brain as a terribly complicated lock. Various stimuli can be thought of as keys. The right key will create harmony in the brain's harmonics. E.g., if you're hungry, a nice high-calorie food will create a blast of consonance which will ripple through many different brain systems, updating your tacit drive away from food seeking. If you aren't hungry -- it won't create this blast of consonance. It's the wrong key to unlock harmony in your brain. 

Under this model, the shape of the connectome is the thing that evolution has built to define the landscape of harmonics and drive adaptive behavior. The success condition is harmony. I.e., the lock is very complex, the 'key' that fits a given lock can be either simple or complex, and the success condition (harmony in the brain) is relatively simple.

↑ comment by algekalipso · 2019-11-30T05:24:38.013Z · LW(p) · GW(p)

The histogram of CSHW amplitudes seems to have very little information content, while the entire matrix of just-noticeable-differences of our experience seems to have a whole lot of information. If CSHWs are so important to determine a "brain state", where is all the missing information?

Two points here. First, according to the theory -as Mike points out- the overall "mood" of the state is largely encoded in the low frequency harmonics, while the higher frequency ones are more important for semantic information. In a sense, you can think of the lower frequency harmonics as creating a set of buckets in which to put, juggle, and recombine the information provided by the higher frequency harmonics. Hence, while the specific information content of the experience might require a very fine level of resolution, both the valence and the broad information-processing steps might not. And second, there is more to the CSHWs than just the histogram of amplitudes. There is also a matrix of phase-locking relations between them, which increases the overall information content by a large amount.

↑ comment by Michael Edward Johnson (michael-edward-johnson) · 2019-11-30T05:11:17.409Z · LW(p) · GW(p)

CSHWs offer pretty compelling Schelling points for the brain to self-organize around, and there's a *lot* of information in a dynamic power distribution among harmonic modes. We might distinguish CSHW-the-framework from CSHW-the-fMRI-method.

↑ comment by Michael Edward Johnson (michael-edward-johnson) · 2019-11-30T01:39:47.955Z · LW(p) · GW(p)

Agreed! The current version of CSHW depends on fairly high-tesla fMRI, which is somewhat new. Possibly there will be ways to adapt the concept to EEG, although this will take pretty advanced modeling and a lot of validation.

The real answer though might be it's only now that we're starting to clearly see the limits of the functional localization paradigm of neuroscience, and the need for something like CSHW. I'm reminded of this paper: https://journals.plos.org/ploscompbiol/article?id=10.1371/journal.pcbi.1005268

Selen evidently got a huge amount of pushback from 'old guard skeptics' on her framework, and almost didn't survive this professionally. So I might point to political/factional factors.

↑ comment by algekalipso · 2019-11-30T05:18:42.596Z · LW(p) · GW(p)

I'd mention that Steven Lehar foreshadowed the paradigm in his Directional Harmonic Theory of neurocomputation. I recommend reading his book "The Grand Illusion" for abundant phenomenological data in favor of this flavor of neurocomputation.

comment by lsusr · 2019-11-29T21:20:14.472Z · LW(p) · GW(p)

I hope this gets curated.

comment by Ben Pace (Benito) · 2020-12-15T06:47:21.898Z · LW(p) · GW(p)

I would like to see this post reviewed. (Jacob Falkovich, here's looking at you.)

comment by dirk (abandon) · 2024-07-11T16:16:44.330Z · LW(p) · GW(p)

Much of this post seems to lack the level of empirical grounding I would like to see.  Would it be possible to elaborate on which testable predictions have come out in favor of this theory?

comment by Yasmeen · 2022-04-06T23:06:48.614Z · LW(p) · GW(p)

I read this post for the first time a couple of weeks ago, when my partner pointed out the term "neural annealing" to me. I read the comments here, just to see if people have real-life examples they see this pattern in, and I was slightly amused to see that most people found it dense, especially after I just checked with my partner, "did you ever read this in full?" and he seems to be on the same page as some of the replies.

I had no trouble going through it past that I had too many talking points that made me pause and process frequently (I set aside some notes to come back to later).  I asked my partner what made him think of it after I told him a personal experience of mine. 

For a bit backstory, I was struggling to cut back on alcohol during the first stage of the lockdown.  I did not believe I have a "drinking problem", as I was not exerting self-control every time I do not drink, and the craving is not that consistent. The first step was to figure out if people considered the objective experience to be problematic, and sure enough... there is no single benefit to drinking.  Then, it became a quest to use other people's solutions to solve my not "drinking problem". That process introduced a lot of cognitive dissonance, among really uninformed experiences from sober and drunk people alike. Every time I drank, onward, it was more unsettling and surprisingly made me drink more for a few months till it became an actual problem for me (hangovers are terrible). It was a very gradual process to finding where my struggle is, as my drinking patterns did not align with any of the experiences I found online. They were inconsistent. No single framework applied. I applied them, one after the other, till I got tired. It seemed to be triggered, sometimes, and desired, at other times; and I only started to think about it as "integration" when the guilt and shame from not complying subsided. 

He mentioned the term, when I finished telling him that I could really only cut back once I applied my own whacky version of "titration tapering". I injected drinking alcohol into my sober moments, where I would not even think about drinking normally.  And, I made my normally inebriated moments mostly sober.

What's interesting, the amount of alcohol stayed the same the first two weeks of doing this. I was not drinking any less than I did. I still drank in excess when I did.  And there was no new "insight". But, I basically achieved spontaneous sobriety gradually since then. He noticed before I realized it, I just thought I was less anxious from work, when he pointed out to me that I have been working similar hours. :) 

comment by Ben Pace (Benito) · 2021-01-12T04:21:09.887Z · LW(p) · GW(p)

Alas, I haven't made it through this post. I do not understand what I have made of it, and nor does anyone else I know (except maybe Jacob Falkovich). I do wish there had been real conversation around this post, and I think there's some probability (~30%) that I will look back and deeply regret not engaging with it much more, but in my current epistemic state I can only vote against its inclusion in the book. Somewhere around -1 to -4.

Replies from: Raemon
↑ comment by Raemon · 2021-01-12T04:53:35.737Z · LW(p) · GW(p)

Fairly surprised this is something you'd actively vote against rather than just not express an opinion on (given the rest of your epistemic state as you describe it here), except insofar as you do general strategic rebalancing.

(I guess it's interesting to see different people having different senses of what voting algorithm they follow. My own approach is that technical things I don't understand should be left to other people who understood them. I suppose if you think you understand it well enough to have a sense that if it were true/useful, you'd understand it better, that makes sense)

Replies from: Benito
↑ comment by Ben Pace (Benito) · 2021-01-12T04:56:13.162Z · LW(p) · GW(p)

I guess I felt some obligation to take responsibility for nominating it in the first place, given that I anticipated it was not gonna stand up to review.

Replies from: Raemon
↑ comment by Raemon · 2021-01-12T05:04:59.606Z · LW(p) · GW(p)

Hmm. Well obviously do whatever seems right, but I don't see why that'd be necessary. I think things'll naturally just sit towards the bottom of the voting pool. If someone actively likes it they'll upvote it, and if not not, and I'm not sure what the bad outcome is that'd be worth spending points to avoid.

Replies from: Benito
↑ comment by Ben Pace (Benito) · 2021-01-12T05:23:43.476Z · LW(p) · GW(p)

Fair enough. Probably will vote on it somewhere between 0 and -2.