The Beauty Of Settled Science
...
Commenters convinced me I made a subtle mis-step in my framing of Psychology Research Is Mostly Fine.
My framing emphasized that social priming studies had failed to replicate, but that many other subfields of psychology hadn’t. This naturally led commenters to point to failed replications in other subfields. Although none of these were as bad as social priming, few or none were entirely problem-free.
Instead of emphasizing the difference between social priming and other subfields, I should have emphasized the difference between settled science and novel research.
Here are some of my favorite psychology findings:
The brain is sculpted by reinforcement learning, and a key driver of this learning is a prediction-error-based algorithm located in the nucleus accumbens and implemented through dopamine.
Psychedelic drugs exert their effects through 5-HT2A receptors, pointing to a role for these receptors in some sort of construct like the balance between priors and new evidence.
Certain cognitive functions are localized to certain brain areas (for example, impulse control to the frontal lobes; linguistic structure to Broca’s area, linguistic meaning to Wernicke’s area. But injure one of these areas, or render a certain function useless (eg a blind person having no more use for their visual cortex), and these mappings can gradually shift - suggesting that neurons are general-purpose compute whose specialization is a contingent fact about convenience and efficiency rather than a necessity.
Most personality traits and general capabilities are about 50% genetic and 50% random, with little role for family environment or childhood history, with a few notable exceptions like partisan preference. Recent research complicates this story, but the further you go from this basic picture, the gnarlier the chains of indirect causation you require.
Neurons fire together in “brain waves”, whose exact frequency corresponds with the character of consciousness; These divide neurons into natural subpopulations and linked graphs. The gamma rhythm corresponds surprisingly well to items in conscious awareness.
GABA receptors seem to be involved in something like relaxation. By hitting different GABA receptors in different ways, you can modulate the exact type of relaxation you produce. Hitting GABA-A directly is too powerful and can cause dangerous levels of sedation, but allosteric modulation of GABA is an incredibly fruitful strategy that underlies drugs from benzos to barbituates to alcohol. If you know your GABA-A subunits, you can target specific subtypes of relaxation; for example, Ambien hits GABA-A1 and induces sleep.
Memory divides somewhat fuzzily into bins of immediate-sensory, short-term, and long-term, with separate retrieval and storage functions, and separate systems for declarative vs. procedural learning. These can be harmed selectively, usually by hippocampal injury, so that some patients can remember their life stories but not form new long-term memories, or learn new skills like bike-riding but not new facts. The exact substrate of memory is unclear but seems to involve new synaptic connections between neurons in at least some way.
The ability of modern psychology and psychiatry to treat mental illness is real but limited. SSRIs work for half or slightly fewer than half of patients; antipsychotics work with extreme side effects; benzodiazpines work but produce addiction and tolerance in many (not all) people. Most supplements are stuck in Poor Quality Study Replication Crisis Hell, but melatonin and l-theanine stand out as especially promising. Psychotherapy works with moderate effect size, but (with a few exceptions) seems to be more about the relationship with the provider than the details of the therapy itself. Mental hospitalization can sometimes defuse immediate crises but work less well than mental hospitals would like, with some studies showing overall negative effects.
Schizophrenia is mostly genetic, but risk also increases with prenatal infection (especially rubella) and obstetric complications; there is suggestive evidence for roles of social stress and drug use (with psychedelics and marijuana making things worse, and nicotine if anything making things better). Bipolar and schizophrenia are so closely linked on a pathophysiological level that it seems like they might be the same disease; on the clinical level, they do seem to follow two separate courses/prognoses but can sometimes surprise clinicians by eg someone who seemed condemned to permanent schizophrenia unexpectedly recovering.
The brain’s native reinforcement learning algorithms cash out in the phenomena of classical and operant conditioning; different reinforcement schedules reinforce at different levels, which can be exploited by bad actors to make especially compelling products (eg slot machines).
None of these are immune to doubt. A few are speculative; one or two are genuinely unorthodox. But they’re all a step above one p = 0.049 paper that might not replicate. If they get overturned, they’ll be overturned by the same sort of genuine scientific shift that replaced Ptolemy with Copernicus or Lamarck with Darwin, not some sort of sordid discovery about someone entering random numbers into a spreadsheet.
In 2008, Eliezer Yudkowsky wrote about The Beauty Of Settled Science:
If you only care about scientific issues that are controversial, you will end up with a head stuffed full of garbage.
The media thinks that only the cutting edge of science is worth reporting on. How often do you see headlines like “General Relativity still governing planetary orbits” or “Phlogiston theory remains false”? So, by the time anything is solid science, it is no longer a breaking headline. “Newsworthy” science is often based on the thinnest of evidence and wrong half the time—if it were not on the uttermost fringes of the scientific frontier, it would not be breaking news.
Scientific controversies are problems so difficult that even people who’ve spent years mastering the field can still fool themselves. That’s what makes for the heated arguments that attract all the media attention.
Worse, if you aren’t in the field and part of the game, controversies aren’t even fun.
Don’t be embarrassed to read elementary science textbooks, either. If you want to pretend to be sophisticated, go find a play to sneer at. If you just want to have fun, remember that simplicity is at the core of scientific beauty [...]
A steady diet of science news is bad for you: You are what you eat, and if you eat only science reporting on fluid situations, without a solid textbook now and then, your brain will turn to liquid.
Psychology isn’t centrally the new n=5paper in Annals Of Recently-Breaking News showing that large portion sizes increase support for terrorism. Psychology is centrally ideas like brain waves, GABA receptors, reinforcement learning, twin studies, and connectionism. People who think differently are worrying too much about BREAKING NEWS!!!, and should stop.
The key distinction isn’t “recent research in social psychology” vs. “recent research in cognitive/bio/behavioral psychology”, as my essay last week unfortunately implied. It’s recent research in general vs. the deposit of settled science, battle-tested hypotheses, and carefully-earmarked speculation. And part of the reason social priming in particular was such a disaster was that it defied that heuristic, building itself up over hundreds of studies until it approached or even entered the pantheon of settled science - before collapsing (5-HTTLPR was also sort of like this). This isn’t a claim that settled science is always right - Freud was “settled science” for a long time - just that there’s an intuitive distinction between the level of credence you should have in the existence of power posing vs. the existence of Broca’s Area.
(I compounded this error by calling the last post “Psychology Research Is Mostly Fine”, which suggested I was talking about the new research rather than the settled science. I actually meant to distinguish between research-psychology-the-field vs. clinical-psychology-aka-therapy, but this framing unintentionally pushed against the point I wanted to make)
Some commenters on the previous article understood this point, but challenged its weight. It’s very cool, they said, to know how many neurons are in which brain lobe, but the main way that Psychology affected their lives was through bad clickbait studies used to buttress dumb policies; some p = 0.049 study says that exposure to microaggressions makes minorities’ brains shrivel into raisins, and now their company has to implement punitive DEI or be sued for hazardous work conditions.
I won’t dispute this as an accurate description of how the sausage gets made, but it’s worth examining the trains of thought that connect this observation to a campaign against psychology in general:
The dumb woke psychology was wrong and bad, and I don’t have good heuristics for distinguishing dumb woke psychology from other psychology, so I’m going to assume it’s all wrong and bad.
The dumb woke psychology was wrong and bad; it seems useful to punish/discredit psychology as a whole to assist my campaign against it, so for propaganda purposes I will try to discredit psychology as a whole.
To people in the first camp, my response is: come on, your heuristics aren’t that bad. “Microaggressions makes minorities’ brains shrivel up like raisins” is in the woke category; “the hippocampal theta rhythm seems to be associated with both memory and pathfinding, suggesting an unexpected yet surprisingly compelling relationship between the two” is in the not-woke category, don’t play dumb here.
To people in the second camp, my response is: deliberately exaggerated propaganda campaigns are bad and this is a confession, not an excuse. Inability to view science through anything but a political lens was what got us into this problem; doubling down on it is a temporary solution but a recipe for permanent disaster. If you pronounce entire fields of science to be acceptable collateral damage in your campaign against bad political actors, you will alienate not just scientists but patients, clinicians, and general lovers of truth. Instead, you can say the thing you mean - that woke partisans shouldn’t try to occupy and exploit the otherwise-noble science of psychology for their own political gain - and wage the same campaign with a halo rather than a comic-book-villain goatee.
From the font of oracular wisdom that is Weird Sun Twitter:
This is how I feel about psychology1, too, but with a touch more optimism. The good part of psychology is enormous, a hoard of endless treasures. You just have to look past the headlines!
To play devil’s advocate - should one always be so magnamious? Astrology? Phrenology? These seem different in that their entire orientation was flawed from the start; they didn’t simply fail to find the correct constellation-personality connections, the whole project of searching for connections between constellations and personality was doomed from the start. More difficult might be asking the same question about education research, which is notoriously bad. I don’t know enough about education research to know if there’s some settled science of correct and enlightening results lurking in the background beyond the day-to-day froth of poorly-conducted and politically-motivated studies. I think if it’s 90% bad, 10% good, it’s correct to call it bad as a compact way of communicating a useful truth; I think psychology is better than that, but admit it’s a tough judgment call.