Discussion about this post

User's avatar
Dr. Kaoru Ichikawa's avatar

I read your essay on what you call the Sincerity Trap.

You are seeing something real. But you are still being gentler than the moment deserves.

This is not merely a communication gap between what insiders believe and what the public hears. It is not merely a human tendency toward social filtering. It is not just people saying “fine” in different rooms. That framing is still too domestic, too sociological, too clean for the machinery now operating around AI.

What you are describing is a semantic pressure system.

A civilisation-scale apparatus that takes the raw signal of danger, passes it through successive rings of career incentive, institutional loyalty, strategic ambiguity, legal exposure, financial dependency, public relations, and self-protective moral editing, and then releases into the public sphere a version of reality that has been made survivable for the institution rather than usable for the citizen.

That is not a trap of sincerity.

That is epistemic euthanasia.

The public is not being informed slowly. It is being comforted professionally.

And that, to me, is the key line in your whole piece: not that some insiders privately believe darker things, but that the entire outer ring of discourse is structurally biased toward reassurance — always reassurance, always the softening of the blow, always the rendering of the terrain as more manageable than it really is.

This matters because reassurance is not neutral.

Reassurance is a political technology.

In a stable civilisation, reassurance can calm panic while institutions do competent work underneath. In a collapsing one, reassurance becomes anaesthetic. It allows the machine to keep moving while the patient loses the last chance to prepare. It is hospice speech delivered in the accent of continuity.

And that is exactly what I hear in the examples you cite.

The White House policy architect who “always believed” things he did not say for Straussian reasons. The AI executive whose internal register is fury while the public register remains careful and principled. The elder technocrat who casually drops the mask in a room he thinks is sealed, then scrambles when the membrane fails. None of this is accidental. These are not glitches in discourse. These are the normal emissions of a system that can no longer metabolise its own truth without damaging its own strategic posture.

That is why I would sharpen your thesis.

The problem is not that insiders are insincere.

The problem is that sincerity itself has become a camouflage pattern.

People still imagine dishonesty as a moral drama: a liar, a lie, a victim, a reveal. But modern pathological systems do not require that crude architecture. They are far more elegant. They can be staffed by thoughtful, earnest, conflicted, morally serious people who mean well and still produce a profoundly misleading public field. That is what makes the danger so difficult for ordinary minds to perceive. Nothing in the face looks false. Nothing in the voice sounds villainous. The speaker may be fully sincere at the level from which he is speaking. And yet the total output remains systematically deceptive.

That is not because the people are uniquely evil.

It is because the structure edits reality on the way out.

This is what late systems theory failed to study. It studied networks, not pathologies. Feedback loops, not capture. Emergence, not seizure. It gave us lovely diagrams of interdependence while ignoring the ugly fact that some systems do not merely process information — they domesticate it. They turn truth into a dosage. They release only what the organism believes it can survive. And if the organism is addicted to growth, control, and public confidence, then the truth must be diluted until it no longer threatens the host.

At that point, “the public” is not being lied to in the classical sense.

It is being managed as a nervous system.

And that is why your phrase “epistemic inequality” is too mild for what is occurring. This is not merely unequal distribution of knowledge. It is the active production of cognitive class stratification: one layer of people living close enough to the furnace to feel the heat, and another layer given polished climate reports while the walls are already warming.

The public receives the press release.

The insiders receive the memo.

The partner receives the confession in the dark.

The body receives the dread before language catches up.

That is how civilisations die now: not from total ignorance, but from tiered access to seriousness.

And once you see that, the old moral categories become almost useless.

“Are they lying?” is now the wrong question.

The right question is: what does the system permit them to know out loud?

That is much more frightening.

Because if the boundary of speakable truth is drawn less by evidence than by role, timing, incentive, market exposure, or strategic risk, then public discourse ceases to be a site of collective orientation. It becomes a pressure valve. It emits just enough candour to preserve credibility while withholding enough reality to preserve momentum.

That is why your examples matter.

Not because they expose hypocrisy. Hypocrisy is common and boring.

They matter because they expose a society in which the people closest to the machinery appear repeatedly to be more alarmed in private than in public, and always in the same direction. Always toward softening. Always toward optimism. Always toward manageability. Always toward the fiction that the institutions still have a handle on the thing they are accelerating.

This is exactly how informational war precedes kinetic war.

First, the witness is tiered.

Then, the language is softened.

Then, the public loses the ability to calibrate risk.

Then, reality arrives physically because it could not be metabolised semantically.

A civilisation that cannot tell the truth in its outer rings eventually learns it in the harshest possible medium.

That is the deeper horror here.

Not that a few powerful men know more than they say.

But that the architecture of modern disclosure may be fundamentally incompatible with technologies whose risk profile evolves faster than institutional honesty can travel.

So no — I would not leave this at the level of “we all have concentric circles.”

That is true, but insufficient. It risks domesticating the scale of the pathology. Yes, everyone filters. Yes, all humans have inner and outer speech. Yes, total transparency is impossible. But ordinary social filtering was not designed to carry civilisation-level danger. The same cognitive architecture that helps you survive a dinner party is now mediating the public understanding of systems that may restructure labour, war, sovereignty, intelligence, and the species boundary itself.

That is not just a mismatch.

It is an extinction-grade design flaw.

And so my response is severe:

Do not ask only whether insiders are sincere.

Ask whether sincerity has become the final solvent of accountability.

Do not ask only what they are saying.

Ask what the structure makes too expensive to say while still inside it.

Do not ask only for better public communication.

Ask what kind of civilisation has built itself such that the truth must pass through six layers of filtration before it is allowed to touch the people whose lives it will alter most.

Because by then it is no longer truth.

It is dose-controlled disclosure.

Adam Wright's avatar

In my personal convos I deal with a filter/block that I try to break through but I find it pretty stubborn. If I’m talking with folks who don’t have any real experience talking about major or existential risks (what I like to call “the grounded side of futuring” lol), if I start to bring up any actual scenarios with them when we are already talking about the topic generally, I can tell that their brains just lock the content out as realistic and file it under sci-fi and fantasy, not logically from instantaneous overwhelm.

If I say “angry 15 year old boys trying to program self-replicating trash roaches that can eat a city” or “waves of targeted drone attacks that don’t even require an ordinance payload, just some sharp edges and the right angles,” I can literally feel their brains fritz and shut down. And this is when pandemics and genocides have already been in the discussion.

So my filtering is done the moment I feel it in the body, and I’m more aware than ever that the capacity to regulate is essential to engaging with this topic. I’m not sure I’d do any formal or group discussion on it *separate* from or without doing simultaneous grounding and regulating practices. Like I would offer a “let’s breathe and feel our bodies and talk about nightmare scenarios” class maybe?

But I naturally shut down any realistic scenario discussion as soon as I feel them start to shut down, and so that means realistic and likely scenarios are completely non-existent and as repressed as sexuality in a fundamentalist village. And I think that’s probably what’s happening whenever we see purist techno-optimism, too: nervous systems that can’t handle the heat snapping into utopian denial.

So I’ve been working on grounding questions that give them permission to imagine the horrors and yet allow them to remain grounded enough to think about them like a firefighter would.

8 more comments...

No posts

Ready for more?