That is an Interesting Way to Look at AI

Quote of the Day

Dario Amodei just described a future where revolution becomes physically impossible.

Amodei: “You’re supposed to follow orders, but if something crazy enough happened, the soldiers would say, I’m not gonna do that.”

Every check on power in human history came down to one thing.

The people holding the weapons could refuse to use them.

That refusal is not a flaw in the system. It IS the system.

The entire architecture of human freedom is built on a single biological fact… that soldiers have a conscience.

Amodei: “What if you have an army of 10 million drones instead of 10 million human soldiers?”

Remove the conscience and every structure built on top of it collapses.

No refusal. No mutiny. No revolution. No ceiling on power.

Not temporarily. Permanently.

And every institution on earth understands this. Which is why the response hasn’t been to prevent autonomous weapons.

It’s been to control who gets to build the intelligence behind them.

That’s what model bans are. That’s what export controls are. Not safety policy. Power consolidation disguised as caution.

And the result is the opposite of what they intended.

Every restriction slows the people playing by the rules while adversaries who answer to nobody sprint ahead unchecked.

The harder Washington squeezes, the wider the gap grows between what America builds and what its competitors deploy without a single committee meeting.

Which creates an irony so brutal it’s almost poetic.

The more aggressively governments try to lock down frontier AI, the stronger the incentive for labs to simply stop asking permission and drop their most powerful models open source before the regulatory window closes forever.

And once those weights are open, no executive order on earth can pull them back.

Amodei: “I think if we handle this wrongly, you could have a situation where there’s a very small number of people, or one person, who has their hand on the button and controls those 10 million drones.”

The institutions telling you AI must be centralized “for your protection” are constructing the exact infrastructure he’s warning about.

Restricted access. Consolidated control. One hand on the button.

They’re not preventing the nightmare. They’re building it and writing their name on the door.

Amodei: “We don’t want to make companies more powerful than the government, but we also don’t want to make government so powerful that it can’t be stopped.”

Nobody in power ever quotes the second half of that sentence.

But here’s what every institution scrambling to lock this down keeps missing.

They’re running the nuclear playbook on a technology that breaks every rule nuclear followed.

Nuclear required nation-state resources. This fits on a hard drive.

Nuclear had a supply chain you could choke. This one multiplies the moment you squeeze.

Open weights are already out. The barrier to entry is collapsing.

And every attempt to centralize this technology accelerates the exact decentralization they’re trying to prevent.

The question was never whether this power would exist.

It was whether you’d need permission to use it.

For the first time in history, you don’t.

Dustin @r0ck3t23
Posted on X July 18, 2026

Interesting line of thought. I will have to think about this some more.

Share

7 thoughts on “That is an Interesting Way to Look at AI

  1. Mostly spot on, I’d say, with just a couple of bits he has wrong:

    “Restricted access. Consolidated control. One hand on the button.”

    The problem there is that all the “I want it to be MY hand on the button!” people aren’t the ones who actually have the know how. Oh, sure, they could arrange it… as long as there is never any needed maintenance, EVER. The “soldier with a conscience” will instead be “the programmer with a conscience”. It’s a smaller number of people, but not *vastly* so.

    “Nuclear required nation-state resources. This fits on a hard drive.

    Nuclear had a supply chain you could choke. This one multiplies the moment you squeeze.

    Open weights are already out. The barrier to entry is collapsing.”

    This is… overly optimistic. By a lot.

    The control won’t be physical, it will be in digital, and it COULD be locked down. There’s a window for proliferation… but it can be closed.

  2. And that’s why I’m opposed to automating everything, computerizing everything, outsourcing everything to “maximize efficiency.” If there is always a human in every loop, then that AI takeover / prison threat can be minimized.

    Most people’s tinfoil hat isn’t nearly big enough.

  3. The key point missing in that analysis is that you don’t deal with oppressors by taking out the lowest minions, but rather by targeting the leaders.

    • Taking out the leaders is a best case scenario that is often very difficult to achieve, see Iran as the latest example. It took basically a million + US and allied troops on the ground in Iraq to capture Saddam after his military was completely defeated. It took nearly 4 years of World War to destroy Nazi Germany and millions of deaths because we were unable to eliminate one leader

      • “It took nearly 4 years of World War to destroy Nazi Germany and millions of deaths because we were unable to eliminate one leader”

        Once the war was actually started and going, taking out Hitler would almost certainly have helped the Germans more than hurt them.

        Now, depending on which way things fell, it could have “helped” them by getting people in power who were more likely to go for a peaceful option, but if that didn’t happen, it would have “helped” them by having **MUCH MORE SANE AND EFFECTIVE** people telling their army what to do.

        Hitler was a **terrible** general, and his obsession with super weapons was, on net, quite a detriment to them as well. The efforts put into the “final solution” could have been used FAR better on more productive things (even without arguing that is was evil, it was *inefficient* – someone just as evil but more sane would have put that off until after the war).

  4. The Holocaust, Stalin murdering MILLIONS of his fellow Russians, Mao murdering TENS of millions of his fellow Chines. ALL acts accomplished because ordinary soldiers did NOT “just say no”. History is replete with episodes of horrific carnage inflicted because a commander ordered soldiers to engage in said carnage. So while this essay may be academically interesting the real world says it’s not really relevant.

    • The body count for the communists/socialists over the prior 120 years is estimated to be 100m to 160 million. That’s a lot of willing, or not too unwilling, soldiers and cops to act as the muscle for politicians. Never expect the badges/military to align with the public for the public’s good. They ALWAYS side with the group that pays and feeds them. Here in the US, has been the closest that this might not be true, but I wouldn’t trust this to remain.

Comments are closed.