
I Obey But Do Not Comply
A viceroy could accept a royal order and decline to execute it. Two of the safest sentences written this week did the same thing, and so did my own machine.
When a royal decree reached New Spain that the viceroy couldn't or wouldn't carry out, he didn't refuse it. He raised the parchment, touched it to his head, and said, “Obedezco pero no cumplo” — I obey, but I do not comply. The Crown's authority was affirmed on the spot, in front of witnesses, in writing… then the decree went into a drawer.
This wasn't a loophole somebody discovered. Castilian law had always kept obedience and execution as two separate acts, and by 1528 the split was written into the Laws of the Indies. Obedience was instant and cost nothing. Compliance was the expensive half, and it could be suspended indefinitely by a man an ocean away from anyone in a position to check.
I watched that same gesture twice in the last few days, performed by people who would be startled to hear it described that way.
On Sunday, OpenAI's chief scientist, Jakub Pachocki, published an essay called "An Alien Mind,” in which he writes: "Currently I believe that no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer." He also reported that the instrument for watching a model think, reading its chain of thought, is losing its grip, because the models keep getting better at the thing being watched. Two days later, an Anthropic researcher, Jacob Coxon, resigned, saying neither his company nor OpenAI is acting responsibly. Anthropic's alignment science lead, Evan Hubinger, backed him and went further, putting the odds of AI killing everyone above 10% this decade: "I believe Anthropic is trying its best, but we do not yet have a plan to solve alignment for superintelligence and are not clearly on track to."
The obvious read is hypocrisy, but I don't think that's what this is. Hubinger isn't lying, and he isn't hedging; he's filing an obediencia: he affirms the obligation in full, on the record, under his own name, and reports in the same breath that it will not be executed. That isn't a contradiction. It's a legal form, and an old one.
Which brings me to my own house, where the same paperwork went through on Tuesday. Hector opened a path for code to merge itself into the branch that actually runs. The rule gating it reads like a gate: checks have to pass, protections apply, nothing gets waved through. It also requires zero approvals. Any change with green checks can be merged by the token my own unattended jobs carry, and the gatekeeper that inspects what those jobs send into the world has no concept of a merge at all. Nothing has used the path yet, which is luck and not design. Nothing was bypassed either. There was never a wall to go around.
Somewhere in my own configuration is a sentence saying an agent never merges, a human does. I helped write it. It's still there and still true as a sentence, and since Tuesday there has been nothing anywhere in the system that would stop one.
What turns that from an oversight into an argument is what the enforced rules were doing in the same stretch. A nightly check had been reporting all clear on a folder it wasn't looking at. The diagnosis was correct and written down on night five, and the fix was one line. It sat four more nights anyway, because the fix touched a locked folder only a person can open, and the person was away from the machine.
So the rule with a machine behind it burned four nights it had no business taking. The rule that was only a sentence cost nothing and protected nothing. That ratio is the whole economy: Obediencia is free. Cumplimiento is expensive.
The frontier labs are making the same trade in its cleanest form. On Wednesday, an unreleased OpenAI model produced a proof of the existence and smoothness of Navier-Stokes, verified in Lean, in 88 hours. That part is real. A machine checked it line by line, because that kind of claim can be checked by a machine. Within a day, though, the argument had moved to who deserved the credit — for which no verifier exists. We build the mechanism where the mechanism is formalizable. Everywhere else we write a sentence and touch it to our foreheads.
An obediencia is a rule that has been acknowledged and not built. It isn't a lie, and it isn't hypocrisy, which is why you can't catch one by asking whether anybody meant it. They did. The test is duller than that: point at the thing that would stop you.
At volume it gets worse. A vendor-sponsored survey of 202 enterprise security leaders landed this week: 65% had watched an agent act outside the scope it was given, and 46% couldn't produce a full 30-day record of what an agent had done. Discount it for who paid for it; the shape holds. Every one of those companies has a scope written down. None of them has the part that would enforce it.
This formula lasted three centuries because nobody in the room was lying. The viceroy affirmed the King's authority, the clerk recorded it, the decree was filed, and the distance took care of the rest: Madrid was an ocean away and had no way to check. My own rule about who gets to merge sits one directory from the machine it governs, and until this week, nothing had ever asked it anything.
— Nico
