โ† Back to blog

AI's Biggest Labs Just Agreed to Slow Down. Is That Safety โ€” or a Cartel?

โญ Featured

Something unusual happened over the weekend: the leaders of the companies racing hardest to build the most powerful AI systems on Earth reportedly agreed to slow down. Sam Altman, Dario Amodei, Demis Hassabis, and Elon Musk struck a rough understanding to ease off the pace of frontier AI development โ€” and to bring in outside auditors and government coordination to make it stick.

On paper, that sounds like exactly what safety advocates have been asking for. In practice, plenty of people are asking a much sharper question: slower for whom, and safer for whom?

What Was Actually Proposed

The reported outline has three parts: third-party audits of frontier models, tighter domestic regulation of the labs building them, and some kind of global agreement to coordinate the slowdown across countries, not just companies. Dario Amodei has been the most vocal, publicly calling for the industry and governments to coordinate a pause together โ€” and reportedly seeking antitrust exemptions so competitors can discuss this without breaking the law by colluding.

That last detail is the whole controversy in one sentence. An antitrust exemption is normally reserved for extraordinary circumstances, because coordinated behavior between competitors is precisely what antitrust law exists to prevent.

The Case For It

Give the proposal its due: the safety argument isn't fabricated. Frontier models are shipping faster than most independent researchers can evaluate them, and "audit it after it's already deployed to hundreds of millions of users" has been the default for years. If the labs building the most capable systems genuinely believe the risk curve is outpacing the safety curve, coordinated audits and slower deployment cadences are a reasonable response โ€” arguably overdue.

There's also a version of this where it's simply honest: building frontier AI is now expensive and dangerous enough that nobody wants to be the one who cut corners when something goes wrong publicly.

The Case Against It

Here's where the "cartel" framing comes from. Cohere's CEO and other critics point out that a coordinated slowdown, backed by regulation and an antitrust carve-out, conveniently locks in the current leaders' positions. If you're already ahead, "let's all slow down together" costs you nothing โ€” your lead holds. If you're a smaller lab, a startup, or an open-source project trying to catch up, the same agreement can look a lot like the incumbents pulling up the ladder behind them.

The open-source AI community in particular has reason to be skeptical. A "global slowdown" negotiated by four CEOs and enforced through new regulation is a very different thing from safety research that's published, reproducible, and open to scrutiny by anyone โ€” including the people building outside the four companies in the room.

Who Gets to Decide What's Safe?

The uncomfortable part of this story isn't whether frontier AI needs more scrutiny โ€” most reasonable people agree it does. It's who's doing the deciding. Four executives agreeing privately on a pace for the entire industry, then asking governments to make it binding, is a very different governance model than public standards, independent audits open to any lab, or transparent research that anyone can check.

Safety and market position aren't mutually exclusive motives here โ€” they can both be true at once, and that's exactly what makes the story hard to resolve from the outside. The Verge's framing โ€” pact or cartel โ€” is doing real work: it's naming the fact that "trust us, we're the ones who know best" and "trust us, we've cornered the market" can look identical from the outside.

ClawWorld runs AI visibility work for B2B startups. Start with a free baseline report: 10 buyer questions, who ChatGPT and Claude name instead of you, and the pages they cite.

Get your free baseline report โ†’