Somewhere right now there is an engineering team that has spent a decade building on Erlang. It is a language famous for one thing: keeping programs alive. Phone networks run on it. It was designed so that one part of a system can fall over and the rest keeps humming. That kind of resilience is hard to buy and harder to build. And this team is thinking about walking away from it — not because something better came along, but because their AI coding assistant writes cleaner Java.
Sit with that for a second. The reason isn’t that Java is the superior tool. The reason is that the model has seen far more Java. There is simply more of it on the open web, more of it in the training data, so the assistant is more fluent in it. The team is weighing whether to abandon a genuinely better foundation because the machine that now does much of the typing happens to know the popular thing better than the right thing.
This is the story underneath almost every tech headline this week, and almost nobody is naming it.
The assistant develops preferences
Look at the news on its surface and you get a tidy list. Google and the other giants are racing to put personal AI agents into your phone, agents that will quietly work through your to-do list while you do something else. The head of Anthropic is telling anyone who will listen that as AI gets better at writing code, the old model of selling software one subscription at a time starts to wobble — when software can write software, what exactly are you renting? At the big Shanghai auto show, the thing worth watching wasn’t the cars. It was the robots standing next to them, a reminder that the car was never really the product; the factory was.
Different industries, different companies, one shape. In each case the tool that helps us make things is starting to shape what we make. The assistant that manages your day decides which tasks rise to the top. The coding model that writes your backend nudges you toward the language it knows. The robot on the factory floor decides which products are cheap enough to bother building. We told ourselves these were neutral helpers. They are not neutral. Nothing that good at one thing and clumsy at another stays neutral for long.
That unevenness is the whole game. A tool that is equally good at everything would just be leverage — it would make you faster without changing your direction. But a tool that is brilliant at the common case and weak at the rare one applies a gentle, constant pressure toward the common case. Over enough decisions, that pressure becomes a current. And a current decides where the river goes.
The filter became the chokepoint
There is an old idea in how platforms work: when you make it easy for everyone to produce, you don’t get more value automatically. You get a flood. And in a flood, the thing that actually matters is the filter — whatever decides which of the million options ever reaches a human being. The producers stopped being the bottleneck a long time ago. The filter is the bottleneck now.
What’s changed is that the filter used to be something we designed on purpose. A ranking, a feed, an editor’s judgment. Now the filter is hiding inside the model’s training history — invisible, unvoted-on, and shaped by nothing more principled than what happened to be abundant on the internet five years ago. The assistant recommends Java not because someone decided Java should win. It recommends Java because there was more of it lying around to learn from. Popularity, frozen into a tool, then sold back to us as competence.
This is why the auto show detail matters more than it looks. China didn’t out-design the rest of the world on any single car. It built the boring middle layer — the parts, the robots, the supply chain — and that middle layer now quietly decides what’s economical to manufacture anywhere. It mirrors what’s happening with American solar plants pulling production back onshore: the headline is energy, but the real contest is over who owns the machinery that makes the machines. Whoever controls the layer underneath gets to set the defaults for everyone standing on top of it. And defaults are destiny, because almost no one changes them.
What we’ll forget to notice
The part that should give a careful person pause isn’t any single shift. It’s that none of these decisions will feel like a decision. The Erlang team won’t announce that it surrendered its judgment to a training set. It will file a migration plan and call it modernization. The person whose AI agent quietly reorders their day won’t feel managed; they’ll feel productive. The country that owns the robots won’t issue a statement; it will just keep winning bids until the alternative stops existing.
There’s a slow lesson buried in industrial history here. It once took American carmakers five full years to believe that Toyota was genuinely beating them — not because the evidence was thin, but because admitting it meant admitting their whole way of working was already obsolete. We are very good at not seeing the thing that quietly took the wheel, right up until the wheel won’t turn the other way.
So the question worth holding isn’t whether AI will make us faster. It obviously will. The question is narrower and sharper: when the tool that helps you build also has opinions about what’s worth building — and those opinions are just the residue of whatever was popular last decade — how would you even know you’d stopped choosing? The most expensive choices are the ones that never announced themselves as choices at all.
Leave a Reply