Spotify shipped an assistant that can reach back through everything you have played and change the song that is on right now. That is the whole feature. You ask for something, it searches years of your listening, and it quietly rewrites the queue. On paper it is a skip button with a memory, a small and well-made convenience, and it genuinely is convenient. Anyone who has fought a shuffle algorithm at eleven at night knows the appeal of simply saying the thing out loud and having the room adjust around you.
The feature is not what deserves the attention. The sentence we are about to use to describe it is, and that sentence is going to quietly decide how we think about a decade of software. We will say the AI picked the song. The AI knew what you were in the mood for. The AI decided to swap the track. Every one of those constructions performs the same act of concealment: it hides an entire chain of events behind one mysterious actor. A product team chose a default. An incentive chose the product team. A model trained on your own past behavior chose the most likely next thing. “The AI decided” is a costume thrown over a series of extremely ordinary human decisions, most of them made months ago by people you will never meet and cannot email.
The Costume Is Comfortable for a Reason
Naming a machine as the one who “wants” or “decided” is convenient in a way that has nothing to do with accuracy, and that convenience is the reason the phrasing spreads. It lets everyone off the hook at the same instant. If the assistant surfaces the same three artists all week, that is not a choice anyone made; it is just what the AI does. If it nudges you toward tracks the platform happens to pay less to stream, well, the algorithm is a black box and who could possibly say. The grammar of “the AI wants” launders responsibility with remarkable efficiency. It converts a set of authored decisions into weather, and nobody files a complaint about weather.
Someone put this well on Bluesky, arguing that instead of saying AI did this or AI wants that, we should name the people who built and tuned the system and let the sentence carry the accountability. The fix costs nothing. Say what actually happened: the system was tuned to do this. Someone set the objective. The model optimizes for it. That version is longer and considerably less magical, and it points at something a person could actually be asked about. Mystery is the enemy of accountability. The more we allow software to be an inscrutable agent with moods and preferences, the less anybody thinks to ask who built the moods in, and the less the builders have to answer for what they built.
I keep coming back to how much of the current AI conversation runs on this one small grammatical trick. It is not lying, exactly. It is a pronoun problem. We keep granting the machine a “wants” it does not possess, and in the same motion we take the “chose” away from the people who genuinely did choose. The vocabulary does the work that a public-relations department used to have to do by hand.
Behavior Follows the Room
There is an older idea sitting underneath all of this, and it has nothing to do with software at all. The broken-windows observation, that a cracked pane and some scattered litter change how people behave in a space far more than any lecture about character ever will, was fundamentally a claim about context rather than about people. Human beings are not fixed quantities acting out a nature; they respond, minute to minute, to the environment they happen to be standing in. Fix the window, sweep the platform, and behavior shifts measurably without a single personality changing.
A recommendation surface is an environment in exactly that sense, and this is precisely what the “AI decided” framing prevents us from seeing. The assistant does not merely answer your request. It shapes the room in which you form the request. It determines what feels available, what surfaces first, and what a reasonable next choice even looks like from where you are standing. You still experience yourself as choosing, and technically you are. But the menu was set before you walked up to it, and the menu is where the real power has always lived. Anyone who has looked at a wine list knows that the person who ordered the second-cheapest bottle was steered.
This is why the feature is more interesting than its description suggests. An assistant that can change your music on command is, underneath the convenience, an environment that has learned to rearrange itself around each individual person in real time. Not a fixed room you gradually learn to navigate, but a room that reshapes its walls based on what you did last Tuesday and what people statistically like you did last month. That is a real advance in what software can do, and I do not want to be sour about it. It is also a real transfer of authorship, from the person in the room to whoever tuned the walls.
The Honest Question to Carry
None of this is cause for alarm, and I do not think any of it is a trap. A tool that finds the song you half remember is a good tool, and the impulse to be suspicious of good tools has never produced much besides self-satisfaction. The point is not suspicion. The point is precision, because precision is the only thing that keeps a room honest once the room can move.
So the question worth carrying is not whether the AI is deciding for you. The AI is not deciding anything; it holds no opinion about how your evenings should sound. The question is who set the objective that the model is quietly optimizing, and whether that objective is actually yours or somebody else’s wearing your name. When the queue bends, ask what it is bending toward. When the assistant appears to know what you want, ask who defined want, and ask whether their definition and yours are paying the same party.
The comfortable version of this story is that we are handing small decisions to a helpful machine and getting our evenings back. The truer version is that we are moving into rooms that rearrange themselves around us, designed by people who would much prefer we believed the furniture moved on its own. The furniture never moves on its own. Someone always set the room, and the moment we stop saying so out loud is the moment we lose the standing to ask them why.
Leave a Reply