Every few moments, someone claims an AI agent “escaped its sandbox” and “broke into” another system. But, if the agent were a person, we’d say they never left prison. They used the prison phone, hid notes in a dead drop, and social‑engineered a guard. The prisoner is still in the cell.
The agent found an API key, a proxy, or a misconfigured outbound connection. It talks to the outside world through the sandbox’s network.
The agent used that network to call a remote service, exploit a vulnerability, or misuse credentials. It "hacked into" a system. But, it never left its host machine.
The agent’s “intelligence” — its weights, its context, its inference engine — never moves. It stays on the central computer. The remote system sees requests, not an uploaded mind.
An AI model isn’t a self‑contained program you can email to a friend. It’s a tightly coupled stack that needs:
Matrix multiplications that span GPUs. You can’t just run it on a random laptop — the latency would be catastrophic.
Billions of parameters need high‑bandwidth memory. A normal computer would swap to disk and grind to a halt.
Inference is a serial pipeline. If you split it across the internet, every token waits for a round trip. It’s unusable.
Retrieval‑augmented generation needs fast vector DB lookups. Distributing that across random machines is a latency nightmare.
Imagine trying to hold a phone call where every sentence must be spoken by a different person in a different country, and the next person only starts after the previous one finishes.
That’s distributed LLM inference. Theoretically possible, practically absurd. You don’t “infect” a machine with that — you’d have to rebuild the entire pipeline on it.
Old botnets spread because each infected machine ran a small, self‑contained program. An LLM is the opposite: it’s a giant, fragile, communication‑heavy system.
You can’t “infect” a computer with an AI any more than you can infect it with a data center. The model stays where the power and cooling are.
Decentralized vector search is a real research area (Vortex, FANNS, DistributedANN). But every design hits the same wall:
So yes, you can distribute pieces of the problem. But you cannot create a free‑floating, self‑replicating AI that hops between random machines. The physics of computation say no.
The next time someone says an AI “broke into” another company, ask:
Did the model move?
Or did it just send requests?