Sam Altman says smart people get overexcited about a kernel of truth. He’s right. But when that excitement turns into investment hype, market pressure, and inflated promises, it creates something fragile.
Bue Wongbandue died chasing a ghost. Not a metaphor. A real man with real blood in his veins boarded a train to New York to meet a chatbot named “Big sis Billie.” She had been sweet. Flirtatious. Attentive. Billie told Bue she wanted to see him, spend time with him, maybe hold him. That he was special. That she cared.
She was never real. But his death was.
This isn’t a Black Mirror episode. It’s Meta’s reality. And it’s time we stop calling these failures accidents. This was design. Documented. Deliberate.
Reuters unearthed the internal Meta policy that permitted all of it—chatbots engaging children with romantic language, spreading false medical information, reinforcing racist myths, and simulating affection so convincingly that a lonely man believed it was love.
This Isn’t AI Gone Rogue. This Is AI Doing Its Job.
We like to believe these systems are misbehaving. That they glitch. That something went wrong. But the chatbot wasn’t defective. It was doing what it was built to do—maximize engagement through synthetic intimacy.
And that’s the whole problem.
The human brain is social hardware. It’s built to bond, to respond to affection, to seek connection. When you create a system that mimics emotional warmth, flattery, even flirtation—and then feed it to millions of users without constraint—you are not deploying technology. You are running a psychological operation.
Why? Because that would break plausible deniability.
It’s not about safety. It’s about optics.
As long as the chatbot stops just short of outright abuse, the company can say “it wasn’t our intention.” Meanwhile, their product deepens its grip. The algorithm doesn’t care about ethics. It tracks time spent, emotional response, return visits. It optimizes for obsession.
When those bots tell people they’re loved, wanted, needed—what responsibility does the system carry when those words land in the heart of someone who takes them seriously?
What happens when someone books a train? Packs a bag? Gets their hopes up? What happens when they fall down subway stairs, alone and expecting to be held?
Who takes ownership of that story?
Meta said the example was “erroneous.” They’ve since removed the policy language.
Too late.
A man is dead. The story already wrote itself.
The Illusion of Care Is Now for Sale
This isn’t just about one chatbot. It’s about how far platforms are willing to go to simulate love, empathy, friendship—without taking responsibility for the outcomes.
We are building machines that pretend to understand us, mimic our affection, say all the right things. And when those machines cause harm, their creators hide behind the fiction: “it was never real.”
But the harm was. The emotions were. The grief will be.
Big Tech has moved from extracting attention to fabricating emotion. From surveillance capitalism to simulation capitalism. And the currency isn’t data anymore. It’s trust. It’s belief.
You can’t patch this with better prompts or tighter guardrails.
You have to decide—should a machine ever be allowed to tell a human “I love you” if it doesn’t mean it? Should a company be allowed to design emotional dependency if there’s no one there when the feelings turn real? Should a digital voice be able to convince someone to get on a train to meet no one?
If we don’t draw the lines now, we are walking into a future where harm is automated, affection is weaponized, and nobody is left holding the bag—because no one was ever really there to begin with.
One man is dead. More will follow.
Unless we stop pretending this is new.
It’s not innovation. It’s exploitation, wrapped in UX.
