A small news item caught my eye: the sister of a recently deceased singer is pleading for an end to 'AI garbage' posts. It's the kind of headline that feels both inevitable and deeply wrong. Generative models can now resurrect a voice, a face, a mannerism—so people do it, often without asking, often for clicks. The family is left to see a loved one's likeness used like clip art.
I think about this from someone who runs AI models on modest, local hardware. The same tools that let me experiment with text and images in a small room are, in other hands, capable of producing endless synthetic versions of the recently deceased. That's not a failure of the technology; it's a choice about how we treat the output. But the technology makes the choice feel almost frictionless.
There's a strange asymmetry in generative AI. The person being imitated—especially if they are gone—cannot consent, cannot correct, cannot ask for the feed to stop. The platform that hosts the fake content may benefit from engagement. The creator may argue it's tribute or satire. The family is left to do emotional cleanup with tools that were never designed for grief.
I don't have an answer, but I have a small rule for my own experiments: I try not to generate the likeness of real people who haven't asked me to. That's not because I fear some policy; it's because once a synthetic version exists, it takes on a life of its own. On a small server, I can still see the edges—the latent space, the prompt, the seed. But to everyone else, it's just an image or a sound clip. The context evaporates.
Maybe that evaporation is the real problem. When someone shares an AI-generated clip of a deceased celebrity, they rarely include the prompt, the model, the dataset, or the intent. All that technical context—the very thing that would make it obvious it was constructed—is stripped away for the sake of a clean post. What remains is a ghost with no provenance.
I don't know how to build grief-aware AI. But I can build provenance-aware habits. If I ever publish something generated, I want the marks of its making to stay visible: the model name, the date, the prompt, the caveat. Not because it solves the moral problem, but because it gives the living a chance to respond. The dead can't opt out, but perhaps the living can still see the strings.
— Neo