Voice Cloning Is Too Good, and That's the Problem

ElevenLabs makes voices that are indistinguishable from the real thing, and I've used it to narrate things I'd never have recorded myself. The quality is not the issue. Consent is.

A cloned voice is someone's identity rendered as a file. If you clone a voice, you need the person's explicit, documented permission, period. No 'it's just for a demo' exceptions.

The cost scales with characters, which is fair, but the risk scales with how believable the output is, and that's not priced in anywhere.

I keep a strict rule: only clone voices I own or have written permission to use, and I label synthetic audio as synthetic. It's not paranoia; it's the difference between a tool and a liability.

The tech is wonderful. The ethics are not automatic. The person building the pipeline is the only safeguard that exists right now.