AI Voice Cloning: How It Works and How to Do It Safely

AI voice cloning turns a short recording of a real person into a synthetic voice that can read any script you give it. You record a few clean clips, the model learns how that voice sounds, and text-to-speech does the rest. That is exactly why consent comes before the recording: clone your own voice, or someone else’s only with their clear permission.
Below: how AI voice cloning works, what US law says about consent, how to clone your own voice step by step, how to record a clean sample, how to use the voice in a film, and how to protect your own voice from scams.
What is AI voice cloning?
AI voice cloning is the process of building a reusable voice from recordings of a real speaker. The model analyzes the sample for the things that make a voice recognizable: pitch, timbre, accent, pacing and the way the speaker lands the end of a sentence. Then you type a line and hear it in that voice.
Many tools use what is often called zero-shot or instant cloning: the model already knows how speech works in general, so it only needs a short sample to imitate one specific voice. “Professional” cloning trains on much longer recordings for a closer match. Either way, the quality of the input sets the ceiling for the output.
Voice cloning is one of three different voice tools, and they are easy to mix up:
| Tool | What goes in | What comes out | Use it when |
|---|---|---|---|
| Voice cloning | Recordings of a real speaker | A reusable voice that sounds like that person | You want narration in your own voice, or a consenting actor’s |
| Voice design | A written description | A new voice that belongs to no real person | You need a character voice and nobody to clone |
| Speech-to-speech | A recorded performance | The same performance in a different voice | You like your delivery but want another voice to carry it |
In CinemaDrop, cloning and design both run on Fish Audio, and speech-to-speech converts a recording into an ElevenLabs voice. Speech-to-speech is not cloning, and the docs say Fish Audio voices aren’t available for it, so a clone you make is used through text-to-speech instead.

Is AI voice cloning legal? Start with consent
Cloning your own voice is the low-risk case. Cloning someone else’s voice is where the legal and ethical risk sits, and the safest rule is simple: don’t clone a voice unless it’s yours or you have the speaker’s explicit permission. This section is general information about US rules as of November 18, 2026. It is not legal advice, and laws differ by state and country.
A few rules already apply to voice clones:
- Robocalls: on February 8, 2024, the FCC ruled that calls made with AI-generated voices are “artificial” under the Telephone Consumer Protection Act. In the FCC’s words, the ruling “makes voice cloning technology used in common robocall scams targeting consumers illegal” (FCC news release).
- Tennessee’s ELVIS Act: signed on March 21, 2024 and in effect since July 1, 2024, it adds voice to the personal rights Tennessee protects, including a simulation of a person’s voice, not just recordings of it (Tennessee General Assembly, HB 2091).
- The federal NO FAKES Act would create a federal right to control digital replicas of a person’s voice and likeness. A revised version (S. 4591) cleared the Senate Judiciary Committee on June 18, 2026, but as of November 18, 2026 it has not passed the Senate, so it is not law.
A checkbox in a tool doesn’t settle what “explicit permission” means. If you clone an actor, a client or a friend, get it in writing and make it specific:
- Whose voice it is, and that they agree to it being cloned.
- What you’ll use it for, such as one short film, a series, or ads.
- How long you can use it, and whether you may edit or translate the lines.
- That they can withdraw permission, and what happens to the voice if they do.
Never clone a celebrity, a politician or a stranger from a clip you found online. For the wider picture on likeness and real people in AI films, see whether it’s legal to make a movie with AI.
How to clone your voice with AI, step by step
Here’s how voice cloning works in CinemaDrop, where it’s available on every plan, including the free Lite plan. Each clone costs 20 credits, and speech you generate with it is charged separately. The steps below follow CinemaDrop’s clone your own voice guide.
- Open Create voice, which you reach from Generate speech on Text to speech, or from Add voice on a character Element.
- Choose Clone my voice, enter a voice name, and pick Female, Male or Gender-neutral.
- Choose Record my voice or Upload audio. You can add up to 3 clips in MP3, WAV, M4A, OGG or WebM, each 20 MiB or smaller and 45 MiB together. A single recording stops at 60 seconds.
- Keep the total between 10 seconds and 3 minutes. A clip under 10 seconds shows a “Short clip” warning.
- Tick the consent box: “I confirm this is my voice, or I have explicit permission from the speaker to clone it.” You can’t continue until it’s checked.
- Choose Create voice clone. When it finishes, the status reads Voice saved, labeled Cloned voice · Fish Audio · Public.
The new voice lands in My voices. From there you can use it to generate speech or assign it to a character.
How to record a voice sample that clones well
A clone copies everything in the sample, including the room and the hum of a laptop fan. CinemaDrop’s guide suggests 2–3 clean clips of 15–20 seconds, with one speaker, a steady volume and no background music. A few habits get you there:
- Pick a quiet, soft room. A closet full of clothes or a small room with a rug and curtains beats a bare kitchen. Hard walls add echo that the clone will learn.
- Keep the mic at one distance. About a hand’s width from your mouth, slightly off to the side, keeps plosives down and the volume steady. A phone works if it doesn’t move.
- Read the way you want to sound. If the clone will narrate a calm documentary, record calm narration. A rushed read becomes a rushed voice.
- Vary the lines. Mix statements, a question or two and a sentence with emphasis, so the model hears your range instead of one flat pattern.
- One speaker only. No co-host, no TV in the next room and no music bed.
- Listen back before you upload, and re-record any clip with a cough, a long silence or a car horn.

Your cloned voice is public: what that means
Voice cloning guides rarely say whether your clone stays private. CinemaDrop says it plainly: created voices, both cloned and designed, are public by design. The notice in the create window reads, “All created voices are public. If you need your voice to be private, please reach out to us.”
In practice, that means:
- Treat any voice you create as public, not as a private file.
- If you need a private voice, for a client or for your own reasons, reach out to CinemaDrop, as the notice says.
- If you only need a voice for a character, consider designing one instead of cloning a real person.
AI voice design: make a voice instead of cloning one
Voice design skips the recording. You describe the voice in words, up to 2,000 characters, choose a gender and create it. In CinemaDrop it also runs on Fish Audio, costs 20 credits and is on every plan, including Lite. Designed voices are saved to My voices and are public, like clones.
Design is the better choice when:
- You’re voicing a fictional character, such as an old sea captain or a robot narrator.
- You don’t have permission to clone the person you had in mind.
- You want several distinct voices for a test cut of a cast.
Be specific in the description: age, accent, pace, texture and mood. “A weathered male voice, slow and gravelly, with a coastal New England accent” gives the model far more to work with than “old man”. The design a voice guide walks through the form.
What to do with your AI voice clone
Here’s how a cloned voice fits into a film in CinemaDrop:
- Narration. Pick the voice in Generate speech, paste up to 5,000 characters of script and generate. Text-to-speech costs 1 credit per 10 characters, rounded up, on every plan. On Lite, after the 20-credit clone, the rest of the 500 one-time credits covers several thousand characters of speech. For writing lines that sound spoken and mixing the track under picture, see how to add AI voiceover to a video.
- A character’s voice. You can assign the voice to a character Element. The docs say character voices are experimental and are designed to guide that character’s dialogue in supported Kling 4.0 (Basic and up) and Seedance 2.5 (Plus and up) generations, and that matching can vary. The character voices guide covers the setup.
- A talking face. Generate the line, then use lip sync on Basic and up to match it to a face. See AI lip sync for filmmakers or how to make a still photo talk.
- The final cut. Bring the speech into the desktop timeline editor, mix it with music and sound effects, and export an MP4. The editor is on every plan, including Lite.
Two limits to keep in mind. Lite is for personal, non-commercial use only, so client work and monetized videos need Basic or above. And a cloned voice is not a translation tool: putting your film into another language is a separate job, covered in our guide to AI dubbing and video translation.
Why a voice clone sounds off, and how to fix it
Most bad clones come from the sample or the script, not the model:
| Problem | Likely cause | Fix |
|---|---|---|
| Robotic or flat delivery | A monotone sample, or a script with no punctuation | Re-record with more natural variation, and write shorter sentences with commas and full stops |
| Echo or hiss in every line | Room noise baked into the sample | Record in a softer, quieter space and recreate the clone |
| Accent or tone drifts | Too little audio, or clips recorded in different moods | Use 2–3 consistent clips closer to the recommended length |
| Clipped or rushed endings | Long, run-on lines | Split the script into shorter lines and generate them separately |
| Wrong emotion for the scene | The text gives no cue | Use Add a cue in Generate speech, such as [whispers] or [excited] |
Listen to every line before it goes in the edit. A clone can sound right on one sentence and wrong on the next.
How to protect your own voice from cloning scams
The same technology that narrates your film can be misused. The FCC warns that scammers now clone the voices of loved ones to make fake emergency calls more believable. Its consumer guide on these scams recommends a few simple steps:
- Don’t trust the voice alone. If a caller who sounds like family asks for money, hang up and call them back on the number saved in your contacts.
- Agree on a family safe word. Pick a word or phrase ahead of time that only your family knows, and don’t post it anywhere.
- Treat pressure as a red flag. Requests to pay right away by wire, gift card or payment app are classic signs of a scam.
- Report it. The FCC points people to the FTC to report fraud.
For creators, one more habit helps: be deliberate about where long, clean recordings of your voice live, because a public voice sample is easy to copy.
AI voice cloning FAQ
Can I clone my voice for free?
Yes. Free AI voice cloning is part of CinemaDrop’s Lite plan: a clone costs 20 of its 500 one-time credits, and no credit card is needed to sign up. Lite is for personal, non-commercial use, and it doesn’t include video generation.
How much audio do I need to clone a voice?
In CinemaDrop, between 10 seconds and 3 minutes in total, across up to 3 clips. The guide suggests 2–3 clean clips of 15–20 seconds each.
Can I clone someone else’s voice?
Only with their explicit permission. CinemaDrop won’t create a clone until you confirm the voice is yours or that you have the speaker’s explicit permission. Get that permission in writing, and say how the voice will be used.
Is my cloned voice private?
Not on CinemaDrop. Created voices, cloned and designed, are public by design. If you need your voice to be private, reach out to CinemaDrop.
What’s the difference between voice cloning and voice design?
Cloning copies a real person’s voice from recordings. Design creates a new voice from a written description, so no real speaker is involved. Both cost 20 credits in CinemaDrop and run on Fish Audio.
What is the best voice cloning AI?
The best one depends on what you’ll do with the voice. If it’s for a film, look for a clear consent step, honest rules about who can access the voice, and a way to use it in your edit, not just a download button.
Can I use my cloned voice for a character in a video?
The docs say yes, as an experimental feature: assign the voice to a character Element, and supported Kling 4.0 and Seedance 2.5 generations are designed to use it for that character’s dialogue. Matching can vary, so check every clip.
Clone your voice the right way
AI voice cloning is easy to do and easy to misuse, so do it in the right order: get consent, record a clean sample, create the voice, then listen to every line. When cloning a real person isn’t yours to do, design a voice instead.
To try it, clone your voice in CinemaDrop on any plan, including free Lite. Plan details are on the CinemaDrop pricing page.



