Telnyx Voice: Voice Design — Full Documentation
Complete page content for Voice Design (Voice section) of the Telnyx developer docs (https://developers.telnyx.com). Root index: https://developers.telnyx.com/llms.txt · Lightweight index for this subsection: https://developers.telnyx.com/development/llms/voice-voice-design-llms-txt.md
Overview
Source: https://developers.telnyx.com/docs/voice/voice-design-lab.mdThe Voice Design lets you create custom voices for text-to-speech. No recording studio, no training datasets, no waiting. Start from a description. Write what you want in plain text — age, tone, accent, energy — and the AI generates it. Start from a recording. Upload an audio clip (or record one in the browser) and the AI captures that voice identity.
Design a Voice
Overview
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/concepts.md
What voice design does
Voice design generates a synthetic voice from a natural language description. You describe what you want — age, tone, accent, pacing — and the AI creates audio samples that match. This is not voice cloning. There’s no source audio. The voice is generated from scratch based on your text prompt.The two-step flow: design → clone
The API has two separate resources:- Voice Design — an intermediate artifact. Think of it as a draft. You can iterate on it (up to 50 versions per design). It is NOT usable for TTS directly.
- Voice Clone — a production-ready voice. Created from a design. This is what you pass to AI Assistants, Call Control, and the TTS API.
Quickstart
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/quickstart.md
Portal walkthrough
Select Telnyx or Minimax using the provider toggle. Write a natural language description of the voice you want — gender, age, tone, pace, texture, personality. Click Generate Samples to create three audio previews. Each reads a different script in your chosen language. Listen to each sample. Click Regenerate All to try again, or refine your description. Click Save This Voice. Give it a name and gender tag — this creates a production-ready voice clone.Using the API
1. Create a voice design
"provider": "minimax" to use the Minimax provider instead.
2. Listen to the generated sample
audio/wav.
3. Save as a usable voice clone
A voice design is a draft. To use it in production, save it as a clone:Full example
Python
Node.js
Parameters
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/api-details.md
Providers
Set via theprovider body parameter on POST /v2/voice_designs.
Generation Parameters
Body parameters onPOST /v2/voice_designs. Telnyx provider only — ignored when provider is "minimax".
The defaults are a great starting point — you can skip these parameters entirely and get good results. Adjust them later if you want to fine-tune the output.
Prompting Guide
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/prompting-guide.md
Recommended format
Structure your prompt for consistent results:Female, mid-thirties. Warm and full, slightly husky. Moderate pace, sounds like someone who smiles while talking.
Dimensions to describe
Age
Tone / Timbre
- Deep / low-pitched — gravitas, authority
- Smooth / rich — polished, professional
- Gravelly / raspy — character, authenticity
- Airy / breathy — intimate, soft
- Warm / mellow — approachable, friendly
Gender
Male, female, or describe the sound directly: “a lower-pitched, husky female voice” or “a neutral, mid-pitched androgynous voice.”Pacing
- Measured / deliberate — careful, authoritative
- Rapid-fire / quick — energetic, urgent
- Relaxed / conversational — natural, approachable
- Rhythmic — storytelling, narration
Emotion / Energy
- Calm / serene — support, meditation
- Enthusiastic / upbeat — marketing, announcements
- Authoritative / matter-of-fact — IVR, instructions
- Warm / empathetic — customer service, healthcare
Accent / Regional
Describe the regional quality you want. Be specific:- “Slight British accent” rather than “British”
- “Neutral American” rather than just “American”
- “Soft Southern drawl” rather than “Southern”
Use case context
Adding context helps the model understand intent:- “Customer service agent for a bank”
- “Podcast narrator for true crime”
- “Bedtime story reader for children”
Example prompts
Common pitfalls
- Too vague — “nice voice” or “good voice” produces generic output. Be specific about at least 3 dimensions.
- Contradictory traits — “whisper” + “booming” confuses the model. Pick a coherent set of characteristics.
- Provider differences — the same prompt may produce noticeably different results on Telnyx vs Minimax. Try both.
- Ignoring the preview text — the text you provide for synthesis should match the voice’s intended use. Don’t use a cheerful script for a somber voice.
The Enhance button
The portal’s Enhance button uses AI to expand a short description into a detailed prompt.
This is a good starting point, but review the expanded prompt before generating — you may want to tweak specific dimensions.
Clone from Audio
Overview
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/concepts.md
What voice cloning does
Voice cloning captures a speaker’s vocal characteristics — timbre, cadence, accent, pronunciation — from a short audio sample and applies them to new speech synthesis. The clone is a representation of the voice, not a recording of it. The system learns patterns from your audio and encodes them into parameters that guide TTS. This means:- The cloned voice can say things the original speaker never said
- Clone quality is bounded by what the model can learn from your sample
- Poor recordings, background noise, or inconsistent delivery degrade the clone
What cloning doesn’t do
A clone is not a recording. It’s a statistical approximation of a voice — the model extracts patterns (formant frequencies, prosodic tendencies, spectral characteristics) and applies them during synthesis. This means:- Output passes through the TTS model, which has its own characteristics. A clone sounds like the speaker, but through the lens of the model.
- Quality has a ceiling set by your source audio. No amount of API parameters will fix a noisy or inconsistent recording.
- The clone may not handle speech styles far from the original sample well. A voice cloned from calm narration may sound different when asked to express strong emotion.
Two ways to create a clone
Both produce the same output: a voice clone with a voice ID you can use in production.
Recording best practices
- Match your recording to your use case. Don’t read a monotone script if you want an expressive clone. The AI replicates what it hears — including energy, emotion, and pacing.
- Speak clearly, avoid background noise. Use a decent microphone in a quiet space. Background noise gets cloned too. You don’t need a 100-300 USB condenser in a quiet room is sufficient.
- Avoid long pauses. The cloned voice will mimic pauses between sentences. Keep speech flowing naturally.
- Trim your recording. Speech from start to finish, no dead air at the beginning or end.
- Speak in the target language. If you want the clone to speak Spanish, record in Spanish.
- Keep it consistent. Same tone, accent, and energy throughout. Wide fluctuations confuse the model. The AI clones everything — including stutters, “uhms”, and inconsistencies.
- Aim for the right volume. Target -23 to -18 dB RMS with peaks no higher than -3 dB. Too quiet = noise floor issues. Too loud = clipping.
- Audio codec doesn’t matter much. MP3 at 128 kbps or above is fine. WAV is ideal but higher bitrate MP3 won’t noticeably hurt quality.
- Optimal duration by model:
- Qwen3TTS: 5–10 seconds. Auto-trims to 10s. More isn’t better.
- Ultra: Up to 10 seconds.
- Minimax: 1–2 minutes is the sweet spot. Longer recordings capture more vocal range, but beyond 3 minutes yields diminishing returns.
Quickstart
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/quickstart.md
Upload a file
Select Telnyx or Minimax using the provider toggle. In the Voice Design, click Upload Audio and choose your file or drag and drop it. Enter a name for the voice and select the gender. Click Clone Voice. The system processes the audio and creates a voice clone, typically in a few seconds.Record directly in the browser
Click Upload Audio, then select the Record tab. Select the language you’ll speak in. The system generates a reading script optimized for voice cloning. Click Start Recording and read the script clearly. It’s designed to capture the full range of phonemes. Listen to your recording. Re-record if needed, then click Clone Voice.Using the API
Clone with Telnyx (default)
Clone with Minimax
Supports longer audio (up to 5 minutes):Clone with Ultra model
Ultra clones use the higher-qualityUltra model. The request returns 202 Accepted — poll the clone’s status until it becomes active.
202 Accepted):
GET /v2/voice_clones until status is active.
SDK Examples
Clone with Telnyx (default)
Python
Node.js
Clone with Minimax
Minimax supports longer audio (up to 20MB) and uses thespeech-2.8-turbo model.
Python
Node.js
Clone with Ultra model
Ultra clones return202 Accepted and require polling until the status is active.
Python
Node.js
Parameters
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/parameters.md
Models
Set viamodel_id (body) on POST /v2/voice_clones/from_upload, or use provider (body) to select Minimax.
Audio Requirements
Body parameteraudio_file (multipart) on POST /v2/voice_clones/from_upload.
- Qwen3TTS: aim for 5–10 seconds. Longer isn’t better — auto-trims to 10s.
- Minimax: longer is better. 1–2 minutes of varied speech gives more vocal range.
The ref_text Parameter
Body parameter on POST /v2/voice_clones/from_upload. Optional.
A transcript of what’s being said in the audio. Improves clone quality by giving the model a text reference to align against.
Ultra Async Flow
Whenmodel_id is "Ultra", the API returns 202 Accepted instead of 201:
Responses
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/responses.md
Voice ID Format
Every clone response includes fields to construct the voice ID:{Provider}.{Model}.{provider_voice_id}
See Using Custom Voices for how to use these IDs across products.
Clone Status
Qwen3TTS and Minimax clones are always
active on creation.
Errors
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/errors.md
General Errors
These errors apply to all providers.Telnyx / Cartesia Errors
Minimax Errors
Using Custom Voices
Using Custom Voices
Source: https://developers.telnyx.com/docs/voice/voice-design-lab/using-custom-voices.mdEvery voice clone gets a unique voice ID:
{Provider}.{Model}.{voice_id}
- Telnyx:
Telnyx.Qwen3TTS.33226e69-3abd-429b-b64a-86775c9b5850 - Minimax:
Minimax.speech-2.8-turbo.TB4ZMVKanThGeldiw8rLBEg21v4ifjUTRgLpkodJxpMYV
provider, provider_supported_models, and provider_voice_id fields.
AI Assistants
Select your custom voice in the assistant’s voice settings. Telnyx clones appear under Telnyx / Qwen3TTS, Minimax clones under Minimax.Call Control
Pass the voice ID in thevoice field of the speak command.
TTS WebSocket
Pass the voice ID as thevoice query parameter on the WebSocket URL.
See the TTS streaming guide for the full connection flow.
API Reference (Voice Design)
Voice Designs
- List voice designs: Returns a paginated list of voice designs belonging to the authenticated account.
- Create or add a version to a voice design: Creates a new voice design (version 1) when
voice_design_idis omitted. Whenvoice_design_idis provided, adds a new version to the existing design instead… - Get a voice design: Returns the latest version of a voice design, or a specific version when
?version=Nis provided. Theidparameter accepts either a UUID or the design name. - Rename a voice design: Updates the name of a voice design. All versions retain their other properties.
- Delete a voice design: Permanently deletes a voice design and all of its versions. This action cannot be undone.
- Download voice design audio sample: Downloads the WAV audio sample for the voice design. Returns the latest version’s sample by default, or a specific version when
?version=Nis provided. The `… - Delete a specific version of a voice design: Permanently deletes a specific version of a voice design. The version number must be a positive integer.
Voice Clones
- List voice clones: Returns a paginated list of voice clones belonging to the authenticated account.
- Create a voice clone from a voice design: Creates a new voice clone by capturing the voice identity of an existing voice design. The clone can then be used for text-to-speech synthesis.
- Create a voice clone from an audio file upload: Creates a new voice clone by uploading an audio file directly. Supported formats: WAV, MP3, FLAC, OGG, M4A. For best results, provide 5–10 seconds of clear spe…
- Update a voice clone: Updates the name, language, or gender of a voice clone.
- Delete a voice clone: Permanently deletes a voice clone. This action cannot be undone.
- Download voice clone audio sample: Downloads the WAV audio sample that was used to create the voice clone.