Skip to main content

Telnyx Voice: Voice Design — Full Documentation

Complete page content for Voice Design (Voice section) of the Telnyx developer docs (https://developers.telnyx.com). Root index: https://developers.telnyx.com/llms.txt · Lightweight index for this subsection: https://developers.telnyx.com/development/llms/voice-voice-design-llms-txt.md

Overview

Source: https://developers.telnyx.com/docs/voice/voice-design-lab.md
The Voice Design lets you create custom voices for text-to-speech. No recording studio, no training datasets, no waiting. Start from a description. Write what you want in plain text — age, tone, accent, energy — and the AI generates it. Start from a recording. Upload an audio clip (or record one in the browser) and the AI captures that voice identity.

Design a Voice

Overview

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/concepts.md

What voice design does

Voice design generates a synthetic voice from a natural language description. You describe what you want — age, tone, accent, pacing — and the AI creates audio samples that match. This is not voice cloning. There’s no source audio. The voice is generated from scratch based on your text prompt.

The two-step flow: design → clone

The API has two separate resources:
  1. Voice Design — an intermediate artifact. Think of it as a draft. You can iterate on it (up to 50 versions per design). It is NOT usable for TTS directly.
  2. Voice Clone — a production-ready voice. Created from a design. This is what you pass to AI Assistants, Call Control, and the TTS API.
The portal hides this two-step flow behind a single “Save This Voice” button. If you’re using the API directly, you need both steps.

Quickstart

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/quickstart.md

Portal walkthrough

Select Telnyx or Minimax using the provider toggle. Write a natural language description of the voice you want — gender, age, tone, pace, texture, personality. Click Generate Samples to create three audio previews. Each reads a different script in your chosen language. Listen to each sample. Click Regenerate All to try again, or refine your description. Click Save This Voice. Give it a name and gender tag — this creates a production-ready voice clone.

Using the API

1. Create a voice design

Set "provider": "minimax" to use the Minimax provider instead.

2. Listen to the generated sample

Returns audio/wav.

3. Save as a usable voice clone

A voice design is a draft. To use it in production, save it as a clone:

Full example

Python
Node.js
Once saved, see Using Custom Voices for how to use it in AI Assistants, Call Control, and the TTS API.

Parameters

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/api-details.md

Providers

Set via the provider body parameter on POST /v2/voice_designs.

Generation Parameters

Body parameters on POST /v2/voice_designs. Telnyx provider only — ignored when provider is "minimax". The defaults are a great starting point — you can skip these parameters entirely and get good results. Adjust them later if you want to fine-tune the output.

Prompting Guide

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/design-voice/prompting-guide.md
Structure your prompt for consistent results:
Example:
Female, mid-thirties. Warm and full, slightly husky. Moderate pace, sounds like someone who smiles while talking.

Dimensions to describe

Age

Tone / Timbre

  • Deep / low-pitched — gravitas, authority
  • Smooth / rich — polished, professional
  • Gravelly / raspy — character, authenticity
  • Airy / breathy — intimate, soft
  • Warm / mellow — approachable, friendly

Gender

Male, female, or describe the sound directly: “a lower-pitched, husky female voice” or “a neutral, mid-pitched androgynous voice.”

Pacing

  • Measured / deliberate — careful, authoritative
  • Rapid-fire / quick — energetic, urgent
  • Relaxed / conversational — natural, approachable
  • Rhythmic — storytelling, narration

Emotion / Energy

  • Calm / serene — support, meditation
  • Enthusiastic / upbeat — marketing, announcements
  • Authoritative / matter-of-fact — IVR, instructions
  • Warm / empathetic — customer service, healthcare

Accent / Regional

Describe the regional quality you want. Be specific:
  • “Slight British accent” rather than “British”
  • “Neutral American” rather than just “American”
  • “Soft Southern drawl” rather than “Southern”

Use case context

Adding context helps the model understand intent:
  • “Customer service agent for a bank”
  • “Podcast narrator for true crime”
  • “Bedtime story reader for children”

Example prompts

Common pitfalls

  • Too vague — “nice voice” or “good voice” produces generic output. Be specific about at least 3 dimensions.
  • Contradictory traits — “whisper” + “booming” confuses the model. Pick a coherent set of characteristics.
  • Provider differences — the same prompt may produce noticeably different results on Telnyx vs Minimax. Try both.
  • Ignoring the preview text — the text you provide for synthesis should match the voice’s intended use. Don’t use a cheerful script for a somber voice.

The Enhance button

The portal’s Enhance button uses AI to expand a short description into a detailed prompt. This is a good starting point, but review the expanded prompt before generating — you may want to tweak specific dimensions.

Clone from Audio

Overview

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/concepts.md

What voice cloning does

Voice cloning captures a speaker’s vocal characteristics — timbre, cadence, accent, pronunciation — from a short audio sample and applies them to new speech synthesis. The clone is a representation of the voice, not a recording of it. The system learns patterns from your audio and encodes them into parameters that guide TTS. This means:
  • The cloned voice can say things the original speaker never said
  • Clone quality is bounded by what the model can learn from your sample
  • Poor recordings, background noise, or inconsistent delivery degrade the clone

What cloning doesn’t do

A clone is not a recording. It’s a statistical approximation of a voice — the model extracts patterns (formant frequencies, prosodic tendencies, spectral characteristics) and applies them during synthesis. This means:
  • Output passes through the TTS model, which has its own characteristics. A clone sounds like the speaker, but through the lens of the model.
  • Quality has a ceiling set by your source audio. No amount of API parameters will fix a noisy or inconsistent recording.
  • The clone may not handle speech styles far from the original sample well. A voice cloned from calm narration may sound different when asked to express strong emotion.

Two ways to create a clone

Both produce the same output: a voice clone with a voice ID you can use in production.

Recording best practices

  1. Match your recording to your use case. Don’t read a monotone script if you want an expressive clone. The AI replicates what it hears — including energy, emotion, and pacing.
  2. Speak clearly, avoid background noise. Use a decent microphone in a quiet space. Background noise gets cloned too. You don’t need a 10Kmica10K mic — a 100-300 USB condenser in a quiet room is sufficient.
  3. Avoid long pauses. The cloned voice will mimic pauses between sentences. Keep speech flowing naturally.
  4. Trim your recording. Speech from start to finish, no dead air at the beginning or end.
  5. Speak in the target language. If you want the clone to speak Spanish, record in Spanish.
  6. Keep it consistent. Same tone, accent, and energy throughout. Wide fluctuations confuse the model. The AI clones everything — including stutters, “uhms”, and inconsistencies.
  7. Aim for the right volume. Target -23 to -18 dB RMS with peaks no higher than -3 dB. Too quiet = noise floor issues. Too loud = clipping.
  8. Audio codec doesn’t matter much. MP3 at 128 kbps or above is fine. WAV is ideal but higher bitrate MP3 won’t noticeably hurt quality.
  9. Optimal duration by model:
    • Qwen3TTS: 5–10 seconds. Auto-trims to 10s. More isn’t better.
    • Ultra: Up to 10 seconds.
    • Minimax: 1–2 minutes is the sweet spot. Longer recordings capture more vocal range, but beyond 3 minutes yields diminishing returns.

Quickstart

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/quickstart.md

Upload a file

Select Telnyx or Minimax using the provider toggle. In the Voice Design, click Upload Audio and choose your file or drag and drop it. Enter a name for the voice and select the gender. Click Clone Voice. The system processes the audio and creates a voice clone, typically in a few seconds.

Record directly in the browser

Click Upload Audio, then select the Record tab. Select the language you’ll speak in. The system generates a reading script optimized for voice cloning. Click Start Recording and read the script clearly. It’s designed to capture the full range of phonemes. Listen to your recording. Re-record if needed, then click Clone Voice.

Using the API

Clone with Telnyx (default)

Clone with Minimax

Supports longer audio (up to 5 minutes):

Clone with Ultra model

Ultra clones use the higher-quality Ultra model. The request returns 202 Accepted — poll the clone’s status until it becomes active.
Response (202 Accepted):
Poll with GET /v2/voice_clones until status is active.

SDK Examples

Clone with Telnyx (default)

Python
Node.js

Clone with Minimax

Minimax supports longer audio (up to 20MB) and uses the speech-2.8-turbo model.
Python
Node.js

Clone with Ultra model

Ultra clones return 202 Accepted and require polling until the status is active.
Python
Node.js
Once saved, see Using Custom Voices for how to use it in AI Assistants, Call Control, and the TTS API.

Parameters

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/parameters.md

Models

Set via model_id (body) on POST /v2/voice_clones/from_upload, or use provider (body) to select Minimax.

Audio Requirements

Body parameter audio_file (multipart) on POST /v2/voice_clones/from_upload.
  • Qwen3TTS: aim for 5–10 seconds. Longer isn’t better — auto-trims to 10s.
  • Minimax: longer is better. 1–2 minutes of varied speech gives more vocal range.

The ref_text Parameter

Body parameter on POST /v2/voice_clones/from_upload. Optional. A transcript of what’s being said in the audio. Improves clone quality by giving the model a text reference to align against.

Ultra Async Flow

When model_id is "Ultra", the API returns 202 Accepted instead of 201:
Poll until ready:
See Responses for status values and voice ID format. See Errors for Minimax error codes.

Responses

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/responses.md

Voice ID Format

Every clone response includes fields to construct the voice ID: {Provider}.{Model}.{provider_voice_id} See Using Custom Voices for how to use these IDs across products.

Clone Status

Qwen3TTS and Minimax clones are always active on creation.

Errors

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/clone-voice/errors.md

General Errors

These errors apply to all providers.

Telnyx / Cartesia Errors

Minimax Errors


Using Custom Voices

Using Custom Voices

Source: https://developers.telnyx.com/docs/voice/voice-design-lab/using-custom-voices.md
Every voice clone gets a unique voice ID: {Provider}.{Model}.{voice_id}
  • Telnyx: Telnyx.Qwen3TTS.33226e69-3abd-429b-b64a-86775c9b5850
  • Minimax: Minimax.speech-2.8-turbo.TB4ZMVKanThGeldiw8rLBEg21v4ifjUTRgLpkodJxpMYV
Find it in the Voice Design by clicking on any saved voice, or build it from the clone response’s provider, provider_supported_models, and provider_voice_id fields.

AI Assistants

Select your custom voice in the assistant’s voice settings. Telnyx clones appear under Telnyx / Qwen3TTS, Minimax clones under Minimax.

Call Control

Pass the voice ID in the voice field of the speak command.

TTS WebSocket

Pass the voice ID as the voice query parameter on the WebSocket URL. See the TTS streaming guide for the full connection flow.

API Reference (Voice Design)

Voice Designs

  • List voice designs: Returns a paginated list of voice designs belonging to the authenticated account.
  • Create or add a version to a voice design: Creates a new voice design (version 1) when voice_design_id is omitted. When voice_design_id is provided, adds a new version to the existing design instead…
  • Get a voice design: Returns the latest version of a voice design, or a specific version when ?version=N is provided. The id parameter accepts either a UUID or the design name.
  • Rename a voice design: Updates the name of a voice design. All versions retain their other properties.
  • Delete a voice design: Permanently deletes a voice design and all of its versions. This action cannot be undone.
  • Download voice design audio sample: Downloads the WAV audio sample for the voice design. Returns the latest version’s sample by default, or a specific version when ?version=N is provided. The `…
  • Delete a specific version of a voice design: Permanently deletes a specific version of a voice design. The version number must be a positive integer.

Voice Clones