AIAny
AI Audio2025
Icon for item

Kitten TTS

Provides text-to-speech synthesis and one-shot voice cloning via compact ONNX models and a larger KittenTTS 2 speech model. Offers CPU-first inference (25–506 MB models), 47 built-in voices, multilingual output, expression tags, streaming, and a Python SDK.

Introduction

Kitten TTS matters because it removes the GPU barrier for many TTS workflows while still offering a path to higher-fidelity, in-context voice cloning. Instead of forcing you to choose only tiny offline models or a separate cloud service, the project ships both extremely small ONNX runtimes for edge use and a much larger KittenTTS 2 model for cloning and expressive speech.

What Sets It Apart
  • Two-tier shipping model: tiny CPU-optimized ONNX models (15–80M parameters, ~25–80 MB in quantized form) for local, low-latency inference, plus KittenTTS 2 (≈1.7B ternary weights, ~506 MiB) for in-context voice cloning and expressive control. This lets teams prototype and deploy on-device, then scale up to cloning quality when needed.
  • Voice cloning and expression control: one-request reference-based cloning from 5–30s of audio, plus bracketed emotion tags, inline event tags and emphasis spans to steer delivery without fine-tuning.
  • CPU-first engineering and streaming: optimized ONNX runtime paths, optional vLLM/cpp backends, chunk-aware streaming with sentence-level joins, and common output formats (wav/mp3/etc.).
  • Practical developer ergonomics: a Python SDK, 47 built-in voices across ~20 languages, text normalization, and explicit options for different decoder/weight presets.
Who It's For and Trade-offs

Great fit if you need: edge or embedded TTS that runs without a GPU; a reproducible local runtime for demos and apps; or an easy migration path to a higher-quality, clone-capable model. Product teams benefit from the lightweight ONNX variants for client devices and KittenTTS 2 for server-side cloning.

Look elsewhere if you require: guaranteed commercial licenses for every weight (models carry separate licenses and KittenTTS 2 uses a Stellon Labs Community License), the absolute highest-fidelity studio-grade TTS without increased resource cost, or strict token-level streaming (KittenTTS streams at chunk level). Also consider ethical and legal constraints when using voice cloning features.

This introduction focuses on where the project changes architectural trade-offs: it deliberately spans tiny on-device models and a larger, clone-capable speech language model so teams can choose latency/size versus cloning expressiveness without switching ecosystems.

Information

  • Websitegithub.com
  • OrganizationsKittenML, Stellon Labs
  • Published date2025/08/05

Categories

More Items

Hugging Face
AI Audio2026

Generates directed, multi-character, long-form speech from text with natural-language directions and voice cloning. Built on a 35B MoE backbone (3B active per token) with a codebook multi-token-prediction decoder to enable multi-turn revision, infilling edits, streaming, and expressive control.

GitHub
AI Audio2025

Generates full songs from lyrics and style prompts by first writing an editable melody-and-chord score and then rendering vocals and accompaniment. Unifies symbolic planning and audio synthesis in one pipeline, enabling readable score inspection, zero‑shot covers, and agent-driven editing.

Hugging Face
AI Audio2026

On-device speech-to-text for short clips (up to 30s) in seven languages, yielding transcripts, word-level timestamps and per-frame speech embeddings in a single 16.9 MB model. Runs on the Needle CPU engine with 2–4 bit quantization, supports keyword biasing and returns empty transcripts for silence.