Generates streaming, low‑latency neural speech for real‑time dialogue by autoregressively producing audio frames as text arrives; joint text–speech training preserves natural prosody. Optimized for vLLM streaming (~50 ms first chunk), supports short‑clip voice cloning and four languages.
Browser-based photorealistic 3D globe that visualizes live public signals — flights, ships, satellites, earthquakes, traffic and public cameras — paired with a realtime AI voice agent for entity Q&A, scene summaries and hands‑free navigation.
Local English text-to-waveform TTS producing a single fixed synthetic voice in a deployable package below 10M parameters. Offers deterministic seeds, punctuation-aware long-text chunking, CPU/CUDA and ONNX runtime options, measured evaluations and a compact FP32 footprint; English-only, one voice.
Generates English speech locally from text into 24 kHz waveforms with a fixed synthetic male voice. Complete text-to-waveform TTS under ~4M parameters (≈16 MB FP32), supports CPU/CUDA inference, deterministic seeds, long-text chunking and an ONNX export path under Apache-2.0 license.
Generates real-time, infinite-length interactive videos of voice-controllable digital characters — 540p at up to 42 FPS on consumer GPUs. Uses TurboDiffusion and TurboServe to maintain temporal coherence without blur or drift, and accepts custom person, anime, or pet images plus selectable voice tones.
Multilingual, real-time ASR for edge CPUs that uses heterogeneous quantization to reduce model size (4.62→1.58 GB) and lower inference latency. Trades some accuracy for 1.6–2.3× faster inference vs. Whisper.cpp and real-time capability on a few CPU threads, making it suitable for memory- and compute-constrained on-device transcription.
Multilingual neural text-to-speech model (0.6B params) with zero-shot voice cloning and a bundled 44.1 kHz codec. Preview release targets 11 recommended languages and aims to deliver near-SOTA quality in a compact checkpoint suited for voice cloning and multilingual TTS prototypes.
An end-to-end 11B full-duplex speech model for real-time conversational AI that jointly performs streaming speech understanding and generation, enabling ~450 ms turn-taking, barge‑in and live tool calling in a single unified architecture; research use only.
Generates multi‑speaker speech and environmental audio from textual instructions or a reference clip, supporting zero‑shot voice cloning and detailed scene/specification control. Combines a cleaned, captioned dataset with a VAE-based multimodal generator, reward-conditioned quality control, and staged training to improve expressiveness and multi-audio modeling.
Runs persistent, self-hosted AI teammates that retain conversation, memory, routines and a sandboxed browser/shell. Supports bring-your-own models, local or remote sandbox providers, voice, team computers and integrations for auditable, controllable agent workflows.
Generates and edits speech from natural-language instructions plus optional reference audio, supporting zero-shot TTS, content/acoustic/paralinguistic edits, enhancement, and source separation. Open-source 1.5B-parameter base model with a 4-step distilled AuK‑Flash for faster inference.