Generates 48kHz multilingual speech from text using a tokenizer-free diffusion-autoregressive TTS architecture, supporting natural-language voice design, controllable cloning, and low-latency streaming. Notable for a 2B-parameter backbone and built-in AudioVAE super-resolution (16k→48k).
Local-first voice workflows for cloning, multi-engine TTS/ASR, video dubbing, dictation, transcription and audiobook production across 646 languages. Desktop app with a local OpenAI-compatible API, engine catalogue (TTS/ASR/LLM), and explicit opt-ins for remote features to keep audio and projects on-device.
Desktop app for local voice cloning, real-time dictation, and end-to-end video dubbing using zero-shot TTS across 600+ languages; features multi-engine TTS/ASR, speaker diarization, vocal isolation, batch pipelines, and invisible audio watermarking — all run fully offline.
Automates video editing driven by LLM agents: reads word-level transcripts to propose and execute cuts, remove filler words, auto grade color, burn subtitles, and generate animation overlays. Self-evaluates every cut before showing a preview; aimed at talking-heads, tutorials and interviews.
Turns books, long videos, and podcasts into executable, testable AI agent skills using a structured RIA‑TV++ pipeline. Produces multi-file skill packs (BOOK_OVERVIEW.md, SKILL.md, INDEX.md, DIGEST.md), applies triple verification and pressure tests, and can install skills into Claude Code/Cursor for agent use.
Generates expressive, prompt-driven text-to-speech audio with optional 10-second voice cloning; prompts control speaker identity, emotion, pauses and nonverbal sounds. An IC‑LoRA fine-tune of LTX‑2.3 that applies an imperceptible Resemble Perth watermark.
Unified multimodal LLM for enterprise workflows: ingests video, audio, image and text to perform transcription, OCR, Q&A, summarization and long-context reasoning. Provides BF16/FP8/NVFP4 weights and integrations with vLLM, TensorRT-LLM and other runtimes.
Benchmarks ASR on long-form English call-center conversations with wide accent coverage; 128.6 hours across 14 accent groups and 16 service domains, designed for segmentation-sensitive evaluation and intended for evaluation/analysis (CC BY‑SA 4.0).
Provides a lightweight assistant (draft) model for Gemma 4 E4B used in speculative-decoding pipelines — it predicts token drafts that the target model verifies in parallel, enabling up to ~2× decoding speedups while preserving identical final outputs. Useful for low-latency, multimodal assistant and on-device scenarios.
Unifies video, audio, image and text understanding for enterprise Q&A, summarization, transcription and document intelligence. The NVFP4 quantized variant reduces footprint to ~20.9GB for more efficient single‑GPU deployment and is tuned for NVIDIA runtimes (vLLM, TensorRT).
Generates expressive, scene-aware speech from XML-style prompts and supports zero-shot voice cloning from 10–20s references. Produces emotional acting, ambient SFX, multilingual output, and continuous long-form narration; requires large model weights and gated Gemma text-encoder access.
Unified omnimodal foundation model for text, image, video and audio understanding and agentic workflows, with support for up to 1M-token context. Combines a sparse MoE LLM backbone, dedicated vision/audio encoders, multi-token prediction, and a hybrid sliding-window + global attention design to reduce KV-cache overhead.