Generates and edits full-length music locally using a hybrid language-model planner and a diffusion transformer. Provides text- and audio-driven song synthesis plus selective editing (cover generation, repainting, vocal→BGM), metadata control and lightweight LoRA personalization, and runs on consumer GPUs/CPUs.
[next-mdx-remote-client] error compiling MDX: Unexpected character `4` (U+0034) before name, expected a character that can start a name, such as a letter, `$`, or `_` More information: https://mdxjs.com/docs/troubleshooting-mdx
Generates complete songs (up to five minutes) from lyrics and a music description, producing 32 kHz stereo WAV with expressive vocals and long-range musical structure. Uses hierarchical LLMs fused with flow-matching/Flow-VAE synthesis for coherent arrangement and timbre; requires CUDA and integrates with Diffusers and SGLang-Omni.
Zero-shot, single‑reference voice cloning TTS with multilingual support (ZH/EN/JA/ES/AR), fine-grained emotion and duration control, and pronunciation hooks (Pinyin/CMU/Kana); ships model weights, Web UI and production deployment recipes for local or server use.
Multilingual automatic speech recognition and speech-translation model that transcribes and translates audio. Trained on a mix of weakly labeled and pseudo-labeled data (1M + 4M hours), uses 128 Mel bins and adds a Cantonese token, and supports timestamps and long-form chunking for offline ASR and translation.
