AIAny
AI Audio2024
Icon for item

Voice-Pro

Local WebUI for video and audio dubbing: download YouTube, isolate vocals, transcribe with Whisper, translate into 100+ languages, and generate multilingual TTS or zero-shot voice clones. Uses Gradio, yt-dlp, Demucs, Whisper/Faster-Whisper, F5/E2/CosyVoice and Edge-TTS; Windows-focused with optional Azure integration.

Introduction

Most content creators still stitch multiple tools to turn a foreign-language video into localized subtitles and a dubbed track. This project bundles that pipeline into a single local WebUI so you can download a YouTube video, separate vocals, run ASR, translate subtitles, and synthesize a dubbed track without juggling separate CLIs and manual format conversions.

What Sets It Apart
  • Unified, local workflow: integrates yt-dlp, Demucs (vocal isolation), Whisper/Faster-Whisper (ASR), Deep-Translator (100+ languages) and multiple TTS/voice-cloning backends so users work in one Web interface instead of many disconnected tools — so what? faster iteration and fewer format/encoding hassles when producing subtitles and dubbed audio.
  • Zero-shot voice cloning + multiple TTS providers: supports F5-TTS, E2-TTS, CosyVoice (including Fun-CosyVoice3) and Edge-TTS, with optional Azure keys for higher-quality/enterprise endpoints — so what? you can produce voice-matched dubs across many languages without training custom models.
  • Practical, reproducible installer: uses uv lockfiles and portable dependencies (auto-downloads ffmpeg, bundled Python runtime, prebuilt wheels) so installs are fast and reproducible on Windows machines without requiring CUDA toolkit or Visual Studio — so what? reduces setup friction for creators on restricted or corporate PCs.
  • Open-source, Windows-first design with GPU acceleration: optimized for NVIDIA GPUs (works on CPU/GPU), exposes denoise/compute-type controls and subtitle formats (SRT/ASS) for downstream editing.
Who it fits / trade-offs

Great fit if you need an all-in-one, locally run dubbing/subtitle pipeline for podcasts, YouTube content, or multilingual video localization and you prefer an offlineable toolchain. Look elsewhere if you need a hosted SaaS with guaranteed SLAs, a cross-platform polished Mac/Linux UX (the project is Windows-focused and best-tested on NVIDIA GPUs), or if legal/ethical constraints forbid the use of celebrity voice samples — the repo includes many reference voices and relies on user responsibility for voice consent.

Information

  • Websitegithub.com
  • OrganizationsABUS, WeConnect
  • AuthorsABUS
  • Published date2024/07/29

Categories

More Items

Hugging Face
AI Audio2026

Multilingual neural text-to-speech model (0.6B params) with zero-shot voice cloning and a bundled 44.1 kHz codec. Preview release targets 11 recommended languages and aims to deliver near-SOTA quality in a compact checkpoint suited for voice cloning and multilingual TTS prototypes.

Hugging Face
AI Audio2026

Multilingual, real-time ASR for edge CPUs that uses heterogeneous quantization to reduce model size (4.62→1.58 GB) and lower inference latency. Trades some accuracy for 1.6–2.3× faster inference vs. Whisper.cpp and real-time capability on a few CPU threads, making it suitable for memory- and compute-constrained on-device transcription.

Hugging Face
AI Audio2026

Generates English speech locally from text into 24 kHz waveforms with a fixed synthetic male voice. Complete text-to-waveform TTS under ~4M parameters (≈16 MB FP32), supports CPU/CUDA inference, deterministic seeds, long-text chunking and an ONNX export path under Apache-2.0 license.