Provides an uncensored, self‑hostable studio for generating AI images, videos, and lip‑synced talking videos in browser or desktop. Integrates 200+ models via Muapi.ai, supports local inference (stable-diffusion.cpp), multi-image inputs and workflow automation — no content filters.
Reference implementation for Stability AI's diffusion models: SDXL base/refiner/Turbo for text-to-image, plus Stable Video Diffusion, SV3D, and SV4D for image-to-video and 4D synthesis. A modular engine separates samplers, guiders, and conditioners.
Swaps a face from a single photo onto a live webcam feed or video in real time, using the inswapper_128 model with GFPGAN enhancement. Runs on NVIDIA, Apple Silicon, and Intel GPUs, with a built-in filter that blocks explicit or sensitive media.
Converts videos between languages by transcribing audio, translating subtitles, and producing AI dubbing—supports local and online ASR/LLM/TTS providers, speaker diarization, voice cloning, and GUI/CLI workflows for batch or headless use.
Automates uploading and scheduled publishing of videos to major Chinese and international social platforms (Douyin, Bilibili, Xiaohongshu, Kuaishou, WeChat Video Channel, TikTok, etc.). Offers a CLI, platform-specific uploader modules, headless/browser automation and agent-skill integration for scripted cross-posting workflows.
Automates online monetization workflows—generating and scheduling YouTube Shorts, posting to X (Twitter), running affiliate campaigns, and outreach. Modular provider-based design (TTS, LLM hooks, CRON scheduler) and configurable pipelines; legal/ToS risks mean use with caution.
Generates HD short videos from a single topic/keyword — auto-creates script, finds/assembles footage, generates subtitles, TTS and background music. Offers web UI + API, batch mode, multiple LLM/TTS providers and common short-video aspect ratios.
Generates short videos from text, images, or videos and ships a full training/inference pipeline with checkpoints and demos. Key features include multi-stage training (VAE / 3D-VAE), rectified-flow training, video compression modules, and support for 2s–16s clips at up to 720p. Best for researchers and engineers who can provide substantial GPU resources.
Generates Netflix-quality single-line subtitles and optional dubbing for videos by automating download, ASR, word-level alignment, translation, terminology management and TTS integration. Emphasizes word-level alignment with WhisperX and cinematic translation/adaptation for cleaner, single-line subtitles and smoother dubbing.
Reference architectures and microservices for building GPU-accelerated vision agents that enable natural-language video search, long-video summarization, visual Q&A, and alert verification. Integrates NVIDIA NIM models, embeddings, VLMs/LLMs, and agent workflows for deployable video-analytics stacks.
VideoCaptioner is an AI-powered video subtitling assistant that combines ASR (local or cloud) with LLM-based subtitle segmentation, correction and translation. It supports offline GPU transcription, concurrent chunk transcription, VAD, speaker-aware processing, batch subtitling and one-click subtitle-to-video synthesis, with both GUI and CLI options.
Generates video from text or images via a DiT-based latent diffusion model: text-to-video, image-to-video, frame extension, and multi-keyframe conditioning in one model. A distilled 2B variant runs near real-time on one H100; 13B for higher quality.