Swaps a face from a single photo onto a live webcam feed or video in real time, using the inswapper_128 model with GFPGAN enhancement. Runs on NVIDIA, Apple Silicon, and Intel GPUs, with a built-in filter that blocks explicit or sensitive media.
Converts videos between languages by transcribing audio, translating subtitles, and producing AI dubbing—supports local and online ASR/LLM/TTS providers, speaker diarization, voice cloning, and GUI/CLI workflows for batch or headless use.
Provides a diffusion-model studio for image, video, audio-video, editing, LoRA, and full training workflows so many model families share one inference and training framework.
Runs GPT-4o-class vision, speech, and full-duplex audio-video conversation on a 9B model small enough to deploy on phones and tablets. The 4.5 release scores 77.6 on OpenCompass and adds real-time bilingual voice with voice cloning.
Automates online monetization workflows—generating and scheduling YouTube Shorts, posting to X (Twitter), running affiliate campaigns, and outreach. Modular provider-based design (TTS, LLM hooks, CRON scheduler) and configurable pipelines; legal/ToS risks mean use with caution.
Generates HD short videos from a single topic/keyword — auto-creates script, finds/assembles footage, generates subtitles, TTS and background music. Offers web UI + API, batch mode, multiple LLM/TTS providers and common short-video aspect ratios.
Generates short videos from text, images, or videos and ships a full training/inference pipeline with checkpoints and demos. Key features include multi-stage training (VAE / 3D-VAE), rectified-flow training, video compression modules, and support for 2s–16s clips at up to 720p. Best for researchers and engineers who can provide substantial GPU resources.
Accelerates video generation with a unified framework for inference, finetuning, LoRA, distillation, sparse attention, and distributed execution for research and demos.
BYOK desktop app working as a universal MCP client: run any MCP server against OpenAI, Anthropic, Gemini, Grok, Ollama and 10+ providers. Also offers prompt-anywhere, AI text commands, local-file RAG, media generation and voice input.
Reference architectures and microservices for building GPU-accelerated vision agents that enable natural-language video search, long-video summarization, visual Q&A, and alert verification. Integrates NVIDIA NIM models, embeddings, VLMs/LLMs, and agent workflows for deployable video-analytics stacks.
VideoCaptioner is an AI-powered video subtitling assistant that combines ASR (local or cloud) with LLM-based subtitle segmentation, correction and translation. It supports offline GPU transcription, concurrent chunk transcription, VAD, speaker-aware processing, batch subtitling and one-click subtitle-to-video synthesis, with both GUI and CLI options.