AI Audio2023
Terminal CLI for on-device Whisper ASR using Hugging Face Transformers + Optimum, with optional Flash Attention 2, batching, and diarization support — focused on high-throughput transcription on NVIDIA GPUs and Apple Silicon (mps).
AI Audio2023
Unifies text-to-speech, singing voice synthesis, voice conversion, and text-to-audio/music in one PyTorch framework with shared vocoders and a common evaluation pipeline. Ships recipes, pretrained checkpoints, and visualizations of classic models.
AI Audio2023
Performs speaker diarization (who spoke when) with pyannote-audio: combines voice-activity detection, speaker-change and overlapped-speech detection to produce time-stamped speaker segments; compatible with Hugging Face Endpoints and ASR pipelines.
AI Agent2023
Builds realtime voice AI agents that run as server-side participants in WebRTC rooms — mix STT, LLM, and TTS providers or use one realtime model. Adds semantic turn detection, SIP telephony, multi-agent handoffs, and an LLM-judge test harness.
AI Audio2023
Builds real-time voice and multimodal AI agents as composable streaming pipelines. Vendor-neutral: swap among 20+ STT, 20+ LLM and 30+ TTS providers over WebRTC or WebSockets, and compose multi-agent systems with handoff and parallel workers.
AI Audio2024
Lets AI agents place and answer business phone calls, holding spoken conversations to collect structured data, answer questions, and escalate to humans. Built on Azure Communication Services and Azure OpenAI, with RAG over your own documents.
AI Audio2024
Clones a voice from a 5-second sample for zero-shot TTS, or fine-tunes on ~1 minute of audio for few-shot synthesis. Covers Chinese, English, Japanese, Korean, and Cantonese, with a WebUI bundling vocal separation, ASR, and dataset labeling.
AI Audio2024
Converts e-books (epub, pdf, mobi, docx, and more) into chapter-aware audiobooks, with optional zero-shot voice cloning. Bundles eight TTS engines including XTTSv2 and Bark, and covers 1,158 languages via Meta's MMS — all runnable on CPU or GPU.
AI Video2024
Automates online monetization workflows—generating and scheduling YouTube Shorts, posting to X (Twitter), running affiliate campaigns, and outreach. Modular provider-based design (TTS, LLM hooks, CRON scheduler) and configurable pipelines; legal/ToS risks mean use with caution.
MCP Server2024
Continuously records your screen and audio 24/7 to a local, searchable timeline you can query in natural language. Stores screenshots with accessibility data in SQLite, and a plugin system runs scheduled AI agents on what it captures.
AI Audio2024
Open-source TTS that clones a voice from 3-10s of audio and synthesizes cross-lingual speech in 9 languages and 18+ Chinese dialects. Supports streaming at ~150ms latency with instruction control over emotion, speed, and accent.
AI Audio2024
Chains four swappable open modules — voice activity detection, speech-to-text, an LLM, and text-to-speech — into a local voice agent that needs no proprietary APIs. Runs on CUDA, Apple Silicon, or Docker, with an OpenAI-compatible realtime WebSocket mode.