Write repository automation as natural-language markdown that compiles into deterministic GitHub Actions workflows running AI agents. Agents run read-only by default and write only via sanitized safe-outputs. Works with Copilot, Claude, Codex, or Gemini.
Turns OpenAI Whisper into a live streaming transcriber: audio flows in over WebSocket and text returns word-by-word instead of after full utterances. Adds SimulStreaming and LocalAgreement decoding, Silero VAD, and speaker diarization, all self-hosted.
Bridges MCP-capable AI agents (Claude, Copilot, Cursor) to 150+ offensive-security tools, letting them autonomously run pentests, vulnerability scans, and bug-bounty workflows. A decision engine picks the right tools and adapts as findings emerge.
Synthesizes up to 90 minutes of multi-speaker speech in one pass, with as many as four voices in a single conversation. Pairs continuous acoustic and semantic tokenizers at a 7.5 Hz frame rate with a next-token diffusion head on an LLM backbone.
Wraps Claude Code in a loop that re-runs it until a task is done, gating every exit behind two conditions — semantic completion plus an explicit EXIT_SIGNAL — so it never stops early. Adds rate limiting and a circuit breaker for unattended, headless runs.
Generate parametric 3D CAD models from natural language and images in the browser, with real-time preview and exports to STL/SCAD. Runs client-side via OpenSCAD WebAssembly, extracts adjustable parameters, and integrates Anthropic for shape generation—suited for rapid prototyping and 3D-printing workflows.
Isolates any single sound from a complex audio mixture using a text description, a visual cue from a video frame, or a time span, returning both the isolated target and the residual. Released in small, base, and large sizes plus visual-prompt variants.
Composes AI agent teams from a Ghost+Shell+Model formula: each Bot pairs a prompt/MCP/Skills Ghost with a Chat, ClaudeCode, or Dify shell and a model like Claude or DeepSeek. Bots form Teams that run as traceable Tasks, wired to GitHub and DingTalk.
Teaches AI agent principles and practice through a structured Chinese curriculum, pairing theory with runnable code so learners can build, debug, and extend agent systems step by step.
Generates explorable, 3D-consistent virtual worlds from a single image or short video. Includes official implementations of Lyra‑1 (feed‑forward 3D/4D scene generation via video-diffusion self-distillation) and Lyra‑2 (long-horizon, explorable generative 3D worlds). Best for research and creative prototyping; requires substantial GPU compute.
Build and self-host production voice agents with a drag-and-drop workflow builder, real-time telephony integration, and pluggable LLM/STT/TTS backends. Docker-first with an optional managed cloud offering for teams that want faster onboarding.
Extends vLLM beyond text to serve omni-modal models — Qwen3-Omni, TTS like CosyVoice3, and diffusion image/video/audio generators — in one engine, adding the non-autoregressive Diffusion Transformer support the core project never targeted.