Provides tools and samples to build context management, enrichment, and retrieval solutions on Google Cloud Knowledge Catalog — an AI-oriented data catalog that builds a dynamic knowledge graph for structured and unstructured data, suitable for RAG and agent workflows.
Defines OpenTelemetry semantic conventions for generative AI telemetry — spans, metrics, and events for GenAI clients, the Model Context Protocol (MCP), and provider-specific integrations. Includes YAML models, human-readable docs, and reference implementations to standardize observability across GenAI deployments.
Node-based infinite-canvas web workstation for iterative visual creation — integrates image/video generation, reference editing, prompt library, multi-agent assistants, and asset management. Runs in-browser with configurable OpenAI-compatible endpoints; suited for local/personal deployment (AGPL-3.0).
Routes LLM API traffic across providers by translating OpenAI, Anthropic, and OpenAI Responses formats, and orchestrates multi-backend routing with typed algorithms and Prometheus metrics. A Rust proxy/library offering launcher, standalone server, and embeddable routing components; experimental (pre-alpha).
Converts text into expressive conversational speech across 100+ languages with zero-shot voice cloning and inline control tokens for emotion, style, prosody, pauses, and sound effects. Released under a research/non-commercial license; commercial use requires separate licensing.
An agentic multimodal coding model for long-horizon software tasks: MoE architecture (1T params, 32B activated), 256K context, image/video input, native int4 quantization and preserved chain-of-thought (thinking) mode. Tuned for multi-step coding workflows and vLLM/SGLang deployment.
Generates streaming, low‑latency neural speech for real‑time dialogue by autoregressively producing audio frames as text arrives; joint text–speech training preserves natural prosody. Optimized for vLLM streaming (~50 ms first chunk), supports short‑clip voice cloning and four languages.
Converts low‑poly 3D viewport or game/CG renders into photorealistic cinematic video while preserving the input's composition, camera motion and layout; offers Light and Strong LoRA variants to trade fidelity for aggressive photorealism.
Generates synchronized stereo audio and video from multimodal inputs (text, images, video, audio), producing 4–15s clips at 24 FPS with a 768p base and an in‑context regeneration path to 2K; supports first/last‑frame and multi‑reference modes and ships as two task‑specific checkpoints.
A 27B-parameter causal language model with a native vision encoder for image/video+text understanding, long-horizon agentic tasks, and tunable thinking-mode reasoning. Native 262,144-token context (extensible to 1,000,000) and production-focused inference recipes.
Generates complete songs (up to five minutes) from lyrics and a music description, producing 32 kHz stereo WAV with expressive vocals and long-range musical structure. Uses hierarchical LLMs fused with flow-matching/Flow-VAE synthesis for coherent arrangement and timbre; requires CUDA and integrates with Diffusers and SGLang-Omni.
An experimental multimodal model that adds visual understanding to DeepSeek-V4-Flash: accepts text+image inputs and returns text analyses. Improves vision-dependent agent workflows while maintaining comparable text-only performance; released under an MIT license on Hugging Face.