Turns a raw idea, novel, or screenplay into a complete multi-shot video through a multi-agent pipeline that scripts, storyboards, and renders shots while a vision model checks character and scene consistency across the whole story.
Runs open-source LLMs and multimodal models entirely on mobile devices for offline, private inference. Offers Agent Skills, Thinking Mode, Ask Image, audio scribe, model management and benchmarks, with Gemma 4 and Hugging Face integration.
Demonstrates orchestration of specialist customer-service agents built with the OpenAI Agents SDK, pairing a Python backend for agent logic with a Next.js UI (ChatKit) to visualize routing, guardrails, and demo flows. Useful for prototyping multi-agent customer-service workflows; uses mock flight data and requires an OpenAI API key.
A 20B-parameter MMDiT diffusion model that generates and edits images with accurate embedded text, including dense Chinese and English typography. Handles complex multi-line layouts and identity-preserving edits while keeping text legible.
Generate parametric 3D CAD models from natural language and images in the browser, with real-time preview and exports to STL/SCAD. Runs client-side via OpenSCAD WebAssembly, extracts adjustable parameters, and integrates Anthropic for shape generation—suited for rapid prototyping and 3D-printing workflows.
Eight example apps for building with the Claude Agent SDK: an IMAP email assistant, a multi-agent research system, an Excel agent, a React/WebSocket chat UI, a .docx resume generator, and hello-world session demos. Local-only, not production.
Provides a DiT-based audio–video foundation model plus an official Python inference and LoRA trainer. Ships multiple production-ready pipelines (text/image/audio→video), checkpoints, and performance optimizations (FP8, distilled pipelines) for high-fidelity synchronized audio–video generation.
Generates anime-style and other non-photorealistic illustrations from text prompts. A 2B-parameter diffusion base preview trained on millions of anime images (and ~800k non-anime art) and released under a non-commercial license; best used in ComfyUI around ~1MP resolution.
Enables research-grade character animation with neural networks in a single NumPy/PyTorch environment — train models, run inference, and visualize results without leaving Python. Includes ECS-style architecture, mocap import (GLB/FBX/BVH), built-in renderer, and headless/standalone modes for rapid prototyping.
Transforms articulated 3D asset creation into a programmatic, LLM-driven code-generation workflow that produces objects with semantic parts, robust geometry, and physical joints. Includes CLI generation, a local viewer, and pipelines for large-scale dataset contribution.
Generates and reconstructs navigable, editable 3D worlds from text, single images, multi-view photos, or video; outputs meshes and Gaussian Splatting assets and includes WorldMirror 2.0 for fast multi-view reconstruction. Suited for research and production pipelines that import assets into engines; requires substantial GPU resources.
Generates expressive, prompt-driven text-to-speech audio with optional 10-second voice cloning; prompts control speaker identity, emotion, pauses and nonverbal sounds. An IC‑LoRA fine-tune of LTX‑2.3 that applies an imperceptible Resemble Perth watermark.