Orchestrates low-latency, multi-stage pipelines for omni and multimodal models by running each stage with its own scheduler and using zero-copy shared memory for tensor transfer. Emphasizes per-stage bottleneck tuning and OpenAI-compatible streaming endpoints, suitable for TTS and multimodal serving.
Enables research-grade character animation with neural networks in a single NumPy/PyTorch environment — train models, run inference, and visualize results without leaving Python. Includes ECS-style architecture, mocap import (GLB/FBX/BVH), built-in renderer, and headless/standalone modes for rapid prototyping.
Train robot reinforcement-learning agents with a heterogeneous runtime that streams CPU-parallel physics simulations (MuJoCo / Motrix) via shared memory into GPU/accelerator policy learners; provides a unified CLI, cross-platform backend support and demo checkpoints.
A TypeScript framework for building programmable, headless autonomous agents with a harness-centric runtime. Includes an SDK and CLI, virtual sandboxes (just-bash) with optional full container sandboxes, provider-agnostic model settings, and connectors for CI/Daytona/MCP—suited for deployable agent runtimes.
Framework for running agents inside real applications — it exposes shared actions, SQL-backed state, tools, skills, jobs and UI surfaces so agents can act on app state instead of just chatting. Backend-agnostic TypeScript stack with cloneable app templates and visual planning/recap features.
Runs an autonomous self-improvement loop where a meta agent crafts a task-specific agent, a target agent executes trials, and a feedback agent updates both harness (code) and model weights—provider-agnostic profiles with reproducible runs and a live dashboard.
Delivers image and video generation, editing, and understanding inside a single 3B-parameter multimodal model trained from scratch with a multi-task recipe. Notable for strong unified benchmarks at 3B scale; inference requires large GPU memory (≈40GB+ VRAM).
End-to-end Python framework for training and serving NVIDIA's Cosmos world models (Cosmos3), integrating distributed training (FSDP/TP/CP/PP), DCP/safetensors checkpoints, dataset adapters, multiple inference backends, online serving, and agent skills.
Memory layer that lets AI agents remember users and context across sessions.