AI Infra2021
Drop-in transformer building blocks with custom CUDA kernels: memory-efficient exact attention (up to ~10x faster), block-sparse attention, fused softmax/layernorm/SwiGLU ops. Cuts VRAM and speeds up diffusion and LLM training on Nvidia GPUs.
MLOps2021
Orchestrates ML training pipelines and production agent workflows from one Python codebase that runs unchanged from a laptop to Kubernetes or any cloud. Auto-versions artifacts, models, and agent checkpoints, with no orchestrator or framework lock-in.
AI Infra2022
A continuously-updated, categorized self-hosting guide that catalogs tools, deployment notes and resources for containers, networking, home automation and running LLMs/chatbots locally; provided as a long, structured README with links and quick setup tips.
AI Agent2022
Terminal rebuilt around AI agents: orchestrate Claude Code, Codex, and Warp's own agent in parallel, each with codebase indexing and scoped permissions. Run them locally or in the cloud, and bring your own model via Bedrock, LiteLLM, OpenRouter.
AI Infra2022
Provides runtime support for reversible effects and reactive coeffects so components can be declared, composed, and hot-replaced safely; includes effect tracking, coeffect resolution, a declarative component loader and HMR — aimed at plugin-driven agent harnesses and dynamic systems.
AI Infra2022
Collects metrics, distributed traces, and continuous profiles via eBPF with zero code instrumentation, covering apps in any language plus gateways, service meshes, databases, and queues. Profiling adds under 1% overhead.
AI Image2022
Browser-based control panel for running Stable Diffusion locally, built on Gradio. Bundles txt2img, img2img, inpainting, outpainting, and upscalers (ESRGAN, GFPGAN, CodeFormer), plus an extension ecosystem and support for NVIDIA, AMD, and Intel GPUs.
AI Agent2022
Build LLM-powered agents and applications from modular components: provider-agnostic model abstractions, tool integrations, retrievers for RAG, and agent orchestration primitives. Suited for prototyping and production agent workflows; requires developer wiring and dependency management.
AI Infra2022
Build full‑stack web apps entirely in Python — write frontend components and backend state as Python classes with a reactive model. Provides fast refresh, deployment tooling, and AI-focused integrations such as an AI Builder and an Agent Toolkit for connecting LLMs and image models.
Embodied AI2022
GPU-accelerated robot-learning framework on NVIDIA Isaac Sim, running thousands of parallel environments on one GPU for reinforcement and imitation learning. Ships 30+ ready-to-train tasks and 16+ robot models wired to RSL RL, SKRL, and RL Games.
AI Infra2022
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.
AI Image2023
X-AnyLabeling is a powerful annotation tool integrated with an AI engine for fast and automatic labeling. Designed for multi-modal data engineers, it offers industrial-grade solutions for complex tasks. Supports images and videos, GPU acceleration, custom models, one-click inference for all task images, and import/export formats like COCO, VOC, YOLO. Handles classification, detection, segmentation, captioning, rotation, tracking, estimation, OCR, VQA, grounding, etc., with various annotation styles including polygons, rectangles, rotated boxes.