Turns a PC, Mac, or Linux machine into a private AI server with one-command installers: local LLM inference, a ChatGPT-style web UI, voice, agents, RAG, workflows, image generation, hardware-aware model selection, and optional cloud/hybrid modes.
Acts as an OpenAI‑compatible local and cloud gateway that routes requests across 100+ LLM providers with smart routing, load balancing, retries and fallbacks. Adds policies, rate limits, semantic caching and observability for reliable, cost‑aware inference in Docker, Electron or npm installs.
Provides a reliability layer for self-hosted LLM tool-calling and multi-step agent workflows. Adds guardrails — rescue parsing, response validation, retry nudges, and a synthetic respond tool — and ships a Drop-in OpenAI-compatible proxy plus a WorkflowRunner for structured loops.
A 26M-parameter LLM distilled for reliable function-call generation on tiny devices, with open weights, local finetuning tooling, and a web playground for on-device testing. Pretrained at scale then post-trained on a single-shot function-call dataset for tool integration.
Runs local AI models on Apple Silicon as an OpenAI‑compatible server, emphasizing low latency, prompt caching, and reliable tool-calling. Optimized for M1–M4 Macs with multimodal support and drop‑in compatibility for IDEs and agent frameworks.
Deploy and manage applications and containers to your own servers or Openship Cloud from a single desktop, web, or CLI interface. Built-in CI/CD with push-to-deploy and preview environments, automatic SSL, managed databases, CDN, backups, and multi-node portability for VPS-to-production workflows.
A distilled 26M-parameter encoder–decoder LLM for on-device function-calling and tool use. Uses a pure-attention Simple Attention Network, provides open weights and local finetuning, and targets high-throughput inference on the Cactus runtime.
Runs the Bonsai family of quantized LLMs locally (including vision-capable 27B): provides scripts and demo UIs to run 1-bit and ternary Bonsai models on macOS (Metal), Linux/Windows (CUDA/Vulkan/ROCm), or CPU, with long context, tool-calling and an optional Open WebUI agent demo.
A 30B-parameter, instruction-tuned language model built for long-context text generation, conversational agents, and tool-calling. It combines supervised fine-tuning and RL alignment, supports 131,072-token context, and is optimized for tasks like summarization, code, and RAG.
Provides a CLI and skill suite that lets coding assistants scaffold, evaluate, and deploy ADK-based AI agents on Google Cloud. Integrates eval pipelines (generate/grade), deployment infra and CI/CD scaffolds, observability, and Gemini Enterprise publishing workflows.
Provides hardware-isolated, sub-60ms, ultra-low-overhead sandboxes to run untrusted LLM/agent code. Offers event-level snapshots, kernel-level egress control, credential vaulting, and drop-in E2B SDK compatibility for high-density AI agent deployment.
Provides a compact GGUF export of a tuned Gemma‑4 26B variant for local inference, optimized for llama.cpp and Apple Silicon to deliver faster, less‑censored chat and coding outputs. Includes Q4_K_M quantization and a neutral embedded template for more reliable local deployments.