AI Infra2023
Puts OpenAI-, Anthropic- and Ollama-compatible endpoints in front of 60+ inference backends, so existing client code runs unchanged against local models for text, vision, audio, image and embeddings. Runs CPU-only or accelerated, data stays local.
Chatbot2023
Runs open-source LLMs entirely on your own laptop or desktop — no GPU, API key, or cloud required. A cross-platform desktop app with LocalDocs, letting you chat privately over your own files; conversations never leave the machine unless you opt in.
AI Client2023
Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.
AI Train2023
Streamlines post-training and fine-tuning for large language and multimodal models with a single YAML-driven pipeline. Supports LoRA/QLoRA, full fine-tuning, preference tuning, RL methods, multi-GPU/FSDP/DeepSpeed, and many model backends (Hugging Face, local checkpoints).
AI Train2023
Connects a frozen vision encoder to a language model via visual instruction tuning, yielding an open multimodal assistant that follows image-grounded instructions. Released checkpoints span 7B-34B and approach GPT-4V on vision-language benchmarks.
AI Client2023
Translates plain-English questions into pandas/SQL code over CSV, Parquet, and SQL databases, returning tables and charts. Combines LLMs with RAG and a semantic layer so non-coders query data; a Docker sandbox isolates generated code.
AI API2023
Self-hosted gateway putting OpenAI, Claude, Gemini, DeepSeek and 20+ providers behind one OpenAI-compatible endpoint. Adds per-token quotas, channel load balancing and usage billing, so teams or resellers meter keys without sharing upstream credentials.
AI Client2023
Self-hostable chat UI that connects to any LLM and adds Agents, Web Search, RAG, connectors, code execution and image generation. Ships connectors to 40+ sources and deployment guides for Docker/K8s. Best for teams needing private, extensible chat platforms.
MLOps2023
Declarative CLI and library to evaluate and red-team LLM apps: run test cases against prompts and models, compare providers side-by-side, and scan for jailbreaks, prompt injection, and data leaks — with CI/CD and pull-request code scanning built in.
Chatbot2023
Wraps a local, OpenAI-compatible inference server in one messages API so you can build private AI apps with no data leaving your network: document ingestion, retrieval with inline citations, and built-in tools (web search, code execution, MCP).
AI API2023
Notebooks and sample apps demonstrating generative-AI workflows on Google Cloud's Vertex AI and Gemini — covering RAG grounding, multimodal demos, function calling, and agent-building examples, with deployment-ready templates for evaluation and production.
MLOps2023
Evaluates and tests LLM apps — RAG pipelines, agents, and workflows — using objective metrics that mix LLM-as-judge scoring with deterministic measures. Auto-generates synthetic test datasets and integrates with LangChain and tracing tools.