Run prompts against OpenAI, Claude, Gemini, and dozens of local or remote models from one terminal command, logging every prompt and response to SQLite. Plugins add new providers, tools, and embeddings; supports schema extraction and function calling.
Streamlines post-training and fine-tuning for large language and multimodal models with a single YAML-driven pipeline. Supports LoRA/QLoRA, full fine-tuning, preference tuning, RL methods, multi-GPU/FSDP/DeepSpeed, and many model backends (Hugging Face, local checkpoints).
Connects a frozen vision encoder to a language model via visual instruction tuning, yielding an open multimodal assistant that follows image-grounded instructions. Released checkpoints span 7B-34B and approach GPT-4V on vision-language benchmarks.
Translates plain-English questions into pandas/SQL code over CSV, Parquet, and SQL databases, returning tables and charts. Combines LLMs with RAG and a semantic layer so non-coders query data; a Docker sandbox isolates generated code.
Self-hosted gateway putting OpenAI, Claude, Gemini, DeepSeek and 20+ providers behind one OpenAI-compatible endpoint. Adds per-token quotas, channel load balancing and usage billing, so teams or resellers meter keys without sharing upstream credentials.
Self-hostable chat UI that connects to any LLM and adds Agents, Web Search, RAG, connectors, code execution and image generation. Ships connectors to 40+ sources and deployment guides for Docker/K8s. Best for teams needing private, extensible chat platforms.
Declarative CLI and library to evaluate and red-team LLM apps: run test cases against prompts and models, compare providers side-by-side, and scan for jailbreaks, prompt injection, and data leaks — with CI/CD and pull-request code scanning built in.
Wraps a local, OpenAI-compatible inference server in one messages API so you can build private AI apps with no data leaving your network: document ingestion, retrieval with inline citations, and built-in tools (web search, code execution, MCP).
Notebooks and sample apps demonstrating generative-AI workflows on Google Cloud's Vertex AI and Gemini — covering RAG grounding, multimodal demos, function calling, and agent-building examples, with deployment-ready templates for evaluation and production.
Evaluates and tests LLM apps — RAG pipelines, agents, and workflows — using objective metrics that mix LLM-as-judge scoring with deterministic measures. Auto-generates synthetic test datasets and integrates with LangChain and tracing tools.
Provides an uncensored, self‑hostable studio for generating AI images, videos, and lip‑synced talking videos in browser or desktop. Integrates 200+ models via Muapi.ai, supports local inference (stable-diffusion.cpp), multi-image inputs and workflow automation — no content filters.
Probes LLMs for failure modes — prompt injection, jailbreaks, data leakage, toxicity, hallucination — the way nmap scans a network. Ships 20+ attack probes that run against Hugging Face, OpenAI, Bedrock, Cohere, or any REST endpoint.