Self-hosted browser chat interface for interacting with local or remote LLMs. Supports multiple backends (Ollama, OpenAI-compatible endpoints, llama.cpp), RAG/document chat, plugins/actions, and Docker-based deployment — aimed at teams that need private, customizable LLM UIs.
Builds stateful LLM agents whose memory persists across sessions: a tiered, self-editing memory system lets an agent rewrite its own context window so it remembers, learns, and improves over time. Model-agnostic, with Python/TypeScript SDKs.
AI Engineering Hub is a comprehensive GitHub repository offering in-depth tutorials and 93+ production-ready projects on LLMs, RAGs, AI agents, and real-world AI applications for all skill levels.
Brings ChatGPT, Claude, Gemini, Perplexity, DeepSeek, Grok and other AI chat services into one desktop app, each in its own isolated session and window. Adds prompt management, multi-window layouts, a built-in terminal, and local-first history.
Benchmark for evaluating general AI assistants with 466 short, real-world questions that require tool use, multimodality and reasoning; provides a public dev set and a withheld test set used for leaderboard evaluation.
Provides a 200k-example filtered conversational dataset derived from UltraChat for supervised fine‑tuning and generation‑ranking of chat models. Stored in parquet with four splits and used as part of Zephyr‑7B‑β training data.
Routes LLM and agent decisions through semantic similarity instead of waiting for full generations, useful for intent routing, tool selection, guardrails, and multimodal handling.
Hands-free voice-first companion with a Live2D avatar for real-time conversations with LLMs. Cross-platform web and desktop clients, runs locally or via cloud APIs, supports local ASR/TTS and modular customization for personas and models.
Collection of runnable model implementations — LLaMA, Mistral, Stable Diffusion, Whisper, CLIP, plus LoRA fine-tuning — ported to the MLX array framework so they run natively on Apple silicon's unified memory rather than CUDA.
A selective State Space Model architecture and PyTorch implementation for linear-time sequence modeling. Hardware-aware, designed for information-dense tasks (e.g. language modeling), with pretrained weights on Hugging Face; requires CUDA-enabled PyTorch.
Runs one-command evaluation of vision-language models across 80+ multimodal benchmarks, handling data download, inference, and metric scoring in a single pass. Supports 220+ LMMs; adding a new model means writing one generate_inner() function.
Builds realtime voice AI agents that run as server-side participants in WebRTC rooms — mix STT, LLM, and TTS providers or use one realtime model. Adds semantic turn detection, SIP telephony, multi-agent handoffs, and an LLM-judge test harness.