AI Engineering Hub is a comprehensive GitHub repository offering in-depth tutorials and 93+ production-ready projects on LLMs, RAGs, AI agents, and real-world AI applications for all skill levels.
Brings ChatGPT, Claude, Gemini, Perplexity, DeepSeek, Grok and other AI chat services into one desktop app, each in its own isolated session and window. Adds prompt management, multi-window layouts, a built-in terminal, and local-first history.
Provides a 200k-example filtered conversational dataset derived from UltraChat for supervised fine‑tuning and generation‑ranking of chat models. Stored in parquet with four splits and used as part of Zephyr‑7B‑β training data.
Routes LLM and agent decisions through semantic similarity instead of waiting for full generations, useful for intent routing, tool selection, guardrails, and multimodal handling.
Hands-free voice-first companion with a Live2D avatar for real-time conversations with LLMs. Cross-platform web and desktop clients, runs locally or via cloud APIs, supports local ASR/TTS and modular customization for personas and models.
Collection of runnable model implementations — LLaMA, Mistral, Stable Diffusion, Whisper, CLIP, plus LoRA fine-tuning — ported to the MLX array framework so they run natively on Apple silicon's unified memory rather than CUDA.
A selective State Space Model architecture and PyTorch implementation for linear-time sequence modeling. Hardware-aware, designed for information-dense tasks (e.g. language modeling), with pretrained weights on Hugging Face; requires CUDA-enabled PyTorch.
Runs one-command evaluation of vision-language models across 80+ multimodal benchmarks, handling data download, inference, and metric scoring in a single pass. Supports 220+ LMMs; adding a new model means writing one generate_inner() function.
Builds realtime voice AI agents that run as server-side participants in WebRTC rooms — mix STT, LLM, and TTS providers or use one realtime model. Adds semantic turn detection, SIP telephony, multi-agent handoffs, and an LLM-judge test harness.
Bundles AI features and coding agents into JetBrains IDEs, using IDE code intelligence for completion, refactoring, and chat. Runs on the proprietary Mellum model or your choice of OpenAI, Gemini, Anthropic, and local models via Ollama or LM Studio.
Provides a PyTorch-native platform for experimenting with and scaling generative AI training, including composable parallelism, checkpointing, float8, logging, and Llama recipes.
Triton kernels and PyTorch layers for linear-attention, state-space, and sparse-attention token mixers (GLA, RWKV, Mamba2, GSA) as drop-in replacements for multihead attention. Runs on NVIDIA, AMD, and Intel GPUs with Hugging Face support.