AI Model2024
Provides code, pretrained weights, and tooling for protein language models and structure prediction — including ESMC, ESMFold2, sparse autoencoders (SAEs), and the ESM Atlas. Includes model checkpoints, tutorials, Hugging Face & Biohub integration, and an MIT license.
AI Model2024
A research codebase and model family for vision–language models that experiments with data‑centric post‑training strategies and long‑context multimodal reasoning. Includes model reports, released research weights (non‑commercial), grounding tools (LocateAnything) and integrations for inference/optimization.
Official code companion to the O'Reilly book by Jay Alammar and Maarten Grootendorst: 12 chapters of runnable notebooks on tokens, embeddings, Transformers, text classification, clustering, prompt engineering, semantic search, RAG, and fine-tuning.
AI Infra2024
kvcache-ai (maintainers / MADSys group, Tsinghua University & contributors)MADSys Lab, Tsinghua University, Approaching.AI +1
Runs huge mixture-of-experts LLMs like DeepSeek-R1/V3 on a single 24GB GPU plus CPU DRAM by keeping attention on the GPU and offloading expert weights to CPU. Reports 3-28x speedups via Intel AMX/AVX512 kernels and fits 139K context in 24GB VRAM.
AI Audio2024
Local WebUI for video and audio dubbing: download YouTube, isolate vocals, transcribe with Whisper, translate into 100+ languages, and generate multilingual TTS or zero-shot voice clones. Uses Gradio, yt-dlp, Demucs, Whisper/Faster-Whisper, F5/E2/CosyVoice and Edge-TTS; Windows-focused with optional Azure integration.
AI Model2024
Generates images from text prompts using a 12-billion-parameter rectified-flow transformer trained with guidance distillation for more efficient sampling. Distributed with diffusers/ComfyUI support and multiple conditioning/editing variants; weights released under a non-commercial license.
AI Audio2024
Chains four swappable open modules — voice activity detection, speech-to-text, an LLM, and text-to-speech — into a local voice agent that needs no proprietary APIs. Runs on CUDA, Apple Silicon, or Docker, with an OpenAI-compatible realtime WebSocket mode.
AI Train2024
Trains a sub-100M-parameter LLM from scratch — pretraining, SFT, LoRA, DPO/RLHF, and distillation, sized from ~26M up to ~100M-plus dense and MoE. Headline figure: the ~64M minimind-3 variant's SFT stage runs 1 epoch in ~2h and ~3 RMB on one NVIDIA 3090.
AI Deploy2024
Runs and optimizes ML and generative-AI models on-device across mobile, desktop, web, and IoT. Successor to TensorFlow Lite, it adds automated GPU/NPU accelerator selection and zero-copy buffer interop to cut latency without cloud round-trips.
AI Image2024
Trains a 65M-parameter vision-language model from scratch in ~2 hours on one RTX 3090, about 3 RMB (~$0.40) of GPU rental. Connects a frozen SigLIP2 encoder to a small MiniMind LLM via a two-layer MLP projector; full PyTorch code for pretraining and SFT.
Embodied AI2024
GPU‑accelerated framework for training physically simulated humanoid characters and robots using reinforcement learning and motion imitation. Provides a modular multi‑backend simulator stack, large‑scale multi‑GPU training recipes, built‑in motion retargeting and an ONNX deployment pathway to real robots.
AI Infra2024
A compact domain-specific language for writing high-performance GPU/CPU kernels (GEMM, FlashAttention, sparse kernels) with Python-like syntax. It provides tiling/pipelining primitives, a TVM-based compiler and multiple backends (CUDA/CuTeDSL, NVRTC, WebGPU, Metal, Ascend) for operator-level performance work.