AI Train2023
Fine-tunes 100+ LLMs and VLMs from one config file or a no-code web UI, unifying LoRA, QLoRA, full tuning, DPO, PPO, KTO and ORPO behind a single interface. Bundles GaLore, Unsloth, FlashAttention-2 and 2-8bit quantization to fit a single 24GB GPU.
AI Infra2023
Runs 70B-class LLM inference on a single 4GB GPU without quantization and supports Llama3.1 405B on 8GB VRAM. Uses layer-splitting and block-wise model compression (4/8-bit) to reduce disk load and can speed up inference loading by up to ~3x; integrates with Hugging Face models.
AI Image2023
Reference implementation for Stability AI's diffusion models: SDXL base/refiner/Turbo for text-to-image, plus Stable Video Diffusion, SV3D, and SV4D for image-to-video and 4D synthesis. A modular engine separates samplers, guiders, and conditioners.
Enables real-time (≥30 fps) 1080p novel-view synthesis by representing scenes as optimized anisotropic 3D Gaussians plus a visibility-aware splatting renderer; provides the paper's reference implementation, pretrained models and viewers — high-quality training requires CUDA GPU and significant VRAM.
Builds a GPT-style LLM in PyTorch step by step — tokenizer, attention, pretraining, and finetuning — with no external LLM frameworks. Companion code to a Manning book, with bonus chapters on LoRA and modern Llama/Qwen-style architectures.
AI Train2023
Trains LLMs with RLHF at scale by splitting actor, critic, reward, and reference models across separate GPU groups via Ray, with vLLM-accelerated generation and DeepSpeed ZeRO-3. Supports PPO, GRPO, REINFORCE++, DPO, plus async and agentic multi-turn RL.
AI Train2023
Fine-tunes and deploys 600+ LLMs and 400+ multimodal models in one framework, with SFT, pretraining, RLHF (DPO, PPO, GRPO), and lightweight methods like LoRA and QLoRA. Adds Megatron parallelism, vLLM/SGLang/LMDeploy inference, and a training web UI.
AI Image2023
Runs Stable Diffusion XL behind a Midjourney-style interface, hiding samplers, model swaps, and LoRA weights. A built-in GPT2 expander rewrites prompts into richer styling, and it works fully offline on as little as 4GB of Nvidia VRAM.
AI Train2023
Applies deep learning workflows to geospatial data, covering imagery search, dataset preparation, model training, inference, visualization, and QGIS integration for remote sensing.
AI Audio2023
Converts microphone or streamed audio to text with sub-second latency, pairing WebRTC/Silero voice-activity detection and wake-word activation with swappable local backends — faster-whisper by default, plus whisper.cpp, Moonshine, and sherpa-onnx.
AI Audio2023
Generates expressive multilingual speech from text, with sub-word control over prosody and emotion via inline tags like [whisper] or [angry]. Handles multi-speaker, multi-turn dialogue; the weights ship under a research-only license.
AI Audio2023
Terminal CLI for on-device Whisper ASR using Hugging Face Transformers + Optimum, with optional Flash Attention 2, batching, and diarization support — focused on high-throughput transcription on NVIDIA GPUs and Apple Silicon (mps).