Collection of runnable model implementations — LLaMA, Mistral, Stable Diffusion, Whisper, CLIP, plus LoRA fine-tuning — ported to the MLX array framework so they run natively on Apple silicon's unified memory rather than CUDA.
Provides a diffusion-model studio for image, video, audio-video, editing, LoRA, and full training workflows so many model families share one inference and training framework.
Reworks AUTOMATIC1111's Stable Diffusion WebUI onto a custom backend that auto-manages GPU memory to speed inference and cut VRAM use. Adds native FLUX support with NF4/GGUF quantization and a UNetPatcher framework for model-agnostic extensions.
Produces real-time 3D reconstructions from multi-view images using Gaussian splatting, with on-device training and interactive viewing across native desktops, Android, and the browser. Uses WebGPU and the Burn ML framework to ship dependency-free binaries, a CLI, live training visualization, and streaming .ply support.
BYOK desktop app working as a universal MCP client: run any MCP server against OpenAI, Anthropic, Gemini, Grok, Ollama and 10+ providers. Also offers prompt-anywhere, AI text commands, local-file RAG, media generation and voice input.
Turns a UI screenshot into structured elements so a vision LLM can act without HTML or accessibility trees. A fine-tuned detector finds interactable icons; a caption model describes their function, lifting GPT-4V grounding on ScreenSpot and Mind2Web.
Trains a 65M-parameter vision-language model from scratch in ~2 hours on one RTX 3090, about 3 RMB (~$0.40) of GPU rental. Connects a frozen SigLIP2 encoder to a small MiniMind LLM via a two-layer MLP projector; full PyTorch code for pretraining and SFT.
High-resolution image and video generation codebase and models that run with far lower compute and memory than typical diffusion systems. Uses linear-attention DiT variants, aggressive latent compression, and inference-scaling to support text-to-image (up to 4K), fast one/few-step generation, and efficient video pipelines.
Generates high-quality, editable 3D assets from text or images and decodes to radiance fields, 3D Gaussians, or textured meshes. Ships pretrained models up to 2B parameters, a 500K asset dataset and training code; best used with image conditioning and a ≥16GB NVIDIA GPU.
Optimizes and tests AI prompts in the browser, comparing original and rewritten versions side by side against any connected model. Runs fully client-side—keys go straight to the provider—and ships as web app, Chrome extension, and desktop builds.
Real-time DETR detector on a DINOv2 backbone, covering detection, segmentation, and keypoints. Ships in six sizes (Nano to 2XL), beats YOLO on the COCO speed-accuracy curve, and transfers better to non-COCO real-world domains.