Generates images from text prompts using a 12-billion-parameter rectified-flow transformer trained with guidance distillation for more efficient sampling. Distributed with diffusers/ComfyUI support and multiple conditioning/editing variants; weights released under a non-commercial license.
Turns a UI screenshot into structured elements so a vision LLM can act without HTML or accessibility trees. A fine-tuned detector finds interactable icons; a caption model describes their function, lifting GPT-4V grounding on ScreenSpot and Mind2Web.
Trains a 65M-parameter vision-language model from scratch in ~2 hours on one RTX 3090, about 3 RMB (~$0.40) of GPU rental. Connects a frozen SigLIP2 encoder to a small MiniMind LLM via a two-layer MLP projector; full PyTorch code for pretraining and SFT.
Turns PDFs and images into clean Markdown with a 7B vision-language model, keeping tables, equations, handwriting, and multi-column reading order while removing headers and footers. Runs on one 12GB+ GPU at about 1/32 the cost of GPT-4o APIs.
High-resolution image and video generation codebase and models that run with far lower compute and memory than typical diffusion systems. Uses linear-attention DiT variants, aggressive latent compression, and inference-scaling to support text-to-image (up to 4K), fast one/few-step generation, and efficient video pipelines.
Curated collection of production-oriented AI projects that implement OCR, RAG, multi-agent systems, and multimodal pipelines. Each entry provides runnable code, setup notes, and engineering patterns to help developers move prototypes toward production.
Provides curated ComfyUI workflow templates and subgraph blueprints that package reusable node graphs, preview assets, and publishing pipelines for image/video generation. Includes a browsable Astro site with i18n, CI-driven sync/publish scripts, and PyPI packaging for easy distribution.
Real-time DETR detector on a DINOv2 backbone, covering detection, segmentation, and keypoints. Ships in six sizes (Nano to 2XL), beats YOLO on the COCO speed-accuracy curve, and transfers better to non-COCO real-world domains.
Converts document images—scans, photos, born-digital PDFs—into structured text in two stages: first map layout and reading order, then parse each element (text, tables, formulas, figures) in parallel, each guided by its own task prompt.
Real-time 3D Gaussian Splatting renderer for web apps using THREE.js. Integrates splat and mesh rendering with a Rust + Wasm component, supports major splat formats (.PLY, .SPZ, .SOG) and targets broad WebGL2 support for mobile-friendly dynamic scenes.
GPU-accelerated, non-destructive RAW photo editor designed for fast, low-footprint desktop workflows (<20MB). Built with Rust/WGPU/Tauri, it offers real-time 32-bit GPU processing, AI-assisted masking and optional ComfyUI integration for generative edits, plus presets and batch export.