AIAny
AI Train2023
Icon for item

AI Toolkit

Trains and fine-tunes diffusion models on consumer GPUs: LoRA and LoKr for image families like FLUX.1/2, SDXL and Qwen-Image, plus video models such as Wan 2.x and LTX. Layer-specific targeting, configurable VRAM, and a browser dashboard for runs.

Introduction

Most diffusion fine-tuning tooling forces a choice: a friendly UI that hides the knobs, or a config-file workflow that assumes you already know what every flag does. This project refuses the trade-off, exposing the same training engine through both a CLI and a web dashboard — and quietly tracking the field's churn by adding new architectures as they ship rather than freezing on whichever model was hot at release.

What Sets It Apart
  • Breadth across modalities: image (FLUX.1/2, SDXL, SD 1.5, Qwen-Image, HiDream, Z-Image), video (Wan 2.1/2.2, LTX), and audio (Ace Step) all share one trainer, so a learned config transfers across model families.
  • Method-level control: LoRA and LoKr with adjustable rank, plus layer-specific training via only_if_contains and selective exclusion — you can train only the layers that matter instead of the whole network.
  • Consumer-hardware focus: configurable VRAM optimization targets single NVIDIA GPUs, with optional offload to RunPod, Modal, or Ostris Cloud when local memory runs out.
  • A dashboard at localhost:8675 that monitors runs without needing to stay open, separating launch from observation.
Who It's For

Great fit if you fine-tune image or video diffusion models regularly and want one tool that keeps pace with new architectures instead of switching repos every quarter. Look elsewhere if you need a fully managed, no-config service — this still expects you to understand rank, layer targeting, and VRAM trade-offs, and assumes an NVIDIA GPU.

Information

  • Websitegithub.com
  • AuthorsOstris
  • Published date2023/07/23

More Items

Hugging Face
AI Video2026

Provides Parallel Decoding Distillation (PDD) LoRA adapters that accelerate MiniMax-H3 video generation into few inference steps. Includes official 8-step Acc LoRAs for FL2VA and Ref2VA (rank=64, network_alpha=64, BF16), demo comparison videos, and example scripts using Diffusers' MiniMax-H3 ModularPipeline.

Hugging Face
AI Video2026

Conditions a MiniMax‑H3 video generator with a single ControlNet‑Union checkpoint to accept Canny, Depth, HED, MLSD or Pose control videos and run video inpainting. Guidance‑distilled for one‑pass inference; requires the base MiniMax‑H3 weights and specific control-branch config.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.