AIAny
AI Model2026
Icon for item

Qwen3-VL-32B Heretic (MiniMax-H3 text encoder) — NVFP4

An uncensored NVFP4-quantized text encoder for MiniMax-H3 video generation that fits on a single 16 GB GPU. Mixed-precision bake (mostly NVFP4, embedding left as INT8), preserves ConvRot rotation semantics, and includes the unrotate step required to avoid corrupted conditioning.

Introduction

The practical barrier for many creators is not model capability but hardware: large multimodal encoders often require 32–80 GB GPUs. This re-quantization brings the uncensored MiniMax-H3 text encoder down to 15.7 GB while preserving output parity with the upstream INT8 ConvRot build — making single‑GPU (16 GB) video generation feasible without changing downstream pipelines.

What Sets It Apart
  • Fits on 16 GB GPUs: the baked file is 15.7 GB and was measured to generate 6 s of 480×864 vertical video with peak VRAM ~9.9 GB on an RTX PRO 2000 Blackwell (16 GB). This makes MiniMax-H3 text encoding viable on consumer/prosumer cards.
  • ConvRot-aware re-quantization: upstream weights were stored rotated (W_stored = W @ H^T per 256-group). The bake explicitly un-rotates weights (multiply by Hadamard H) before NVFP4 quantization; skipping this yields unrelated or meaningless conditioning despite no runtime errors.
  • Mixed-precision strategy: most linear layers are NVFP4 (TensorCoreNVFP4Layout, group size 16) while the large embed_tokens layer remains INT8 to avoid OOM during baking; ComfyUI per-layer metadata supports this mix transparently.
  • Practical constraints documented: inherits upstream INT8 rounding choices, requires NVFP4-capable hardware (e.g., NVIDIA Blackwell with NVFP4 support), and is distributed as a drop-in CLIPLoader replacement for existing MiniMax-H3 ComfyUI workflows.
Who it's for and trade-offs

Great fit if you need to run MiniMax-H3 video generation on a single 16 GB GPU, want a drop-in replacement for ComfyUI CLIPLoader, and accept uncensored (Heretic) encoder variants under the MiniMax H3 Community License. Look elsewhere if you lack NVFP4 hardware (hardware support is required for NVFP4 acceleration), require a bake from BF16 (this build re-quantizes from INT8 and thus inherits its rounding), or cannot use uncensored weights for policy/compliance reasons. Also note that the diffusion model and VAEs from Comfy-Org/ MiniMax-H3 are still required for full generation.

Where It Fits

This artifact is a compatibility-and-efficiency engineering result rather than a new architecture: it trades higher-precision storage for a quantized layout tailored to NVFP4 Tensor Cores, preserving behavioral parity with the upstream INT8-ConvRot encoder while enabling practical single‑GPU workflows.

Information

  • Websitehuggingface.co
  • OrganizationsLna-Lab, ethanfel, MiniMaxAI, Comfy-Org, Alibaba / Qwen team
  • Authorssakamakismile
  • Published date2026/08/04

Categories

More Items

Hugging Face
AI Model2024

Generates images from text prompts using a 12-billion-parameter rectified-flow transformer trained with guidance distillation for more efficient sampling. Distributed with diffusers/ComfyUI support and multiple conditioning/editing variants; weights released under a non-commercial license.

Hugging Face
AI Model2026

Provides a GGUF-quantized, llama.cpp-compatible build of LiquidAI's LFM2.5-2.6B for local CPU inference and offline deployment. Supports multilingual generation and long-context workflows; optimized for low-memory, on-device use.

Hugging Face
AI Audio2026

An end-to-end 11B full-duplex speech model for real-time conversational AI that jointly performs streaming speech understanding and generation, enabling ~450 ms turn-taking, barge‑in and live tool calling in a single unified architecture; research use only.