AIAny
AI Video2026
Icon for item

MiniMax-H3-Prompt-Rewriter-LoRA

Turns a short prompt plus aspect ratio and duration into a structured, shot-by-shot audio-video description for text-to-audio-video generation. A PEFT LoRA on Qwen3.6-27B that expands timing, camera motion, continuity, and synchronized diegetic/non‑diegetic sound; text-only and requires MiniMax-H3 + LightX2V to produce final AV.

Introduction

Most short user prompts lack the temporal, compositional, and audio cues needed for time-aligned audio-video synthesis. This adapter fills that gap by translating a compact user instruction into a structured H3 prompt that explicitly describes shots, timings, camera motion, physical actions, diegetic sounds, and non‑diegetic music cues — making downstream T2AV inference deterministic and easier to control.

What Sets It Apart
  • Task-specific prompt rewriting: instead of producing final pixels/audio, it produces a machine-friendly, multimodal description optimized for MiniMax‑H3 inference, preserving user intent while adding shot-level detail. This reduces iteration between prompt edits and generated outputs.
  • Lightweight PEFT adapter workflow: implemented as a LoRA on top of Qwen3.6‑27B so users can attach it to an existing LLM stack (or its quantized equivalents) without retraining the base generator. The adapter focuses on structure and timing rather than low-level generation heuristics.
  • Integration-first design: explicitly designed to be run with LightX2V and MiniMax‑H3 so the rewritten prompt includes duration and aspect-ratio cues that map directly to T2AV configs, improving alignment between prompt conditions and final MP4 outputs.
Who it's for and tradeoffs

Great fit if you need more deterministic, time-aligned prompts for local T2AV pipelines and already plan to use MiniMax‑H3 (via LightX2V). It speeds workflow when many short prompts must be expanded into full scene descriptions.

Look elsewhere if you need reference-image/video conditioning, multimodal prompt inputs, or a turnkey cloud service — the adapter is text-only, learned as an approximation of an official Context-IR service, and the repository does not include MiniMax‑H3 generator weights. Final quality still depends on MiniMax‑H3 inference settings and hardware resources required for the 27B base model.

Information

  • Websitehuggingface.co
  • Organizationslightx2v, ModelTC, MiniMaxAI, Qwen
  • Published date2026/08/07

Categories

More Items

Hugging Face
AI Video2026

LoRA adapters for MiniMax H3 that sharpen and enhance videos in ComfyUI by conditioning on source clips via guide latents for pixel-level alignment. Designed mainly for ref2va as a second-pass sharpening tool, includes a ComfyUI workflow and example before/after clips; requires aligned guide clips at the target resolution and valid clip lengths.

Hugging Face
AI Video2026

Replaces a character in a video using a single repainted frame from the same clip and propagates that edit across the shot while preserving motion, camera and lighting; requires no pose estimator, segmentation, face tracker or text prompt. Key facts: a 33.1B MiniMax-H3 finetune, DMD-distilled to three forward passes, 124 frames in ~26s on one B200 GPU.

Hugging Face
AI Video2026

Generates short multimodal videos from text, images, or reference clips using a fine-tuned MiniMax‑H3 fusion model; improves HDR clarity, motion fluidity, distant-face fidelity and VFX while preserving MiniMax‑H3’s prompt/style behavior. Best used via ComfyUI.