AIAny
AI Video2026
Icon for item

MiniMax-H3-Prompt-Rewriter-LoRA

Turns a short prompt plus aspect ratio and duration into a structured, shot-by-shot audio-video description for text-to-audio-video generation. A PEFT LoRA on Qwen3.6-27B that expands timing, camera motion, continuity, and synchronized diegetic/non‑diegetic sound; text-only and requires MiniMax-H3 + LightX2V to produce final AV.

Introduction

Most short user prompts lack the temporal, compositional, and audio cues needed for time-aligned audio-video synthesis. This adapter fills that gap by translating a compact user instruction into a structured H3 prompt that explicitly describes shots, timings, camera motion, physical actions, diegetic sounds, and non‑diegetic music cues — making downstream T2AV inference deterministic and easier to control.

What Sets It Apart
  • Task-specific prompt rewriting: instead of producing final pixels/audio, it produces a machine-friendly, multimodal description optimized for MiniMax‑H3 inference, preserving user intent while adding shot-level detail. This reduces iteration between prompt edits and generated outputs.
  • Lightweight PEFT adapter workflow: implemented as a LoRA on top of Qwen3.6‑27B so users can attach it to an existing LLM stack (or its quantized equivalents) without retraining the base generator. The adapter focuses on structure and timing rather than low-level generation heuristics.
  • Integration-first design: explicitly designed to be run with LightX2V and MiniMax‑H3 so the rewritten prompt includes duration and aspect-ratio cues that map directly to T2AV configs, improving alignment between prompt conditions and final MP4 outputs.
Who it's for and tradeoffs

Great fit if you need more deterministic, time-aligned prompts for local T2AV pipelines and already plan to use MiniMax‑H3 (via LightX2V). It speeds workflow when many short prompts must be expanded into full scene descriptions.

Look elsewhere if you need reference-image/video conditioning, multimodal prompt inputs, or a turnkey cloud service — the adapter is text-only, learned as an approximation of an official Context-IR service, and the repository does not include MiniMax‑H3 generator weights. Final quality still depends on MiniMax‑H3 inference settings and hardware resources required for the 27B base model.

Information

  • Websitehuggingface.co
  • Organizationslightx2v, ModelTC, MiniMaxAI, Qwen
  • Published date2026/08/07

Categories

More Items

GitHub
AI Image2022

Web and desktop/mobile WebUI for generating, editing, captioning and processing images and videos with Stable Diffusion and many diffusion models. Key features include automatic model download, SDNQ on-the-fly quantization for VRAM savings, balanced CPU/GPU offload, multi-backend GPU support, and built-in captioning/tagging/upscaling workflows.

Hugging Face
AI Video2026

Generates short videos with stereo audio from text prompts using a MiniMax‑H3 checkpoint; community‑uploaded on Hugging Face and distributed under Apache‑2.0. Tuned toward stylized creature and floral visuals and updated frequently per the model card.

Hugging Face
AI Video2026

Provides ComfyUI-compatible conversions and LoRA adapters of the MiniMax‑H3 video+audio generative model, with example presets and demo videos to run short stereo audio+video inference inside ComfyUI workflows.