AIAny
AI Video2025
Icon for item

ViMax: Agentic Video Generation

Turns a raw idea, novel, or screenplay into a complete multi-shot video through a multi-agent pipeline that scripts, storyboards, and renders shots while a vision model checks character and scene consistency across the whole story.

Introduction

The hard part of AI video was never generating one good clip — it was keeping the same character's face, the same lighting, and a coherent plot across the dozens of clips stitched into minutes of footage. ViMax reframes long-form video as an orchestration problem rather than a single model call, wiring a crew of role-specialized agents (director, screenwriter, producer) around whatever underlying image and video generators you plug in.

What Sets It Apart
  • Four entry points, one pipeline. Idea2Video, Novel2Video, Script2Video, and AutoCameo all funnel into the same scripting → storyboard → shot-generation flow, so you can start from a one-line concept or a finished screenplay and reach the same downstream consistency machinery.
  • A consistency check that actually runs. A multimodal model (MLLM/VLM) inspects generated frames and flags drift in characters and scenes before shots are assembled — the step most DIY text-to-video chains skip, which is why their outputs visibly wander.
  • RAG-grounded screenwriting. Script generation is retrieval-augmented rather than one big prompt, keeping a long story's continuity intact and letting shots be planned and rendered in parallel instead of in one slow chain.
Who It's For

Great fit if you want minutes-long, multi-scene videos — episodic adaptations of a novel, a narrated idea, or cameo clips built from your own photos — and care more about character and scene continuity than per-clip polish. Look elsewhere if you need a single hero shot at maximum fidelity, real-time generation, or a turnkey hosted product: this is a research-grade, self-hosted Python system that orchestrates external generators, so final quality and cost ride on the models you supply.

Information

  • Websitegithub.com
  • OrganizationsData Intelligence Lab @ HKU
  • AuthorsHKUDS
  • Published date2025/03/30

Categories

More Items

Hugging Face
AI Video2026

Generates a new camera viewpoint from a reference video: an IC‑LoRA adapter for LTX‑Video 2.3 that re‑renders the same scene from a requested discrete camera angle while preserving subject and content. Trained on synthetic multi‑view data, proof‑of‑concept with limited viewpoint range and best for small, chained angle shifts.

Hugging Face
AI Video2026

Generates minute-scale, temporally coherent dance videos from full music tracks using a hierarchical two-stage approach: global keyframe planning plus local temporal refinement; suitable when long-range musical structure and rhythmic continuity matter.

GitHub
AI Video2026

Cross-platform native video editor with hardware-accelerated processing and frame-accurate multi-track timeline; core editor is open-source and free while optional Pro AI features (natural-language editing, auto-captions, smart reframing) are paid.