AIAny
AI Video2025
Icon for item

ViMax: Agentic Video Generation

Turns a raw idea, novel, or screenplay into a complete multi-shot video through a multi-agent pipeline that scripts, storyboards, and renders shots while a vision model checks character and scene consistency across the whole story.

Introduction

The hard part of AI video was never generating one good clip — it was keeping the same character's face, the same lighting, and a coherent plot across the dozens of clips stitched into minutes of footage. ViMax reframes long-form video as an orchestration problem rather than a single model call, wiring a crew of role-specialized agents (director, screenwriter, producer) around whatever underlying image and video generators you plug in.

What Sets It Apart
  • Four entry points, one pipeline. Idea2Video, Novel2Video, Script2Video, and AutoCameo all funnel into the same scripting → storyboard → shot-generation flow, so you can start from a one-line concept or a finished screenplay and reach the same downstream consistency machinery.
  • A consistency check that actually runs. A multimodal model (MLLM/VLM) inspects generated frames and flags drift in characters and scenes before shots are assembled — the step most DIY text-to-video chains skip, which is why their outputs visibly wander.
  • RAG-grounded screenwriting. Script generation is retrieval-augmented rather than one big prompt, keeping a long story's continuity intact and letting shots be planned and rendered in parallel instead of in one slow chain.
Who It's For

Great fit if you want minutes-long, multi-scene videos — episodic adaptations of a novel, a narrated idea, or cameo clips built from your own photos — and care more about character and scene continuity than per-clip polish. Look elsewhere if you need a single hero shot at maximum fidelity, real-time generation, or a turnkey hosted product: this is a research-grade, self-hosted Python system that orchestrates external generators, so final quality and cost ride on the models you supply.

Information

  • Websitegithub.com
  • OrganizationsData Intelligence Lab @ HKU
  • AuthorsHKUDS
  • Published date2025/03/30

Categories

More Items

GitHub
AI Client2024

Unifies visual creator tools, reusable Skills, and a Codex-powered Agent to handle video translation, image/video generation, voiceovers, and editing in one local multimodal workspace. Desktop and web clients share a synchronized state machine and keep data local by default.

GitHub
AI Video2026

Turns Claude Code or Codex into an agent skill that storyboards, animates, and sound-designs cinematic product promos from your real screenshots using Remotion. Packs tuned shot recipe cards, 150+ motion previews, a production-ready template, Remotion components, and audio assets for web/desktop product films.

GitHub
AI Image2022

Interactive IDE for composing AI-generated 2D and 3D scenes and producing images and videos. Provides visual scene-blocking, 3D image compositing, character posing, image-to-3D conversion, and multi-provider model integrations to make generation consistent and repeatable.