Encodes and clones camera motion from reference videos to generate multi-shot videos — uses a visual "camera grid" to represent camera parameters, trains on million-scale grid–video pairs, and employs a hierarchical prompt-expansion agent to coordinate camera, subject, and action control for multimodal diffusion models.
Proposes chunk-level multimodal retrieval and chunk-adaptive reranking for retrieval-augmented generation on long egocentric videos; introduces V-RAGBench to decouple retrieval vs. generation evaluation and CARVE to run parallel retrievers and select per-chunk configurations.
Provides a training-free, code-as-action framework that lets VLM-backed agents write and run stateful Python cells to compose perception and geometry primitives for open-ended 3D/4D spatial reasoning. Demonstrates consistent gains across 20 benchmarks and multiple VLM backbones.
A quantized 27B coder LLM fine-tuned for repository-level code generation, multi-turn tool calling, and agentic workflows — packaged for local GGUF/llama.cpp deployment with MTP speculative decoding and trace-inversion SFT. Optimized for developer tooling; experimental and not fully safety-validated.
Implements a blockwise sparse attention (MiniMax Sparse Attention) that scores and Top-k selects key-value blocks per Grouped Query Attention group to enable attention over million-token contexts. Paired with an exp-free Top-k GPU kernel and KV-outer sparse execution, it reduces per-token attention compute and yields large prefill/decoding speedups.
Provides 1000+ hours of high-precision optical motion-capture for humanoid robotics and embodied AI, including full-body skeleton, 20+DoF hands, object 6D, and multi-view video at 120 Hz. Sub-mm spatial accuracy, BVH/CSV/NPZ outputs and Unitree G1 retargets; ideal for imitation learning and sim-to-real, with some raw captures gated by license.
Benchmark for evaluating multimodal LLM safety in Korean cultural contexts — includes KSAFE-MM-G which localizes global safety queries into Korean scenarios and KSAFE-MM-C which targets culture-specific visual-textual vulnerabilities. Provides curated image–text pairs and jailbreak-style prompts to reveal both unsafe behaviors and over-refusal.
A post-trained Mixture-of-Experts multimodal LLM with ~397B total (≈17B active) and a 1,010,000-token context for image-text-to-text and conversational tasks. Integrates SwiReasoning to switch between latent and explicit reasoning; MIT-licensed and optimized for Portuguese/English research and on-prem inference.
Adds interleaved text–image generation to existing image generators via a multi-agent pipeline: a planner sequences stepwise instructions, a critic detects and refines failures, and single-step RL (GRPO) reinforces per-step corrections—suited for visual narratives and embodied guidance.
Provides experimental GGUF-format quantized weights for MiniMax-M3 to run local multimodal (image‑text‑video) inference via llama.cpp or Unsloth Studio. The model is very large (~428B params) and requires GPU offload or large CPU RAM; llama.cpp currently falls back from sparse to dense attention.
Provides a locally runnable GGUF quantized build of Kimi K2.7 Code for multimodal, coding-focused agentic workflows — a 1T-parameter MoE model with 256K context, native int4 support, preserved thinking-mode, and image/video input support.
Provides an open-weight native multimodal agent that understands text and images within a 1,048,576-token context window for long-horizon coding, visual reasoning, and tool-driven workflows. Uses a 2.8T-parameter Mixture-of-Experts architecture (KDA + AttnRes) with MXFP4 quantization; best suited for research and large-scale inference setups.