Video understanding is often treated as a job for large models, but this checkpoint makes a different trade-off: a 256M-parameter model can handle video questions and descriptions with about 1.38 GB of GPU memory. That makes local experimentation and domain-specific fine-tuning more practical, though its benchmark results reflect the limits of a very small model.
Key Capabilities
- Accepts video, image, multi-image, and text inputs, then produces text such as captions, answers, or visual narratives. It is an analysis model, not a media generator.
- Scores 33.7 on Video-MME, 40.6 on MLVU, and 32.7 on MVBench. These results make it a compact baseline for video tasks, not a substitute for larger models when accuracy is paramount.
- Built on the Idefics3 approach, with SigLIP for visual encoding and SmolLM2 for text generation. Its small footprint supports experiments on constrained hardware and specialized fine-tuning.
- Released under Apache 2.0, allowing use and adaptation under that license.
Who It Suits—and the Trade-off
Great fit if you need a small, adaptable model for video or image analysis on limited hardware, or want to fine-tune it for a narrow visual task. Look elsewhere if you need high-confidence factual answers, high-stakes decisions, image or video generation, or the strongest benchmark performance: outputs can be inaccurate, and larger variants perform better.