An instruction‑tuned Gemma 4 E4B multimodal model on Hugging Face that accepts text, images and audio and generates text; notable for 128K long context support, built-in thinking mode, and an on‑device‑friendly E4B architecture under an Apache‑2.0 license.
Community fine-tuned multimodal Qwen3.5-9B using Claude 4.6 distilled data to change the model's 'thinking' behavior; offers an uncensored 'heretic' flavor with image-text-to-text I/O, benchmark comparisons, and deployment notes for inference frameworks.
Provides an annotated multimodal human-motion dataset for language-to-action and robotics research, with BVH and MuJoCo files plus recordings targeted at Unitree-G1 and NVIDIA-SOMA platforms. Covers locomotion, gestures, dance and object interaction with English annotations and 100K–1M samples.
Generate text, images, video, audio and action/robot trajectories from combined text, image, video, audio and action inputs. A Mixture-of-Transformers omnimodal foundation model (Cosmos3‑Nano, 16B params) focused on Physical AI (robotics, AV, simulation) and optimized for NVIDIA GPU runtimes.
Provides 10 million synchronized egocentric experience episodes with structured 3D/4D multimodal annotations — 2.88B RGB frames, 720M depth frames, 576M pose/mocap frames and ~1PB total. Designed for embodied AI, robotics, and multimodal pretraining; research-only, gated access.
Instruction-tuned Mixture-of-Experts multimodal model that generates text from text+image inputs while activating a 4B subset of parameters for faster inference; supports a 256K context window, multilingual vision-language tasks, and is available under Apache-2.0.
Large-scale mid-training corpora for multimodal models: 10,809 ~60s video shards, caption splits (30s/60s/180s/>10min), 84 spatial-reasoning shards, and CSV mappings to source YouTube IDs. Small Parquet preview configs are provided for schema inspection.
Runs the Bonsai family of quantized LLMs locally (including vision-capable 27B): provides scripts and demo UIs to run 1-bit and ternary Bonsai models on macOS (Metal), Linux/Windows (CUDA/Vulkan/ROCm), or CPU, with long context, tool-calling and an optional Open WebUI agent demo.
Orchestrates end-to-end video production with agentic pipelines that research, script, generate assets, edit, and render finished videos. Distinguishes itself by supporting true real-footage retrieval (Archive.org, NASA, Wikimedia), Remotion/HyperFrames composition, and usable zero-key workflows alongside cloud providers.
Provides a diagnostic suite that audits video-understanding benchmarks to find samples solvable without visual or temporal input, filters those shortcuts, and produces a distilled video-native testbed that reveals major capability gaps in current Video-LLMs.
A dense 128B multimodal model with a 256k context window, configurable reasoning effort, and native function-calling for agentic workflows. Supports text+image input, multilingual output, and is released on Hugging Face under a Modified MIT license with revenue-based exceptions.
Turns a repo's code, docs, PDFs, images, and videos into a queryable multimodal knowledge graph for AI coding assistants. Uses deterministic AST extraction for code and LLM-based semantic extraction for other assets, exporting interactive HTML, JSON, and a human-readable audit report.