Runs local AI models on Apple Silicon as an OpenAI‑compatible server, emphasizing low latency, prompt caching, and reliable tool-calling. Optimized for M1–M4 Macs with multimodal support and drop‑in compatibility for IDEs and agent frameworks.
An instruction‑tuned Gemma 4 E4B multimodal model on Hugging Face that accepts text, images and audio and generates text; notable for 128K long context support, built-in thinking mode, and an on‑device‑friendly E4B architecture under an Apache‑2.0 license.
Instruction-tuned Gemma 4 31B multimodal model that generates text from text+image inputs with up to 256K context. Dense 31B variant optimized for vision-language understanding, long-context reasoning, and coding; Apache‑2.0 licensed.
Provides 10 million synchronized egocentric experience episodes with structured 3D/4D multimodal annotations — 2.88B RGB frames, 720M depth frames, 576M pose/mocap frames and ~1PB total. Designed for embodied AI, robotics, and multimodal pretraining; research-only, gated access.
Instruction-tuned Mixture-of-Experts multimodal model that generates text from text+image inputs while activating a 4B subset of parameters for faster inference; supports a 256K context window, multilingual vision-language tasks, and is available under Apache-2.0.
Transforms articulated 3D asset creation into a programmatic, LLM-driven code-generation workflow that produces objects with semantic parts, robust geometry, and physical joints. Includes CLI generation, a local viewer, and pipelines for large-scale dataset contribution.
Pretrained image-model checkpoint hosted on Hugging Face by Facebook (Meta) for vision experiments and transfer learning. Includes downloadable weights and metadata under CC BY‑NC 4.0 — suitable for research and prototyping but restricted for commercial use.
Large-scale mid-training corpora for multimodal models: 10,809 ~60s video shards, caption splits (30s/60s/180s/>10min), 84 spatial-reasoning shards, and CSV mappings to source YouTube IDs. Small Parquet preview configs are provided for schema inspection.
Runs the Bonsai family of quantized LLMs locally (including vision-capable 27B): provides scripts and demo UIs to run 1-bit and ternary Bonsai models on macOS (Metal), Linux/Windows (CUDA/Vulkan/ROCm), or CPU, with long context, tool-calling and an optional Open WebUI agent demo.
Provides a diagnostic suite that audits video-understanding benchmarks to find samples solvable without visual or temporal input, filters those shortcuts, and produces a distilled video-native testbed that reveals major capability gaps in current Video-LLMs.
Provides curated short video clips (49- and 81-frame) with layered ground truth—edit layers, alpha mattes, and composite targets—for training and evaluating content-preserving layered diffusion video editing. Contains background-replace and object-add edits; Apache-2.0 licensed.
Multimodal image-text-to-text fork of Gemma 4 (31B) using a 'CRACK v2' abliteration — tuned for conversational vision inputs and thinking-mode support in JANG v2 safetensors format. Recommended to run in vMLX; published by dealignai.