Provides PyTorch code, pretrained checkpoints, and evaluation tooling for V-JEPA 2 — a Meta FAIR family of self-supervised video encoders and an action-conditioned world model. Includes training recipes, HuggingFace checkpoints, evaluation probes, and robot post‑training artifacts.
Real-time, streaming world model for interactive long-horizon video and scene generation — provides persistent memory across interactions, streaming inference for live scenarios, and example demos for building interactive environments.
Forecasts financial candlesticks (OHLCV K-lines) with a decoder-only transformer pre-trained on 12B+ records from 45 exchanges. A tokenizer turns market data into discrete tokens, enabling price/volatility forecasting and synthetic K-line generation.
Runs named-entity recognition, text classification, structured-JSON parsing and relation extraction from one 205M-parameter encoder in a single CPU forward pass, using schemas with per-field regex validators. A larger 1B model is available via API.
Detects, segments, and tracks every instance of an open-vocabulary concept in images and video from a text phrase or visual exemplar, not just one object per prompt. An 848M-param model reaching ~75-80% of human accuracy across 270K concepts.
Unifies agentic tasks, reasoning, and coding in a single MoE model with 355B total / 32B active parameters and a switchable thinking mode. A lighter 106B-param Air variant trades scale for efficiency; both ship MIT-licensed.
A 20B-parameter MMDiT diffusion model that generates and edits images with accurate embedded text, including dense Chinese and English typography. Handles complex multi-line layouts and identity-preserving edits while keeping text legible.
Self-supervised vision foundation model producing dense, patch-level features that transfer to classification, segmentation, depth, and detection with a frozen backbone. Spans ViT-S (21M) to ViT-7B (6.7B params), plus ConvNeXt and satellite variants.
A large multi-config collection of query–document pairs assembled to reproduce and extend the mGTE/LateOn data recipe for pre-training text embedding models. Data come in source-specific configs and include per-row drop/duplicate flags and guidance for using cleaned subsets for training.
Isolates any single sound from a complex audio mixture using a text description, a visual cue from a video frame, or a time span, returning both the isolated target and the residual. Released in small, base, and large sizes plus visual-prompt variants.
Generates and edits full-length music locally using a hybrid language-model planner and a diffusion transformer. Provides text- and audio-driven song synthesis plus selective editing (cover generation, repainting, vocal→BGM), metadata control and lightweight LoRA personalization, and runs on consumer GPUs/CPUs.
Generates explorable, 3D-consistent virtual worlds from a single image or short video. Includes official implementations of Lyra‑1 (feed‑forward 3D/4D scene generation via video-diffusion self-distillation) and Lyra‑2 (long-horizon, explorable generative 3D worlds). Best for research and creative prototyping; requires substantial GPU compute.