Pretrained image-model checkpoint hosted on Hugging Face by Facebook (Meta) for vision experiments and transfer learning. Includes downloadable weights and metadata under CC BY‑NC 4.0 — suitable for research and prototyping but restricted for commercial use.
Converts text to natural-sounding speech across 600+ languages in a zero-shot way, with short-reference voice cloning and fine-grained voice-design controls; uses a diffusion language-model-style architecture to balance quality and very low inference latency.
Generates 48kHz multilingual speech from text using a tokenizer-free diffusion-autoregressive TTS architecture, supporting natural-language voice design, controllable cloning, and low-latency streaming. Notable for a 2B-parameter backbone and built-in AudioVAE super-resolution (16k→48k).
An 8B-parameter, instruction-tuned long-context LLM optimized for instruction following, tool-calling, and multilingual dialogue — supports 131072-token context and common NLP tasks such as summarization, QA, code, and RAG.
An open text-to-image generation model built on an 8B Diffusion Transformer that focuses on layout-sensitive, text-heavy, and instruction-following image synthesis. Notable for accurate text rendering, structured/compositional generation (posters, comics), and ability to run on consumer 24GB GPUs when paired with prompt enhancement.
Generates and reconstructs navigable, editable 3D worlds from text, single images, multi-view photos, or video; outputs meshes and Gaussian Splatting assets and includes WorldMirror 2.0 for fast multi-view reconstruction. Suited for research and production pipelines that import assets into engines; requires substantial GPU resources.
Generates text by iteratively denoising blocks of tokens with a two-tower design: a frozen autoregressive context tower and a trainable diffusion denoiser tower, trading minimal quality loss for higher wall-clock throughput.
Reconstructs camera poses and dense 3D point clouds from video streams using a feed‑forward foundation model. Combines a Geometric Context Transformer (anchor + local window + trajectory memory) with paged KV‑cache attention to enable stable, long‑sequence streaming inference (~20 FPS at 518×378).
Performs feed‑forward streaming 3D reconstruction from image sequences, combining coordinate grounding, dense geometric cues and trajectory memory to correct long‑range drift; uses paged KV‑cache attention for ~20 FPS inference at 518×378 and supports sequences >10,000 frames.
Unified multimodal LLM for enterprise workflows: ingests video, audio, image and text to perform transcription, OCR, Q&A, summarization and long-context reasoning. Provides BF16/FP8/NVFP4 weights and integrations with vLLM, TensorRT-LLM and other runtimes.
A 284B-parameter Mixture-of-Experts LLM with only 13B activated parameters, designed for 1,000,000-token contexts. Uses hybrid compressed attention and mixed FP4/FP8 precision to reduce long-context KV-cache and per-token FLOPs; aimed at long-document QA, RAG pipelines, and local/high-capacity inference.
Provides instruction-based (before, after) structured 3D latents (SLAT) with aligned RGB views and natural-language edit prompts for training and evaluating instruction-following 3D editing models. Covers part-level semantic edits across seven edit types (deletion, addition, modification, scale, material, color, global) and supplies shard-based NPZ assets and loader code.