An instruct-focused LLM (104B total, 7.4B active) optimized for fast, token-efficient inference in agent workflows. Uses hybrid linear attention plus a sparse MoE to raise throughput and cut token use; suited for high-frequency production agents, with some trade-offs in very deep reasoning.
Curated multimodal training corpus for spatial intelligence: ~8.16M QA-style samples paired with ~2.72M unique images (≈1.1 TB). Provides JSONL annotations, a 1,000-sample preview, and 52 independent image archives — used to train SenseNova-SI models.
Provides the dataset and accompanying technical report for a DeepSeek project that interleaves spatial markers (points and boxes) into multimodal LLM reasoning. Includes a public subset of data and benchmarks under an MIT license; model weights are not included.
Generates uncensored videos from text and images using an LTX 2.3–based diffusion model with native t2v and i2v support; ships with a prompt enhancer and developer-focused gguf/bf16 dev releases for local experimentation.
Transforms pretrained latent-diffusion priors into pixel-space diffusion models by removing the VAE and training shallow pixel layers on LDM-generated synthetic images — enabling fast convergence, native 4K output, and low-data training on 8 GPUs.
Preview of an MoE model family (V4-Pro: 1.6T params, 49B active; V4-Flash: 284B, 13B active) built for 1M-token contexts. A hybrid attention design cuts single-token inference FLOPs to 27% and KV cache to 10% versus V3.2 at million-token length.
Provides 173M DNA/RNA sequences (≈1.1 trillion nucleotides) assembled specifically for pretraining genomic foundation models. Includes eukaryote, prokaryote, and mRNA configs plus a 10B‑token eukaryote subset for faster experiments; formatted for streaming and tokenized with Carbon's 6‑mer setup.
Distilled dev checkpoint of an image foundation model that natively unifies raw pixels and text tokens for text-to-image, image editing, long-text rendering, and subject-driven personalization at up to 2048×2048. The Dev variant targets faster (28-step) inference for iterative use and research.
Processes text and images to produce conversational, reasoning-focused multilingual outputs for agentic workflows. Built as a sparse MoE decoder (25B active / 218B total parameters) with 128K context and available in BF16/FP8/W4A4 quantizations to balance quality and deployability.
Converts video inputs into text outputs — supports captioning, temporal grounding, and video-text-to-text queries using a Qwen-3.5-2B finetuned multimodal backbone. Suited for prototyping video understanding and caption-generation pipelines.
Transfers pretrained latent diffusion priors into pixel space to train pixel-space diffusion models using only synthetic images from LDMs. Trains shallow pixel layers while freezing most LDM internals, reducing data and compute needs and enabling native 4K generation without a VAE.
A trillion-parameter reasoning model aimed at long-horizon, multi-step agent workflows and tool collaboration. Offers adjustable Reasoning Effort modes (high, xhigh), async RL training (IcePop), and very long context (128K→256K) for complex production scenarios.