A looped-Transformer LLM series using Mixture-of-Experts (20B with 2B active; 6B with 0.6B active) that trades extra pretraining compute for repeated looping. Shows superior compute-efficiency versus matched-compute vanilla baselines and attains gold-medal performance on 2025 IMO and IPhO after a post-training pipeline.
Generates robot manipulation actions from visual observations and text instructions using a 1.5B vision-language-action model. Uses streaming context and visual-token compression to cut per-step compute, runs a unified policy across tasks, and is open-sourced on Hugging Face under Apache-2.0.
Predicts eight future [x,y,yaw] waypoints for language-conditioned embodied person-following using fused DINOv3 and SigLIP visual features; trained with quality-driven, DAgger-style self-evolving data and optimized for on-device inference (~5+ FPS, ~180 ms).
Open preview checkpoint of a sparse Mixture-of-Experts causal LLM with ~314B total params (~13B active per token) and native 256K context for long-context multilingual text generation. Ships with custom modeling code (trust_remote_code) and a research/non-commercial use license.
Analyzes internal computation of text-to-image diffusion transformers and shows structural template tokens act as implicit semantic registers that maintain object identity during denoising. Introduces a causal interpretability framework (attention decomposition + targeted interventions) and a training-free pruning rule that cuts ~20% attention FLOPs for a ~1.4-point GenEval drop.
Efficient 4B native-resolution diffusion foundation model for text-to-image generation and instruction-based image editing. Uses a lightweight Mage‑VAE tokenizer and a 4B NR‑MMDiT backbone to produce 512–2048 outputs with low memory and fast inference; ships in Base, RL-aligned and few-step Turbo variants.
Provides GGUF-format quantized shards of Laguna S 2.1 for local or self-hosted inference—packaged for llama.cpp/llama-server and usable with vLLM/Transformers runtimes; targeted at long-context, agentic coding workloads.
1B-parameter text-generation model tuned for conversational and agentic workflows with a focus on security and vulnerability-detection; suited for low-cost or on-prem/edge deployments and terminal-agent integrations.
Performs instruction-based image editing from reference images using a 4B native-resolution diffusion transformer; the Turbo variant uses 4-step distillation for interactive latency (≈1.02 s per 1024² edit on A100) while supporting semantic, appearance, structure-aware and restoration edits.
Compact 3B-scale agentic LLM for multi-step tool use and reasoning, using a Looped Transformer to increase capacity without adding parameters; built for local deployment with configurable "thinking" modes and benchmark gains vs larger open models.
A 250B-parameter mixture-of-experts LLM that activates 15B parameters per token to lower inference cost for agentic tasks—tool calling, long-context reasoning, and coding. Uses a hybrid softmax+linear-attention stack with 1M-token context and supports English, Korean, and Japanese; requires H200/B200-class GPUs to run efficiently.
Provides a 2‑bit quantized build of Qwen3.6‑35B‑A3B for local serving via an OpenAI‑compatible HTTP API. Key features: 12.3 GB on disk, eschamoe mixed 2/3‑bit expert quantization with int8 dense layers, runs on a single 16–24 GB NVIDIA GPU and ships with Escha SGLang and ZML runtimes.