Performs image-to-text document parsing and OCR for complex elements (tables, formulas, charts, seals), with multilingual support (en/zh). It uses region-aware data optimization and progressive post-training to improve weak-region supervision and is plug-and-play compatible with PaddleOCR-VL-1.5.
Quantized NVFP4 build of the Qwen3.6-35B MoE language model, optimized with NVIDIA Model Optimizer to cut model size and GPU memory by ~3.06× for inference. Designed for vLLM and NVIDIA GPU deployments (Hopper/Blackwell).
Hybrid LFM2.5 text-generation model optimized for on-device assistants and agentic workflows — 8.3B total / 1.5B active parameters with 131,072-token context. Prioritizes low-latency, high-throughput inference and multilingual instruction-following; not optimized for pure heavy programming or knowledge-heavy QA without retrieval.
Performs training-free early-stage visual token compression inside the vision encoder to cut time-to-first-token (TTFT) and FLOPs for Video-LLMs. Introduces a decoupled spatial token selection strategy and reports up to 2.65× TTFT reduction and 61% FLOPs savings on LLaVA-OneVision-7B (NVIDIA A100) while preserving full-token accuracy — aimed at latency-sensitive video understanding.
GGUF quantizations of Step-3.7-Flash: a sparse multimodal Mixture-of-Experts LLM with native image understanding, selectable reasoning levels, and a 256K context window. Ships multiple calibrated Q3/Q4/IQ quant files plus an mmproj vision projector for local llama.cpp inference on high-memory hosts.
Introduces Draft-OPD, an on-policy distillation method for training lightweight draft models used in speculative decoding — it focuses learning on draft-induced errors via target-assisted rollouts and replay, improving acceptance length and enabling >5× lossless LLM inference acceleration.
Open-weight frontier LLM for agentic reasoning and long-context analysis (up to 1M tokens). Uses a LatentMoE + Mamba-2 hybrid with Multi-Token Prediction and NVFP4 efficiency (550B total / 55B active). Suited for multilingual agents, RAG, and heavy tool-use workloads.
Provides compact, agentic text-generation for long-horizon, tool-enabled workflows — trading some peak capability for lower latency and easier on-prem deployment. Key features: adaptive/coherent thinking traces, function-calling support, and sglang/docker-ready serving.
A surgically modified Gemma 4 (12B) that removes refusal behavior while preserving benchmark parity; released as an uncensored research artifact with GGUF quantizations for local inference and red‑team/alignment evaluation.
Implements MXFP4 quantization on MoE experts plus a BF16 DFlash block-diffusion drafter to propose whole-token blocks for verification, cutting memory bandwidth and backbone forward passes for trillion‑parameter text generation—targeting long‑context, agent and code workloads.
Multilingual, low-latency text-to-speech model for speech generation and zero-shot voice cloning. Uses an MoE backbone with ECAPA-TDNN speaker embeddings, supports audio prefixes, fine-grained prosody/emotion controls and 44.1kHz output; optimized for Linux + NVIDIA GPUs.
Implements a blockwise sparse attention (MiniMax Sparse Attention) that scores and Top-k selects key-value blocks per Grouped Query Attention group to enable attention over million-token contexts. Paired with an exp-free Top-k GPU kernel and KV-outer sparse execution, it reduces per-token attention compute and yields large prefill/decoding speedups.