Performs zero-shot classification and regression on mixed numerical and categorical tabular data by treating training rows as in-context examples and predicting in a single forward pass. Uses alternating row/column attention and row compression; limited to 10 classes and model weights are non-commercial.
Provides GGUF/llama.cpp quantized variants of Qwen3.6-27B for local multimodal inference, tuned via online RL to cut average 'thinking' tokens by ≈50% while preserving answer quality; offers Q4_K_M/Q8_0/f16 builds and a separate mmproj for vision input.
Provides quantized GGUF weights and configs for Agents‑A1 — a 35B Mixture-of-Experts agent trained for long-horizon, tool-enabled reasoning; supports 262K-context serving and runtimes like vLLM and SGLang.
Streams routed experts from disk and treats storage, RAM and VRAM as a single inference hierarchy so MoE models (hundreds of billions to trillions of parameters) can run on consumer or heterogeneous hardware; single-file C engines with zero runtime deps and optional Vulkan/CUDA/Metal backends, speed governed by placement and disk I/O.
Predicts per-request MoE expert footprints from prefill activations and routes decode requests to workers that maximize expert-locality, lowering decode latency by combining offline K-means partitioning with online locality-band routing and a KV-block–coindexed signature cache.
Provides a portable C++ inference runtime to deploy embodied AI models (vision–language–action and world–action) on heterogeneous robot hardware, enabling latency-first batch-1 closed-loop control. Key features include modular multi-rate layers, fused low-latency inference, and extensible head/IO plugins.
Provides a large Mixture-of-Experts instruct LLM (295B total parameters, 21B active, 256K context) optimized for reasoning, long-context retention and agent workflows; open-sourced under Apache-2.0.
Generates real-time, infinite-length interactive videos of voice-controllable digital characters — 540p at up to 42 FPS on consumer GPUs. Uses TurboDiffusion and TurboServe to maintain temporal coherence without blur or drift, and accepts custom person, anime, or pet images plus selectable voice tones.
Runs a full 27B-class language model using end-to-end binary (1.125-bit) weights, cutting FP16 size to ~3.9 GB. Key features: 262k-token context, custom 1-bit kernels for Apple MLX and CUDA, and an optional DSpark drafter for faster decoding. Best when memory footprint matters; trades some FP16 accuracy for on-device feasibility.
Provides a 27B-class Qwen3.6-derived language model in GGUF with end-to-end ternary weights (Q2_0_g128), reducing deployed footprint to ~7.2 GB while retaining ~95% of FP16 reasoning ability and enabling on-device 262K-token context inference.
Runs a full 27B-class Qwen3.6-derived language model in a ~3.9 GB 1-bit GGUF pack for on-device inference with a 262K-token context; true 1.125 bits/weight binary representation, DSpark speculative drafter, and llama.cpp (CUDA/Metal/CPU) support.
Runs a full 27B-class Qwen3.6-derived LLM in a ~7.2 GB ternary/2‑bit format for on-device or single‑GPU text generation, retaining ~95% of FP16 performance and supporting a 262K‑token context. Designed for laptop/GPU deployment; exceeds typical phone memory limits.