Most small-parameter LLMs trade reasoning ability for footprint; ZAYA1-8B flips that expectation by using a Mixture-of-Experts design plus a post-training reasoning phase so a model with relatively few active parameters can match much larger models on formal math and coding benchmarks. The release targets scenarios where test-time compute and latency matter but you still need strong stepwise reasoning.
AI Model2026
ZAYA1-8B
Mixture-of-Experts LLM tuned for mathematical and coding reasoning, with ~760M active / 8.4B total parameters and post-training for improved stepwise reasoning. Optimized for inference efficiency (vLLM/transformers forks) so it can run in computation-constrained or local deployments; Apache-2.0 licensed.
Introduction
Information
- Websitehuggingface.co
- AuthorsZyphra
- Published date2026/05/04
Categories
More Items
AI Model2026
A dynamically quantized GGUF build of Ornith-1.5-35B optimized for agentic code-fixing and multi-turn conversations: targets 4-bit/≈22GB deployments, includes a vision projector, a custom importance matrix and a concise chat template.
AI Model2026
Open-weights LLM fine-tuned for phone-based voice agents that prioritizes low latency and reliable tool/function calling. Based on NVIDIA Nemotron 3 Nano (30B total, 3.5B active), supports very long contexts (262,144 tokens) and recommends temperature=0 with thinking disabled for deployment.
AI Model2026
A large open-weights MoE language model for complex coding, long-horizon agentic workflows, and cyber/security evaluations; post-trained from the GLM-5 family with substantial gains over GLM-5.2. Provides FP8/BF16 checkpoints and native support for very long contexts (up to 1M tokens).