A 29B-parameter mixture-of-experts LLM for long-context reasoning and agent-style workflows, with native 256K context and Ascend NPU co-optimizations. Compatible with Transformers/vLLM ecosystems; suitable for long-horizon agents and domain fine-tuning.
Evaluates multi-field JSON schemas in parallel to extract boolean or categorical field values from text, producing guaranteed-valid JSON and per-field calibrated confidences. Uses KV-cache broadcasting, sub-vocabulary logit slicing and token-tree disambiguation to cut latency (5.6x–7.0x on M4 Max) versus autoregressive decoding; requires Apple Silicon and MLX.