Evaluates multi-field JSON schemas in parallel to extract boolean or categorical field values from text, producing guaranteed-valid JSON and per-field calibrated confidences. Uses KV-cache broadcasting, sub-vocabulary logit slicing and token-tree disambiguation to cut latency (5.6x–7.0x on M4 Max) versus autoregressive decoding; requires Apple Silicon and MLX.
Fast, non-autoregressive decision engine that answers typed questions (choice/score/noul) over text or JSON states with calibrated probabilities and confidences in a single forward pass. Suited for routing, triage and moderation workflows; includes a Router to pick checkpoints per request.