Oops! Something went wrong
[next-mdx-remote-client] error compiling MDX: Could not parse expression with acorn More information: https://mdxjs.com/docs/troubleshooting-mdx
AI Model2026
Ternary Bonsai 27B (prism-ml/Ternary-Bonsai-27B-mlx-2bit)
Runs a full 27B-class Qwen3.6-derived LLM in a ~7.2 GB ternary/2‑bit format for on-device or single‑GPU text generation, retaining ~95% of FP16 performance and supporting a 262K‑token context. Designed for laptop/GPU deployment; exceeds typical phone memory limits.
Introduction
Information
- Websitehuggingface.co
- OrganizationsPrism ML, Hugging Face
- Published date2026/07/04
Categories
More Items
AI Model2026
Generates calibrated decisions (choice/score/noul) from a prompt and optional images, up to 256 options. Routed MoE experts are quantized to NVIDIA NVFP4 to reduce weights to ~25.6 GB and GPU memory to ~23.3 GiB; provided as a vLLM-compatible System 1 decision model with a /v1/decide endpoint.
AI Model2026
Runs a 24B-parameter mixture-of-experts reasoning model with only ~2B active parameters per token for fast on-device agentic workflows; provides a 131K-token context and 128K vocabulary, post-trained for tool calling and agentic RL—pair with retrieval for knowledge-heavy tasks.
AI Model2026
Multimodal image/video-to-text model optimized for on-device inference: the 1B variant uses early visual-token compression and multiple quantization formats to improve capability-per-compute, and supports mobile platforms and common inference frameworks.