AI Dataset2026
Provides labeled prompts with full-reference answers (including chain-of-thought and code blocks) and per-example metadata to train edge routing/orchestrator models that decide whether to handle inputs locally or route them to larger models. Includes complexity scores, coding/math flags, routing justifications, and an automated override rule; suited for fine-tuning small models (50M–1.5B) for edge deployment.
AI Model2026
Fine-tuned variant of Qwen3.6-27B that cuts internal reasoning (‘thinking’) token usage by roughly 46% on average while preserving benchmark accuracy and safety behavior. Targets lower latency and inference cost; ships on Hugging Face with GGUF quantizations for local use.
AI Model2026
GGUF-format quantized release of DeepSeek‑V4‑Flash for local inference — compatible with llama.cpp and Unsloth runtimes, with guidance for FP4/FP8 mixed precision and Q4/Q8 quantization; tuned for million-token long-context usage.
AI Model2026
Provides pre-converted colibrì-format int4 weights so GLM-5.2 (744B MoE) can run by streaming routed experts from disk on a consumer machine with ~25 GB RAM. Includes MTP shard for lossless speculative decoding; requires the colibrì engine and ~400 GB NVMe.
AI Model2026
GGUF-quantized builds of a 1B 'Thinking' MiniCPM5 model fine-tuned on Fable 5 (V2) for local runtimes; enhances tool/function-calling, coding and instruction-following, and supports long contexts (up to 128K tokens).
AI Model2026
Provides low-bit quantized Hy3 (hy_v3) GGUF model weights and mixed-precision quantization recipes for running Hy3 on llama.cpp, with optional MTP self-speculative decoding and imatrix-based calibration for improved quality/speed trade-offs.