An uncensored GGUF build of GLM-5.2 that applies weight “abliteration” to remove refusal filters and produce a locally runnable text-generation model; includes quantization conversions and shard-merge instructions, intended for experimental research rather than production use.
Provides a portable C++ inference runtime to deploy embodied AI models (vision–language–action and world–action) on heterogeneous robot hardware, enabling latency-first batch-1 closed-loop control. Key features include modular multi-rate layers, fused low-latency inference, and extensible head/IO plugins.
Provides a large Mixture-of-Experts instruct LLM (295B total parameters, 21B active, 256K context) optimized for reasoning, long-context retention and agent workflows; open-sourced under Apache-2.0.
Runs a full 27B-class language model using end-to-end binary (1.125-bit) weights, cutting FP16 size to ~3.9 GB. Key features: 262k-token context, custom 1-bit kernels for Apple MLX and CUDA, and an optional DSpark drafter for faster decoding. Best when memory footprint matters; trades some FP16 accuracy for on-device feasibility.
Runs a full 27B-class Qwen3.6-derived language model in a ~3.9 GB 1-bit GGUF pack for on-device inference with a 262K-token context; true 1.125 bits/weight binary representation, DSpark speculative drafter, and llama.cpp (CUDA/Metal/CPU) support.
Runs a full 27B-class Qwen3.6-derived LLM in a ~7.2 GB ternary/2‑bit format for on-device or single‑GPU text generation, retaining ~95% of FP16 performance and supporting a 262K‑token context. Designed for laptop/GPU deployment; exceeds typical phone memory limits.
Decides whether a user prompt should be executed locally on an edge small LLM or routed to a larger cloud model, emitting a deterministic pipe-separated decision string. A 51.7M micro-LLM fine-tuned with multi-task sequence generation to predict domain, complexity and code/math flags, optimized for ultra-low latency edge routing.
Provides labeled prompts with full-reference answers (including chain-of-thought and code blocks) and per-example metadata to train edge routing/orchestrator models that decide whether to handle inputs locally or route them to larger models. Includes complexity scores, coding/math flags, routing justifications, and an automated override rule; suited for fine-tuning small models (50M–1.5B) for edge deployment.
Fine-tuned variant of Qwen3.6-27B that cuts internal reasoning (‘thinking’) token usage by roughly 46% on average while preserving benchmark accuracy and safety behavior. Targets lower latency and inference cost; ships on Hugging Face with GGUF quantizations for local use.
GGUF-format quantized release of DeepSeek‑V4‑Flash for local inference — compatible with llama.cpp and Unsloth runtimes, with guidance for FP4/FP8 mixed precision and Q4/Q8 quantization; tuned for million-token long-context usage.
Provides pre-converted colibrì-format int4 weights so GLM-5.2 (744B MoE) can run by streaming routed experts from disk on a consumer machine with ~25 GB RAM. Includes MTP shard for lossless speculative decoding; requires the colibrì engine and ~400 GB NVMe.
A GGUF-format Qwen3.6 35B base model image-text-to-text release repaired via tensor-level SVD/scale correction and packaged with Hermes agent tweaks; multimodal (vision + text), MoE architecture, ready for GGUF runtimes like llama.cpp.