Tag

Qwopus-3.6-27B-Coder

A quantized 27B coder LLM fine-tuned for repository-level code generation, multi-turn tool calling, and agentic workflows — packaged for local GGUF/llama.cpp deployment with MTP speculative decoding and trace-inversion SFT. Optimized for developer tooling; experimental and not fully safety-validated.

Omnigent

Orchestrates, composes, and governs multiple AI agents (Claude Code, Codex, Cursor, Pi, and custom agents) via a meta-harness that enforces policy-based sandboxing, spend caps, and live collaborative sessions. Agent behavior is declared in YAML and can run locally or in managed cloud sandboxes.

unsloth/MiniMax-M3-GGUF

Provides experimental GGUF-format quantized weights for MiniMax-M3 to run local multimodal (image‑text‑video) inference via llama.cpp or Unsloth Studio. The model is very large (~428B params) and requires GPU offload or large CPU RAM; llama.cpp currently falls back from sparse to dense attention.

Kairos: A Native World Model Stack for Physical AI

Learns, maintains, and runs unified world models for Physical AI using a cross-embodiment pretraining curriculum and a hybrid linear temporal-attention architecture. Emphasizes long-horizon state persistence, theoretical bounds on error accumulation, and deployment-aware low-latency inference for real-world embodied agents.

GLM-5.2-FP8

Provides FP8-quantized weights of GLM-5.2 — a 744B long-context LLM tuned for sustained 1M-token engineering, coding and agentic workflows; compatible with vLLM, Transformers, SGLang and Ascend NPU deployments.

GLM-5.2 (Unsloth GGUF)

Provides GGUF-quantized GLM-5.2 builds for local text-generation with a solid 1M-token context, dynamic 1-/2-bit quant options, and Unsloth runtime integrations — targeted at long-horizon coding, reasoning and agent workflows. MIT licensed.

Gemma4-12B v2 — Coding + Agentic Edition (GGUF)

A local, quantized Gemma 4 12B fine-tune packaged as GGUF quants that runs on ~4.5 GB VRAM. Optimized for coding and multi-step agentic tool use (read→reason→act→verify), ships multiple quant sizes (Q3_K_M–Q8_0) and MTP draft support; English-centric with trade-offs versus generalist models.

NVIDIA GLM-5.2 NVFP4

Provides a pre-quantized NVFP4 checkpoint of GLM-5.2 for long-context reasoning and coding; reduces model footprint so GLM-5.2 can run on multi‑GPU Blackwell nodes and is ready for inference with SGLang and vLLM.

nvidia/Qwen3.6-27B-NVFP4

NVFP4-quantized variant of Qwen3.6-27B that reduces parameter bits from 16 to 4, cutting disk and GPU memory requirements by ~2.5× while keeping comparable benchmark accuracy; ready for vLLM-based inference on NVIDIA hardware and supports long, multimodal contexts.

LFM2.5-230M

230M-parameter multilingual instruction-tuned text-only LLM for on-device agentic pipelines and data extraction; 32K context, 19T-token pretraining, optimized for fast CPU/edge inference (e.g., 213 tok/s on Galaxy S25 Ultra, 42 tok/s on Raspberry Pi 5); not for heavy reasoning or complex code generation.

Inflect-Nano-v2

Generates English speech locally from text into 24 kHz waveforms with a fixed synthetic male voice. Complete text-to-waveform TTS under ~4M parameters (≈16 MB FP32), supports CPU/CUDA inference, deterministic seeds, long-text chunking and an ONNX export path under Apache-2.0 license.

Ornith-1.0-35B-GGUF

A self-improving, agentic coding LLM tailored for terminal-style coding agents and tool-calling, provided as 35B MoE GGUF weights with very large context support. Trained with reinforcement learning to jointly generate task scaffolds and solutions; designed for local inference and OpenAI-compatible tool endpoints.