Tag

Nex-N2-mini

Provides compact, agentic text-generation for long-horizon, tool-enabled workflows — trading some peak capability for lower latency and easier on-prem deployment. Key features: adaptive/coherent thinking traces, function-calling support, and sglang/docker-ready serving.

google/gemma-4-12B-it-qat-q4_0-gguf

Provides a GGUF-ready QAT (Q4_0) quantized build of Gemma 4 12B that preserves near-bfloat16 quality while reducing memory footprint for local inference; compatible with Transformers-based and GGUF runtimes.

Gemma-4-12B-OBLITERATED

A surgically modified Gemma 4 (12B) that removes refusal behavior while preserving benchmark parity; released as an uncensored research artifact with GGUF quantizations for local inference and red‑team/alignment evaluation.

unsloth/gemma-4-12B-it-qat-GGUF

GGUF-format QAT (quantization-aware training) build of Gemma 4 12B that reduces memory needs for local or lightweight inference while preserving near bfloat16 quality. Ready for any-to-any conversational pipelines and ecosystem deployment.

Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings

Removes the subspace of frequent, uninformative tokens that LLMs inject into text embeddings via the model's unembedding matrix. EmbedFilter is a lightweight linear transform that refines LLM-derived embeddings to improve zero‑shot semantic retrieval, enable dimensionality reduction, and speed up indexing; code on GitHub.

On the Geometry of On-Policy Distillation

Analyzes the parameter-space geometry of on-policy distillation (OPD) for LLM training, showing OPD updates affect fewer weights, avoid principal directions, and rapidly lock into a low-dimensional update subspace. Compares OPD with supervised fine-tuning (SFT) and reinforcement learning with verifiable rewards (RLVR) and studies implications for optimization and objective mixing.

unsloth/gemma-4-26B-A4B-it-qat-GGUF

A GGUF release of Gemma 4 26B A4B (QAT) packaged by Unsloth for local multimodal inference — quantization-aware trained to keep near-bfloat16 quality while significantly lowering memory requirements, compatible with Transformers and Unsloth tooling.

North Mini Code (CohereLabs/North-Mini-Code-1.0)

Code-focused sparse Mixture-of-Experts LLM designed for agentic coding and terminal/tool use, offering very long context (256K) and long outputs. Released with open weights under Apache-2.0 and optimized for transformers/vLLM workflows.

huihui-ai/Huihui-gemma-4-12B-it-abliterated

Experimental, uncensored fine-tune of Google Gemma-4-12B-it that applies an 'abliteration' technique to remove refusal behaviors; intended for research and testing only and carries elevated safety and legal risks.

Nemotron-Labs-Audex-30B-A3B

Adds discrete audio tokens and an audio encoder to a 30B MoE text LLM so a single model can perform ASR, speech translation, TTS, text-to-audio and speech-to-speech while preserving text reasoning and long-context capabilities; supports thinking/instruct modes and up to 1M-token context.

MiMo-V2.5-Pro-FP4-DFlash

Implements MXFP4 quantization on MoE experts plus a BF16 DFlash block-diffusion drafter to propose whole-token blocks for verification, cutting memory bandwidth and backbone forward passes for trillion‑parameter text generation—targeting long‑context, agent and code workloads.

DiffusionGemma 26B A4B

Generates text from interleaved text, image, and short-video inputs using discrete diffusion and block‑autoregressive multi‑canvas sampling; built on a sparse MoE (8/128) Gemma 4 backbone and optimized for low‑latency inference and very long contexts (up to 256K tokens).