AI Model2026
An instruct-focused LLM (104B total, 7.4B active) optimized for fast, token-efficient inference in agent workflows. Uses hybrid linear attention plus a sparse MoE to raise throughput and cut token use; suited for high-frequency production agents, with some trade-offs in very deep reasoning.
AI Model2026
A trillion-parameter LLM optimized for long-context, low-latency text generation and agentic coding workflows. Combines MLA+Linear Attention and a post-training 'fast thinking' token-suppression strategy to reduce token overhead and improve multi-step execution reliability for production agents.
AI Model2026
Distills DeepSeek‑V4's multi-step structured reasoning into a Qwen3.5‑9B model for fast image-text-to-text reasoning and agentic tool workflows. Trades larger teacher size for inference efficiency and improved procedural reasoning — good for low-latency research, evaluation, and agent integration.
AI Model2026
Unified 4B vision-language model for document understanding that converts images or text into template-driven structured JSON or clean Markdown. Key features: multimodal inputs (image+text), template-based extraction, reasoning vs non-reasoning modes, and vLLM/OpenAI-compatible deployment for OCR, invoice/forms extraction, and RAG preprocessing.
AI Model2026
An uncensored, fine-tuned and GGUF-quantized variant of Qwen3.6-27B tailored for long-context, coding, vision and creative-writing use. Offers multiple NEO-CODE Di-Matrix quants (IQ2/IQ4/Q6/Q8), mmproj vision support and recommended inference settings for local servers.
AI Model2026
Draft model for speculative decoding that uses a lightweight block-diffusion drafter to propose multiple tokens in parallel; designed to pair with google/gemma-4-31B-it and accelerate autoregressive text generation (official benchmarks report up to ~5.8× throughput).
AI Model2026
DavidAU/Qwen3.6-40B-Claude-4.6-Opus-Deckard-Heretic-Uncensored-Thinking-NEO-CODE-Di-IMatrix-MAX-GGUF
A 40B GGUF-quantized Qwen3.6 variant fine-tuned with Claude 4.6 Opus and Deckard/Heretic datasets for multimodal image-text-to-text tasks. Offers 256K context, custom NEO-CODE Di-IMatrix quants for long conversations and coding, optimized for local inference and creative/coding use cases; safety alignment removed.
AI Deploy2026
Runs local LLMs on Apple Silicon using native MTP speculative decoding to accelerate token generation while preserving the model's output distribution. Leverages the model's own MTP heads with batched verification and exact rejection sampling; ships with a Mac app, CLI, local OpenAI/Anthropic-compatible server, auto-tune, and Forge for building/verifying MTP adapters.
AI Model2026
Generates uncensored videos from text and images using an LTX 2.3–based diffusion model with native t2v and i2v support; ships with a prompt enhancer and developer-focused gguf/bf16 dev releases for local experimentation.
AI Model2026
Mixture-of-Experts LLM tuned for mathematical and coding reasoning, with ~760M active / 8.4B total parameters and post-training for improved stepwise reasoning. Optimized for inference efficiency (vLLM/transformers forks) so it can run in computation-constrained or local deployments; Apache-2.0 licensed.
AI Infra2026
Defines OpenTelemetry semantic conventions for generative AI telemetry — spans, metrics, and events for GenAI clients, the Model Context Protocol (MCP), and provider-specific integrations. Includes YAML models, human-readable docs, and reference implementations to standardize observability across GenAI deployments.
AI Infra2026
Native local inference engine for DeepSeek V4 Flash (also supports GLM 5.2 and PRO on high‑memory machines). Focused features include model-specific loading, SSD expert streaming, asymmetric routed-expert 2-bit quant support, multi-GPU/tensor/pipeline parallelism, and an OpenAI-compatible server plus a native coding agent.