AI Deploy2026
Runs local AI models on Apple Silicon as an OpenAI‑compatible server, emphasizing low latency, prompt caching, and reliable tool-calling. Optimized for M1–M4 Macs with multimodal support and drop‑in compatibility for IDEs and agent frameworks.
AI Model2026
Identifies and surgically removes the internal activation directions that trigger refusal behavior in large language models, with one-click options on a HuggingFace Space or a local Python API. Combines multiple extraction methods (SVD, whitened SVD, sparse autoencoders), reversible steering, and analysis-informed verification to quantify capability and refusal trade-offs.
AI Model2026
Community fine-tuned multimodal Qwen3.5-9B using Claude 4.6 distilled data to change the model's 'thinking' behavior; offers an uncensored 'heretic' flavor with image-text-to-text I/O, benchmark comparisons, and deployment notes for inference frameworks.
AI Model2026
A distilled 26M-parameter encoder–decoder LLM for on-device function-calling and tool use. Uses a pure-attention Simple Attention Network, provides open weights and local finetuning, and targets high-throughput inference on the Cactus runtime.
AI Infra2026
Compresses high-dimensional embeddings into low-bit TurboQuant indexes for fast, memory-efficient local vector search. Supports online ingest (no train/rebuild), SIMD kernels that match or beat FAISS, per-vector length-renormalization, and runtime allowlists — suited for privacy-sensitive, low-latency RAG.
AI Model2026
A dense 128B multimodal model with a 256k context window, configurable reasoning effort, and native function-calling for agentic workflows. Supports text+image input, multilingual output, and is released on Hugging Face under a Modified MIT license with revenue-based exceptions.
AI Infra2026
Provides hardware-isolated, sub-60ms, ultra-low-overhead sandboxes to run untrusted LLM/agent code. Offers event-level snapshots, kernel-level egress control, credential vaulting, and drop-in E2B SDK compatibility for high-density AI agent deployment.
AI Model2026
Provides a compact GGUF export of a tuned Gemma‑4 26B variant for local inference, optimized for llama.cpp and Apple Silicon to deliver faster, less‑censored chat and coding outputs. Includes Q4_K_M quantization and a neutral embedded template for more reliable local deployments.
AI Model2026
Generates text by iteratively denoising blocks of tokens with a two-tower design: a frozen autoregressive context tower and a trainable diffusion denoiser tower, trading minimal quality loss for higher wall-clock throughput.
AI Model2026
A Mixture-of-Experts instruct-capable LLM (295B total, 21B active) designed for long-context reasoning, code/agent workflows and instruction-following; released by Tencent Hy Team with safetensors weights on Hugging Face.
AI Model2026
Drafts multiple tokens in parallel with a lightweight block-diffusion drafter to enable speculative decoding for faster LLM inference. Designed to pair with Qwen3.6-35B-A3B and reports up to ~2.9× throughput improvements on common benchmarks.