AI Deploy2026
Shuo Yang, Xiaoze Fan +9University of California, Berkeley, Massachusetts Institute of Technology +2
Runs large open-weight MoE models locally by coordinating CPU and GPU resources, caching experts, and reallocating VRAM at runtime. It targets consumer hardware, from laptops to workstation GPUs.
AI Model2026
Provides GGUF-format quantized shards of Laguna S 2.1 for local or self-hosted inference—packaged for llama.cpp/llama-server and usable with vLLM/Transformers runtimes; targeted at long-context, agentic coding workloads.
AI Model2026
4-bit NVFP4 (W4A4) quantized pack of Upstage Solar Open2 250B for vLLM serving on NVIDIA Blackwell GPUs, preserving MoE routing and near-BF16 quality while cutting model size from 500.6 GB to 153.3 GB.
AI Model2026
A 250B-parameter mixture-of-experts LLM that activates 15B parameters per token to lower inference cost for agentic tasks—tool calling, long-context reasoning, and coding. Uses a hybrid softmax+linear-attention stack with 1M-token context and supports English, Korean, and Japanese; requires H200/B200-class GPUs to run efficiently.
AI Model2026
Provides a 2‑bit quantized build of Qwen3.6‑35B‑A3B for local serving via an OpenAI‑compatible HTTP API. Key features: 12.3 GB on disk, eschamoe mixed 2/3‑bit expert quantization with int8 dense layers, runs on a single 16–24 GB NVIDIA GPU and ships with Escha SGLang and ZML runtimes.
AI Model2026
A text-only open-weight MOE code model (35B total, 3B active) fine-tuned with SFT+RL for agentic coding; achieves strong agentic-code benchmarks, supports 262k context and deployment via Transformers/vLLM; vision weights are not included.
AI Model2026
Provides a 750-billion-parameter multilingual Mixture-of-Experts (MoE) foundation language model optimized for long-context understanding, agentic workflows, and instruction following. Key features include a 262,144-token context window, speculative decoding (MTP/DSpark), 37B active parameters, 10-language support, and an Apache-2.0 license.
AI Model2026
Enables local use of a GGUF-quantized DeepSeek-V4-Flash-0731 via Unsloth Dynamic quantizations; provides a Q8 (162GB) lossless option and smaller Q4 variants for lower-memory inference and agentic scenarios using Unsloth tooling.
AI Model2026
Finetunes Qwen3.6‑35B using an adversarial generator–critic loop that synthesizes ~10,000 verifiable “frontier” tasks to boost scientific research, long‑horizon reasoning, coding and tool use; supports an extended 262,144‑token context and common serving stacks.
AI Model2026
A 27B-parameter causal language model with a native vision encoder for image/video+text understanding, long-horizon agentic tasks, and tunable thinking-mode reasoning. Native 262,144-token context (extensible to 1,000,000) and production-focused inference recipes.
Tao Feng, Fangxu Yu +10University of Illinois Urbana-Champaign, University of Maryland, College Park +3
Frames LLM routing as a sequential decision process and introduces LLMRouter plus the xRouteBench benchmark to develop, evaluate, and deploy learned routing policies across heterogeneous LLMs, optimizing response quality versus inference cost.
AI Model2026
FP8-quantized checkpoint of the Qwen3.8 text-only causal LLM (2.4T params, 95B activated) for text-generation; preserves near-original performance, supports very long contexts (262k–1M), Mixture-of-Experts architecture, and is compatible with vLLM/SGLang/TokenSpeed. Thinking mode and preserve_thinking are enabled by default.