AI Infra2026
Provides high-performance CUDA/CUTLASS kernels implementing Kimi Delta Attention (KDA), accelerating KDA prefill on SM90+ (Hopper) GPUs. Integrates as a drop-in backend for flash-linear-attention, supports native variable-length batching, and targets K=V=128; requires CUDA 12.9+/PyTorch 2.4+.
AI Deploy2026
Provides reusable Docker compose files, scripts and benchmarked configs to serve modern LLMs (Qwen, Gemma, etc.) on 1–2 NVIDIA RTX 3090/4090/5090 GPUs. Multi-engine (vLLM, llama.cpp, ik_llama), measured TPS/context tradeoffs, and validated single/dual‑GPU recipes.
AI Dataset2026
A collection of biology-focused 'mystery' tasks for benchmarking model performance on biomedical reasoning, evidence synthesis, and problem solving; curated by Anthropic and hosted on Hugging Face, designed for granular evaluation of scientific decision-making.
AI Dataset2026
Provides 545,431 math problems with model-generated solution traces (chain-of-thought and Python tool-integrated reasoning) verified against reference answers for training and evaluating LLM mathematical reasoning. Parquet-format dataset; DeepSeek‑V4‑Pro generated traces and mixed CC BY / CC BY‑SA licensing.
AI Infra2026
Ingests and normalizes security telemetry, runs multi-model AI agents to produce replayable investigations and automated triage/response; key features include a step-by-step Investigation Ledger, CI-gated eval harness, and self-hostable deployments.
AI Deploy2026
Runs local LLMs on Apple Silicon using native MTP speculative decoding to accelerate token generation while preserving the model's output distribution. Leverages the model's own MTP heads with batched verification and exact rejection sampling; ships with a Mac app, CLI, local OpenAI/Anthropic-compatible server, auto-tune, and Forge for building/verifying MTP adapters.
AI Infra2026
Native local inference engine for DeepSeek V4 Flash (also supports GLM 5.2 and PRO on high‑memory machines). Focused features include model-specific loading, SSD expert streaming, asymmetric routed-expert 2-bit quant support, multi-GPU/tensor/pipeline parallelism, and an OpenAI-compatible server plus a native coding agent.
Measures how well LLMs and agent-driven workflows prepare supervised training data end-to-end by jointly benchmarking data construction and data-quality evaluation across six domains, using a downstream-grounded protocol and new metrics.
AI Dataset2026
Provides ~3.8M chain-of-thought training examples (~3B tokens) that use a fixed 'Inventory / Interaction / Execution' scaffold to improve concise, reliable reasoning in small LLMs; topic-labeled, deduped, includes real tool-execution traces, CC-BY-4.0.
AI Agent2026
Provides a ruleset and skills that make AI coding agents prefer the simplest correct implementation: reuse existing code, prefer stdlib/native features, and only write minimal new code. Cuts generated LOC, tokens, cost and time while preserving validation and safety.
AI Model2026
Provides an open-weight native multimodal agent that understands text and images within a 1,048,576-token context window for long-horizon coding, visual reasoning, and tool-driven workflows. Uses a 2.8T-parameter Mixture-of-Experts architecture (KDA + AttnRes) with MXFP4 quantization; best suited for research and large-scale inference setups.
AI Model2026
Policy-adaptive multimodal safety classifier that evaluates text and images against free-form natural-language policies and returns a continuous yes/no safety score. Produces a single-token verdict from a 3B-parameter model, supports multiple languages, and is designed for lightweight real-time moderation.