Merges Unsloth UD XL quantized GGUF of Qwen3.6-27B with compact Q8_0 MTP heads to enable multi-token (speculative) decoding on llama.cpp builds that support MTP; aimed at image-text-to-text usage with reduced MTP overhead.
High-throughput LLM inference engine for agentic workloads, combining a local‑SPMD static compiler for parallelism, a C++ scheduler with a Python execution plane and type‑safe KV‑cache reuse, pluggable high-performance kernels (including an MLA implementation), and a low‑overhead AsyncLLM entrypoint for production GPU inference.
Converts text into natural-sounding speech locally using compact ONNX TTS assets. Optimized for CPU/edge inference (~99M params) with support for 31 languages, expression tags (e.g., <laugh>), and improved stability versus Supertonic 2 — suitable for on-device multilingual TTS.
A reasoning-enhanced Mixture-of-Experts (MoE) LLM fine-tuned for multimodal image-text-to-text tasks and long-context reasoning; built on Qwen3.6-35B-A3B with LoRA and released as an experimental GGUF community model.
Provides 1,781 OpenTelemetry execution traces of LLM-powered agents across six benchmarks, including full conversations, token usage, timing, tool calls and model metadata—useful for performance analysis, agent-behavior research, and inference debugging.
Distilled dev checkpoint of an image foundation model that natively unifies raw pixels and text tokens for text-to-image, image editing, long-text rendering, and subject-driven personalization at up to 2048×2048. The Dev variant targets faster (28-step) inference for iterative use and research.
A 30B mixture-of-experts multilingual translation model supporting 33 languages and instruction-following translation. Offers MoE architecture, fast-thinking mode, and quantized/deployment-ready variants for production translation and subtitle tasks.
A family of multilingual translation models optimized for real-world, instruction-following translation across 33 languages. The 1.8B model targets on-device use with extreme quantization (≈440 MB via AngelSlim), while 7B/30B variants trade size for higher accuracy.
7B multilingual translation model optimized for instruction-following and low-latency deployment across 33 languages; provides quantized/FP8/GGUF builds and integrations (vLLM, llama.cpp) for server and on-device inference.
A GGUF-quantized build of Qwen3.6-35B packaged by unsloth for local and accelerated inference. Adds MTP speculative decoding guidance and deployment notes for llama.cpp, vLLM, SGLang and long-context/multimodal use cases.
Generates production-ready offensive-security artifacts from prompts—Nuclei templates, CVE PoCs, exploit scripts and pentest tooling—fine-tuned on bug-bounty reports and CVE writeups and quantized for consumer/server GPU deployment.
Early pretraining checkpoint of a compact multilingual causal LM aimed at low-memory deployment and Indic language support. Explores a Shared KV cache mode that can cut KV-cache memory by ~50% for inference; results are provisional (not a final, fully trained model).