A GGUF-quantized build of Qwen3.6-35B packaged by unsloth for local and accelerated inference. Adds MTP speculative decoding guidance and deployment notes for llama.cpp, vLLM, SGLang and long-context/multimodal use cases.
Generates production-ready offensive-security artifacts from prompts—Nuclei templates, CVE PoCs, exploit scripts and pentest tooling—fine-tuned on bug-bounty reports and CVE writeups and quantized for consumer/server GPU deployment.
Runs a Kubernetes-native runtime that multiplexes many stateful agent-like actors onto a small pool of sandboxed worker pods via full-state snapshots and pre-warmed workers, enabling sub-second suspend/resume and 30x+ oversubscription.
Multilingual streaming ASR that transcribes 40 language-locales using a cache-aware FastConformer‑RNNT architecture. Supports language-ID prompting (or auto-detect), punctuation/capitalization, and configurable chunk sizes to trade latency vs. accuracy for production transcription and streaming voice agents.
Provides a locally runnable 26.9B Qwen3.6 checkpoint that surgically reduces refusal behavior in weight space while preserving capability; ships bfloat16 safetensors and a GGUF quant ladder for local runtimes and red-team evaluation.
Routes LLM API traffic across providers by translating OpenAI, Anthropic, and OpenAI Responses formats, and orchestrates multi-backend routing with typed algorithms and Prometheus metrics. A Rust proxy/library offering launcher, standalone server, and embeddable routing components; experimental (pre-alpha).
End-to-end Python framework for training and serving NVIDIA's Cosmos world models (Cosmos3), integrating distributed training (FSDP/TP/CP/PP), DCP/safetensors checkpoints, dataset adapters, multiple inference backends, online serving, and agent skills.
A ternary-weight (~1.58-bit) 4B text-to-image diffusion transformer optimized for NVIDIA GPUs using Gemlite INT2 and HQQ; it reduces the transformer to ~1.21 GB (4.55 GB CUDA payload) and targets 1024×1024 generation with a 4-step FlowMatch-Euler sampler.
Processes images and text to produce structured, reasoning-rich text outputs for high-throughput agentic workflows. Sparse MoE design (198B total, ~11B active per token), 256k context window and selectable reasoning levels—optimized for single-pass parsing, verification, and multi-step automation.
Performs fast, high-quality vision–language grounding: given an image plus a natural-language prompt it returns bounding boxes or points for referred objects. Uses Parallel Box Decoding for parallel coordinate prediction (higher throughput) and targets research/non-commercial use.
Performs image-to-text document parsing and OCR for complex elements (tables, formulas, charts, seals), with multilingual support (en/zh). It uses region-aware data optimization and progressive post-training to improve weak-region supervision and is plug-and-play compatible with PaddleOCR-VL-1.5.
Quantized NVFP4 build of the Qwen3.6-35B MoE language model, optimized with NVIDIA Model Optimizer to cut model size and GPU memory by ~3.06× for inference. Designed for vLLM and NVIDIA GPU deployments (Hopper/Blackwell).