Provides per-tensor mixed-precision GGUF quantizations of the Qwen3.8-Flash-Next MoE model using GSQ (Gumbel-Softmax Quantization) to produce tensor-level quantized variants and RCO (Riemannian Constrained Optimization) to allocate quant types under exact size budgets; includes a BF16 vision projector and three size/bit-width operating points.
Evaluates whether AI agents can autonomously use Sparse Autoencoders (SAEs) to discover interpretable features and causally steer model behavior. Introduces a 20-task benchmark that has agents design contrastive probes to search a 131K+ feature dictionary in Gemma-2-9B-IT and evaluates activation rank, selectivity, and causal steering against expert references.
A multimodal, agentic LLM optimized for long‑horizon, visually grounded workflows — capable of operating browsers and terminals and autonomously executing and testing code. Open‑source weights are available and the family ships in mini, Pro and Max variants for different compute/quality tradeoffs.
Explores a practical mechanism for recursive self-improvement by post-training LLMs: uses a routing harness to record agent executions and convert traces into curriculum-guided supervised fine-tuning and on-policy distillation data, closing an evaluation-selection-update loop and improving benchmark performance.
A reasoning‑efficient fine-tune of Qwen3.8-27B that penalizes overthinking tokens to shorten internal reasoning traces — about 58.3% fewer thinking tokens with <1% accuracy loss and ~1.95× speedup; designed for long-context, multimodal and quantized deployments.
Multimodal agentic model for long-horizon computer and browser tasks, with visual self-correction and function-calling. The Pro variant is a 397B Mixture-of-Experts (≈17B active) model with a 262,144-token context window, Docker deployment recipes, and weights currently marked “coming soon.”
Adds a Next Concept Prediction objective that predicts discrete, product-quantized latent concepts spanning multiple tokens alongside next-token prediction, yielding faster pretraining convergence and measurable downstream gains with an 8.9B-parameter latent-space LLM.
Generates full songs from lyrics and a style prompt, producing vocals and accompaniment and exporting editable symbolic scores for melody/chord control. Uses symbolic planning with agentic multi-turn editing and runs local 48 kHz inference on a 24GB GPU.
A multimodal Mixture-of-Experts foundation model with a million-token context window; uses a causal encoder–decoder layout and aggressive KV-cache compression (~890 bytes/token) to limit per-token activation to 8B/16B—designed for long-context, agentic, and multimodal workloads.
Defines recursive self-improvement (RSI) with an evaluation metric (Headroom-Closed Index) and a five-level autonomy roadmap—from executing human-specified improvements to recursively improving improvement mechanisms—while analyzing scenarios, verification challenges, and governance risks.
Progressively prunes and distills audio encoders for speech LLMs to cut inference cost while preserving decoder-facing embeddings, using behavioral probes, representation alignment, cross-scale distillation and LoRA finetuning; reports reduced macro-error on Chinese–English benchmarks.
F16 GGUF release packaged for llama.cpp and similar runtimes that applies UkisAI's Swift adapter to Qwen3.8-27B. Cuts reasoning/thinking tokens by ~58% with <1% performance loss, includes multimodal projector, MTP layers, multiple GGUF quant tiers, and is distributed under the Swift Open License v1.0.