Generates long-form, text-controlled music with explicit arrangement and planning. Uses a 50 Hz single-codebook tokenizer, a flow-matching diffusion Transformer to predict VAE latents, and an MoE autoregressor with ABC‑CoT planning to produce 48 kHz audio up to 5m30s.
AI Model2026
Preview agentic language model for research and engineering workflows that turns research questions into executable, verifiable workflows via tool use and long-context reasoning; built on a 744B-parameter MoE (GLM-5.2) with MIT-licensed BF16 and FP8 checkpoints.
AI Model2026
A pretrained autoregressive foundation LLM from Yandex that uses a hybrid MoE design (80B params, 3B active) and supports up to 262,144-token context. Notably strong on Russian factual knowledge, math and coding benchmarks; intended for research and fine-tuning rather than out-of-the-box production.
AI Model2026
A 29B-parameter mixture-of-experts LLM for long-context reasoning and agent-style workflows, with native 256K context and Ascend NPU co-optimizations. Compatible with Transformers/vLLM ecosystems; suitable for long-horizon agents and domain fine-tuning.
Describes DeepSeek-V4.1-Flash, a 552B-parameter multimodal Mixture-of-Experts LLM that supports up to 1M-token contexts and reduces KV cache footprint using Compressed Sparse Attention 2, FP4 KV caching, and SWA Bounded Replay to lower HBM/SSD and prefill costs.
An all-in-one multilingual scene text recognition approach that pairs a shared visual encoder with a script-aware Mixture-of-Experts (ScriptMoE) decoder to route each image to top-2 script experts. Introduces TextMuSS-10M, a synthetic dataset covering 10 scripts and 229 languages, and reports state-of-the-art accuracy and large end-to-end OCR F1 gains while remaining parameter-efficient.
AI Model2026
A sparse-MoE multimodal LLM fine-tuned with large-scale mixed reinforcement learning, supporting text/image/video/audio and a 1M-token context window; designed for long-horizon agentic tasks, coding and visual reasoning with groupwise grading and on-policy distillation.
AI Model2026
Open-weights multimodal LLM checkpoint designed for 1M-token long-context agent runs that combines large-scale on-policy RL with groupwise grading for iterative self-improvement. Key traits: sparse MoE backbone (≈1.02T total / 42B active), text-only output with image/video/audio inputs, MIT-licensed weights on HuggingFace—suited for long-horizon agents and research at significant infra cost.
Xingyu Miao, Zizun Li +46Shanghai AI Laboratory: Affiliation: Project page:https://internrobotics.github.io/InternW0-Delta/
Learns joint predictive visual dynamics and action generation for generalist robot manipulation, translating future-relevant visual representations into actions. Integrates a Mixture-of-Transformers coupling a video expert and action expert, a frozen vision-language model for semantics, 4D distillation, and Causal Imprint; pretrained on a 20K+ hour heterogeneous corpus.
AI Model2026
Capability-targeted compression of Qwen3.8-Flash-Next: half the experts are removed and remaining weights quantized to 3.5 bpw, producing a 58.4 GB GGUF (29.6 GB resident) that preserves coding and multimodal ability while trading off other domains.
AI Model2026
Open-weight 309B Mixture-of-Experts causal LLM with 15.5B active parameters and a native 1M-token context for coding and AI R&D. Combines Sliding-Window Attention and DeepSeek Sparse Attention (no full-attention layers), supports FP8 inference; weights under MIT license.
Arseny Ivanov, Alexander Kolesov +3Affiliation: AXXX, Moscow, Russia, Affiliation: Applied AI Institute, Moscow, Russia
Models sequence generation by unmasking multiple tokens per denoising step and replaces a factorized reverse process with a mixture over discrete routing-based latents from an MoE backbone; improves few-step sampling quality without increasing active parameters.