Experimental MiniMax H3 variant that injects learned stylistic and motion 'character' from LTX 2.3, Wan 2.2 and Krea 2 into H3 by surgically grafting attention and MLP components; preserves H3 modality routing while shifting t2v/i2v aesthetics, with limited audio impact and community-license constraints.
A 9B dense reasoning LLM optimized for single‑GPU deployment and terminal-based coding agents, with long-context support (up to 262,144 tokens) and GGUF/quantized builds for edge/mobile. Strong on coding and agentic benchmarks.
Introduces Declarative Attention (DA), a zero-shot protocol that has LMs declare which parts of long context to attend to during chain-of-thought, letting the runtime build dynamic attention masks and skip most KV-cache reads. Produces large token savings (up to ~52% on Gemma-4-31B) with modest accuracy loss.
Evaluates whether AI agents can autonomously use Sparse Autoencoders (SAEs) to discover interpretable features and causally steer model behavior. Introduces a 20-task benchmark that has agents design contrastive probes to search a 131K+ feature dictionary in Gemma-2-9B-IT and evaluates activation rank, selectivity, and causal steering against expert references.
Analyzes why on-policy distillation can produce excessively long student rollouts by identifying termination-token mismatch between students and teachers, and proposes aggregating functionally equivalent EOS tokens as a shared semantic stopping action to mitigate length inflation.
Converts multimodal inputs (text, image, audio, video) plus a question and options into calibrated probability distributions over choices. Built on Gemma 4 12B with a 30,000-question fine-tune, optimized for per-question decision classification and low-latency inference (Apache-2.0).