Proposes Recuris, a recursive Experiential-Working Memory architecture that separates Working Memory (task progress) from Experiential Memory (skills) and uses a Meta-Agent to validation-gate localized skill updates, enabling bounded recursive skill evolution for long-horizon agents.
Generates unified embeddings for text, images, video, visual documents and interleaved multimodal inputs with configurable output dimensions and Matryoshka truncation to trade accuracy for cost. Model weights and code are released under Apache-2.0; the 9B variant scores 80.6 on MMEB-v2.
Rewrites physical scenes as executable world programs (e.g., MuJoCo scene descriptions) and uses an agentic abductive loop to propose, execute, render, verify, and iteratively refine those programs from videos or text. Verified executable worlds supply scalable physical supervision for training vision–language models.
Trains LLM agents to proactively edit and manage their working context for long-horizon tasks using an expanded toolset (planning, long-term memory, soft offloading) and a fine-grained RL algorithm that identifies critical edits and assigns action-level credit. Improves accuracy while keeping contexts compact on long-context QA and deep search.
Provides 23,625 semi-structured smart-contract audit findings (title, description, PoC, recommendation, normalized severity) for defensive-security research; requires cleaning, deduplication, and PoC filtering before model training.
Studies looping shared transformer layers in Mixture-of-Experts models under matched budgets and proposes SMELT: loop the middle half twice while matching per-token FLOPs, non-embedding parameters, and KV cache. Shows 6.8–18.0% training-FLOPs savings on the compute-optimal frontier, stronger downstream gains on code and long-context tasks.
Distills operational know‑how from ML GitHub repositories into compact, verified 'skills' that research agents can load and reuse. Produces a skill format (SKILL.md, references, scripts), the AREX‑Skill Library (5,000+ skills from 1,000 repos), and demonstrates sizable benchmark gains when agents use skills.
Selectively admits dense token-level teacher supervision only after a prompt-level verifier audit, routing prompts that fail the audit to verifier-grounded trajectory supervision instead — reducing harmful updates from confidently wrong teachers and improving teacher GPU utilization.
A curated set of 1,000 high-quality chain-of-thought coding and reasoning traces generated by Fable 5.1, totaling ~30M tokens (109 MB). Designed for SFT/distillation to teach smaller models step-by-step programmatic reasoning and debugging.
Transforms source code into verifiable, reusable agent skills by extracting atomic operations, workflows, and recurring patterns and validating them via source-body-blind reconstruction. Produces CodeSkillBank (1,006,822 accepted records from 19,769 GitHub repos) and yields ~11.7% average downstream improvement.
Provides layered code pretraining corpora (L2 ~400B tokens, L3 ~150B tokens) across 11 languages by filtering ~192M public GitHub repositories into standardized files, algorithmically relevant selections, and implementation-grounded programming exercises. Includes per-file metadata (role, algo relevance, quality) and serialized task records; released under Apache-2.0.
Provides a bilingual Chinese–English corpus for LLM training covering pretraining, capability-oriented midtraining (16K–256K long contexts), and supervised fine-tuning. Includes ~4.2T pretrain tokens, ~600B midtrain tokens, and ~4.57M SFT samples; sources span web, PDFs/OCR, code, math, QA, and agentic trajectories under mixed upstream licenses.