A curated set of 1,000 high-quality chain-of-thought coding and reasoning traces generated by Fable 5.1, totaling ~30M tokens (109 MB). Designed for SFT/distillation to teach smaller models step-by-step programmatic reasoning and debugging.
Transforms source code into verifiable, reusable agent skills by extracting atomic operations, workflows, and recurring patterns and validating them via source-body-blind reconstruction. Produces CodeSkillBank (1,006,822 accepted records from 19,769 GitHub repos) and yields ~11.7% average downstream improvement.
Provides layered code pretraining corpora (L2 ~400B tokens, L3 ~150B tokens) across 11 languages by filtering ~192M public GitHub repositories into standardized files, algorithmically relevant selections, and implementation-grounded programming exercises. Includes per-file metadata (role, algo relevance, quality) and serialized task records; released under Apache-2.0.
Provides a bilingual Chinese–English corpus for LLM training covering pretraining, capability-oriented midtraining (16K–256K long contexts), and supervised fine-tuning. Includes ~4.2T pretrain tokens, ~600B midtrain tokens, and ~4.57M SFT samples; sources span web, PDFs/OCR, code, math, QA, and agentic trajectories under mixed upstream licenses.
Provides ~86K verifiable-reward RL training samples across Math, Knowledge (STEM), Long-Context, and Code for post-training LLMs; each sample includes a ground-truth and verifier-friendly JSONL format for stable reward signals. Note: code tasks require an external sandbox to execute tests.
Trains LVLMs to improve 3D spatial reasoning using a synthetic block-stacking dataset of 15,000 problems that cover 3D→2D projection, viewpoint transforms, and structural combination; includes color-anchored cues and provides code and data.
Selected ~245B-token corpus of algorithmically relevant code across 11 languages from The Stack v3, produced by file-level language-adaptive selection (UltraData-Code-L2-Classifier). Concentrates problem-solving implementations for LLM code pretraining while preserving broad language coverage; released under ODC-By.
Lets vision-language models control robots via a compact semantic action interface that maps intent to discrete action units; supports zero-shot use of closed-source VLMs, low-cost fine-tuning of open VLMs, and GUI-based demonstration collection.
Transforms scientific code repositories into executable, agent-learnable environments that support task generation, execution, and scientific verification. Agent-guided repository transformation produces verified interaction trajectories used to train the PhAI-IDE model family. Intended for research on agent learning, scientific-code repair, and training RL/SFT models.
Provides a domain-agnostic world-modeling framework that factorizes latent targets into orthogonal predictive components, with dedicated prediction branches and synthesis for multi-domain forecasting and intervention. Demonstrates improved dynamics and long-horizon rollouts across seven domains and includes experimental biological validation.
Turns implemented functionality in open-source codebases into executable RL training environments by automatically generating behavioral specifications, execution-grounded tests, and post-rollout filtering; yields 5,545 verifiable coding tasks across 23 languages to train coding agents.
Provides mixed-domain, verifiable RL training environments for LLM agents (code, cyber, knowledge work, web dev, music) as Parquet datasets, with domain-specific verifiers, Docker artifacts and links to training code for reproducible agentic RL experiments.