AI Dataset2024
Provides ~1.3 trillion tokens of web pages filtered for educational quality using an LLM-trained classifier; includes per-Crawl configs, smaller random samples (10B/100B/350B tokens), and the classifier code and model for reproducible filtering.
A 236B-parameter Mixture-of-Experts LLM that activates only 21B parameters per token, cutting training cost 42.5% versus a dense 67B model and shrinking the KV cache 93.3% via Multi-head Latent Attention, with 128K context.
Publishes a structured open textbook on large language model foundations, covering language modeling, LLM architectures, prompt engineering, PEFT, model editing, and RAG.
AI Agent2024
Enables agents to autonomously operate GUIs and complete complex computer tasks — includes the Agent S papers and the gui-agents SDK, grounding-model support, and runnable S3 agent implementations for Windows/macOS/Linux.
Open-weight Mixture-of-Experts LLM with 671B total parameters but 37B activated per token, trained on 14.8T tokens for 2.788M H800 GPU-hours. Matches leading closed models at a fraction of typical training cost via FP8 and architectural tricks.
AI Agent2025
Drives your computer from natural language: a vision-language model reads raw screenshots and works the mouse and keyboard like a person, controlling any GUI app without APIs or accessibility hooks. Local or remote operator modes on Windows and macOS.
Shows that LLM reasoning can be incentivized through pure reinforcement learning, with no human-annotated reasoning traces. Self-reflection, verification, and strategy-switching emerge on their own, and the patterns transfer to distill smaller models.
AI Agent2025
Lets you build, generate, and run multi-agent LLM workflows from natural-language prompts with no coding. Automatically profiles agents, creates tools/workflows, and supports multiple LLM providers plus CLI/Docker deployment.
AI Dataset2025
High-quality, efficiently verified and filtered web corpus for LLM pretraining — supplies ~1 trillion English tokens and ~120 billion Chinese tokens with English/Chinese Parquet splits. Designed for large-scale pretraining experiments and data-filtering research.
AI Dataset2025
Jake Poznanski, Jon Borchardt +7Allen Institute for Artificial Intelligence (AI2), AllenNLP / olmOCR team
Benchmark for evaluating OCR systems that convert PDFs and scans into Markdown and structured text: 1,403 PDFs and 7,010 unit tests covering text presence/absence, reading order, tables, and math formula accuracy. Diverse sources and ODC-BY-1.0 license for research use.
AI Image2025
Real-time DETR detector on a DINOv2 backbone, covering detection, segmentation, and keypoints. Ships in six sizes (Nano to 2XL), beats YOLO on the COCO speed-accuracy curve, and transfers better to non-COCO real-world domains.
AI Agent2025
Autonomously proposes hypotheses, runs experiments, analyzes results, and drafts workshop-level papers via an agentic tree-search pipeline. Unlike template-driven predecessors, it explores open-ended ML research paths but requires GPU/PyTorch and careful sandboxing due to execution of LLM-written code.