Publishes a structured open textbook on large language model foundations, covering language modeling, LLM architectures, prompt engineering, PEFT, model editing, and RAG.
AI Agent2024
Enables agents to autonomously operate GUIs and complete complex computer tasks — includes the Agent S papers and the gui-agents SDK, grounding-model support, and runnable S3 agent implementations for Windows/macOS/Linux.
Open-weight Mixture-of-Experts LLM with 671B total parameters but 37B activated per token, trained on 14.8T tokens for 2.788M H800 GPU-hours. Matches leading closed models at a fraction of typical training cost via FP8 and architectural tricks.
AI Agent2025
Drives your computer from natural language: a vision-language model reads raw screenshots and works the mouse and keyboard like a person, controlling any GUI app without APIs or accessibility hooks. Local or remote operator modes on Windows and macOS.
Shows that LLM reasoning can be incentivized through pure reinforcement learning, with no human-annotated reasoning traces. Self-reflection, verification, and strategy-switching emerge on their own, and the patterns transfer to distill smaller models.
AI Agent2025
Lets you build, generate, and run multi-agent LLM workflows from natural-language prompts with no coding. Automatically profiles agents, creates tools/workflows, and supports multiple LLM providers plus CLI/Docker deployment.
AI Dataset2025
High-quality, efficiently verified and filtered web corpus for LLM pretraining — supplies ~1 trillion English tokens and ~120 billion Chinese tokens with English/Chinese Parquet splits. Designed for large-scale pretraining experiments and data-filtering research.
AI Dataset2025
Jake Poznanski, Jon Borchardt +7Allen Institute for Artificial Intelligence (AI2), AllenNLP / olmOCR team
Benchmark for evaluating OCR systems that convert PDFs and scans into Markdown and structured text: 1,403 PDFs and 7,010 unit tests covering text presence/absence, reading order, tables, and math formula accuracy. Diverse sources and ODC-BY-1.0 license for research use.
AI Image2025
Real-time DETR detector on a DINOv2 backbone, covering detection, segmentation, and keypoints. Ships in six sizes (Nano to 2XL), beats YOLO on the COCO speed-accuracy curve, and transfers better to non-COCO real-world domains.
AI Agent2025
Autonomously proposes hypotheses, runs experiments, analyzes results, and drafts workshop-level papers via an agentic tree-search pipeline. Unlike template-driven predecessors, it explores open-ended ML research paths but requires GPU/PyTorch and careful sandboxing due to execution of LLM-written code.
AI Agent2025
Transforms research papers, natural-language specs, and technical descriptions into runnable code via a multi-agent system. Covers Paper2Code, Text2Web, and Text2Backend; scores 75.9% on OpenAI's PaperBench, ahead of top ML PhDs.
AI Audio2025
Synthesizes up to 90 minutes of multi-speaker speech in one pass, with as many as four voices in a single conversation. Pairs continuous acoustic and semantic tokenizers at a 7.5 Hz frame rate with a next-token diffusion head on an LLM backbone.