AI Agent2024
Orchestrates configurable deep-research agent workflows that combine LLMs, web search, and MCP tools to produce structured research reports and evaluation outputs. Supports LangGraph Studio, multiple model providers (OpenAI, Anthropic, local models), and Deep Research Bench evaluation for benchmarked comparisons.
AI Dataset2024
A fine-grained, domain-labeled web corpus for NLP and LLM research that decomposes a deduplicated web crawl into 67 domains via iterative URL/content labeling and coarse→fine recall; includes per-domain statistics, validation subsets, and domain-benchmark analysis tools.
AI Infra2024
Full-stack AI red‑teaming platform that fingerprints AI infrastructure for known CVEs, audits MCP servers and agent skills with LLM-driven analysis, and runs cross-model jailbreak evaluations; designed for hands-on security assessment of AI deployments.
AI Audio2025
Generates full songs from lyrics and style prompts by first writing an editable melody-and-chord score and then rendering vocals and accompaniment. Unifies symbolic planning and audio synthesis in one pipeline, enabling readable score inspection, zero‑shot covers, and agent-driven editing.
AI Dataset2025
A benchmark dataset for evaluating MLLM-driven interactive webpage code generation: provides prototyping screenshots, action.json interaction metadata, and example generation scripts across 127 webpages and 374 interactions to test dynamic UI-to-code capabilities.
AI Agent2025
Simulates adversarial attacks against LLMs and AI agents to surface vulnerabilities (e.g., jailbreaks, prompt injection, PII leakage) and ships guardrails to block risky inputs/outputs; runs locally and can be driven from CLI or Python.
AI Dataset2025
Jake Poznanski, Jon Borchardt +7Allen Institute for Artificial Intelligence (AI2), AllenNLP / olmOCR team
Benchmark for evaluating OCR systems that convert PDFs and scans into Markdown and structured text: 1,403 PDFs and 7,010 unit tests covering text presence/absence, reading order, tables, and math formula accuracy. Diverse sources and ODC-BY-1.0 license for research use.
AI Agent2025
Autonomously executes diverse biomedical research tasks by combining LLM reasoning, retrieval-augmented planning, and code-based execution. Includes a web UI and Gradio demo, a curated Know‑How library, MCP integration, and a biology-tailored reasoning model (Biomni‑R0).
AI Others2025
Argues AI has entered its 'second half': a working recipe (language pre-training priors + scale + reasoning) now generalizes RL across tasks, so the bottleneck shifts from inventing methods to defining problems and rethinking evaluation.
AI Agent Papers2025
Tests whether browsing agents can uncover obscure facts across the web through 1,266 short-answer questions. Answers are easy to check even when finding them requires sustained, creative search.
Practical, full-stack tutorial for building Retrieval-Augmented Generation (RAG) systems—covers data preprocessing, vector embedding and indexing, hybrid and multimodal retrieval, generation integration, evaluation and production-ready engineering. Includes hands-on projects and examples for developers with Python experience.
AI Agent Papers2025
Tests research agents on 100 expert-written tasks across 22 fields. Separates report quality from citation reliability, using adaptive reference-based grading and checks that cited pages support individual claims.