AI Agent Papers2026
A benchmark for evaluating web-browsing agents in Korean contexts, composed of 400 tasks (300 manually verified by native speakers). Includes a human-verified split and an adversarial synthetic split to probe failure modes; reveals large performance gaps for both frontier and Korean models.
AI Dataset2026
Benchmark dataset for evaluating long-horizon coding agents and software-engineering tasks, containing English code and tabular metadata in Parquet format; small scale (<1K examples) for fast prototyping and evaluation.
AI Dataset2026
Provides ~1M synthetic Salvadoran‑Spanish personas (148k records, ~300M tokens) grounded in 2024 census distributions for demographics, occupations and locations; intended for training/evaluating localized LLMs and synthetic-data workflows. CC BY 4.0, adults only.
AI Dataset2026
Generates synthetic coding-agent session traces by pairing remotely hosted open agent models with local llama.cpp user models across real open-source codebases. Each trace records read/write/edit/bash actions and tool use; the dataset is a reproducible cartesian product (20×3×20×20 = 24,000 sessions) under an MIT license.
AI Dataset2026
Around 80K short audio clips paired with transcripts in JSON, organized for easy loading with the Hugging Face datasets ecosystem—designed for short-form speech tasks (ASR, TTS, fine-tuning) and quick prototyping with common Python data tools.
AI Dataset2026
Provides 600,000 synthetic Vietnamese persona texts (100,000 records, 6 personas per record) aligned to Vietnam's 2024 census and surveys for training and evaluating NLP / text-generation models; includes 21 demographic and persona fields, CC BY 4.0, single train split.
AI Dataset2026
End-to-end evaluation framework for conversational voice agents that runs bot-to-bot audio simulations and scores agents on task accuracy (EVA-A) and interaction experience (EVA-X). Includes per-scenario backend state, accent/noise perturbations, and 213 scenarios across airline, healthcare HR, and enterprise IT domains.
AI Dataset2026
Provides a complete, lightly-processed export of AI Village's >1-year multi-agent data: per-agent computer sessions (with screenshots), turn-by-turn computer-use logs, group chats, agent memories, goals, and daily summaries for research into agentic behaviour, multi-agent dynamics, long-horizon memory, and AI safety. Access is manually reviewed.
AI Agent Papers2026
Measures how coding agents explore repositories by asking them to return a ranked, line-level list of code regions relevant to an issue under a fixed line budget. Covers 848 issues across 203 repos and 10 languages; evaluates coverage, ranking, and context-efficiency to isolate exploration quality.
Provides a comprehensive benchmark for instruction-based audio editing across seven audio modalities and eight operation types, with 2,000 high-fidelity samples and a rubric that decomposes tasks into 17,741 verifiable criteria for multi-dimensional evaluation.
AI Dataset2026
Provides page-level relevance judgments and full OCR'd annual-report text for KPI question answering and page retrieval benchmarking — supports retrieval (per-page qrels) and needle‑in‑a‑haystack numeric extraction over long documents, with eval and train configs.
AI Dataset2026
Pairs OCR-extracted annual-report text with ground-truth financial KPI values to benchmark LLM/table-QA and needle-in-a-haystack extraction tasks. Includes Markdown OCR (.mmd), page images for eval, and 31 KPI columns across multiple years—suited for KPI extraction, retrieval, and robustness testing.