Provides a machine-readable collection of 5,426 open and historically significant mathematical problems with LaTeX statements, structured metadata and curated per-problem AI-assisted research notes. Includes difficulty labels, canonical problem sets (Millennium, Hilbert, Erdős) and files optimized for benchmarking math reasoning.
Provides a physical reconstruction benchmark of OmniDocBench v1.5 by producing five real-world photographic variants (Scanning, Warping, Screen‑Photography, Illumination, Skew) for each of 1,355 pages, inheriting original ground-truth to enable controlled, scenario-wise evaluation of document parsing robustness.
Rust library for fast PDF classification and position-aware text extraction that converts native-text PDFs to structured Markdown without OCR. Offers per-page OCR routing, multi-column and table detection, and Python/Node.js/WebAssembly bindings for low-latency local pipelines.
Benchmarks LLM agents on realistic legal work by packaging lawyer-style assignments with client materials and expert, per-deliverable rubrics. Includes an execution harness to run, score, and compare agents across a large, evolving task set spanning multiple practice areas.
Monitors and detects risky behavior in enterprise AI agents via high-fidelity telemetry, security benchmarking, and a two-tier detector. Comprises ADR Sensor, ADR-Bench, and ADR Detector; deployed in production at Uber and validated on public benchmarks.
Provides reusable Docker compose files, scripts and benchmarked configs to serve modern LLMs (Qwen, Gemma, etc.) on 1–2 NVIDIA RTX 3090/4090/5090 GPUs. Multi-engine (vLLM, llama.cpp, ik_llama), measured TPS/context tradeoffs, and validated single/dual‑GPU recipes.
A small image-folder dataset for multimodal/vision model safety benchmarking, containing under 1,000 curated images with annotations to exercise safety-related model behaviours; licensed CC BY 4.0 and hosted on HuggingFace.
Provides a curriculum-aligned knowledge graph extracted from Chinese K–12 textbooks and accompanying benchmarks and training data to evaluate and train educational LLMs. Releases a 23,640-question multi-select benchmark and a 7,335-sample graph-guided training corpus with multimodal VQA pairs and the full construction pipeline.
Reviews Git diffs or entire files via a CLI that combines deterministic pipelines (precise file selection, bundling, rule matching) with an LLM agent to produce line-level review comments. Includes built-in security rules and integrations for multiple LLM providers, designed for CI and large changesets.
Benchmark dataset for evaluating long-horizon coding agents and software-engineering tasks, containing English code and tabular metadata in Parquet format; small scale (<1K examples) for fast prototyping and evaluation.
Local English text-to-waveform TTS producing a single fixed synthetic voice in a deployable package below 10M parameters. Offers deterministic seeds, punctuation-aware long-text chunking, CPU/CUDA and ONNX runtime options, measured evaluations and a compact FP32 footprint; English-only, one voice.