Provides a token-level benchmark for Russian PII detection and NER, with 2,841 sentences and 5,614 annotated spans across 21 fine-grained entity types in BIO format. Mixes sanitized production-log examples, synthetic document templates, and hard negatives to evaluate guardrails and anonymization pipelines.
Refines large-scale English pretraining corpora by predicting per-instance structured edits (insert, delete, replace) and deterministically applying them to produce cleaner text for LLM training. Provides five ~20B-token refined corpora in parquet with edit metadata and simple loading configs.
Survey of methods for engineering interactive environments for LLM-based agents, covering environment modeling, symbolic and neural synthesis, evaluation, and agent–environment co-evolution. Identifies evolution paradigms and future directions like Environment-as-a-Service and multi-agent systems.
Proposes a router redesign for Mixture-of-Experts (MoE) that aligns each router row with its expert's principal singular direction using Manifold Power Iteration (MPI), improving token–expert affinity. MPI applies a 'power‑then‑retract' step to push router rows toward principal singular vectors while enforcing norm constraints; the paper gives convergence theory and pretraining results on 1B–11B MoE models.
Synthesizes shortcut-resistant search tasks to train deep search agents by controlling four shortcut risks across entity selection, evidence-graph construction, question formulation, and adversarial refinement. Produces training trajectories with longer pre-answer search and fewer shortcut patterns; code will be released on GitHub.
Benchmarks evolving environments as sequences of progressive updates and introduces EvoMem, a patch-based memory that records structured update histories so LLM agents can reason about environment evolution. Demonstrates measurable gains on EvoArena and other benchmarks.
Provides kanji-level evaluation data for Japanese TTS: disambiguated sentence contexts targeting 4,378 kanji-reading pairs (2,136 Jōyō kanji) with 13,095 native-speaker–verified sentences and katakana-marked ground-truth readings for kanji-level error metrics.
A JSON-format text dataset of 'vibe-coding' prompt–response examples sized in the 1M–10M category. Packaged for Hugging Face Datasets with pandas/polars-ready structure; useful for fine-tuning or evaluation but lacks an explicit license and detailed provenance.
A collection of 953 JSON-formatted Fable 5 interaction traces (includes chain-of-thought entries), published on Hugging Face under AGPL-3.0 — meant for fine-tuning or analyzing LLM behavior but subject to license and provenance constraints.
Provides 1.8M synthetic Belgian personas (1.2M records; 300k per language) in Dutch/French/German/English, grounded in Belgian census distributions to improve representativeness for LLM training and evaluation. Includes 23 persona and contextual fields, CC BY 4.0 license, produced with NeMo Data Designer.
Transcribes Arabic speech to text using a CohereLabs-trained ASR model compatible with the Hugging Face Transformers pipeline. Provides safetensors weights, endpoint compatibility and a DOI-tagged release; suitable for Arabic transcription workflows but may require adaptation for diverse dialects or noisy audio.
Provides pre-parsed arXiv LaTeX source files aligned with official metadata as ready-to-query Parquet rows. Bundles each paper's .tex/.bib/.sty etc. into a single readable tree, updates monthly, and simplifies large-scale access for LLM pretraining, document understanding, and citation analysis while requiring adherence to original arXiv licenses.