AIAny
Icon for item

DeepSeek V4 Pro Hermes Reasoning Traces

Provides 19,331 multi-turn ChatML Hermes reasoning traces produced by DeepSeek V4 Pro for LoRA fine-tuning of agent-style models; includes VRAM-tiered variants, train/valid/test splits, and dense tool-calling annotations in Parquet format.

Introduction

Most agent fine-tuning needs two things that are hard to synthesize at scale: realistic multi-turn dialog in an agent format (ChatML/Hermes) and dense, varied tool-calling behavior. This dataset supplies both — 19,331 multi-turn Hermes traces generated by DeepSeek V4 Pro with 138k total tool calls — so you can train LoRA adapters that learn tool selection, session memory usage, and stepwise reasoning patterns typical of a Hermes agent.

What Sets It Apart
  • High tool-call density and diversity: ~138k tool invocations (terminal, read_file, search_files, execute_code, web_search, memory, etc.), meaning models can learn realistic tool-switching patterns rather than isolated examples — useful when you want models that manage multi-step tasks with external tools.
  • ChatML + 100% "think blocks": traces are formatted for agent-style training (ChatML) and include explicit reasoning/thought structure, which helps supervision for chain-of-thought or decompositional behaviors.
  • VRAM-tiered variants and standard Parquet splits: four variants (nano, budget, standard, spark) target different context-length and GPU tiers, and the dataset is provided in optimized Parquet for efficient batch loading and DataLoader pipelines.
  • Synthetic teacher pipeline transparency: generated by DeepSeek V4 Pro with 96 parallel workers and a JSON repair filter (62% pass rate), which signals scale and the synthetic provenance you should expect when judging label quality.
Who It's For — and Tradeoffs

Great fit if you want to fine-tune small-to-medium local models via LoRA/QLoRA to behave like a Hermes agent, especially for tool-calling, function-calling, or SFT on agent workflows. It’s also useful when you need VRAM-aware variants to match available hardware. Look elsewhere if you require human-annotated reasoning traces, multilingual data (this dataset is English-only), or provenance beyond DeepSeek V4 Pro’s synthetic style — the traces reflect the generator’s decisions and biases and can encourage overfitting to DeepSeek-specific behaviors.

Where It Fits

Practically, this dataset is a ready supervised corpus for training agent-like policies (tool selection, session search/memory usage, stepwise code/terminal workflows) and for LoRA/SFT experiments. Use it to bootstrap agent capabilities quickly, then complement with human reviews or task-specific logging for production reliability and bias mitigation.

More Items

Hugging Face

Contains 73 images used in Hugging Face library documentation, packaged in Parquet and imagefolder formats for examples, demos, and small-scale image experiments; distributed under CC BY‑NC‑SA 4.0.

Hugging Face

A monthly-updated, hive-partitioned parquet corpus of billions of standard rated chess games from Lichess for data analysis and ML — includes move lists with clock info, player Glicko2 ratings, openings, timestamps, and some Stockfish evals under CC0.

Hugging Face

A 12K-question multiple-choice benchmark that raises difficulty by expanding choices to ten and adding reasoning-focused problems. Designed for robust LLM evaluation with cross-domain coverage, expert curation, and emphasis on chain-of-thought performance.