AIAny
AI Agent2023
Icon for item

PentestGPT

Drives autonomous penetration testing and CTF solving via cooperating LLM sessions that track a pentest task tree. Scored 86.5% on the XBOW benchmark suite at ~$1.11 per solved task, and works with OpenAI, Claude, Gemini, and local Ollama models.

Introduction

Most "AI hacker" demos collapse the moment a task outlives the model's context window — the agent simply forgets what it already tried. The real contribution here is structural: work is split across cooperating LLM sessions that maintain an explicit Pentesting Task Tree, so the agent keeps a coherent plan and can restart with prior knowledge after hitting token limits. It also grew out of peer-reviewed research (USENIX Security 2024, Distinguished Artifact Award) rather than a weekend prototype.

What Sets It Apart
  • A task tree, not a chat log — separate reasoning, generation, and parsing sessions share a structured tree of subtasks, which is why long engagements don't drift into incoherence the way single-prompt agents do.
  • Measured, not hand-waved — 86.5% on the XBOW validation suite (90/104 benchmarks), median 3.3 minutes and ~$1.11 per solved task, so you can reason about cost before pointing it at a target.
  • Model-agnostic — the autonomous pipeline and a human-in-the-loop legacy mode both run across OpenAI, Anthropic, Gemini, DeepSeek, xAI, Qwen, Moonshot, and local Ollama, avoiding lock-in to one vendor.
Great Fit / Look Elsewhere

Great fit if you're a security researcher or CTF player who wants an agent to triage web, crypto, reversing, and privilege-escalation challenges, or a reproducible benchmark for studying LLM offensive-security capability. Look elsewhere if you expect a turnkey, hands-off pentest of production systems: outputs still need expert validation, scoping, and legal authorization, and this remains a research tool rather than a managed product.

Information

  • Websitegithub.com
  • OrganizationsNanyang Technological University, Quantstamp
  • AuthorsGelei Deng, Yi Liu, Víctor Mayoral-Vilches, Peng Liu, Yuekang Li, Yuan Xu, Tianwei Zhang, Yang Liu, Martin Pinzger, Stefan Rass
  • Published date2023/02/27

Categories

More Items

Hugging Face
AI Model2026

Open-weights LLM fine-tuned for phone-based voice agents that prioritizes low latency and reliable tool/function calling. Based on NVIDIA Nemotron 3 Nano (30B total, 3.5B active), supports very long contexts (262,144 tokens) and recommends temperature=0 with thinking disabled for deployment.

GitHub
AI Agent2026

A curated collection of production-ready Agent Skills that turn tasks—presentation production, image generation, local KB retrieval, article assembly, and web-design—into agent-loadable skill folders. Uses a SKILL.md contract, supports multiple agent runtimes (Claude Code, Cursor, Codex), and offers modular install paths with pinned release zips.

GitHub
AI Agent2026

Provides a ruleset and skills that make AI coding agents prefer the simplest correct implementation: reuse existing code, prefer stdlib/native features, and only write minimal new code. Cuts generated LOC, tokens, cost and time while preserving validation and safety.