AIAny
AI Agent2023
Icon for item

PentestGPT

Drives autonomous penetration testing and CTF solving via cooperating LLM sessions that track a pentest task tree. Scored 86.5% on the XBOW benchmark suite at ~$1.11 per solved task, and works with OpenAI, Claude, Gemini, and local Ollama models.

Introduction

Most "AI hacker" demos collapse the moment a task outlives the model's context window — the agent simply forgets what it already tried. The real contribution here is structural: work is split across cooperating LLM sessions that maintain an explicit Pentesting Task Tree, so the agent keeps a coherent plan and can restart with prior knowledge after hitting token limits. It also grew out of peer-reviewed research (USENIX Security 2024, Distinguished Artifact Award) rather than a weekend prototype.

What Sets It Apart
  • A task tree, not a chat log — separate reasoning, generation, and parsing sessions share a structured tree of subtasks, which is why long engagements don't drift into incoherence the way single-prompt agents do.
  • Measured, not hand-waved — 86.5% on the XBOW validation suite (90/104 benchmarks), median 3.3 minutes and ~$1.11 per solved task, so you can reason about cost before pointing it at a target.
  • Model-agnostic — the autonomous pipeline and a human-in-the-loop legacy mode both run across OpenAI, Anthropic, Gemini, DeepSeek, xAI, Qwen, Moonshot, and local Ollama, avoiding lock-in to one vendor.
Great Fit / Look Elsewhere

Great fit if you're a security researcher or CTF player who wants an agent to triage web, crypto, reversing, and privilege-escalation challenges, or a reproducible benchmark for studying LLM offensive-security capability. Look elsewhere if you expect a turnkey, hands-off pentest of production systems: outputs still need expert validation, scoping, and legal authorization, and this remains a research tool rather than a managed product.

Information

  • Websitegithub.com
  • OrganizationsNanyang Technological University, Quantstamp
  • AuthorsGelei Deng, Yi Liu, Víctor Mayoral-Vilches, Peng Liu, Yuekang Li, Yuan Xu, Tianwei Zhang, Yang Liu, Martin Pinzger, Stefan Rass …
  • Published date2023/02/27

Categories

More Items

GitHub
AI Client2024

Unifies visual creator tools, reusable Skills, and a Codex-powered Agent to handle video translation, image/video generation, voiceovers, and editing in one local multimodal workspace. Desktop and web clients share a synchronized state machine and keep data local by default.

GitHub
AI Coding2025

Runs many shells inside one terminal and treats coding agents as first-class panes. Combines daemon-backed persistent sessions, vim-style modal control, BSP tiling, a session rail and an Inbox that surfaces approvals, questions and finished turns from LLM-based coding agents — useful when you run and manage agent workflows alongside shells.

GitHub
AI Agent2026

Audits deployed AI agents for governance and operational misalignment, running up to 60 inspections that detect deception, manipulation, fabrication, unpredictability and opacity; outputs JSON/Markdown scorecards, a graded A–F score, and optional Pro reports and dashboards.