GUI agents can appear capable on English benchmarks while still missing the labels and conventions users encounter on Korean websites. This benchmark makes that gap measurable: each example pairs a Korean instruction with a screenshot and a target element, testing whether an agent can point to the right place rather than merely describe the page.
What the Evaluation Reveals
The 3,319 examples were derived from 540 human-recorded tasks across 142 websites. Two native Korean annotators contributed about 480 hours of collection and review, including scrutiny of 267 potentially ambiguous questions; 163 were removed. This manual process matters because small wording or target ambiguities can distort point-in-box scores. The remaining examples cover both text targets and icon or widget targets, so results can distinguish reading visible labels from grounding less explicit controls.
The benchmark uses a deliberately narrow, single-screenshot protocol: an agent receives an image and a Korean grounding instruction, then predicts a location. That makes it useful for measuring visual grounding without mixing in navigation planning or task completion. It is one component of a broader Korean GUI evaluation suite, alongside offline action prediction and live website tasks.
Who Should Use It
A good fit for researchers comparing GUI agents on Korean-language interface grounding, or checking whether improvements transfer beyond English-centric screenshots. Look elsewhere if you need to measure multi-step task completion, broad language coverage, or performance on changing live websites: this benchmark evaluates static screenshot grounding, and its viewer exposes only a small illustrative preview. Full-data access is restricted to authorized Hugging Face users.