Design files reconstructed from pixels rarely support real edits: visual fidelity metrics miss whether a recovered file can actually be edited in a real design app. ReDesign reframes raster→design reconstruction as a long-horizon, agentic decomposition problem where specialized tool calls build up a layered representation and lightweight local verification prevents errors from compounding.
Key Findings
- Agentic decomposition for multi-modal recovery: ReDesign composes specialized modules (text, vector geometry, colors, grouping, layer ordering) in a decision sequence, so outputs target editability rather than only pixel fidelity. This means reconstructed files are structured for downstream edits (e.g., text replacement, recoloring).
- Graceful verification to contain errors: After each expansion step the system either accepts, prunes, or retries a tool output, which avoids large-scale reruns and reduces cascading mistakes — translating to more reliable long-horizon reconstruction.
- Figma Edit Replay Benchmark and empirical gains: The paper introduces a benchmark of 909 raw Figma files and 14,796 controlled edit instructions that replay edits on reconstructions; ReDesign achieves top editability on layout, color, and text edits while keeping strong visual fidelity compared to layered-decomposition and serial-tool baselines.
Who It's For and Trade-offs
Great fit if you need recoverable, editable design artifacts from images—product designers, UI/tooling teams, and researchers building AIGC→authoring workflows. Look elsewhere if your priority is only pixel-level reconstruction (single-shot image metrics) or if you require a lightweight on-device solution: ReDesign targets editability and relies on multi-step tool orchestration, which increases pipeline complexity and runtime compared with one-shot methods.
Where It Fits
ReDesign sits between reconstruction pipelines that optimize only visual similarity and end-to-end vectorization heuristics: it prioritizes a structured, edit-ready output and introduces a reproducible benchmark to measure the practical utility of reconstructions in real editing scenarios.
