Most text-to-image systems separate reasoning, tool use (search, retrieval), and image synthesis into fixed pipelines, which limits open‑world generation that needs multi-step reasoning and external knowledge. The core insight here is that placing the entire open‑world image generation loop under a single unified multimodal agent policy — through post-training a Unified Multimodal Model (UMM) and agentic RL — yields more coordinated, verifiable, and higher-quality results than piecemeal or fixed workflows.
Key Findings
- Unified agentic control: The work shows how supervised fine-tuning with a teacher agent (that uses search tools and an image-generation tool) can produce UMM trajectories where the image tool is concealed but generated outputs are kept, enabling a single policy to learn when and how to reason, call tools, and produce images.
- Agentic RL with RAD-GRPO: They introduce Reason-Act-Draw GRPO (RAD-GRPO), an RL scheme combining complementary intent and quality rewards to jointly optimize reasoning/action selection and image quality under one model.
- Empirical outcome: Experiments indicate that a fully agentic pipeline (reasoning, tool invocation, and native generation coordinated by one policy) consistently outperforms approaches that use fixed pipelines or only partially agent-controlled components. The authors also release the collected training trajectories and the post-training infrastructure to enable reproduction and further research.
Who it fits and tradeoffs
Great fit if you research or build open‑world image generation systems that must integrate multi-step reasoning, web/external knowledge, and controllable generation within a single decision policy — especially for projects that can afford the engineering and compute cost of post‑training and agentic RL. Look elsewhere if you need a lightweight off‑the‑shelf T2I model for simple single-step generation: the approach adds complexity (teacher trajectory collection, RL infrastructure, reward design) and requires nontrivial compute and tooling to reproduce at scale.