AIAny

OpenCUA: Open Foundations for Computer-Use Agents

Turns human desktop demonstrations into training data for agents that reason over screenshots and control mouse and keyboard. Releases a cross-OS collection tool, AgentNet data, and models; the paper reports 45.0% on OSWorld-Verified for its 72B model.

Introduction

Recording more clicks is not enough to teach reliable desktop work. The central insight is to augment demonstrations with reasoning about state changes and recovery from mistakes, so training teaches how to correct a trajectory as well as imitate it.

Key Findings
  • AgentNet includes 22,625 released human tasks across Windows, macOS, and Ubuntu; this makes cross-system transfer a concrete research question.
  • Reflective reasoning and mixed training data improve scaling beyond raw state-action imitation, providing an inspectable training recipe.
  • The paper reports 45.0% success for the 72B model on OSWorld-Verified at 100 steps. AgentNetBench offers cheaper offline iteration, while online execution still tests end-to-end completion. Paper
Who Should Read It

Great fit if you study desktop agents, demonstration collection, or recovery from GUI mistakes and need released data and models to examine the pipeline. Look elsewhere if you need dependable unattended automation: most benchmark tasks still fail, and small environment changes can alter outcomes. Treat these results as research evidence rather than a deployment guarantee. Project

Information

  • Websitearxiv.org
  • OrganizationsThe University of Hong Kong, Moonshot AI, Stanford University, University of Waterloo, Carnegie Mellon University
  • AuthorsXinyuan Wang, Bowen Wang, Dunjie Lu, Junlin Yang, Tianbao Xie, Junli Wang, Jiaqi Deng, Xiaole Guo, Yiheng Xu, Chen Henry Wu …
  • Published date2025/08/12

Categories

More Items

Embeds an agent's reasoning together with its search query to improve retrieval. Trains a 4B embedding model on synthesized deep-research trajectories, helping preserve intent across multi-step searches.

Trains an 8B model to search, synthesize evidence, and write cited research reports. Its reinforcement-learning rewards use evolving rubrics grounded in retrieved evidence and contrasting model responses.

Trains long-horizon web researchers by combining agentic mid-training, synthetic trajectories, and reinforcement learning. A 30.5B-parameter model activates 3.3B parameters per token and learns to plan, search, and synthesize evidence.