AIAny
Icon for item

Democratizing Robot-Use Agents: A Unified Harness with Open Models

Provides a unified tool and execution harness for open-weight language models to operate robots and support further training. The paper reports a RoboDojo score of 31.39 for Qwen3.8-Flash-Next and competitive results across 19 real-world tasks.

Introduction

Robot-use research is often constrained not only by robot access, but by dependence on proprietary frontier models that researchers cannot readily adapt. This paper shifts the emphasis toward the harness: a common interface can make open-weight models competitive while leaving room for continued training and analysis.

Key Findings
  • The proposed unified harness, uni-robot-agent, lets open-weight models use robots without privileged inputs, making comparisons and further training more accessible.
  • Qwen3.8-Flash-Next scores 31.39 on RoboDojo, above the cited GPT-6 Astra-RoboProbe result of 28.97. This suggests that the surrounding system and model choice both matter—not just access to the most expensive model.
  • The authors also report competitive performance on 19 real-world tasks, extending the evaluation beyond benchmark simulation.
  • Analyses across model generations, families, and sizes associate effective robot use with four general capabilities. The practical implication is that training for robot use may need to improve these capabilities jointly rather than optimize isolated skills.
Method and Positioning

The work treats a unified harness as research infrastructure: it connects models to robot-use tasks in a way intended to support both evaluation and additional training. This contrasts with relying exclusively on proprietary agents, which can make it difficult to inspect, adapt, or train the system. The reported scores are results from the paper, not a guarantee that every open model or robot setup will achieve comparable performance.

Who Should Read It

A good fit for researchers studying embodied agents, open-weight model training, or reproducible robot benchmarks. Look elsewhere if you need a ready-to-deploy real-time robot controller or a detailed account of individual robot tasks: the headline results establish competitive potential, but the abstract does not provide enough evidence to assess latency, robustness, or performance across diverse hardware.

Information

  • Websitearxiv.org
  • OrganizationsTsinghua University, Berkeley (*Core Contributor)
  • AuthorsJiarui Yuan, Yuxin Zuo, Xiaoyu Huang, Wenbo Zhang, Kwanyoung Park, Junlin Yang, Tianxiang Zhang, Ruoqu Chen, Yutao Ouyang, Bingxiang He …
  • Published date2026/11/01

More Items

Trains computer-use agents on verified trajectories from long interactions, connecting task generation, execution, evaluation, and policy improvement in a feedback loop. Reports Nano, Mini, and Pro models across desktop and web benchmarks.

Mines real computer-use workflows from instructional videos, turns them into reusable skills, and composes them into verifiable tasks. An open-data and model-feedback loop guides each round of dataset expansion.

Explores how agent harnesses coordinate video models for multi-shot production, interactive world modeling, and recursive self-improvement. It distinguishes improvements to outputs, tools, model parameters, and the development process itself.