AIAny

Do As I Can, Not As I Say: Grounding Language in Robotic Affordances

Grounds language-based robot planning in learned skill value functions, selecting actions that are both useful and feasible. PaLM-SayCan reports 84% planning and 74% execution success across 101 real-world instructions.

Introduction

A plausible plan can still ask a robot to do something physically impossible. The central insight is to separate knowing which action would help from estimating whether that action can succeed, then combine those judgments before acting.

Key Findings
  • Language-model scores assess task relevance; skill value functions assess feasibility in the current state. Their combination grounds each choice in the robot's capabilities.
  • On 101 instructions in two kitchen environments, the updated PaLM-SayCan system reports 84% planning success and 74% execution success. The gap shows that correct decomposition does not guarantee reliable control.
  • Repeated skill selection supports extended instructions without asking the language model to generate motor commands directly.
Who Should Read It

Useful for researchers connecting high-level reasoning to a trained skill library. The approach assumes suitable skills and value functions already exist; it does not learn arbitrary physical actions from language. Feedback through current value estimates also leaves failure recovery less explicit than in later closed-loop planners.

Information

  • Websitearxiv.org
  • OrganizationsRobotics at Google, Everyday Robots
  • AuthorsMichael Ahn, Anthony Brohan, Noah Brown, Yevgen Chebotar, Omar Cortes, Byron David, Chelsea Finn, Chuyuan Fu, Keerthana Gopalakrishnan, Karol Hausman …
  • Published date2022/04/04

More Items

Embeds an agent's reasoning together with its search query to improve retrieval. Trains a 4B embedding model on synthesized deep-research trajectories, helping preserve intent across multi-step searches.

Trains an 8B model to search, synthesize evidence, and write cited research reports. Its reinforcement-learning rewards use evolving rubrics grounded in retrieved evidence and contrasting model responses.

Trains long-horizon web researchers by combining agentic mid-training, synthetic trajectories, and reinforcement learning. A 30.5B-parameter model activates 3.3B parameters per token and learns to plan, search, and synthesize evidence.