AIAny
Icon for item

mobile-mcp

Gives an LLM agent direct control of iOS and Android apps over one MCP interface, across simulators, emulators, and real devices. Reads the native accessibility tree to pick elements deterministically, using screenshot coordinates only as fallback.

Introduction

Mobile UI automation has long meant brittle, platform-specific scripts — XPath selectors that break on the next release, or vision models guessing where to tap. The bet here is different: a phone's accessibility tree is already a structured, labeled description of the screen, so an LLM can reason over it the way it reasons over a DOM. That turns "tap the login button" into a deterministic lookup rather than a pixel gamble, and the same agent code runs unchanged across iOS and Android.

What Sets It Apart
  • One platform-agnostic API spans iOS and Android, simulators, emulators, and real devices — you write the automation once instead of maintaining separate Appium/XCUITest stacks per platform.
  • Accessibility-first element selection means no computer-vision model in the loop for labeled UIs, which is cheaper, faster, and far more stable than coordinate-based tapping.
  • A screenshot-plus-coordinate fallback covers custom-drawn or unlabeled screens, so the agent degrades gracefully instead of failing when accessibility data runs out.
  • Speaking native MCP, it plugs straight into Claude, Copilot, Gemini, or any MCP client without glue code.
Who It's For

Great fit if you want an AI agent to explore, test, or drive real mobile apps end-to-end, or to build reproducible mobile test flows without hand-writing selectors. Look elsewhere if you need a polished record-and-replay GUI, guaranteed support for heavily custom-rendered (game-engine) UIs, or a managed cloud device farm out of the box — this is developer tooling you run against your own simulators and devices, and the accessibility advantage shrinks on apps with poor accessibility hygiene.

Information

  • Websitegithub.com
  • AuthorsMobile Next
  • Published date2025/03/28

More Items

GitHub
AI Client2025

Turns Chromium into a local-first AI browser with an embedded assistant that can summarise pages, extract structured data, automate web tasks, and run scheduled agents. Built as an open-source Chromium fork with 53+ built-in browser tools, 40+ app integrations, and support for BYO AI keys or fully local models (Ollama / LM Studio).

GitHub
AI Infra2025

Defines a vendor-neutral JSON/YAML semantic model specification and tooling to exchange metrics, dimensions, lineage and other business semantics across analytics, AI and BI platforms; includes a core spec, validators, converters (dbt, GoodData, Salesforce) and example models.

GitHub
AI Train2025

An asynchronous, high-throughput framework for large-scale reinforcement learning and agentic training that scales to 1T+ MoE models and 1000+ GPUs, with native verifiers integration, end-to-end SFT/RL/evals, and Slurm/Kubernetes deployment; requires NVIDIA GPUs.