AIAny
Icon for item

mobile-mcp

Gives an LLM agent direct control of iOS and Android apps over one MCP interface, across simulators, emulators, and real devices. Reads the native accessibility tree to pick elements deterministically, using screenshot coordinates only as fallback.

Introduction

Mobile UI automation has long meant brittle, platform-specific scripts — XPath selectors that break on the next release, or vision models guessing where to tap. The bet here is different: a phone's accessibility tree is already a structured, labeled description of the screen, so an LLM can reason over it the way it reasons over a DOM. That turns "tap the login button" into a deterministic lookup rather than a pixel gamble, and the same agent code runs unchanged across iOS and Android.

What Sets It Apart
  • One platform-agnostic API spans iOS and Android, simulators, emulators, and real devices — you write the automation once instead of maintaining separate Appium/XCUITest stacks per platform.
  • Accessibility-first element selection means no computer-vision model in the loop for labeled UIs, which is cheaper, faster, and far more stable than coordinate-based tapping.
  • A screenshot-plus-coordinate fallback covers custom-drawn or unlabeled screens, so the agent degrades gracefully instead of failing when accessibility data runs out.
  • Speaking native MCP, it plugs straight into Claude, Copilot, Gemini, or any MCP client without glue code.
Who It's For

Great fit if you want an AI agent to explore, test, or drive real mobile apps end-to-end, or to build reproducible mobile test flows without hand-writing selectors. Look elsewhere if you need a polished record-and-replay GUI, guaranteed support for heavily custom-rendered (game-engine) UIs, or a managed cloud device farm out of the box — this is developer tooling you run against your own simulators and devices, and the accessibility advantage shrinks on apps with poor accessibility hygiene.

Information

  • Websitegithub.com
  • AuthorsMobile Next
  • Published date2025/03/28

More Items

GitHub
AI Infra2025

Measures generative AI inference performance with token-level metrics (TTFT, inter-token latency), latency, and throughput under realistic traffic patterns. Provides a multiprocess engine, real-time TUI dashboard, extensible plugins, and integrations for telemetry and result uploads, aimed at inference benchmarking and capacity planning.

GitHub
AI Train2019

Train and experiment with multi-billion to trillion-parameter transformer models on large GPU clusters using GPU-optimized building blocks and reference training scripts; offers advanced parallelism and mixed-precision support for research teams and ML engineers.

GitHub

Indexes full text of visited web pages and local files on a self‑hosted server so you can search your personal knowledge from a web UI, terminal, CLI, or an AI assistant. Runs without mandatory telemetry, offers a browser extension for automatic capture, and supports optional semantic search via a configurable embeddings endpoint.