Provides a year-scale multimodal benchmark and evaluation framework for on-device long-term memory in personal assistants, built from real mobile user trajectories. Tests memory construction, retrieval, updating, temporal reasoning, and implicit preference inference, and includes a knowledge-grounded synthesis pipeline to form coherent long-horizon trajectories.
Turns natural-language instructions into end-to-end Android automation that drives real devices and captures Logcat and screenshots. Uses a multimodal “Dynamic‑First, Coordinate‑Fallback” locator and a native MCP server for IDE integration, supporting fast Flash (3–5s/step) and verifiable Pro workflows.
A 9B open-weight reasoning LLM that uses a self-improvement loop to auto-generate tasks, construct scaffolds, and optimize rollouts for stronger agentic coding and long-context reasoning. Single-GPU deployable, supports tool-calling and a 262,144-token context window.
Assesses mobile planning agents' ability to call tools, plan long-horizon workflows, and coordinate sub-agents in realistic, interactive phone scenarios via a stateful executable sandbox. Covers 13 domains, 212 tools, evidence-based verification, and tests memory, skill usage, permission and runtime constraints.
Autonomous multimodal GUI agent that executes natural-language interface tasks across mobile apps, web domains, and desktop OS. Expands environment coverage (170+ multilingual apps, 4,000+ web domains), uses function-grounded task generation and keypoint-based multi-model verification to produce reliable RL rewards for real-world deployment.
Runs a 35B-class sparse MoE LLM with SSD-streamed experts, 4-bit quantization, prerouter routing prediction and Recover-LoRA adapters to enable ~2.9–3 GiB active memory and interactive decoding (~15 tok/s) for on-device inference.
Compresses a 27B-class multimodal model into end-to-end ternary weights to run 27B reasoning on-device: 5.9–8.6 GB deployed footprint, 262K-token context, ~98.2% of FP16 benchmark performance; ships MLX and GGUF packs and runs on Apple MLX and CUDA.
Runs locally on constrained devices to turn text into guaranteed-parsable JSON tool calls, typed structured extractions, or sentence embeddings. Delivered as a single compact weights file (8–29 MB) with a laddered 2–20-layer design, low-bit quantisation and calibrated confidence scores for on-device apps.
A mobile-planning agent paper that develops a closed-loop AI-for-AI lifecycle to generate data, train a planner model, and co-evolve a runtime Harness for multi-app task execution. Demonstrates top performance on MobilePA-Bench with improved tool use, memory, skill coordination and low estimated per-task output cost.
On-device speech-to-text for short clips (up to 30s) in seven languages, yielding transcripts, word-level timestamps and per-frame speech embeddings in a single 16.9 MB model. Runs on the Needle CPU engine with 2–4 bit quantization, supports keyword biasing and returns empty transcripts for silence.
Multimodal image/video-to-text model optimized for on-device inference: the 1B variant uses early visual-token compression and multiple quantization formats to improve capability-per-compute, and supports mobile platforms and common inference frameworks.
GGUF (llama.cpp) quantized build of MiniCPM‑V 4.7 35B‑A3B for local/CPU and on-device multimodal image/video→text inference; supports imatrix mixed quantization, Lookahead Expert Scheduling and DSpark speculative decoding to reduce expert-loading stalls and improve throughput.