Tag
Explore by tags
Provides a deliberative Agent OS layer for robots that handles scene-conditioned planning, context-isolated skill execution, multi-stage verification, persistent multi-modal graph memory, and edge–cloud collaboration. Introduces EmbodiedWorldBench (16 scenes, 200+ tasks) and a failure-driven self-evolution loop; shows improved task success and strong memory benchmark scores.
Unifies high-level visual-language reasoning and low-level control for visual navigation by decoupling cognition and control: a slow vision-language reasoner produces pixel goals with explicit chain-of-thought, and a fast action expert converts those anchors into continuous waypoints for robust urban and indoor navigation.
Analyzes adversarial weaknesses of World-Action Models (WAMs) via BadWAM, a framework that crafts visual perturbations to decouple a model’s imagined future from its executed actions. Introduces two attack modes—action-only (disruptive) and imagination-preserving (stealthy)—and shows large drops in closed-loop task success (e.g., 96.5%→43.1%).
A vision-language-action foundation model trained on 100k+ hours of real-world robot manipulation trajectories to follow natural-language instructions and adapt to downstream tasks with minimal fine-tuning. Uses a two-stage (pre-/post-) training recipe and a scalable auto-labeling pipeline; shows clear scaling benefits and state-of-the-art sim-to-real transfer on standard benchmarks.
Generates robot manipulation actions from visual observations and text instructions using a 1.5B vision-language-action model. Uses streaming context and visual-token compression to cut per-step compute, runs a unified policy across tasks, and is open-sourced on Hugging Face under Apache-2.0.
Predicts eight future [x,y,yaw] waypoints for language-conditioned embodied person-following using fused DINOv3 and SigLIP visual features; trained with quality-driven, DAgger-style self-evolving data and optimized for on-device inference (~5+ FPS, ~180 ms).
Provides 2,000 hours of synchronized, high‑fidelity robot‑free bimanual manipulation demonstrations with multi‑view video, calibrated end‑effector trajectories, gripper states, and language annotations. Curated from a 20,000+ hour corpus; features 6 camera views, ~3 mm pose accuracy, <40 µs cross‑sensor sync, and LeRobot v3‑style Parquet+MP4 export under CC BY 4.0.
Generates and reasons about multimodal physical-world content—text, images, video and action trajectories—conditioned on text, images, video and robot/vehicle action inputs. An edge-sized (4B) Mixture‑of‑Transformers omni-model optimized for single‑GPU inference and Physical AI tasks (image→video, action prediction, robot policy).
A compact evaluation dataset and harness for testing agentic AI on safety-critical robotics tasks. Includes multimodal episodes in parquet format, task-specific eval scripts (gauge reading, human safety monitoring, VLA estimators), and TFDS/Hugging Face integration for reproducible safety evaluations.
Selects a referred target from candidate bounding boxes, then decodes tracking waypoints for single-camera embodied visual tracking. Injects past selected-bbox geometry via sliding-window TVBI tokens and is co-trained on a Refer‑QA dataset; achieves SOTA on EVT‑Bench and demonstrates sim-to-real on legged and humanoid robots.
Provides a unified survey of progress-reward modeling for robotic learning, detailing interfaces, modeling techniques, and evaluation practices. Organizes the literature into three perspectives—interface, model internals, and data/benchmarks—and highlights limitations and open problems. Useful for researchers designing rewards for long-horizon or sparse-reward robotic tasks.
Enables tactile-aware robot manipulation by pretraining a vision–tactile–language–action foundation model and improving offline policies with ALTER. Combines large-scale NeoData visuo-tactile pretraining, a latent tactile pathway for predictive touch signals, and advantage‑conditioned offline RL for contact-rich tasks.