Embodied AI2024
Provides an open platform of omnimodal world models, datasets, and tools to build Physical AI — joint perception, generation, and action reasoning for robots, autonomous vehicles, and smart infrastructure. Supports images, video, audio, and action-conditioned workflows.
Embodied AI2025
Turns camera, audio, LIDAR and web inputs into robot motion, navigation and speech by routing them through pluggable LLMs and VLMs. Hardware-agnostic Go runtime configured via JSON5, with ROS2/Zenoh middleware for real robots and simulators.
Embodied AI2025
A vision-language-action foundation model and reference stack for generalized humanoid and cross-embodiment robot manipulation. Provides pretrained checkpoints, demo datasets, and tooling for fine-tuning, evaluation, and deployment (ONNX/TensorRT); released as Early Access.
Embodied AI2025
GPU-accelerated physics simulation engine for robotics and simulation research — built on NVIDIA Warp with MuJoCo Warp backend, offering differentiable simulation, OpenUSD support, and extensions for RL/embodied-AI workflows. ([github.com](https://github.com/newton-physics/newton))
AI Video2025
Provides PyTorch code, pretrained checkpoints, and evaluation tooling for V-JEPA 2 — a Meta FAIR family of self-supervised video encoders and an action-conditioned world model. Includes training recipes, HuggingFace checkpoints, evaluation probes, and robot post‑training artifacts.
AI Dataset2025
Physics-aware simulated sensor dataset for training and evaluating autonomous-vehicle perception and control models. Includes multimodal sensor streams with physical-scene annotations intended for tasks that require grounding in real-world dynamics.
Embodied AI2025
Provides a unified Python interface to collect data, train visual/dynamics world models, and evaluate them with model-predictive control across many standardized environments. Includes reference baselines, planning solvers, dataset converters, and LanceDB-backed formats for reproducible experiments. Best suited for researchers benchmarking world-model algorithms.
Embodied AI2025
Contains training, evaluation, and deployment code plus checkpoints for humanoid whole-body controllers (Decoupled WBC and GEAR‑SONIC). Includes C++ inference, VR teleoperation, data pipelines (Bones‑SEED) and Hugging Face checkpoints for research-to-robot workflows.
AI Dataset2025
Large-scale, real-world dual-arm video corpus for embodied robotics and reinforcement-learning research — over 1TB of multimodal recordings on Hugging Face, intended for training and evaluating agents in real manipulation scenarios; CC BY‑SA 4.0.
Embodied AI2026
Train robot reinforcement-learning agents with a heterogeneous runtime that streams CPU-parallel physics simulations (MuJoCo / Motrix) via shared memory into GPU/accelerator policy learners; provides a unified CLI, cross-platform backend support and demo checkpoints.
AI Dataset2026
Provides an annotated multimodal human-motion dataset for language-to-action and robotics research, with BVH and MuJoCo files plus recordings targeted at Unitree-G1 and NVIDIA-SOMA platforms. Covers locomotion, gestures, dance and object interaction with English annotations and 100K–1M samples.
AI Model2026
Generate text, images, video, audio and action/robot trajectories from combined text, image, video, audio and action inputs. A Mixture-of-Transformers omnimodal foundation model (Cosmos3‑Nano, 16B params) focused on Physical AI (robotics, AV, simulation) and optimized for NVIDIA GPU runtimes.