AIAny
Icon for item

ABot-Earth 0.5: Generative 3D Earth Model

Synthesizes scalable, photoreal 3D Earth tiles from georeferenced satellite imagery using a generative 3D Gaussian Splatting representation; trained on urban reconstructions, it generates novel scenes at under 10 minutes/km² with hierarchical LOD for real-time web map visualization and Embodied AI use cases.

Introduction

Large-scale 3D mapping is often limited by costly capture and slow reconstruction pipelines. ABot-Earth 0.5 flips that constraint by learning a generative 3D representation so you can synthesize new, geographically consistent 3D scenes directly from widely available satellite imagery — fast enough to produce tiles at a rate under 10 minutes per square kilometer and structured for interactive display.

Key Findings
  • Generative use of 3D Gaussian Splatting (3DGS): the paper formulates a generative model directly on the 3DGS representation, letting the system produce both geometry and texture rather than reconstructing them deterministically from multi-view inputs.
  • Training on urban reconstructions enables realistic urban geometry and materials: by learning from existing city-scale reconstructions, the model internalizes typical urban layouts and appearances, improving plausibility when synthesizing novel tiles conditioned on satellite input.
  • Practical throughput and delivery: inference synthesizes novel 3D scenes at a reported rate of under 10 minutes per km², and outputs a hierarchical level-of-detail (LOD) structure designed for real-time, web-based map engines.
  • Embodied-AI focus: the produced scenes aim to reduce sim-to-real gaps for downstream tasks such as closed-loop UAV navigation by providing large-scale, low-cost simulation sandboxes.
Who it's for and trade-offs

Great fit if you need large-area, geospatially conditioned 3D environments for simulation, rapid prototyping, or as a lightweight dataset generator for embodied agents. It lowers financial and technical barriers compared to full photogrammetric campaigns. Look elsewhere if you require ground-truth-accurate metric geometry (e.g., engineering-grade surveys) or highly detailed street-level fidelity — the method emphasizes scalable plausibility over centimeter-accurate reconstructions. Also note potential limitations: the approach is trained on urban reconstructions (generalization to rural/natural terrains may be limited), quality depends on satellite input resolution and available training reconstructions, and there are potential dataset licensing and ethical/privacy considerations for commercial deployment.

Where it fits technically

The novelty is primarily representational and engineering: using 3D Gaussian Splatting as the learned generative substrate lets the model output LOD-aware 3D assets that are directly renderable in real-time engines. That design choice trades some per-vertex precision for compactness and fast rendering, which is why it can serve map engines and embodied-simulation pipelines at low cost.

Overall, ABot-Earth 0.5 is best read as a systems-level contribution that reframes large-scale 3D earth modeling from reconstruction-first to generation-first, making broad-area synthetic worlds accessible for research and applied Embodied AI tasks.

Information

  • Websitearxiv.org
  • AuthorsMing Qian, Tianjian Ouyang, Mingchao Sun, Zijian Wang, Jincheng Xiong, Jiarong Han, Yongchang Zhang, Jiawei Zhang, Xu Wang, Yu Liu
  • Published date2026/06/08

More Items

Evaluates spatial cognition of image-generation models by eliciting protocol-constrained visual answers and parsing pixel outputs into structured predictions compatible with existing metrics. Introduces the ProVisE framework and SpatialGen-Bench (470 samples) to compare image-generation models and text-output VLMs on unified spatial tasks.

Selects a referred target from candidate bounding boxes, then decodes tracking waypoints for single-camera embodied visual tracking. Injects past selected-bbox geometry via sliding-window TVBI tokens and is co-trained on a Refer‑QA dataset; achieves SOTA on EVT‑Bench and demonstrates sim-to-real on legged and humanoid robots.

Converts image-content removal into a contrastive on-policy self-distillation signal: the EMA teacher produces next-token distributions with and without image content, uses their log-probability differences to sharpen visual-grounded candidates, and distills that full-distribution target into the student—no external teacher or extra inference cost.