AIAny
AI Model2026
Icon for item

Depth Pro 2: Sharp and Temporally Consistent Metric Monocular Depth

Estimates metric depth for every pixel in a photo, video, or live feed, with sharp object boundaries and stable results across frames. Multiple model sizes are available; weights are restricted to non-commercial research and academic development.

Introduction

Video depth has long involved a trade-off: processing frames together improves temporal stability, while single-frame methods tend to preserve sharper edges. The key idea here is to train one scalable model for both settings, so depth can remain crisp at object boundaries without flickering from frame to frame.

Key Capabilities
  • It predicts depth in meters at the input’s native resolution, making fine boundaries more useful for downstream vision tasks.
  • A multi-view transformer can process one frame or several jointly; cross-frame attention helps steady video predictions, while training on single images preserves the ability to infer metric scale from a photo.
  • A shared focal-length estimator handles images without known camera intrinsics. When focal length is available, it can instead be supplied to recover metric depth.
  • Four sizes, from 24M to 872M parameters, offer a practical speed-versus-quality choice. The reported streaming results range from 53 fps for S to 8 fps for H+ at 1080p on a B200.
Who It’s For

A good fit for research and vision pipelines that need dense, metric depth from ordinary cameras, especially when video stability and edge detail both matter. Look elsewhere if you need commercially licensed weights, or if your task requires geometry beyond monocular depth estimation; the model weights are limited to non-commercial scientific research and academic development.

Information

  • Websitehuggingface.co
  • OrganizationsApple
  • AuthorsPeiyun Hu, Marko Mihajlovic, Lyndon Duong, Lahav Lipson, Wei Dong, Amaël Delaunoy, Stephan R. Richter, Vladlen Koltun
  • Published date2026/11/03

Categories

More Items

Hugging Face
AI Model2026

Runs text generation, summarization, and question answering directly on Windows devices as a 2.3B-parameter instruction-tuned model. It supports eight languages and a 32K context window, trading broad world knowledge and deep reasoning for local execution and privacy.

Hugging Face
AI Model2026

Handles text, image, and video understanding with sparse attention designed for contexts up to 1 million tokens. It has 770B total parameters with 49B activated per token, targeting long-document analysis, multimodal reasoning, and extended workflows.

Hugging Face
AI Model2026

Provides quantized GGUF builds of Inkling 2 Mini for local text-and-image inference, with file sizes from about 7.76 to 22.87 GB. Runtime support for its looped transformer architecture may vary.