Depth Anything V2
Robotics modelMonocular relative and metric depth estimation family (DINOv2 + DPT, 24.8M–335.3M released params) with Apache-2.0 code and Small weights, and CC-BY-NC-4.0 Base/Large weights. [1] [2] [4]
Setup & usage →CheckpointsModel hub / homepageGetting started
- For
- Robotics perception engineers needing fast monocular relative or metric depth estimation; Teams deploying Apache-2.0 Depth-Anything-V2-Small on workstations or edge runtimes [1] [2]
- Embodiments
- Embodiment-agnostic monocular RGB camera perception module [1]
- Source rights
- Some licenses are unresolved. Includes noncommercial terms. Review licenses
Source researched · Not tested by us
Sources checked · Research details
Licenses & related hardware
- License
- Apache-2.0, Apache-2.0 (Small) / CC-BY-NC-4.0 (Base, Large, Giant per README) (noncommercial) · license not fully assessed for datasets · Details by part
Overview
Depth Anything V2 (DepthAnything/Depth-Anything-V2, arXiv:2406.09414) is a monocular depth estimation family from HKU and TikTok that pairs DINOv2 Vision Transformer encoders with a Dense Prediction Transformer (DPT) decoder head. Rather than training on noisy real-image depth labels, the authors train a large teacher exclusively on synthetic labeled images and distill student models across large-scale pseudo-labeled real images. At pinned commit a561b849ebae10a6f5ef49e26c83cbbcd36c71bf (last commit March 2026), the repository covers relative depth inference, indoor/outdoor metric depth fine-tuning, and the DA-2K evaluation benchmark. [1] [3] [4] [6]
Model card summary
- Architecture
DINOv2 Vision Transformer encoder (vits, vitb, vitl; intermediate features from 4 transformer stages) paired with a Dense Prediction Transformer (DPT) decoder head for relative depth, or a metric depth regression head (max_depth=20 m indoor / 80 m outdoor).
- Base model
DINOv2 Vision Transformer encoders (vits, vitb, vitl) distilled from a large synthetic-trained teacher model
- Parameter count
Small: 24.8M (0.099 GB), Base: 97.5M (0.39 GB), Large: 335.3M (1.341 GB); Giant (1.3B) listed as Coming soon and unreleased
- Input modalities
- rgb
Single RGB images or video frames (default inference input size 518).
- Output modalities
- video-frames
Outputs dense HxW per-pixel relative or metric depth maps/frames (and optional projected 3D point clouds via depth_to_pointcloud.py) rather than robot actions; mapped to video-frames as the closest controlled-vocabulary visual modality.
- Action space
Perception-only monocular depth model (no robot action output); outputs HxW relative depth maps or metric depth maps in meters (optionally projected to 3D point clouds).
- Trained / supported embodiments
- Embodiment-agnostic monocular RGB camera perception module
- Training datasets
- Synthetic labeled images (used to train teacher model) bridged to large-scale pseudo-labeled real images
- Hypersim (synthetic indoor) and Virtual KITTI 2 (synthetic outdoor) for metric depth fine-tuning
- DA-2K benchmark (1K images, 2K pairwise relative depth annotations) for evaluation
Checkpoints
| Checkpoint | Format | Size | Access | Pinned revision |
|---|---|---|---|---|
| Depth-Anything-V2-Small (24.8M, relative, Apache-2.0) | pytorch | 0.099 GB | open | 03876f8651c7 |
| Depth-Anything-V2-Base (97.5M, relative, CC-BY-NC-4.0) | pytorch | 0.39 GB | open | a4e71a6c2ce5 |
| Depth-Anything-V2-Large (335.3M, relative, CC-BY-NC-4.0) | pytorch | 1.341 GB | open | cbbb86a30ce1 |
| Depth-Anything-V2-Metric-Hypersim-Small (24.8M, indoor metric) | pytorch | 0.099 GB | open | 3bc65d4e14a6 |
| Depth-Anything-V2-Metric-Hypersim-Base (97.5M, indoor metric) | pytorch | 0.39 GB | open | 4ebcd7fd0858 |
| Depth-Anything-V2-Metric-Hypersim-Large (335.3M, indoor metric) | pytorch | 1.341 GB | open | 797208006383 |
| Depth-Anything-V2-Metric-VKITTI-Small (24.8M, outdoor metric) | pytorch | 0.099 GB | open | c725b8589bdf |
| Depth-Anything-V2-Metric-VKITTI-Base (97.5M, outdoor metric) | pytorch | 0.39 GB | open | e96fd0c8cedf |
| Depth-Anything-V2-Metric-VKITTI-Large (335.3M, outdoor metric) | pytorch | 1.341 GB | open | 070e97e4b80e |
Nine public ungated PyTorch checkpoints verified via Hugging Face API (3 relative + 6 metric). Hugging Face Transformers safetensors mirrors (-hf) and Apple Core ML Small exports are also linked in README.
Is this for you?
- Use cases
- Monocular relative depth estimation from single RGB images or videos (run.py, run_video.py, Hugging Face pipeline)
- Indoor (Hypersim, max_depth=20 m) and outdoor (Virtual KITTI 2, max_depth=80 m) metric depth estimation in meters
- Projecting 2D RGB + predicted metric depth into 3D point clouds (metric_depth/depth_to_pointcloud.py)
- Fine-tuning the DINOv2 encoder + DPT head on custom metric depth datasets (metric_depth/dist_train.sh)
- Known limitations
- Split weight licensing: only Depth-Anything-V2-Small is explicitly Apache-2.0 in the README, whereas Base, Large, and Giant are stated as CC-BY-NC-4.0 (note: Base/Large metric-depth Hugging Face cards list apache-2.0 metadata, creating a conflict that commercial users should clarify upstream).
- Depth-Anything-V2-Giant (1.3B) is listed as 'Coming soon' in the README and is not publicly released.
- Relative depth models output scale- and shift-invariant depth maps rather than metric meters; metric variants are fine-tuned separately on synthetic Hypersim (indoor) or Virtual KITTI 2 (outdoor).
- README notes slight prediction differences between native OpenCV preprocessing and Hugging Face Transformers Pillow upsampling.
- Safety and limitations
- Commercial deployment is clearly permitted by the README only for the code and Depth-Anything-V2-Small (24.8M, Apache-2.0); Base and Large are stated as CC-BY-NC-4.0 in the README despite apache-2.0 tags on metric-depth Hugging Face cards.
- Monocular depth estimation is inherently scale-ambiguous for relative models and domain-sensitive for metric models; do not rely on uncalibrated monocular depth alone for safety-critical obstacle avoidance.
- Perception-only model outputting depth maps (or projected point clouds) and no robot actions.
- Open Source Robotics has not installed Depth Anything V2, downloaded weights, run inference, or reproduced DA-2K or metric depth benchmarks.
Compute & fine-tuning
- Inference compute
- Documented hardware: CUDA GPU, Apple Silicon MPS, or CPU (official code selects cuda -> mps -> cpu; also integrated in Apple Core ML; exact minimum VRAM and ms latency not tabulated in README)
- Edge / consumer capable: Yes
Small (24.8M, 0.099 GB) officially supports MPS/CPU and is integrated into Apple Core ML (coreml-depth-anything-v2-small), supporting edge_capable=true; exact VRAM/latency not stated in README.
- Fine-tuning
- Supported: Yes
- Methods: metric depth fine-tuning via metric_depth/dist_train.sh on Hypersim, Virtual KITTI 2, or custom datasets
- Recipe: Upstream fine-tuning documentation
- Host computer
Runs on CUDA GPU, Apple Silicon MPS, or CPU (0.099 GB Small to 1.341 GB Large checkpoints); distributed GPU training used for metric_depth/dist_train.sh.
- Operating system
- Linux
- macOS
README inference code explicitly supports CUDA, Apple MPS (macOS), and CPU; dist_train.sh targets Linux.
[1] · Editorial assessment
- Dependencies
- PyTorch and OpenCV (requirements.txt)
- Optional Hugging Face Transformers (for -hf pipeline)
- Optional Gradio (app.py)
Setup & usage
Open the upstream getting-started guide [1] · Model card / documentation [1]
- Clone DepthAnything/Depth-Anything-V2 and install requirements.txt (or install Hugging Face transformers for pipeline usage).
- Download the desired checkpoint (.pth) from Hugging Face into checkpoints/ (choosing Small for clear Apache-2.0 commercial rights).
- Run python run.py --encoder <vits|vitb|vitl> --img-path <path> --outdir <outdir> (or metric_depth/run.py with --max-depth 20 or 80 for metric meters).
- Optionally project metric depth to 3D point clouds via metric_depth/depth_to_pointcloud.py.
Upstream-reported benchmarks
Upstream-reported only: Open Source Robotics has not run training, inference, or hardware evaluations for these benchmarks.
| Benchmark | Upstream-reported score | Scope & caveats |
|---|---|---|
| DA-2K & Zero-Shot Monocular Depth Benchmarks (arXiv:2406.09414) | Upstream reports >10x faster inference and higher depth accuracy than Stable-Diffusion-based monocular depth baselines, plus finer details and robustness than Depth Anything V1; separately introduces the DA-2K relative depth benchmark (1K images, 2K pairwise annotations). | Upstream-reported paper abstract and README summary; exact per-benchmark numerical scores are not included in the supplied README or abstract, and OSR has not independently reproduced evaluations. |
Project notes
Checkpoints, metric depth variants, and runtime notes
Nine public, ungated PyTorch checkpoints were verified via the Hugging Face API across three released scales—Small (24.8M, 0.099 GB), Base (97.5M, 0.39 GB), and Large (335.3M, 1.341 GB)—comprising three relative depth models plus six fine-tuned metric depth models trained on synthetic Hypersim (indoor, max_depth=20 m) and Virtual KITTI 2 (outdoor, max_depth=80 m). Practically, the relative checkpoints output scale- and shift-invariant relative depth maps rather than metric distances, whereas the metric checkpoints predict depth in meters using the configured indoor or outdoor scale. Across the verified checkpoints, the three 24.8M Small models—relative, Hypersim metric, and Virtual KITTI 2 metric—are the clear Apache-2.0 choices supported by both the README and Hugging Face metadata. The 1.3B Giant variant remains listed as "Coming soon" in the README and is not released. [1] [4] [5]
The native Python snippet automatically selects CUDA, Apple Silicon MPS, or CPU, and the ecosystem includes Hugging Face Transformers -hf mirrors as well as an official Apple Core ML Small export. However, upstream explicitly notes that Pillow upsampling in Hugging Face Transformers can produce slightly different predictions than the native OpenCV pipeline, so native inference is recommended for exact reproduction. For robotics 3D workflows, metric_depth/depth_to_pointcloud.py projects predicted metric depth maps into 3D point clouds. [1] [4]
Upstream-reported performance
In arXiv:2406.09414 and the README, the authors report over 10× faster inference and higher depth accuracy than Stable-Diffusion-based monocular depth baselines, along with finer details and improved robustness compared with Depth Anything V1. Separately, they introduce the DA-2K benchmark (1K images and 2K pairwise relative depth annotations across eight scene types) for evaluating relative depth estimation. Exact per-benchmark numerical scores are not included in the supplied README or abstract. All performance claims are upstream-reported; Open Source Robotics has not installed dependencies, downloaded weights, run training, fine-tuning, or inference, or reproduced DA-2K or metric depth evaluations. [1] [6]
What we checked
Source researched only; no installation, training, fine-tuning, inference, benchmark, or physical hardware test performed. No affiliate links or reused media.
Not yet established
- Documented closed-loop control frequency (Hz)
Updates
- Upstream last updated
- Mar 24, 2026 [3]
- Latest release
- Not established
- Profile updated
- Nov 21, 2026
- Sources last checked
- Nov 21, 2026
- Next review
- Feb 19, 2027
- Reviewed revision
- commit snapshot; no GitHub release / a561b849ebae10a6f5ef49e26c83cbbcd36c71bf · software repository
Separate license matrix
Include Depth Anything V2 as a partially open model family: Apache-2.0 code and Small (24.8M) weights, while Base/Large weights are stated as CC-BY-NC-4.0 in the README (with an HF metric-card metadata discrepancy).
| Layer | Availability / license |
|---|---|
| Code | available · Apache-2.0 Repository code is Apache-2.0. [1] [2] |
| Model weights | available · Apache-2.0 (Small) / CC-BY-NC-4.0 (Base, Large, Giant per README) README states Small is Apache-2.0 and Base/Large/Giant are CC-BY-NC-4.0. Note: Hugging Face metadata on Base/Large metric-depth repos lists apache-2.0, creating a discrepancy that commercial users should verify before using Base or Large. [1] [5] |
| Training datasets | available · License not fully assessed DA-2K evaluation benchmark (1K images, 2K pairwise depth annotations) is published on Hugging Face; synthetic/pseudo-labeled pre-training corpora and external Hypersim/VKITTI2 datasets are not bundled here. [1] [6] |
| Documentation | available · Apache-2.0 README, metric_depth/README.md, and DA-2K.md included in repository. [1] [2] |
Split Apache-2.0 and CC-BY-NC-4.0 licensing
While the repository root LICENSE is Apache-2.0, the README's License section explicitly states that only Depth-Anything-V2-Small is licensed under Apache-2.0, whereas Base, Large, and Giant are under CC-BY-NC-4.0 (non-commercial). Notably, Hugging Face card metadata on the Base and Large metric-depth repositories lists apache-2.0, creating a metadata conflict with the root README; commercial robotics teams should stick to the 24.8M Small checkpoints or obtain written clarification upstream before using Base or Large. [1] [2] [5]
References
Each source links to the exact revision we read. “Used for” shows where this page relies on it.
- S001 Depth Anything V2 README
Model table (Small 24.8M, Base 97.5M, Large 335.3M, Giant 1.3B coming soon), DINOv2-DPT architecture, Transformers/Core ML integrations, and split Apache-2.0 / CC-BY-NC-4.0 weight license.Revision, date & where cited
DepthAnything/Depth-Anything-V2 contributors · github.com · revision
a561b84· Accessed Nov 21, 2026
Used for: Overview, Model card summary, Checkpoints, Is this for you? and 6 more - S002 Depth Anything V2 Apache-2.0 License
Apache License 2.0 in repository root.Revision, date & where cited
DepthAnything/Depth-Anything-V2 · github.com · revision
a561b84· Accessed Nov 21, 2026
Used for: Is this for you?, Separate license matrix - S003 GitHub repository metadata and pinned commit
Last commit 2026-03-24; no GitHub releases; not archived.Revision, date & where cited
DepthAnything/Depth-Anything-V2 / GitHub · github.com · revision
a561b84· main / · Accessed Nov 21, 2026
Used for: Overview, What we checked - S004 Metric Depth Estimation README (metric_depth/README.md)
Six fine-tuned metric depth checkpoints (Hypersim indoor max_depth=20m, Virtual KITTI 2 outdoor max_depth=80m), point-cloud projection, and dist_train.sh fine-tuning.Revision, date & where cited
DepthAnything/Depth-Anything-V2 contributors · github.com · revision
a561b84· Accessed Nov 21, 2026
Used for: Overview, Model card summary, Checkpoints, Is this for you? and 3 more - S005 Hugging Face relative and metric depth checkpoint metadata
Verified exact revisions, file sizes (0.099 GB, 0.39 GB, 1.341 GB), and HF license tags across relative and metric depth repos (noting license-tag discrepancy on Base/Large metric repos vs README).Revision, date & where cited
Depth Anything / Hugging Face · huggingface.co · 9 model repos verified 2026-11-21 · Accessed Nov 21, 2026
Used for: Model card summary, Checkpoints, Is this for you?, Compute & fine-tuning and 2 more - S006 Depth Anything V2 (arXiv:2406.09414) and DA-2K benchmark
Synthetic-trained teacher + pseudo-labeled real-image student distillation; reports >10x faster inference and higher accuracy than Stable-Diffusion-based depth models; introduces DA-2K (1K images, 2K pairwise annotations).Revision, date & where cited
HKU & TikTok (arXiv:2406.09414v1) · arxiv.org · arXiv:2406.09414v1 abstract & DA-2K.md · Accessed Nov 21, 2026
Used for: Overview, Model card summary, Upstream-reported benchmarks, Upstream-reported performance and 1 more
Correction guidance · Discussion is not enabled · Profile format 0.8.0-draft.1
Change history
2026-11-21 — Initial 0.8.0-draft.1 model profile for Depth Anything V2 (9 verified HF checkpoints, split license analysis).