ComfyUI Depth Estimation Node

A robust custom depth estimation node for ComfyUI using Depth-Anything models to generate depth maps from images.

Features

• Multiple model options:
  • Depth-Anything-Small
  • Depth-Anything-Base
  • Depth-Anything-Large
  • Depth-Anything-V2-Small
  • Depth-Anything-V2-Base
  • Depth-Anything-V3-Small (Requires optional dependency)
  • Depth-Anything-V3-Base (Requires optional dependency)
• Post-processing options:
  • Gaussian blur (adjustable radius)
  • Median filtering (configurable size)
  • Automatic contrast enhancement
  • Gamma correction
• Advanced options:
  • Force CPU processing for compatibility
  • Force model reload for troubleshooting
  • Camera Estimation (New in v1.3.4): Extract camera extrinsics and intrinsics (DA3 models only)
  • Raw Depth Output: Option to output metric depth for point clouds

Installation

Method 1: Install via ComfyUI Manager (Recommended)

1. Open ComfyUI and install the ComfyUI Manager if you haven't already
2. Go to the Manager tab
3. Search for "Depth Estimation" and install the node

Method 2: Manual Installation

1. Navigate to your ComfyUI custom nodes directory:

   cd ComfyUI/custom_nodes/

2. Clone the repository:

   git clone https://github.com/Limbicnation/ComfyUIDepthEstimation.git

3. Install the required dependencies:

   cd ComfyUIDepthEstimation
   pip install -r requirements.txt

4. (Optional) To enable Depth Anything V3 models:

   pip install git+https://github.com/ByteDance-Seed/Depth-Anything-3.git

5. Restart ComfyUI to load the new custom node.

Note: On first use, the node will download the selected model from Hugging Face. This may take some time depending on your internet connection.

Usage

Example Results (Depth Anything V3)

Node Parameters

Required Parameters

• image: Input image (IMAGE type)
• model_name: Select from available Depth-Anything models
• blur_radius: Gaussian blur radius (0.0 - 10.0, default: 2.0)
• median_size: Median filter size (3, 5, 7, 9, 11)
• apply_auto_contrast: Enable automatic contrast enhancement
• apply_gamma: Enable gamma correction

Optional Parameters

• force_reload: Force the model to reload (useful for troubleshooting)
• force_cpu: Use CPU for processing instead of GPU (slower but more compatible)
• enable_camera_estimation: Enable extraction of camera pose data (DA3 models only)
• output_raw_depth: Output raw metric depth values instead of normalized 0-1 map (useful for 3D reconstruction)

Outputs

The node provides 5 outputs for maximum flexibility:

1. depth (IMAGE): Standard normalized depth map (0-1, grayscale)
2. confidence (IMAGE): Confidence map visualization
3. extrinsics (CAMERA_EXTRINSICS): [N, 3, 4] Tensor of camera extrinsics (OpenCV format)
4. intrinsics (CAMERA_INTRINSICS): [N, 3, 3] Tensor of camera intrinsics
5. camera_json (STRING): JSON string containing all camera parameters and metadata

Note: For non-DA3 models, the camera outputs will be empty/None.

Video Processing

The node supports video processing via batch inputs. You can load a video using standard ComfyUI video loaders (e.g., "Load Video") or "Load Images from Folder", which pass frames as a batch. The node processes the entire batch efficiently.

Example Usage

1. Add the Depth Estimation node to your ComfyUI workflow
   • Tip: You can find example workflows in the workflows/ directory.
2. Connect an image source to the node's image input
3. Configure the parameters:
   • Select a model (e.g., "Depth-Anything-V2-Small" is fastest)
   • Adjust blur_radius (0-10) for depth map smoothing
   • Choose median_size (3-11) for noise reduction
   • Toggle auto_contrast and gamma correction as needed
4. Connect the output to a Preview Image node or other image processing nodes

Model Information

Model Name	Quality	VRAM Usage	Speed
Depth-Anything-V2-Small	Good	~1.5 GB	Fast
Depth-Anything-Small	Good	~1.5 GB	Fast
Depth-Anything-V2-Base	Better	~2.5 GB	Medium
Depth-Anything-Base	Better	~2.5 GB	Medium
Depth-Anything-V3-Small	Excellent	~2.0 GB	Fast
Depth-Anything-V3-Base	Superior	~2.5 GB	Medium
Depth-Anything-Large	Best	~4.0 GB	Slow

Troubleshooting Guide

Common Issues and Solutions

Model Download Issues

• Error: "Failed to load model" or "Model not found"
• Solution:

  1. Check your internet connection

  2. Try authenticating with Hugging Face:

     pip install huggingface_hub
     huggingface-cli login

  3. Try a different model (e.g., switch to Depth-Anything-V2-Small)

  4. Check the ComfyUI console for detailed error messages

CUDA Out of Memory Errors

• Error: "CUDA out of memory" or node shows red error image
• Solution:
  1. Try a smaller model (Depth-Anything-V2-Small uses the least memory)
  2. Enable the force_cpu option (slower but uses less VRAM)
  3. Reduce the size of your input image
  4. Close other VRAM-intensive applications

Node Not Appearing in ComfyUI

• Solution:

  1. Check your ComfyUI console for error messages

  2. Verify that all dependencies are installed:

     pip install transformers>=4.20.0 Pillow>=9.1.0 numpy>=1.23.0 timm>=0.6.12

  3. Try restarting ComfyUI

  4. Check that the node files are in the correct directory

Node Returns Original Image or Black Image

• Solution:
  1. Try enabling the force_reload option
  2. Check the ComfyUI console for error messages
  3. Try using a different model
  4. Make sure your input image is valid (not corrupted or empty)
  5. Try restarting ComfyUI

Slow Performance

• Solution:
  1. Use a smaller model (Depth-Anything-V2-Small is fastest)
  2. Reduce input image size
  3. If using CPU mode, consider using GPU if available
  4. Close other applications that might be using GPU resources

Where to Get Help

• Create an issue on the GitHub repository
• Check the ComfyUI console for detailed error messages
• Visit the ComfyUI Discord for community support

License

This project is licensed under the Apache License.

---