Skip to main content

Pixel-Accurate Depth Evaluation in Realistic Driving Scenarios

Author(s): Gruber, Tobias; Bijelic, Mario; Heide, Felix; Ritter, Werner; Dietmayer, Klaus

To refer to this page use:
Abstract: This work introduces an evaluation benchmark for depth estimation and completion using high-resolution depth measurements with angular resolution of up to 25" (arcsecond), akin to a 50 megapixel camera with per-pixel depth available. Existing datasets, such as the KITTI benchmark, provide only sparse reference measurements with an order of magnitude lower angular resolution - these sparse measurements are treated as ground truth by existing depth estimation methods. We propose an evaluation methodology in four characteristic automotive scenarios recorded in varying weather conditions (day, night, fog, rain). As a result, our benchmark allows us to evaluate the robustness of depth sensing methods in adverse weather and different driving conditions. Using the proposed evaluation data, we demonstrate that current stereo approaches provide significantly more stable depth estimates than monocular methods and lidar completion in adverse weather. Data and code are available at
Publication Date: 2019
Citation: Gruber, Tobias, Mario Bijelic, Felix Heide, Werner Ritter, and Klaus Dietmayer. "Pixel-Accurate Depth Evaluation in Realistic Driving Scenarios." In International Conference on 3D Vision (3DV) (2019): pp. 95-105. doi:10.1109/3DV.2019.00020
DOI: 10.1109/3DV.2019.00020
ISSN: 2378-3826
EISSN: 2475-7888
Pages: 95 - 105
Type of Material: Conference Article
Journal/Proceeding Title: International Conference on 3D Vision
Version: Author's manuscript

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.