Skip to main content

Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar

Author(s): Scheiner, Nicolas; Kraus, Florian; Wei, Fangyin; Phan, Buu; Mannan, Fahim; et al

To refer to this page use:
Full metadata record
DC FieldValueLanguage
dc.contributor.authorScheiner, Nicolas-
dc.contributor.authorKraus, Florian-
dc.contributor.authorWei, Fangyin-
dc.contributor.authorPhan, Buu-
dc.contributor.authorMannan, Fahim-
dc.contributor.authorAppenrodt, Nils-
dc.contributor.authorRitter, Werner-
dc.contributor.authorDickmann, Jürgen-
dc.contributor.authorDietmayer, Klaus-
dc.contributor.authorSick, Bernhard-
dc.contributor.authorHeide, Felix-
dc.identifier.citationScheiner, Nicolas, Florian Kraus, Fangyin Wei, Buu Phan, Fahim Mannan, Nils Appenrodt, Werner Ritter, Jürgen Dickmann, Klaus Dietmayer, Bernhard Sick, Felix Heide. "Seeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radar." In IEEE/CVF Conference on Computer Vision and Pattern Recognition (2020): pp. 2065-2074, doi:10.1109/CVPR42600.2020.00214en_US
dc.description.abstractConventional sensor systems record information about directly visible objects, whereas occluded scene components are considered lost in the measurement process. Non-line-of-sight (NLOS) methods try to recover such hidden objects from their indirect reflections - faint signal components, traditionally treated as measurement noise. Existing NLOS approaches struggle to record these low-signal components outside the lab, and do not scale to large-scale outdoor scenes and high-speed motion, typical in automotive scenarios. In particular, optical NLOS capture is fundamentally limited by the quartic intensity falloff of diffuse indirect reflections. In this work, we depart from visible-wavelength approaches and demonstrate detection, classification, and tracking of hidden objects in large-scale dynamic environments using Doppler radars that can be manufactured at low-cost in series production. To untangle noisy indirect and direct reflections, we learn from temporal sequences of Doppler velocity and position measurements, which we fuse in a joint NLOS detection and tracking network over time. We validate the approach on in-the-wild automotive scenes, including sequences of parked cars or house facades as relay surfaces, and demonstrate low-cost, real-time NLOS in dynamic automotive environments.en_US
dc.format.extent2065 - 2074en_US
dc.relation.ispartofIEEE/CVF Conference on Computer Vision and Pattern Recognitionen_US
dc.rightsAuthor's manuscripten_US
dc.titleSeeing Around Street Corners: Non-Line-of-Sight Detection and Tracking In-the-Wild Using Doppler Radaren_US
dc.typeConference Articleen_US

Files in This Item:
File Description SizeFormat 
SeeingAroundStreetCorners.pdf4.3 MBAdobe PDFView/Download

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.