Skip to main content

DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding

Author(s): Zhang, Yinda; Bai, Mingru; Kohli, Pushmeet; Izadi, Shahram; Xiao, Jianxiong

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr16z79
Full metadata record
DC FieldValueLanguage
dc.contributor.authorZhang, Yinda-
dc.contributor.authorBai, Mingru-
dc.contributor.authorKohli, Pushmeet-
dc.contributor.authorIzadi, Shahram-
dc.contributor.authorXiao, Jianxiong-
dc.date.accessioned2021-10-08T19:48:58Z-
dc.date.available2021-10-08T19:48:58Z-
dc.date.issued2017en_US
dc.identifier.citationZhang, Yinda, Mingru Bai, Pushmeet Kohli, Shahram Izadi, and Jianxiong Xiao. "DeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understanding." In IEEE International Conference on Computer Vision (ICCV). (2017): pp. 1201-1210. doi:10.1109/ICCV.2017.135en_US
dc.identifier.urihttps://openaccess.thecvf.com/content_ICCV_2017/papers/Zhang_DeepContext_Context-Encoding_Neural_ICCV_2017_paper.pdf-
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/pr16z79-
dc.description.abstract3D context has been shown to be extremely important for scene understanding, yet very little research has been done on integrating context information with deep neural network architectures. This paper presents an approach to embed 3D context into the topology of a neural network trained to perform holistic scene understanding. Given a depth image depicting a 3D scene, our network aligns the observed scene with a predefined 3D scene template, and then reasons about the existence and location of each object within the scene template. In doing so, our model recognizes multiple objects in a single forward pass of a 3D convolutional neural network, capturing both global scene and local object information simultaneously. To create training data for this 3D network, we generate partially synthetic depth images which are rendered by replacing real objects with a repository of CAD models of the same object category1. Extensive experiments demonstrate the effectiveness of our algorithm compared to the state of the art.en_US
dc.format.extent1201 - 1210en_US
dc.language.isoen_USen_US
dc.relation.ispartofIEEE International Conference on Computer Vision (ICCV)en_US
dc.rightsAuthor's manuscripten_US
dc.titleDeepContext: Context-Encoding Neural Pathways for 3D Holistic Scene Understandingen_US
dc.typeConference Articleen_US
dc.identifier.doi10.1109/ICCV.2017.135-
dc.identifier.eissn2380-7504-
pu.type.symplectichttp://www.symplectic.co.uk/publications/atom-terms/1.0/conference-proceedingen_US

Files in This Item:
File Description SizeFormat 
DeepContextPathways.pdf4.45 MBAdobe PDFView/Download


Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.