Skip to main content

Creating consistent scene graphs using a probabilistic grammar

Author(s): Liu, Tianqiang; Chaudhuri, Siddhartha; Kim, Vladimir G; Huang, Qi-Xing; Mitra, Niloy J; et al

To refer to this page use:
Abstract: Growing numbers of 3D scenes in online repositories provide new opportunities for data-driven scene understanding, editing, and synthesis. Despite the plethora of data now available online, most of it cannot be effectively used for data-driven applications because it lacks consistent segmentations, category labels, and/or functional groupings required for co-analysis. In this paper, we develop algorithms that infer such information via parsing with a probabilistic grammar learned from examples. First, given a collection of scene graphs with consistent hierarchies and labels, we train a probabilistic hierarchical grammar to represent the distributions of shapes, cardinalities, and spatial relationships of semantic objects within the collection. Then, we use the learned grammar to parse new scenes to assign them segmentations, labels, and hierarchies consistent with the collection. During experiments with these algorithms, we find that: they work effectively for scene graphs for indoor scenes commonly found online (bedrooms, classrooms, and libraries); they outperform alternative approaches that consider only shape similarities and/or spatial relationships without hierarchy; they require relatively small sets of training data; they are robust to moderate over-segmentation in the inputs; and, they can robustly transfer labels from one data set to another. As a result, the proposed algorithms can be used to provide consistent hierarchies for large collections of scenes within the same semantic class.
Publication Date: Nov-2014
Citation: Liu, Tianqiang, Siddhartha Chaudhuri, Vladimir G. Kim, Qixing Huang, Niloy J. Mitra, and Thomas Funkhouser. "Creating consistent scene graphs using a probabilistic grammar." ACM Transactions on Graphics (TOG) 33, no. 6 (2014): 211:1-211:12. doi:10.1145/2661229.2661243
DOI: 10.1145/2661229.2661243
ISSN: 0730-0301
EISSN: 1557-7368
Pages: 211:1 - 211:12
Type of Material: Journal Article
Journal/Proceeding Title: ACM Transactions on Graphics
Version: Author's manuscript

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.