Skip to main content

Basic level scene understanding: categories, attributes and structures

Author(s): Xiao, Jianxiong; Hays, James; Russell, Bryan C; Patterson, Genevieve; Ehinger, Krista A; et al

To refer to this page use:
Abstract: A longstanding goal of computer vision is to build a system that can automatically understand a 3D scene from a single image. This requires extracting semantic concepts and 3D information from 2D images which can depict an enormous variety of environments that comprise our visual world. This paper summarizes our recent efforts toward these goals. First, we describe the richly annotated SUN database which is a collection of annotated images spanning 908 different scene categories with object, attribute, and geometric labels for many scenes. This database allows us to systematically study the space of scenes and to establish a benchmark for scene and object recognition. We augment the categorical SUN database with 102 scene attributes for every image and explore attribute recognition. Finally, we present an integrated system to extract the 3D structure of the scene and objects depicted in an image.
Publication Date: 2013
Citation: Xiao, Jianxiong, James Hays, Bryan C. Russell, Genevieve Patterson, Krista Ehinger, Antonio Torralba, and Aude Oliva. "Basic level scene understanding: categories, attributes and structures." Frontiers in Psychology 4 (2013). doi:10.3389/fpsyg.2013.00506
DOI: 10.3389/fpsyg.2013.00506
EISSN: 1664-1078
Type of Material: Journal Article
Journal/Proceeding Title: Frontiers in Psychology
Version: Final published version. This is an open access article.

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.