Skip to main content

Shape2Pose: human-centric shape analysis

Author(s): Kim, Vladimir G; Chaudhuri, Siddhartha; Guibas, Leonidas; Funkhouser, Thomas

To refer to this page use:
Abstract: As 3D acquisition devices and modeling tools become widely available there is a growing need for automatic algorithms that analyze the semantics and functionality of digitized shapes. Most recent research has focused on analyzing geometric structures of shapes. Our work is motivated by the observation that a majority of man-made shapes are designed to be used by people. Thus, in order to fully understand their semantics, one needs to answer a fundamental question: "how do people interact with these objects?" As an initial step towards this goal, we offer a novel algorithm for automatically predicting a static pose that a person would need to adopt in order to use an object. Specifically, given an input 3D shape, the goal of our analysis is to predict a corresponding human pose, including contact points and kinematic parameters. This is especially challenging for man-made objects that commonly exhibit a lot of variance in their geometric structure. We address this challenge by observing that contact points usually share consistent local geometric features related to the anthropometric properties of corresponding parts and that human body is subject to kinematic constraints and priors. Accordingly, our method effectively combines local region classification and global kinematically-constrained search to successfully predict poses for various objects. We also evaluate our algorithm on six diverse collections of 3D polygonal models (chairs, gym equipment, cockpits, carts, bicycles, and bipedal devices) containing a total of 147 models. Finally, we demonstrate that the poses predicted by our algorithm can be used in several shape analysis problems, such as establishing correspondences between objects, detecting salient regions, finding informative viewpoints, and retrieving functionally-similar shapes.
Publication Date: Jul-2014
Citation: Kim, Vladimir G., Siddhartha Chaudhuri, Leonidas Guibas, and Thomas Funkhouser. "Shape2Pose: human-centric shape analysis." ACM Transactions on Graphics (TOG) 33, no. 4 (2014): pp. 120:1-120:12. doi:10.1145/2601097.2601117
DOI: 10.1145/2601097.2601117
ISSN: 0730-0301
EISSN: 1557-7368
Pages: 120:1 - 120:12
Type of Material: Journal Article
Journal/Proceeding Title: ACM Transactions on Graphics
Version: Author's manuscript

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.