Identifying Visible Actions in Lifestyle Vlogs
Author(s): Ignat, Oana; Burdick, Laura; Deng, Jia; Mihalcea, Rada
DownloadTo refer to this page use:
http://arks.princeton.edu/ark:/88435/pr1xf9p| Abstract: | We consider the task of identifying human actions visible in online videos. We focus on the widely spread genre of lifestyle vlogs, which consist of videos of people performing actions while verbally describing them. Our goal is to identify if actions mentioned in the speech description of a video are visually present. We construct a dataset with crowdsourced manual annotations of visible actions, and introduce a multimodal algorithm that leverages information derived from visual and linguistic clues to automatically infer which actions are visible in a video. |
| Publication Date: | 2019 |
| Citation: | Ignat, Oana, Laura Burdick, Jia Deng, and Rada Mihalcea. "Identifying Visible Actions in Lifestyle Vlogs." Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (2019): pp. 6406-6417. doi:10.18653/v1/P19-1643 |
| DOI: | 10.18653/v1/P19-1643 |
| Pages: | 6406 - 6417 |
| Type of Material: | Conference Article |
| Journal/Proceeding Title: | Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics |
| Version: | Author's manuscript |
Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.