Skip to main content

REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets

Author(s): Wang, Angelina; Narayanan, Arvind; Russakovsky, Olga

To refer to this page use:
Abstract: Machine learning models are known to perpetuate and even amplify the biases present in the data. However, these data biases frequently do not become apparent until after the models are deployed. To tackle this issue and to enable the preemptive analysis of large-scale dataset, we present our tool. REVISE (REvealing VIsual biaSEs) is a tool that assists in the investigation of a visual dataset, surfacing potential biases currently along three dimensions: (1) object-based, (2) gender-based, and (3) geography-based. Object-based biases relate to size, context, or diversity of object representation. Gender-based metrics aim to reveal the stereotypical portrayal of people of different genders. Geography-based analyses consider the representation of different geographic locations. REVISE sheds light on the dataset these dimensions; the responsibility then lies with the user to consider the cultural and historical context, and to determine which of the revealed biases may be problematic. The tool then further assists the user by suggesting actionable steps that may be taken to mitigate the revealed biases. Overall, the key aim of our work is to tackle the machine learning bias problem early in the pipeline. REVISE is available at
Publication Date: 2020
Citation: Wang, Angelina, Arvind Narayanan, and Olga Russakovsky. "REVISE: A Tool for Measuring and Mitigating Bias in Visual Datasets." In European Conference on Computer Vision (2020): pp. 733-751. doi:10.1007/978-3-030-58580-8_43
DOI: 10.1007/978-3-030-58580-8_43
ISSN: 0302-9743
EISSN: 1611-3349
Pages: 733 - 751
Type of Material: Conference Article
Journal/Proceeding Title: European Conference on Computer Vision
Version: Author's manuscript

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.