Skip to main content

Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection

Author(s): Casey, LS; Chandler, J; Levine, AS; Proctor, A; Strolovitch, Dara Z

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr1qb9v503
Full metadata record
DC FieldValueLanguage
dc.contributor.authorCasey, LS-
dc.contributor.authorChandler, J-
dc.contributor.authorLevine, AS-
dc.contributor.authorProctor, A-
dc.contributor.authorStrolovitch, Dara Z-
dc.date.accessioned2022-01-25T14:53:04Z-
dc.date.available2022-01-25T14:53:04Z-
dc.date.issued2017-06-01en_US
dc.identifier.citationCasey, LS, Chandler, J, Levine, AS, Proctor, A, Strolovitch, DZ. (2017). Intertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collection. SAGE Open, 7 (2), 10.1177/2158244017712774en_US
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/pr1qb9v503-
dc.description.abstractThe online labor market Amazon Mechanical Turk (MTurk) is an increasingly popular source of respondents for social science research. A growing body of research has examined the demographic composition of MTurk workers as compared with that of other populations. While these comparisons have revealed the ways in which MTurk workers are and are not representative of the general population, variations among samples drawn from MTurk have received less attention. This article focuses on whether MTurk sample composition varies as a function of time. Specifically, we examine whether demographic characteristics vary by (a) time of day, (b) day of week, and serial position (i.e., earlier or later in data collection), both (c) across the entire data collection and (d) within specific batches. We find that day of week differences are minimal, but that time of day and serial position are associated with small but important variations in demographic composition. This demonstrates that MTurk samples cannot be presumed identical across different studies, potentially affecting reliability, validity, and efforts to reproduce findings.en_US
dc.format.extent1-15en_US
dc.language.isoen_USen_US
dc.relation.ispartofSAGE Openen_US
dc.rightsFinal published version. This is an open access article.en_US
dc.titleIntertemporal Differences Among MTurk Workers: Time-Based Sample Variations and Implications for Online Data Collectionen_US
dc.typeJournal Articleen_US
dc.identifier.doidoi:10.1177/2158244017712774-
dc.identifier.eissn2158-2440-
pu.type.symplectichttp://www.symplectic.co.uk/publications/atom-terms/1.0/journal-articleen_US

Files in This Item:
File Description SizeFormat 
intertemporal_differences_mturk_online_data_collection.pdf116.57 kBAdobe PDFView/Download


Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.