Header

UZH-Logo

Maintenance Infos

Comparing internet experiences and prosociality in Amazon Mechanical Turk and population-based survey samples


Hargittai, Eszter; Shaw, Aaron (2020). Comparing internet experiences and prosociality in Amazon Mechanical Turk and population-based survey samples. Socius: Sociological Research for a Dynamic World, 6:1-11.

Abstract

Given the high cost of traditional survey administration (postal mail, phone) and the limits of convenience samples such as university students, online samples offer a much welcomed alternative. Amazon Mechanical Turk (AMT) has been especially popular among academics for conducting surveys and experiments. Prior research has shown that AMT samples are not representative of the general population along some dimensions, but evidence suggests that these differences may not undermine the validity of AMT research. The authors revisit this comparison by analyzing responses to identical survey questions administered to both a U.S. national sample and AMT participants at the same time. The authors compare the two samples on sociodemographic factors, online experiences, and prosociality. The authors show that the two samples are different not just demographically but also regarding their online behaviors and standard survey measures of prosocial behaviors and attitudes. The authors discuss the implications of these findings for data collected on AMT.

Abstract

Given the high cost of traditional survey administration (postal mail, phone) and the limits of convenience samples such as university students, online samples offer a much welcomed alternative. Amazon Mechanical Turk (AMT) has been especially popular among academics for conducting surveys and experiments. Prior research has shown that AMT samples are not representative of the general population along some dimensions, but evidence suggests that these differences may not undermine the validity of AMT research. The authors revisit this comparison by analyzing responses to identical survey questions administered to both a U.S. national sample and AMT participants at the same time. The authors compare the two samples on sociodemographic factors, online experiences, and prosociality. The authors show that the two samples are different not just demographically but also regarding their online behaviors and standard survey measures of prosocial behaviors and attitudes. The authors discuss the implications of these findings for data collected on AMT.

Statistics

Citations

Dimensions.ai Metrics
25 citations in Web of Science®
32 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

27 downloads since deposited on 04 Sep 2020
5 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Department of Communication and Media Research
Dewey Decimal Classification:070 News media, journalism & publishing
Uncontrolled Keywords:Amazon Mechanical Turk, survey methods, data bias, Internet use, prosociality, Internet skills
Language:English
Date:9 March 2020
Deposited On:04 Sep 2020 15:08
Last Modified:23 Jun 2024 01:42
Publisher:Sage Publications
ISSN:2378-0231
OA Status:Gold
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.1177/2378023119889834
  • Content: Published Version
  • Licence: Creative Commons: Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)