Header

UZH-Logo

Maintenance Infos

Comparing internet experiences and prosociality in Amazon Mechanical Turk and population-based survey samples


Hargittai, Eszter; Shaw, Aaron (2020). Comparing internet experiences and prosociality in Amazon Mechanical Turk and population-based survey samples. Socius: Sociological Research for a Dynamic World, 6:1-11.

Abstract

Given the high cost of traditional survey administration (postal mail, phone) and the limits of convenience samples such as university students, online samples offer a much welcomed alternative. Amazon Mechanical Turk (AMT) has been especially popular among academics for conducting surveys and experiments. Prior research has shown that AMT samples are not representative of the general population along some dimensions, but evidence suggests that these differences may not undermine the validity of AMT research. The authors revisit this comparison by analyzing responses to identical survey questions administered to both a U.S. national sample and AMT participants at the same time. The authors compare the two samples on sociodemographic factors, online experiences, and prosociality. The authors show that the two samples are different not just demographically but also regarding their online behaviors and standard survey measures of prosocial behaviors and attitudes. The authors discuss the implications of these findings for data collected on AMT.

Abstract

Given the high cost of traditional survey administration (postal mail, phone) and the limits of convenience samples such as university students, online samples offer a much welcomed alternative. Amazon Mechanical Turk (AMT) has been especially popular among academics for conducting surveys and experiments. Prior research has shown that AMT samples are not representative of the general population along some dimensions, but evidence suggests that these differences may not undermine the validity of AMT research. The authors revisit this comparison by analyzing responses to identical survey questions administered to both a U.S. national sample and AMT participants at the same time. The authors compare the two samples on sociodemographic factors, online experiences, and prosociality. The authors show that the two samples are different not just demographically but also regarding their online behaviors and standard survey measures of prosocial behaviors and attitudes. The authors discuss the implications of these findings for data collected on AMT.

Statistics

Citations

Dimensions.ai Metrics

Altmetrics

Downloads

0 downloads since deposited on 04 Sep 2020
0 downloads since 12 months

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Department of Communication and Media Research
Dewey Decimal Classification:700 Arts
Uncontrolled Keywords:Amazon Mechanical Turk, survey methods, data bias, Internet use, prosociality, Internet skills
Language:English
Date:9 March 2020
Deposited On:04 Sep 2020 15:08
Last Modified:04 Sep 2020 15:08
Publisher:Sage Publications
ISSN:2378-0231
OA Status:Gold
Free access at:Publisher DOI. An embargo period may apply.
Publisher DOI:https://doi.org/10.1177/2378023119889834

Download

Gold Open Access

Download PDF  'Comparing internet experiences and prosociality in Amazon Mechanical Turk and population-based survey samples'.
Preview
Content: Published Version
Filetype: PDF
Size: 706kB
View at publisher
Licence: Creative Commons: Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)