Header

UZH-Logo

Maintenance Infos

The comparability of measurements of attitudes toward immigration in the European Social Survey: exact versus approximate measurement equivalence


Davidov, Eldad; Cieciuch, Jan; Meuleman, Bart; Schmidt, Peter; Algesheimer, René; Hausherr, Mirjam (2015). The comparability of measurements of attitudes toward immigration in the European Social Survey: exact versus approximate measurement equivalence. Public Opinion Quarterly, 79(S1):244-266.

Abstract

International survey datasets are analyzed with increasing frequency to investigate and compare attitudes toward immigration and to examine the contextual factors that shape these attitudes. However, international comparisons of abstract, psychological constructs require the measurements to be equivalent–i.e., they should measure the same concept on the same measurement scale. Traditional approaches to assessing measurement equivalence quite often
lead to the conclusion that measurements are cross-nationally incomparable but have been criticized for being overly strict. In the current study, we present an alternative Bayesian approach that assesses whether measurements are approximately (rather than exactly)
equivalent. This approach allows small variations in measurement parameters across groups.
Taking a multiple group confirmatory factor analysis framework as a starting point, this study applies approximate and exact equivalence tests to the anti-immigration attitudes scale that was implemented in the European Social Survey (ESS). Measurement equivalence is tested across the full set of 271,220 individuals in 35 ESS countries over six rounds. The results of the exact and the approximate approaches are quite different. Approximate scalar measurement equivalence is established in all ESS rounds, thus allowing researchers to meaningfully compare these mean scores and their relationships with other theoretical constructs of interest. The exact approach, however, eventually proves to be overly strict and leads to the conclusion that measurements are incomparable for a large number of countries and time points.

Abstract

International survey datasets are analyzed with increasing frequency to investigate and compare attitudes toward immigration and to examine the contextual factors that shape these attitudes. However, international comparisons of abstract, psychological constructs require the measurements to be equivalent–i.e., they should measure the same concept on the same measurement scale. Traditional approaches to assessing measurement equivalence quite often
lead to the conclusion that measurements are cross-nationally incomparable but have been criticized for being overly strict. In the current study, we present an alternative Bayesian approach that assesses whether measurements are approximately (rather than exactly)
equivalent. This approach allows small variations in measurement parameters across groups.
Taking a multiple group confirmatory factor analysis framework as a starting point, this study applies approximate and exact equivalence tests to the anti-immigration attitudes scale that was implemented in the European Social Survey (ESS). Measurement equivalence is tested across the full set of 271,220 individuals in 35 ESS countries over six rounds. The results of the exact and the approximate approaches are quite different. Approximate scalar measurement equivalence is established in all ESS rounds, thus allowing researchers to meaningfully compare these mean scores and their relationships with other theoretical constructs of interest. The exact approach, however, eventually proves to be overly strict and leads to the conclusion that measurements are incomparable for a large number of countries and time points.

Statistics

Citations

3 citations in Web of Science®
5 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

56 downloads since deposited on 27 May 2015
25 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Business Administration
06 Faculty of Arts > Institute of Sociology
Dewey Decimal Classification:300 Social sciences, sociology & anthropology
Uncontrolled Keywords:European Social Survey; approximate vs. exact measurement equivalence; attitudes toward immigration; cross-national research
Language:English
Date:2015
Deposited On:27 May 2015 12:37
Last Modified:05 May 2016 00:00
Publisher:University of Chicago Press
ISSN:0033-362X
Funders:University Research Priority Program “Social Networks,” University of Zurich, Polish National Science Centre [Grant 2011/01/D/HS6/04077]
Publisher DOI:https://doi.org/10.1093/poq/nfv008
Related URLs:http://poq.oxfordjournals.org/content/79/S1/244.abstract

Download

Preview Icon on Download
Preview
Content: Published Version
Language: English
Filetype: PDF
Size: 570kB
View at publisher
Preview Icon on Download
Preview
Content: Accepted Version
Language: English
Filetype: PDF
Size: 720kB

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations