Header

UZH-Logo

Maintenance Infos

The comparability of measurements of attitudes toward immigration in the European Social Survey: exact versus approximate measurement equivalence


Davidov, Eldad; Cieciuch, Jan; Meuleman, Bart; Schmidt, Peter; Algesheimer, René; Hausherr, Mirjam (2015). The comparability of measurements of attitudes toward immigration in the European Social Survey: exact versus approximate measurement equivalence. Public Opinion Quarterly, 79(S1):244-266.

Abstract

International survey datasets are analyzed with increasing frequency to investigate and compare attitudes toward immigration and to examine the contextual factors that shape these attitudes. However, international comparisons of abstract, psychological constructs require the measurements to be equivalent–i.e., they should measure the same concept on the same measurement scale. Traditional approaches to assessing measurement equivalence quite often
lead to the conclusion that measurements are cross-nationally incomparable but have been criticized for being overly strict. In the current study, we present an alternative Bayesian approach that assesses whether measurements are approximately (rather than exactly)
equivalent. This approach allows small variations in measurement parameters across groups.
Taking a multiple group confirmatory factor analysis framework as a starting point, this study applies approximate and exact equivalence tests to the anti-immigration attitudes scale that was implemented in the European Social Survey (ESS). Measurement equivalence is tested across the full set of 271,220 individuals in 35 ESS countries over six rounds. The results of the exact and the approximate approaches are quite different. Approximate scalar measurement equivalence is established in all ESS rounds, thus allowing researchers to meaningfully compare these mean scores and their relationships with other theoretical constructs of interest. The exact approach, however, eventually proves to be overly strict and leads to the conclusion that measurements are incomparable for a large number of countries and time points.

Abstract

International survey datasets are analyzed with increasing frequency to investigate and compare attitudes toward immigration and to examine the contextual factors that shape these attitudes. However, international comparisons of abstract, psychological constructs require the measurements to be equivalent–i.e., they should measure the same concept on the same measurement scale. Traditional approaches to assessing measurement equivalence quite often
lead to the conclusion that measurements are cross-nationally incomparable but have been criticized for being overly strict. In the current study, we present an alternative Bayesian approach that assesses whether measurements are approximately (rather than exactly)
equivalent. This approach allows small variations in measurement parameters across groups.
Taking a multiple group confirmatory factor analysis framework as a starting point, this study applies approximate and exact equivalence tests to the anti-immigration attitudes scale that was implemented in the European Social Survey (ESS). Measurement equivalence is tested across the full set of 271,220 individuals in 35 ESS countries over six rounds. The results of the exact and the approximate approaches are quite different. Approximate scalar measurement equivalence is established in all ESS rounds, thus allowing researchers to meaningfully compare these mean scores and their relationships with other theoretical constructs of interest. The exact approach, however, eventually proves to be overly strict and leads to the conclusion that measurements are incomparable for a large number of countries and time points.

Statistics

Citations

8 citations in Web of Science®
7 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

74 downloads since deposited on 27 May 2015
32 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:03 Faculty of Economics > Department of Business Administration
06 Faculty of Arts > Institute of Sociology
Dewey Decimal Classification:300 Social sciences, sociology & anthropology
Uncontrolled Keywords:European Social Survey; approximate vs. exact measurement equivalence; attitudes toward immigration; cross-national research
Language:English
Date:2015
Deposited On:27 May 2015 12:37
Last Modified:08 Dec 2017 13:02
Publisher:University of Chicago Press
ISSN:0033-362X
Funders:University Research Priority Program “Social Networks,” University of Zurich, Polish National Science Centre [Grant 2011/01/D/HS6/04077]
Publisher DOI:https://doi.org/10.1093/poq/nfv008
Related URLs:http://poq.oxfordjournals.org/content/79/S1/244.abstract

Download

Download PDF  'The comparability of measurements of attitudes toward immigration in the European Social Survey: exact versus approximate measurement equivalence'.
Preview
Content: Published Version
Language: English
Filetype: PDF
Size: 570kB
View at publisher
Download PDF  'The comparability of measurements of attitudes toward immigration in the European Social Survey: exact versus approximate measurement equivalence'.
Preview
Content: Accepted Version
Language: English
Filetype: PDF
Size: 720kB