Header

UZH-Logo

Maintenance Infos

Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity


Latcheva, R (2011). Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity. Quality and Quantity, 45(6):1175-1199.

Abstract

This paper explores the possibilities of method triangulation between two methodological approaches for assessing the validity performance of survey items:cognitive
interviewing and factor analytic techniques. Although their means of approaching validity differ, both methods attempt to prove whether a measure corresponds to a theoretical(latent)concept (e.g. patriotism vs. nationalism), thus both are concerned with the question, whether an indicator measures what it is supposed to measure. Based on two representative samples for Austria [data gathered within the framework of the International Social Survey Program ISSP) on National Identity in 1995 and 2003] and 18 cognitive interviews conducted between 2003 and 2005, the paper shows the considerable advantages of using a multi-method approach for ensuring the quality of survey items. On the one hand, we apply exploratory and
confirmatory factor analysis in order to identify poorly performing indicators with regard to validity and reliability. On the other hand, the analysis of the cognitive interviews reveals the substantial sources of response error. Results show that to a large extent, respondents do not understand the items that have been defined to measure national identification and related
concepts in Austria the way intended by the drafting group of this ISSP Module, a fact that has considerable implications on the scales’ predictive power.

Abstract

This paper explores the possibilities of method triangulation between two methodological approaches for assessing the validity performance of survey items:cognitive
interviewing and factor analytic techniques. Although their means of approaching validity differ, both methods attempt to prove whether a measure corresponds to a theoretical(latent)concept (e.g. patriotism vs. nationalism), thus both are concerned with the question, whether an indicator measures what it is supposed to measure. Based on two representative samples for Austria [data gathered within the framework of the International Social Survey Program ISSP) on National Identity in 1995 and 2003] and 18 cognitive interviews conducted between 2003 and 2005, the paper shows the considerable advantages of using a multi-method approach for ensuring the quality of survey items. On the one hand, we apply exploratory and
confirmatory factor analysis in order to identify poorly performing indicators with regard to validity and reliability. On the other hand, the analysis of the cognitive interviews reveals the substantial sources of response error. Results show that to a large extent, respondents do not understand the items that have been defined to measure national identification and related
concepts in Austria the way intended by the drafting group of this ISSP Module, a fact that has considerable implications on the scales’ predictive power.

Statistics

Citations

8 citations in Web of Science®
11 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

1 download since deposited on 17 Nov 2011
0 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Sociology
Dewey Decimal Classification:300 Social sciences, sociology & anthropology
Language:English
Date:17 October 2011
Deposited On:17 Nov 2011 11:41
Last Modified:07 Dec 2017 09:40
Publisher:Springer
ISSN:0033-5177
Publisher DOI:https://doi.org/10.1007/s11135-009-9285-0
Official URL:http://www.springerlink.com/content/jx02q248v2q12t0h/fulltext.pdf

Download