UZH-Logo

Maintenance Infos

Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity


Latcheva, R (2011). Cognitive interviewing and factor-analytic techniques: a mixed method approach to validity of survey items measuring national identity. Quality and Quantity, 45(6):1175-1199.

Abstract

This paper explores the possibilities of method triangulation between two methodological approaches for assessing the validity performance of survey items:cognitive
interviewing and factor analytic techniques. Although their means of approaching validity differ, both methods attempt to prove whether a measure corresponds to a theoretical(latent)concept (e.g. patriotism vs. nationalism), thus both are concerned with the question, whether an indicator measures what it is supposed to measure. Based on two representative samples for Austria [data gathered within the framework of the International Social Survey Program ISSP) on National Identity in 1995 and 2003] and 18 cognitive interviews conducted between 2003 and 2005, the paper shows the considerable advantages of using a multi-method approach for ensuring the quality of survey items. On the one hand, we apply exploratory and
confirmatory factor analysis in order to identify poorly performing indicators with regard to validity and reliability. On the other hand, the analysis of the cognitive interviews reveals the substantial sources of response error. Results show that to a large extent, respondents do not understand the items that have been defined to measure national identification and related
concepts in Austria the way intended by the drafting group of this ISSP Module, a fact that has considerable implications on the scales’ predictive power.

This paper explores the possibilities of method triangulation between two methodological approaches for assessing the validity performance of survey items:cognitive
interviewing and factor analytic techniques. Although their means of approaching validity differ, both methods attempt to prove whether a measure corresponds to a theoretical(latent)concept (e.g. patriotism vs. nationalism), thus both are concerned with the question, whether an indicator measures what it is supposed to measure. Based on two representative samples for Austria [data gathered within the framework of the International Social Survey Program ISSP) on National Identity in 1995 and 2003] and 18 cognitive interviews conducted between 2003 and 2005, the paper shows the considerable advantages of using a multi-method approach for ensuring the quality of survey items. On the one hand, we apply exploratory and
confirmatory factor analysis in order to identify poorly performing indicators with regard to validity and reliability. On the other hand, the analysis of the cognitive interviews reveals the substantial sources of response error. Results show that to a large extent, respondents do not understand the items that have been defined to measure national identification and related
concepts in Austria the way intended by the drafting group of this ISSP Module, a fact that has considerable implications on the scales’ predictive power.

Citations

7 citations in Web of Science®
9 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

0 downloads since deposited on 17 Nov 2011
0 downloads since 12 months

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Sociology
Dewey Decimal Classification:300 Social sciences, sociology & anthropology
Language:English
Date:17 October 2011
Deposited On:17 Nov 2011 11:41
Last Modified:05 Apr 2016 15:06
Publisher:Springer
ISSN:0033-5177
Publisher DOI:https://doi.org/10.1007/s11135-009-9285-0
Official URL:http://www.springerlink.com/content/jx02q248v2q12t0h/fulltext.pdf
Permanent URL: https://doi.org/10.5167/uzh-51042

Download

[img]
Content: Published Version
Filetype: PDF - Registered users only
Size: 427kB
View at publisher

TrendTerms

TrendTerms displays relevant terms of the abstract of this publication and related documents on a map. The terms and their relations were extracted from ZORA using word statistics. Their timelines are taken from ZORA as well. The bubble size of a term is proportional to the number of documents where the term occurs. Red, orange, yellow and green colors are used for terms that occur in the current document; red indicates high interlinkedness of a term with other terms, orange, yellow and green decreasing interlinkedness. Blue is used for terms that have a relation with the terms in this document, but occur in other documents.
You can navigate and zoom the map. Mouse-hovering a term displays its timeline, clicking it yields the associated documents.

Author Collaborations