Validity Testing of the Conspiratorial Thinking and Anti-Expert Sentiment Scales during the COVID-19 Pandemic Across 24 Languages from a Large-Scale Global Dataset

Abstract

In this study, we tested the validity across two scales addressing conspiratorial thinking that may influence behaviors related to public health and the COVID-19 pandemic. Using the COVIDiSTRESSII Global Survey data from 12,261 participants, we validated the 4-item Conspiratorial Thinking Scale and 3-item Anti-Expert Sentiment Scale across 24 languages and dialects that were used by at least 100 participants per language. We employed confirmatory factor analysis, measurement invariance test, and measurement alignment for internal consistency testing. To test convergent validity of the two scales, we assessed correlations with trust in seven agents related to government, science, and public health. Although scalar invariance was not achieved when measurement invariance test was conducted initially, we found that both scales can be employed in further international studies with measurement alignment. Moreover, both conspiratorial thinking and anti-expert sentiments were significantly and negatively correlated with trust in all agents. Findings from this study provide supporting evidence for the validity of both scales across 24 languages for future large-scale international research.