Header

UZH-Logo

Maintenance Infos

Defining and measuring news media quality: comparing the content perspective and the audience perspective


Bachmann, Philipp; Eisenegger, Mark; Ingenhoff, Diana (2022). Defining and measuring news media quality: comparing the content perspective and the audience perspective. International Journal of Press/Politics, 27(1):9-37.

Abstract

High-quality news is important, not only for its own sake but also for its political implications. However, defining, operationalizing, and measuring news media quality is difficult, because evaluative criteria depend upon beliefs about the ideal society, which are inherently contested. This conceptual and methodological paper outlines important considerations for defining news media quality before developing and applying a multimethod approach to measure it. We refer to Giddens' notion of double hermeneutics, which reveals that the ways social scientists understand constructs inevitably interact with the meanings of these constructs shared by people in society. Reflecting the two-way relationship between society and social sciences enables us to recognize news media quality as a dynamic, contingent, and contested construct and, at the same time, to reason our understanding of news media quality, which we derive from Habermas' ideal of deliberative democracy. Moreover, we investigate the Swiss media system to showcase our measurement approach in a repeated data collection from 2017 to 2020. We assess the content quality of fifty news media outlets using four criteria derived from the deliberative ideal (N = 20,931 and 18,559 news articles and broadcasting items, respectively) and compare the results with those from two representative online surveys (N = 2,169 and 2,159 respondents). The high correlations between both methods show that a deliberative understanding of news media quality is anchored in Swiss society and shared by audiences. This paper shall serve as a showcase to reflect and measure news media quality across other countries and media systems.

Abstract

High-quality news is important, not only for its own sake but also for its political implications. However, defining, operationalizing, and measuring news media quality is difficult, because evaluative criteria depend upon beliefs about the ideal society, which are inherently contested. This conceptual and methodological paper outlines important considerations for defining news media quality before developing and applying a multimethod approach to measure it. We refer to Giddens' notion of double hermeneutics, which reveals that the ways social scientists understand constructs inevitably interact with the meanings of these constructs shared by people in society. Reflecting the two-way relationship between society and social sciences enables us to recognize news media quality as a dynamic, contingent, and contested construct and, at the same time, to reason our understanding of news media quality, which we derive from Habermas' ideal of deliberative democracy. Moreover, we investigate the Swiss media system to showcase our measurement approach in a repeated data collection from 2017 to 2020. We assess the content quality of fifty news media outlets using four criteria derived from the deliberative ideal (N = 20,931 and 18,559 news articles and broadcasting items, respectively) and compare the results with those from two representative online surveys (N = 2,169 and 2,159 respondents). The high correlations between both methods show that a deliberative understanding of news media quality is anchored in Swiss society and shared by audiences. This paper shall serve as a showcase to reflect and measure news media quality across other countries and media systems.

Statistics

Citations

Dimensions.ai Metrics
3 citations in Web of Science®
3 citations in Scopus®
Google Scholar™

Altmetrics

Downloads

20 downloads since deposited on 19 May 2021
20 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Department of Communication and Media Research
06 Faculty of Arts > Institute for Research on the Public Sphere and Society
Dewey Decimal Classification:700 Arts
Uncontrolled Keywords:News media quality, content analysis, representative survey, double hermeneutics, deliberative theory
Language:English
Date:1 January 2022
Deposited On:19 May 2021 12:31
Last Modified:09 Nov 2021 02:04
Publisher:Sage Publications
ISSN:1940-1612
OA Status:Hybrid
Publisher DOI:https://doi.org/10.1177/1940161221999666

Download

Hybrid Open Access

Download PDF  'Defining and measuring news media quality: comparing the content perspective and the audience perspective'.
Preview
Content: Published Version
Filetype: PDF
Size: 910kB
View at publisher
Licence: Creative Commons: Attribution-NonCommercial 4.0 International (CC BY-NC 4.0)