Header

UZH-Logo

Maintenance Infos

Development of a Generic Workshop Appraisal Scale (WASC) for Organizational Health Interventions and Evaluation


Fridrich, Annemarie; Bauer, Georg F; Jenny, Gregor J (2020). Development of a Generic Workshop Appraisal Scale (WASC) for Organizational Health Interventions and Evaluation. Frontiers in Psychology, 11:2115.

Abstract

This study presents the development of a generic workshop appraisal scale (WASC) for the evaluation of organizational health interventions. Based on the session evaluation questionnaire (SEQ) by Stiles (1980), we developed a short, generic 10-item scale with pairs of adjectives, covering five facets: comprehensibility, relevance, novelty, activation, and valence. Our study is based on N = 499 employees from four organizations who participated in 41 workshops and filled out an evaluation questionnaire on-site. The questionnaire contained the newly developed WASC, as well as items capturing satisfaction with the developed output and outcome expectancies. Results from confirmative factor analysis confirmed the hypothesized five-factor structure of the WASC. The factor structure was found to be nearly invariant across the four organizations, a result that needs to be replicated in larger samples. Analysis of intra-class correlations indicated that 25% of the variance in workshop appraisal can be explained at workshop level. Hereby, perceived relevance and novelty exhibited lower amounts of shared variance, indicating that corresponding workshop appraisals are influenced more by individual factors and less by group dynamics. Furthermore, results from mediation analysis revealed that participants' workshop appraisals were significantly related to their outcome expectancies, and that this relationship was mediated by output satisfaction. Again, the facets showed differential effects: Relevance and comprehensibility seem to contribute most to the total effect on outcome expectancy, followed by activation, whereas valence and especially novelty play a minor role. Taken together, participants' workshop appraisals - together with output satisfaction and outcome expectancy - may be helpful for monitoring the implementation process and allow for corrective action if necessary.

Abstract

This study presents the development of a generic workshop appraisal scale (WASC) for the evaluation of organizational health interventions. Based on the session evaluation questionnaire (SEQ) by Stiles (1980), we developed a short, generic 10-item scale with pairs of adjectives, covering five facets: comprehensibility, relevance, novelty, activation, and valence. Our study is based on N = 499 employees from four organizations who participated in 41 workshops and filled out an evaluation questionnaire on-site. The questionnaire contained the newly developed WASC, as well as items capturing satisfaction with the developed output and outcome expectancies. Results from confirmative factor analysis confirmed the hypothesized five-factor structure of the WASC. The factor structure was found to be nearly invariant across the four organizations, a result that needs to be replicated in larger samples. Analysis of intra-class correlations indicated that 25% of the variance in workshop appraisal can be explained at workshop level. Hereby, perceived relevance and novelty exhibited lower amounts of shared variance, indicating that corresponding workshop appraisals are influenced more by individual factors and less by group dynamics. Furthermore, results from mediation analysis revealed that participants' workshop appraisals were significantly related to their outcome expectancies, and that this relationship was mediated by output satisfaction. Again, the facets showed differential effects: Relevance and comprehensibility seem to contribute most to the total effect on outcome expectancy, followed by activation, whereas valence and especially novelty play a minor role. Taken together, participants' workshop appraisals - together with output satisfaction and outcome expectancy - may be helpful for monitoring the implementation process and allow for corrective action if necessary.

Statistics

Citations

Dimensions.ai Metrics
1 citation in Web of Science®
1 citation in Scopus®
Google Scholar™

Altmetrics

Downloads

3 downloads since deposited on 27 Jan 2021
3 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:04 Faculty of Medicine > Epidemiology, Biostatistics and Prevention Institute (EBPI)
Dewey Decimal Classification:610 Medicine & health
Scopus Subject Areas:Social Sciences & Humanities > General Psychology
Language:English
Date:2020
Deposited On:27 Jan 2021 09:39
Last Modified:06 Feb 2021 12:19
Publisher:Frontiers Research Foundation
ISSN:1664-1078
OA Status:Gold
Free access at:PubMed ID. An embargo period may apply.
Publisher DOI:https://doi.org/10.3389/fpsyg.2020.02115
PubMed ID:33013537

Download

Gold Open Access

Download PDF  'Development of a Generic Workshop Appraisal Scale (WASC) for Organizational Health Interventions and Evaluation'.
Preview
Content: Published Version
Filetype: PDF
Size: 743kB
View at publisher
Licence: Creative Commons: Attribution 4.0 International (CC BY 4.0)