Header

UZH-Logo

Maintenance Infos

Assessment of structural knowledge as a training outcome in process control environments


Burkolter, Dina; Meyer, Bertolt; Kluge, Annette; Sauer, Jürgen (2010). Assessment of structural knowledge as a training outcome in process control environments. Human Factors, 52(1):119-138.

Abstract

OBJECTIVE: The objective of the present studies was to apply a novel method for structural knowledge assessment to process control to assess the potential of its measures as a training outcome.

BACKGROUND: Traditionally, knowledge is assessed by verbal achievement tests on the subject matter. However, traditional methods are regarded as limited in their ability to assess higher-order learning or understanding.

METHOD: Two experiments (Experiment 1, N= 41; Experiment 2, N= 50) were conducted in which participants were given a 4-hr training session on a simulated process control task. At a later testing session, participants worked on the task for 70 min and completed knowledge tests on declarative, procedural, and structural knowledge. Structural knowledge was measured with the computer-based Association Structure Test (AST), which combines an association task and Pathfinder network on the basis of relatedness ratings.

RESULTS: In both studies, structural knowledge was significantly related to diagnostic performance, and evidence was found for internal consistency as well as convergent and predictive validity.

CONCLUSION: Findings indicate that structural assessment with the AST shows promise as a training outcome in process control.

APPLICATION: Potential applications of this research include the improvement of training design, delivery, and evaluation.

Abstract

OBJECTIVE: The objective of the present studies was to apply a novel method for structural knowledge assessment to process control to assess the potential of its measures as a training outcome.

BACKGROUND: Traditionally, knowledge is assessed by verbal achievement tests on the subject matter. However, traditional methods are regarded as limited in their ability to assess higher-order learning or understanding.

METHOD: Two experiments (Experiment 1, N= 41; Experiment 2, N= 50) were conducted in which participants were given a 4-hr training session on a simulated process control task. At a later testing session, participants worked on the task for 70 min and completed knowledge tests on declarative, procedural, and structural knowledge. Structural knowledge was measured with the computer-based Association Structure Test (AST), which combines an association task and Pathfinder network on the basis of relatedness ratings.

RESULTS: In both studies, structural knowledge was significantly related to diagnostic performance, and evidence was found for internal consistency as well as convergent and predictive validity.

CONCLUSION: Findings indicate that structural assessment with the AST shows promise as a training outcome in process control.

APPLICATION: Potential applications of this research include the improvement of training design, delivery, and evaluation.

Statistics

Citations

1 citation in Web of Science®
3 citations in Scopus®
Google Scholar™

Altmetrics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Psychology
Dewey Decimal Classification:150 Psychology
Language:English
Date:2010
Deposited On:29 Oct 2012 14:01
Last Modified:05 Apr 2016 16:02
Publisher:Sage Publications
ISSN:0018-7208
Publisher DOI:https://doi.org/10.1177/0018720810367646
PubMed ID:20653230

Download

Full text not available from this repository.
View at publisher