Header

UZH-Logo

Maintenance Infos

Efficiency of Targeted Multistage Calibration Designs Under Practical Constraints: A Simulation Study


Berger, Stéphanie; Verschoor, Angela J; Eggen, Theo J H M; Moser, Urs (2019). Efficiency of Targeted Multistage Calibration Designs Under Practical Constraints: A Simulation Study. Journal of Educational Measurement, 56(1):121-146.

Abstract

Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we investigated whether the efficiency of calibration under the Rasch model could be enhanced by improving the match between item difficulty and student ability. We introduced targeted multistage calibration designs, a design type that considers ability‐related background variables and performance for assigning students to suitable items. Furthermore, we investigated whether uncertainty about item difficulty could impair the assembling of efficient designs. The results indicated that targeted multistage calibration designs were more efficient than ordinary targeted designs under optimal conditions. Limited knowledge about item difficulty reduced the efficiency of one of the two investigated targeted multistage calibration designs, whereas targeted designs were more robust.

Abstract

Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we investigated whether the efficiency of calibration under the Rasch model could be enhanced by improving the match between item difficulty and student ability. We introduced targeted multistage calibration designs, a design type that considers ability‐related background variables and performance for assigning students to suitable items. Furthermore, we investigated whether uncertainty about item difficulty could impair the assembling of efficient designs. The results indicated that targeted multistage calibration designs were more efficient than ordinary targeted designs under optimal conditions. Limited knowledge about item difficulty reduced the efficiency of one of the two investigated targeted multistage calibration designs, whereas targeted designs were more robust.

Statistics

Citations

Altmetrics

Downloads

2 downloads since deposited on 10 Jan 2020
2 downloads since 12 months
Detailed statistics

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Educational Evaluation
Dewey Decimal Classification:370 Education
Scopus Subject Areas:Social Sciences & Humanities > Education
Social Sciences & Humanities > Developmental and Educational Psychology
Social Sciences & Humanities > Applied Psychology
Social Sciences & Humanities > Psychology (miscellaneous)
Uncontrolled Keywords:Applied Psychology, Psychology (miscellaneous), Education, Developmental and Educational Psychology
Language:English
Date:1 March 2019
Deposited On:10 Jan 2020 09:38
Last Modified:01 Mar 2021 01:01
Publisher:Wiley-Blackwell Publishing, Inc.
ISSN:0022-0655
OA Status:Green
Publisher DOI:https://doi.org/10.1111/jedm.12203

Download

Green Open Access

Download PDF  'Efficiency of Targeted Multistage Calibration Designs Under Practical Constraints: A Simulation Study'.
Preview
Content: Accepted Version
Filetype: PDF
Size: 1MB
View at publisher