Header

UZH-Logo

Maintenance Infos

Efficiency of Targeted Multistage Calibration Designs Under Practical Constraints: A Simulation Study


Berger, Stéphanie; Verschoor, Angela J; Eggen, Theo J H M; Moser, Urs (2019). Efficiency of Targeted Multistage Calibration Designs Under Practical Constraints: A Simulation Study. Journal of Educational Measurement, 56(1):121-146.

Abstract

Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we investigated whether the efficiency of calibration under the Rasch model could be enhanced by improving the match between item difficulty and student ability. We introduced targeted multistage calibration designs, a design type that considers ability‐related background variables and performance for assigning students to suitable items. Furthermore, we investigated whether uncertainty about item difficulty could impair the assembling of efficient designs. The results indicated that targeted multistage calibration designs were more efficient than ordinary targeted designs under optimal conditions. Limited knowledge about item difficulty reduced the efficiency of one of the two investigated targeted multistage calibration designs, whereas targeted designs were more robust.

Abstract

Calibration of an item bank for computer adaptive testing requires substantial resources. In this study, we investigated whether the efficiency of calibration under the Rasch model could be enhanced by improving the match between item difficulty and student ability. We introduced targeted multistage calibration designs, a design type that considers ability‐related background variables and performance for assigning students to suitable items. Furthermore, we investigated whether uncertainty about item difficulty could impair the assembling of efficient designs. The results indicated that targeted multistage calibration designs were more efficient than ordinary targeted designs under optimal conditions. Limited knowledge about item difficulty reduced the efficiency of one of the two investigated targeted multistage calibration designs, whereas targeted designs were more robust.

Statistics

Citations

Altmetrics

Downloads

0 downloads since deposited on 10 Jan 2020
0 downloads since 12 months

Additional indexing

Item Type:Journal Article, refereed, original work
Communities & Collections:06 Faculty of Arts > Institute of Educational Evaluation
Dewey Decimal Classification:370 Education
Uncontrolled Keywords:Applied Psychology, Psychology (miscellaneous), Education, Developmental and Educational Psychology
Language:English
Date:1 March 2019
Deposited On:10 Jan 2020 09:38
Last Modified:16 Jan 2020 07:49
Publisher:Wiley-Blackwell Publishing, Inc.
ISSN:0022-0655
OA Status:Closed
Publisher DOI:https://doi.org/10.1111/jedm.12203

Download

Closed Access: Download allowed only for UZH members

Content: Accepted Version
Filetype: PDF - Registered users only until 1 March 2021
Size: 1MB
View at publisher
Embargo till: 2021-03-01