Online Calibration of Polytomous Items Under the Graded Response Model

Frontiers in Psychology

article

Jianhua Xiong¹  Shuliang Ding²  Fen Luo¹  Zhaosheng Luo¹ 

[1] School of Psychology, Jiangxi Normal University;School of Computer and Information Engineering, Jiangxi Normal University

关键词: online calibration;    computerized adaptive testing;    graded response model;    squeezing average method;    one EM cycle method;    multiple EM cycle method;   

DOI  :  10.3389/fpsyg.2019.03085

学科分类：社会科学、人文和艺术（综合）

来源: Frontiers

【 摘 要 】

Computerized adaptive testing (CAT) is an efficient testing mode, which allows each examinee to answer appropriate items according his or her latent trait level. The implementation of CAT requires a large-scale item pool, and item pool needs to be frequently replenished with new items to ensure test validity and security. Online calibration is a technique to calibrate the parameters of new items in CAT, which seeds new items in the process of answering operational items, and estimates the parameters of new items through the response data of examinees on new items. The most popular estimation methods include one EM cycle method (OEM) and multiple EM cycle method (MEM) under dichotomous item response theory models. This paper extends OEM and MEM to the graded response model (GRM), a popular model for polytomous data with ordered categories. Two simulation studies were carried out to explore online calibration under a variety of conditions, including calibration design, initial item parameter calculation methods, calibration methods, calibration sample size and the number of categories. Results show that the calibration accuracy of new items were acceptable, and which were affected by the interaction of some factors, therefore some conclusions were given.

【 授权许可】

CC BY