Automatic Generation of Number Series Reasoning Items of High Difficulty

Frontiers in Psychology

article

Luning Sun¹  Yanan Liu²  Fang Luo² 

[1] The Psychometrics Centre, University of Cambridge, United Kingdom;Beijing Key Laboratory of Applied Experimental Psychology, Faculty of Psychology, Beijing Normal University

关键词: automatic item generation;    number series;    high difficulty;    LLTM;    stimulus features;   

DOI  :  10.3389/fpsyg.2019.00884

学科分类：社会科学、人文和艺术（综合）

来源: Frontiers

【 摘 要 】

Number series reasoning items have been frequently used in educational assessment. This study reviewed the previous literature investigating features relating to item difficulty and developed a new automatic generator for number series reasoning items. Ninety-two items were generated and administered to 466 students. The results showed that the test achieved acceptable reliability. Items requiring two arithmetic operations were of particularly high difficulty. All stimulus features implemented in the automatic item generator proved to be significant predictors of item difficulty, explaining 77% of the total variance. This suggests that the automatic number series reasoning item generator was capable of generating items of considerably predictable difficulty. More importantly, the resulting items covered a wide range of difficulty levels, meeting the particular need for items of high difficulty.

【 授权许可】

CC BY