Reanalysis of the German PISA Data: A Comparison of Different Approaches for Trend Estimation With a Particular Emphasis on Mode Effects

Frontiers in Psychology

Frank Goldhammer¹  Alexander Robitzsch²  Oliver Lüdtke²  Ulf Kroehne³  Olaf Köller⁴ 

[1] Centre for International Student Assessment (ZIB), Frankfurt, Germany;Centre for International Student Assessment (ZIB), Kiel, Germany;DIPF – Leibniz Institute for Research and Information in Education, Frankfurt, Germany;IPN – Leibniz Institute for Science and Mathematics Education, Kiel, Germany;

关键词: educational measurement;    large-scale assessment;    mode effects;    scaling;    linking;   

DOI  :  10.3389/fpsyg.2020.00884

来源: DOAJ

【 摘 要 】

International large-scale assessments, such as the Program for International Student Assessment (PISA), are conducted to provide information on the effectiveness of education systems. In PISA, the target population of 15-year-old students is assessed every 3 years. Trends show whether competencies have changed in the countries between PISA cycles. In order to provide valid trend estimates, it is desirable to retain the same test conditions and statistical methods in all PISA cycles. In PISA 2015, however, the test mode changed from paper-based to computer-based tests, and the scaling method was changed. In this paper, we investigate the effects of these changes on trend estimation in PISA using German data from all PISA cycles (2000–2015). Our findings suggest that the change from paper-based to computer-based tests could have a severe impact on trend estimation but that the change of the scaling model did not substantially change the trend estimates.

【 授权许可】

Unknown