Leveraging computer vision for adaptive learning in STEM education: effect of engagement and self-efficacy

International Journal of Educational Technology in Higher Education

Research Article

Chia-Ju Lin¹  Hsin-Yu Lee¹  Yueh-Min Huang¹  Wei-Sheng Wang¹  Ting-Ting Wu² 

[1] Department of Engineering Science, National Cheng Kung University, No. 1, University Road, 701, Tainan, Taiwan, R.O.C.;Graduate School of Technological and Vocational Education, National Yunlin University of Science and Technology, Yunlin, Taiwan;

关键词: Adaptive learning;    Engagement assessment;    ICAP framework;    STEM education;    Computer vision;    Self-efficacy;   

DOI  :  10.1186/s41239-023-00422-5

 received in 2023-06-14, accepted in 2023-09-15,  发布年份 2023

来源: Springer

【 摘 要 】

In the field of Science, Technology, Engineering, and Mathematics (STEM) education, which aims to cultivate problem-solving skills, accurately assessing learners' engagement remains a significant challenge. We present a solution to this issue with the Real-time Automated STEM Engagement Detection System (RASEDS). This innovative system capitalizes on the power of artificial intelligence, computer vision, and the Interactive, Constructive, Active, and Passive (ICAP) framework. RASEDS uses You Only Learn One Representation (YOLOR) to detect and map learners' interactions onto the four levels of engagement delineated in the ICAP framework. This process informs the system's recommendation of adaptive learning materials, designed to boost both engagement and self-efficacy in STEM activities. Our study affirms that RASEDS accurately gauges engagement, and that the subsequent use of these adaptive materials significantly enhances both engagement and self-efficacy. Importantly, our research suggests a connection between elevated self-efficacy and increased engagement. As learners become more engaged in their learning process, their confidence is bolstered, thereby augmenting self-efficacy. We underscore the transformative potential of AI in facilitating adaptive learning in STEM education, highlighting the symbiotic relationship between engagement and self-efficacy.

【 授权许可】

CC BY   
© Universitat Oberta de Catalunya 2023

【 图 表 】

Fig. 2

Fig. 5

Fig. 4

13690_2023_1170_Article_IEq29.gif

Fig. 1