RCT: with the Treatment condition using a personalized reading platform while the control condition using a static reading platform
MENA (Jordan, Egypt & Saudi Arabia)
School Year: 2022-2023
Highlighted Technology: I Read Arabic
Overview
Children worldwide encounter challenges in reading and comprehension, necessitating innovative approaches to enhance learning outcomes. This longitudinal study investigates the effectiveness of Personalized and Adaptive Learning (PAL) technology in improving early reading skills through a randomized controlled trial involving 1,419 grade 1-3 students from 19 state-run and low-cost private schools in Jordan, Egypt and Saudi Arabia. Using a three-level Hierarchical Linear Modeling analysis, the study addresses gaps in the literature regarding the overall effectiveness of PAL and its various adaptation approaches. It also examines the interplay between PAL, contextual factors and growth in reading achievement, offering valuable insights into the impact of PAL as a supplement to classroom instruction.
PROJECT OBJECTIVES
By conducting a randomized controlled trial, this study explores the impact of using an adaptive and personalized learning technology on early grade literacy skills in Arabic. Using the Early Grade Reading Assessment (EGRA), reading gains between the following two conditions will be compared.
This randomized trial involves 1419 students in grades 1-3 in 19 public and low-cost private schools (LCP) in Jordan, Egypt and Saudi Arabia.
A. The treatment condition which involves adaptation and personalization of the learning experience. In this condition, a group of students from grades 1-3 uses a self-paced and interactive PAL platform that frequently adapts and personalizes the learning content/pathway progression to meet students’ specific reading needs (hereinafter referred to as the Flexible condition);
B. The control condition which involves a determined and fixed approach to the learning experience. In this condition, a group of students uses the same platform, but the learning content/progression is determined based on a baseline measure (hereinafter referred to as the Fixed condition).
The findings demonstrate a positive effect of this technology on early Arabic reading achievement, with an effect size of 0.22.
Contrary to expectations, the study reveals that a determined approach to adaptation is more effective than macro adaptation with limited algorithms, challenging the common assumption that increased adaptation leads to improved learning outcomes.
Furthermore, the study identifies significant factors that contribute to reading achievement disparities, including variations among the studied countries, gender and socioeconomic status.
The results also indicate that each additional minute spent on PAL per week was associated with an average gain of approximately half a point in Reading Achievement, indicating a substantial effect (ES = 0.41).
These findings carry significant implications for educators, policymakers and researchers, emphasizing the potential for widespread adoption of PAL in early reading instruction. The study underscores the importance of targeted interventions and appropriate allocation of resources to support students from disadvantaged backgrounds, as well as to address the gender gap in reading achievement. Furthermore, the findings emphasize the significance of adopting strategies that are both efficient and effective, ensuring that educational interventions reach a wide range of students and lead to tangible improvements in reading outcomes. By providing evidence-based insights, this study lays a solid foundation for informed decision-making. Its outcomes have practical value for educators, policymakers and researchers seeking to enhance reading instruction in the MENA region and beyond.
Many teachers in the study integrated PAL as an essential element of their teaching methods. It was observed that 13% of teachers used PAL on a daily basis, while 49% integrated it up to three times a week. This indicates that that incorporating PAL into regular classroom instruction or using it as a supplementary tool can equally enhance reading achievement among students in the region.
Out of the 35 teachers surveyed after participating in the study, approximately 13% indicated that they had not received any training on incorporating technology into their instruction. About half of these teachers were from Egypt.
25 reported having dedicated daily time for reading instruction, while 6 reported dedicating time to reading instruction less than three times a week.
In this study, among the 35 surveyed teachers (21 from Egypt, 9 from Jordan, and 5 from Saudi Arabia), six reported not receiving any in-service training on pedagogy and teaching. Out of these six teachers, half were from Saudi Arabia, and interestingly, two of the teachers who lacked in-service training were male. While this does not establish anything conclusively, it hints at a potential gender disparity in access to professional development opportunities within the Saudi Arabian context.
Interested in learning more about this project? I’d love to hear from you!
Get In Touch