System Supports for Effective Large-Scale Reading Interventions (Learning at Scale)

Learning outcomes are low and instruction is poor in many low- and middle-income countries (LMICs). These shortcomings are particularly concerning given the substantial learning loss due to COVID-19 from which many systems are suffering. The Learning at Scale study identified eight of the most effective large-scale education programs in LMICs and now is examining what factors contribute to successful improvements in learning outcomes at scale (see list of programs on last page of this brief). These programs were selected based on their demonstrated gains in reading outcomes at-scale, from either midline or endline impact evaluations. The study addresses three overarching research questions, focused on understanding (1) the components of instructional practices (Brief 1), (2) instructional supports (Brief 2), and (3) system supports (Brief 3) that lead to effective instruction. This brief focuses specifically on system supports. It addresses the following research question: What system supports are required to deliver effective training and support to teachers and to promote effective classroom practices?

Instructional Support for Effective Large-Scale Reading Interventions (Learning at Scale)

Learning outcomes are low and instruction is poor in many low- and middle-income countries (LMICs). These shortcomings are particularly concerning given the substantial learning loss due to COVID-19 from which many systems are suffering. The Learning at Scale study identified eight of the most effective large-scale education programs in LMICs and now is examining what factors contribute to successful improvements in learning outcomes at scale (see list of programs on last page of this brief). These programs were selected based on their demonstrated gains in reading outcomes at-scale, from either midline or endline impact evaluations. The study addresses three overarching research questions, focused on understanding (1) the components of instructional practices (Brief 1), (2) instructional supports (Brief 2), and (3) system supports (Brief 3) that lead to effective instruction. This brief focuses specifically on instructional supports. It addresses the following research question: What methods of training and support lead to teachers adopting effective classroom practices in successful, large-scale literacy programs?

Learning at Scale Interim Report

The Learning at Scale study was designed to identify existing early grade reading programs with demonstrated impact on basic skills at scale and to conduct in-depth investigations of these programs to determine what makes them successful. After an extensive search, eight programs (spanning seven countries) were selected for inclusion in the study. Research on these programs has been conducted in order to answer the three overarching research questions, focused on understanding the components of instructional practices, instructional supports, and system supports that lead to effective instruction. Learning at Scale data collection activities for some of these programs were delayed due to COVID-19. However, with demand for information about how to implement effective interventions at large scale at an all-time high, we believe that the timely sharing of findings from Learning at Scale is essential. Accordingly, this interim report provides preliminary findings from our study to date, highlighting key high-level findings across all eight programs, as well as quantitative and qualitative findings from primary research for select programs. The Learning at Scale study is led by RTI International, as part of the Center for Global Development (CGD) education research consortium, funded by the Bill and Melinda Gates Foundation.

Improving Education for Deaf Students in Kenya

In Kenya, USAID supports the training of deaf education teachers like Martha Mwangu to improve learning outcomes of children with disabilities in grade 1, 2, and 3 through the Tusome Literacy Program. Tusome ('Let's read' in Kiswahili) is implemented in all public primary schools.

Uganda/LARA: EGR Action Research Tools

LARA developed action research tools to measure the level of fidelity of implementation of the EGR methods and generate lessons learned to inform adaptations in EGR programming. The action research tools gather both historical and real-time data at the school. They include the EGR core methodologies action research tool; the remedial instruction action research tool and the intensive coaching action research tool (subdivided into two tools i.e. head teacher coaching event log and school based community of practice event log). The EGR core methodologies action research tool assesses the teacher’s perception of the Teacher Guide usability, level of macro pacing, implementation of lesson plan elements, implementation of core EGR methodologies and tracking of instructional adaptations by the teacher. The remedial instruction research tool tracks the teacher’s perception to remedial instruction, the implementation of group-based instruction as well as in-class assessment. The intensive coaching action research tool tracks teacher’s perception of intensive coaching and keeps a log of head teacher instructional coaching events in addition to school-based community of practice activities. The action research tools are designed to be deployed electronically in order to seamlessly incorporate extra data quality standards and innovations like the Stalling’s classroom observation snapshot (Stallings and Kaskowitz, 1974 ). The project also developed the action research process flow guidelines to guide data collection activities.

Do’s and Don’ts of Improving Teaching Through Instructional Support: Findings from a Multi-country study of coaching and communities of practice

RTI’s multi-country study examines a range of instructional support packages that include a variety of designs for coaching and communities of practice across all of RTI’s existing programs in order to determine what modes of coaching support are most effective. This includes coaches at both the school level and external to the school, as well as government officers compared with project hired coaches. This research is able to compare the relative effectiveness of coaching approaches with educational support provided by communities of practice meetings held at the school or the school cluster level. These findings have provided existing and future programs with best practices for how to more effectively implement coaching support structures at scale.This presentation was delivered by RTI at CIES (April 2020) as part of a panel focused on how literacy improvement efforts work at scale, and what types of coaching designs and behaviors impact teacher pedagogy more effectively than others.

Is It Possible to Improve Learning at Scale? Reflections on the Process of Identifying Large-Scale Successful Education Interventions

Improving learning outcomes at scale is hard. That may seem obvious, but only recently have policymakers and donors become aware of just how dire—and broad—the learning crisis is. Most of their efforts to improve learning have been pilot programs, and although in some cases it has been possible to improve outcomes at this small scale, it is an entirely different challenge at scale, which can involve thousands of schools—the level at which change must happen to fix the crisis.

Guiding Teachers Rather than Scripting Them

It is difficult to imagine an effective teacher who does not have mastery of the content nor command of the pedagogical skills needed to teach literacy. Yet many teachers, particularly in low- and middle-income countries, lack these very skills. In those same countries, students exit school without the essential capabilities they need. How can we help teachers to teach more effectively?

Mathematics from the Beginning: Evaluating the Tayari Preprimary Program’s Impact on Early Mathematics Skills

Given the dearth of research on early numeracy interventions in low- and middle-income countries, this paper presents the instructional methodology and impact results of the Tayari program. Tayari is a preprimary intervention in Kenya (2014–2019) that prepares children aged four and five for entry into primary school by providing materials for students, training for teachers, and continuous in-classroom support. The Tayari methodology was built on the Kenyan government’s preprimary syllabus to produce instruction that was developmentally sequenced, linked to out-of-school experiences, and supportive of children’s number sense. Tayari was evaluated using a randomized controlled trial (RCT) and collection of longitudinal data from 2,957 children in treatment and control schools at three time points. Pupil assessment items were drawn from a growing body of research on preprimary numeracy in developing contexts, plus instruments and techniques from the Measuring Early Learning and Quality Outcomes (MELQO) program (UNESCO, UNICEF, Brookings Institution, & World Bank Group, 2017). The impact evaluation of the longitudinal RCT results showed statistically significant effects in the numeracy tasks of producing sets, identifying numbers, and naming shapes, while revealing no initial effects in the areas of oral and mental addition. We present recommendations for Tayari’s improvement in terms of mathematics instruction, as well as preprimary policy implications for Kenya and similar contexts.

Measuring Executive Function Skills in Young Children in Kenya

Interest inmeasuring executive function skills in young children in lowand middle-income country contexts has been stymied by the lack of assessments that are both easy to deploy and scalable. This study reports on an initial effort to develop a tablet-based battery of executive function tasks, which were designed and extensively studied in the United States, for use in Kenya. Participants were 193 children, aged 3–6 years old, who attended early childhood development and education centers. The rates of individual task completion were high (65–100%), and 85% of children completed three or more tasks. Assessors indicated that 90% of all task administrations were of acceptable quality. An executive function composite score was approximately normally distributed, despite higher-than-expected floor and ceiling effects on inhibitory control tasks. Children’s simple reaction time (β = –0.20, p = .004), attention-related behaviors during testing (β = 0.24, p = .0005), and age (β = –0.24, p = .0009) were all uniquely related to performance on the executive function composite. Results are discussed as they inform efforts to develop valid and reliable measures of executive function skills among young children in developing country contexts.

Pages