Developing school-level instruments for better understanding effective numeracy instruction at scale [CIES 2023 Presentation]

While there has been substantial investment in early-grade reading in low- and middle-income country contexts (LMICs) in the last 15 years, and a concomitant increase in evidence around what works to improve reading outcomes, there has been much more limited investment in early-grades mathematics. As a result, the body of evidence on what works to improve mathematics teaching and learning in LMICs is more limited. This study has identified six government- and program-led interventions in LMICs that have evidence of impact on students’ numeracy outcomes and are working at scale, to understand how and why they are effective and consolidate that evidence for the international education community. In order to examine the target programs, the study team has developed a suite of instruments designed to examine the programs and to identify common elements that these successful numeracy may have in common. The goal in designing these instruments was to be able to examine a range of potential factors, based on the evidence that we have on mathematics teaching and learning from research in high-income country contexts, as well as the limited research evidence we have from LMICs. This suite of instruments includes: (1) a quantitative classroom observation instrument, based on multiple frameworks for high-quality math instruction, including work by The Danielson Group (2019), The University of Michigan’s High Leverage Teaching practices, and a cross-institutional working group of math education experts working in LMICs (co-author, 2019); (2) a student cognitive interview instrument intended to provide insight into students’ development of higher order, conceptual understanding of basic mathematics concepts; (3) a qualitative classroom observation instrument and accompanying lesson-based teacher interview; (4) a survey of teachers’ Mathematical Knowledge for Teaching, based on work by Deborah Ball (2011). Focusing primarily on the quantitative classroom observation and student cognitive interview instruments, this paper will present the theoretical foundations of the instrument and the processes for developing, piloting, and adapting the instruments for different country and program contexts. Preliminary findings and lessons learned from utilizing the tools for data collection across country contexts will also be shared. Given the need to expand the body of evidence around what works to improve math teaching and learning, these instruments represent potentially valuable resources for research in this area – and the authors look forward to discussing the potential for use and further development/adaptation.

Examining teacher support and play-based practice in Kenya, Rwanda and Ghana [CIES 2023 Presentation]

While there is growing evidence of the impact of learning through play (LtP) on student outcomes in high-income countries, there is little research linking LtP to learning outcomes in low-and middle-income contexts in primary schools. This presentation focuses on the midline evaluation findings from an education improvement initiative that is seeking to expand playful pedagogies into primary schools in five low and middle-income countries (LMICs). In this presentation, we examine the different approaches taken by projects to support teachers to test, adapt, and adopt LtP in their classroom. We link these findings to classroom observation data on the frequency with which teachers employ more collaborative, interactive, creative, exploratory, and student-driven play-based approaches. We also discuss the impacts of these activities on student outcomes (EGRA, EGMA and SEL).

Mathematics Teacher Guide

A teacher's guide for mathematics instruction in the context of Jordan, developed by the Jordanian Ministry of Education.

Report of Self-Administered EGRA/EGMA Pilot (Ghana, English)

This report summarizes the findings of an effort to develop and validate tablet-based, self-administered assessments of English-language foundational literacy and numeracy in the early grades. The tools described in the report were developed at the request of Imagine Worldwide with the support of the Jacobs Foundation. RTI carried out field testing and a pilot study to assess the tools' internal consistency, test-retest reliability, and concurrent validity with respect to "traditional" EGRA and EGMA. RTI International developed the two assessments, known respectively as the Self-Administered Early Grade Reading Assessment (SA-EGRA) and the Self-Administered Early Grade Mathematics Assessment (SA-EGMA), with the support and at the direction of Imagine Worldwide. The assessments are deemed “self-administered,” because children complete the assessments independently in response to instructions and stimuli imbedded in the tablet-based software. However, adults typically supervise the organization and conduct of the assessment as well as the collection of individual data from the tablets for analysis. The tools have been developed under an open-source license. The code can be viewed and downloaded for reuse or modification at https://github.com/ICTatRTI/SE-tools/blob/main/README.md. Users of RTI's Tangerine software may request that the SA-EGRA and SA-EGMA tools be added to their Tangerine groups via https://www.tangerinecentral.org/contact

LEGO Play Accelerator Baseline Report

The Play Accelerator research partner grant presents a unique opportunity to examine five large-scale educational interventions focused on improving learning through play (in Bangladesh, Ghana, Kenya, Rwanda and Vietnam, respectively). One aspect of this activity is determining if and how these five programs change the practice and attitudes of key education stakeholder and whether or not this leads to improved holistic learning outcomes through increasing playful pedagogies. This, in turn, will generate much-needed rigorous evidence on implementing playful pedagogies successfully through government teacher professional development systems at scale. Due to prolonged school closures and other obstacles resulting from COVID-19, this report presents baseline findings collected between June and November 2021 from three of the five Play Accelerator partner programs: Partners in Play Program (P3) implemented by Right to Play in Ghana; Tucheza Kujifunza (TuKu) implemented by Aga Khan Foundation (AKF) in Kenya; and the Scaling Learning Through Play program implemented by the United Nations Children’s Fund (UNICEF) in Rwanda. The goal of this report is to provide comprehensive baseline estimates for these three Learning through Play (LtP) programs. These results will serve two purposes: 1) to provide a starting point against which program impact will be measured at midline and endline, and 2) to provide programs with data-driven recommendations of areas to focus on for improved implementation throughout the remainder of their programming. While the overall evaluation of these programs includes a wide range of research questions that will be addressed at midline and endline, the baseline study focuses specifically on four main research questions: 1. What are the baseline levels of student literacy, numeracy, and social-emotional learning among Grade 1 students in treatment and control schools? 2. What is the baseline state of teachers’ pedagogical practices in the classroom (including LtP) among Grade 1 teachers in treatment and control schools? 3. What are the baseline perceptions of LtP among school-, district-, and community-level stakeholders? 4. What are the enabling factors associated with implementing LtP pedagogical methods in classrooms? What are the barriers associated with implementing LtP pedagogical methods in classrooms?

Linking EGRA and GALA for Sustainable Benchmarking [CIES Presentation]

Prior Early Grade Reading Assessments (EGRA) have been used to set reading fluency benchmarks in Tanzania for USAID report and for the Government of Tanzania (GoT). Since the EGRA requires one-on-one administration with trained enumerators, tablets, it is currently too expensive to be sustainable within the government system. The Group Administered Literacy Assessment (GALA) is an inexpensive and sustainable way to collect information about students’ reading abilities; is it group administered, does not require intensive training to administer, and is collected on paper, which is then entered into a database. Unfortunately, the GALA does not contain a fluency measure, which is still used as the basis of USAID reporting. The Jifunze Uelewe team created a study in order to identify the reading fluency equivalent benchmarks for the GALA on a subsample of the total GALA respondents. The study is administering the both the EGRA’s reading passage and the GALA to a sample of grade 2 and grade 4 pupils attending public schools in Tanzania. Data collection occurred in October 2021. Data collection was happening during the submission of this abstract, so no results are available for the abstract. But we will report the results and will discuss how well the linking process worked.

Read Liberia Activity: Student Activity Book

A Student Activity Book for grade 1 students in Liberia.

Read Liberia: Student Book Activity Part 2.

This publication covers topic such as reading and arts.

ABE-ACR Tanzania National Early Grade Reading Assessment (EGRA) Final Report

This final report describes the progress made from October 1, 2015 - December 31, 2018 under the Tanzania National Early Grade Reading Assessment activity. USAID/Tanzania contracted RTI International to conduct two rounds of student assessments in early grade reading.

Jordan Early Grade Reading and Mathematics Initiative (RAMP) Endline Survey Report

This report presents the findings of the Jordan Early Grade Reading and Mathematics Initiative (RAMP) endline survey conducted at the end of the 2018–2019 school year (in May 2019).

Pages