Early Grade Reading Assessment 2018, Chichewa National Results for Standards 1 and 3

This report presents key findings of the 2018 national assessment of early grade reading skills in Chichewa, a core language for reading and language development in Malawi. This early grade reading assessment (EGRA) for Standards 1 and 3 was conducted in June 2018 in a nationally representative sample of 86 Ministry of Education, Science and Technology (MoEST) primary schools. The 1,720 tested students—860 Standard 1 and 860 Standard 3 learners, half boys and half girls in each standard from each school—were randomly selected during visits to each school. The results are nationally representative of Standard 1 and 3 learners of MoEST primary schools in Malawi.

Global Learning XPRIZE Data Summary

This presentation was delivered to a team of researchers who participated in a "Data Deep Dive" convened by the XPRIZE Foundation after the announcement of the Global Learning XPRIZE award.

Cambodia, Student Performance in Early Literacy: Baseline Report

This report presents the results of a baseline assessment of upper preschool and grade 1 student performance in pre-literacy and early grade reading. The assessment included samples drawn from three provinces in Cambodia: Kampong Thom, Siem Reap, and Battambang (control). The results will serve as a baseline for comparing the impact of early grade reading interventions being implemented in Kampong Thom and Siem Reap. The data reveal lower than expected levels of oral language ability among students in upper pre-school, especially given that Khmer is the mother tongue for nearly all students in the areas covered. For example, students responded correctly to only 3 out of 5 questions concerning a short passage that had been read to them. And in terms of their pre-literacy skills, when shown the letters they were supposed to learn in upper pre-school, students identified them with only 28% accuracy. Performance of grade 1 students on early literacy skills was also much lower than should be expected for the period during which the test was administered. For example, grade 1 students who were almost three-quarters of the way through the school year could only correctly identify letters 34% of the time and were identifying fewer than 10 letters per minute. When simpler forms of consonants and vowels were tested separately, grade 1 students performed better, but still correctly identified letters with less than 50% accuracy. Reading of familiar words in isolation or reading of a short grade-level passage were essentially non-existent.

Is ‘summer’ reading loss universal? Using ongoing literacy assessment in Malawi to estimate the loss from grade-transition breaks

Published abstract: "Summer learning loss – decreased academic performance following an extended school break, typically during the period after one grade ends and before another grade starts – is a well-documented phenomenon in North America, but poorly described in sub-Saharan African contexts. In this article, we use the term ‘grade-transition break’ loss in lieu of ‘summer’ loss to refer to the period after one grade ends and before another grade starts. This study analyses data from early grade reading assessments in Malawi, estimating statistically significant average reductions of 0.38 standard deviations (SD) across several measures of reading and pre-reading skills during two grade-transition breaks. The data show the loss in reading skills during the extended breaks between grades 1 and 2 and between grades 2 and 3 in two consecutive years. The study found no gender-based differences in loss. The findings suggest a need for early grade reading interventions to develop and evaluate mitigation strategies lest significant proportions of within-year performance gains be lost over the break between academic years."

Measures of quality through classroom observation for the Sustainable Development Goals: Lessons from low-and-middle-income countries

Background paper prepared for the 2016 Global Education Monitoring Report Education for people and planet: Creating sustainable futures for all With the adoption of the United Nations General Assembly’s Sustainable Development Goals (SDGs), global education agencies are grappling with how quality can and should be measured for global reporting purposes. Several factors at the education system, school, and classroom levels shape education quality, including the limited information available at the global level about what is happening in the classroom. Such information can only come through observation-based measures that record teacher practices, either through routine monitoring conducted by system actors or through surveys. Classroom observation is used extensively in not only teacher education and professional development, but also in evaluation studies. However, there are fewer cases where classroom observations are used for system monitoring purposes—particularly in low- and middle- income countries. This paper reviews what has been learned from observation instruments in low- and middle-income countries and what opportunities (i.e., scope) there are to systematize these countries to that they can monitor quality at both the school and system levels.

Independent Evaluation of the Effectiveness of Institut pour l’Education Populaire’s “Read-Learn-Lead” (RLL) Program in Mali

The Institute for People’s Education (Institut pour l’Éducation Populaire, or IEP) designed the Read-Learn-Lead (RLL) program to demonstrate that the new official curriculum, if properly implemented and supported, can be a viable and effective approach to primary education, using mother tongue and a very specific pedagogical delivery approach. The RLL program sought also to demonstrate how the new Curriculum can be effectively implemented and supported, and what resources are needed to do so. RLL offers students and teachers carefully structured and systematic lessons, activities, and accompanying materials for instruction and practice on critical early reading skills in mother-tongue medium during the first years of elementary school. It is organized around three programmatic “results sets,” the first of which focuses on Grades 1 and 2 and is the subject of the present evaluation. This independent evaluation study, funded through a grant from the William and Flora Hewlett Foundation and carried out by RTI, explored the effectiveness of the RLL program’s Results Set 1 as applied over three school years (2009-2010 to 2011-2012) in the Bamanankan language and in other Malian national languages (Bomu and Fulfulde in all three years, and Songhai in 2009 and 2010).

CIES 2017 Presentation: Measurement of early reading under the SDGs

Measurement of learning is central to the Sustainable Development Goals for education, both in early primary (grade 2/3) and in early childhood (under the age of 5) (IAEG 2016). Of particular concern is the ability of global measurement approaches to reflect the social and linguistic differences of a diverse range of societies, including traditionally marginalized groups. This presentation relies on literacy assessment data to answer the following question: can results from non-equated national assessments be used to report against global goals?

Improving procedural and conceptual mathematics outcomes: evidence from a randomised controlled trial in Kenya

Article published in the Journal of Development Effectiveness, Volume 8, 2016 - Issue 3. Published Abstract: To improve learning outcomes, an intervention in Kenya called the Primary Math and Reading (PRIMR) Initiative provided pupil learning materials, teachers’ guides and modest teacher professional development in mathematics. This paper presents the causal impact of PRIMR’s mathematics intervention on pupil achievement indices for procedural and conceptual numeracy, using a differences-in-differences analytic strategy. The mathematics intervention produced modest, statistically significant results: generally similar results for males and females, a larger impact in grade 2 than grade 1, a larger impact in nongovernment schools than public schools, and smaller outcomes in mathematics than for English or Kiswahili. These findings have relevant policy implications in Kenya given an impending national mathematics programme.

Liberia Teacher Training Program Endline Assessment of the Impact of Early Grade Reading and Mathematics Interventions

This report addresses the main research question: In Cohort 1 and Cohort 2 schools, were the pupils who participated in the United States Agency for International Development’s Liberia Teacher Training Program (LTTP) Phase II (LTTP II) reading and mathematics interventions now achieving better results?

MobiLiteracy-Uganda Program: Phase 1: Endline Report

In 2012, Urban Planet Media and Entertainment Corporation/Urban Planet (UP) was awarded a grant through All Children Reading: A Grand Challenge for Development. The grant awarded to UP was used to develop, pilot test, and evaluate an early literacy product in Uganda that targets parents through their mobile phones and encourages them to engage their early primary- school aged children in literacy skills-building activities outside of school hours. The product delivered to caregivers multimedia (text plus audio, or SMS+audio) content in Luganda on a daily basis over period of 91 days. During this period, all of the letters of the Luganda alphabet were introduced as well as 10 key vocabulary words all related to a short story. The product was evaluated by RTI International using RCT methodology. This is the Endline report describing the findings using a product evaluation framework.