The Barometer offers a dynamic tool for interactive use of data on early grade reading outcomes. The ability to look at how the data are impacted by different parameters, like the level at which a reading benchmark is set, allows users to consider what benchmark and target for students achieving that benchmark in the near term may or may not be realistic. Furthermore, when such data are available, the Barometer also allows users to review the impact of interventions that have contributed to improving reading outcomes, and then factor in whether they can expect those kinds of improvements in the future, given the different investments and initiatives underway in their countries. The presentation is a short demonstration of these two features of the Barometer – target setting and considering the impact of previous or current interventions. Presented at CIES 2019.

There is growing demand for policy based on rigorous evidence. Many consider the strongest evidence to come from studies that identify causality with high internal validity - such as RCTs - and systematic reviews of these studies. If policies are based strictly on such rigorous evidence there is a risk of bias towards simple, discrete, measurable interventions and away from complex interventions. Rigorous evidence is also better suited to some questions than others. Evaluations may provide stronger conclusions about impact than about the mechanisms, implementation, context, generalisability and scaling of interventions. For these reasons, policy-making does – and should – consider issues for which there is no conclusive evidence. However, there is little guidance as to how and when such inconclusive evidence can be used. We present a framework for considering inconclusive evidence applied to examples from evidence-based education in low- and middle-income countries. The framework involves a systematic consideration of the estimated costs, benefits and potential harm of a policy, along with the uncertainty in those estimates. This analysis is conducted using standard decision theory and an examination of the utility of policies. We argue that it is rational to pursue a policy with uncertain outcomes if there is a reasonable probability of large positive utility (compared to the cost of the intervention) and a low probability of negative utility. The decision to act under uncertainty is influenced by a number of other considerations including: the potential to improve the evidence base, the urgency of the decision and the analysis of alternative options. The framework also calls for systematic analysis of uncertainty associated with all components of a policy decision. For example, some interventions may have robust evidence of impact but considerable uncertainty associated with the generalisability of the evidence to a new context, or with the scalability of the intervention. We discuss our approach to measuring and reducing uncertainty in policy decisions and its implications for evaluation and research. The overall aim of this work is to make evidence-based decision-making more effective and applicable to a wider range of problems.

This presentation is based on an activity that was designed to apply lessons learned and best practices from the recent EGRA Benchmarks and Standards Research Report (RTI International, 2018) to a five-language benchmarking activity for early grade reading in India.

The Tayari Program – Getting Children Ready for School is a Children’s Investment Fund Foundation (CIFF) funded early education program in Kenya with a goal to increase school readiness skills of pre-primary children in Kenya, including sufficient cognitive, physical, social, and emotional well-being. As of 2018, Tayari has reached 145,000 children 1,500 early childhood centers in four selected counties in Kenya. Tayari’s activities include development of learning materials for students and teachers, teacher training and instructional support, and integrated technology solutions for tracking child development outcomes. Additionally, one component aims to reduce illness-related school absenteeism by promoting improved hygiene practices, water treatment, and health record-keeping in schools. To better understand parental involvement and the feasibility and cost of scaling up a parental component within the project, the Tayari program tested two different approaches to engaging parents in play-based activities at home to promote their child’s learning and development, with an aim to see which modality was more effective in getting parents to engage in their children’s learning and development at home. Reaching over 1200 pre-primary families in 3 counties, Treatment Group 1 parents received weekly face to face meetings, with a new activity introduced each week (for a total of four weeks). Treatment Group 2 parents, received the same activities, but instead of meeting face to face, the activity sheets and materials were sent home with their child from school. The four selected activities are the same for both Treatment Groups, and include a memory card game, a counting game, a read aloud, and a letter recognition game. The content of the four activities was designed to align with the Tayari curricular content. All materials were designed to be low cost and illustrated locally. Data and feedback on the pilot was collected through weekly SMS messages sent to the mobile phones of the represented parent in both treatment groups. We used the program, “Gooseberry” to request response from parents regarding each activity, including attendance to the meeting (for treatment group 1) and whether they received the materials (for treatment group 2), how often parents played the game with their children over the course of the week, and their level of satisfaction or enjoyment with the activity. Both treatment groups also participated in a conclusion workshop, at the end of the pilot, to receive qualitative feedback from parents via small group focus groups and interviews.

This panel shared presentations from Uganda government officials and development partners which are collaboratively engaged in the efforts to improve and assess EGR in Uganda’s primary schools. Panel participants will discuss the process of gradually scaling up program activities to reach the majority of the nation’s schools by working with and through government structures. The Uganda MoES which has led the process from the begin will discuss how it has worked with donors and other development partners to mobilize resources and technical assistance by incorporating EGR in the ministry’s overall strategic plans. The Uganda National Examinations Board and the Uwezo Uganda initiative will discuss how they have been able to scale up assessment of Ugandan children’s reading skills through government ownership and civil society engagement in conducting early grade reading assessments. The GPE, SHRP, and LARA projects will share how they have worked through government structures at both the national and district levels to develop instructional materials in 12 local languages plus English and improve EGR instruction and learning in schools in a sustainable way. The panel will illustrate that attaining measurable improvements in reading scores at scale takes considerably more time and effort than smaller scale and pilot programs because interventions at scale require working through government structures and personnel, requiring systems strengthening and capacity building while also implementing program activities. This requires enormous effort and constant collaboration among government and development partners with sustainability as the ultimate objective.

This presentation introduces the panel of authors who presented at CIES 2019 about their chapter of the book.

In an optimally efficient education system, all children enroll and complete the primary cycle in a one year to one grade ratio, acquiring basic reading, math and critical thinking skills along the way. Unfortunately, in many LMICs, particularly in Sub-Saharan Africa, many children entering primary school are met with limited instructional materials and under-equipped teachers (UNESCO, 2014), which can lead to education systems that are inefficient and characterized by low primary school completion rates, high grade-specific gross enrolment rates, and under-reported repetition rates, particularly in the early grades. This presentation reports the findings from a nationally representative study of over-enrollment and repetition in primary 1 in Uganda. The following research questions are addressed: 1) What is the enrolment pattern and the age distribution of pupils enrolled in primary 1, according to school records, teachers, and parents/guardians; 2) What is the repetition rate in primary 1, according to school records, teachers, and parents/guardians; 3) What is the relationship between repetition and age of enrolment in primary 1; 4) What is the enrolment rate in pre-primary education and its relationship with primary 1 repetition; 5) What are parents’/guardians’ attitudes and expectations about pre-primary education and repetition in primary 1. Data from enrollment, classroom, and administrative records on age and repetition were gathered from 120 schools. Caregivers and teachers of 1,440 randomly selected primary 1 students were also interviewed about student age, repetition in primary 1, and past enrollment in pre-primary education programs. Information from caregiver and teacher interviews was compared with data from enrollment, classroom, and school administrative records on the age of primary 1 students and repetition in primary 1. We also analyzed the relationship between participation in pre-primary education programs and student repetition in primary 1 through an odds-ratio logistic regression. Findings show that reports by caregivers and teachers of under-age and over-age pupil enrollment and repetition in Primary 1 were much higher than official reports. Additionally, pupils with no pre-primary education were 3.8 times more likely to repeat Primary 1, even controlling for gender, age at enrollment, and SES. Finally, almost 30 percent of caregivers enrolled their children in Primary 1 early, expecting repetition. Research and policy implications include the need to understand and challenge official repetition rates, to examine the effect of pre-primary on education system efficiency, and to investigate the effectiveness of automatic promotion policies.

Executive functions are a cognitive skill set that underlie our goal-directed, planning, and problem solving behavior, and include the components of working memory, inhibitory control, and cognitive flexibility. EF skills undergo the majority of development during the pre-primary years of a child’s life and have been shown to contribute to academic success. However, most of our knowledge about children’s EF skills have been based on research with children living in high-income countries. This presentation reports on findings from the administration of an EF assessment with children from a West African country. Students entering Primary 1 grade for the first time from Kindergarten class were sampled. All students were administered four pre-literacy tasks and a set of questions measuring socio-economic status. Half of the sample also received EF touch games, including two training modules, two tasks measuring inhibitory control and 1 task measuring working memory. The presentation will focus on the findings of the use of EF Touch with this sample of children from a West African country. First, a brief description of the process of adapting and revising the tools for use in Liberia is reported. Second, a descriptive analysis is presented in order to describe the feasibility of using EF Touch with young children in this context. Third, children’s performance on the three tasks is summarized and correlations among the scores on the three tasks is reported and discussed. Fourth, a model exploring the unique contributions of simple reaction time and demographic characteristics is presented. Finally, the overall contribution to the field of early childhood assessment and executive function measurement in LMICs is discussed.

Core EGMA instrument in English

This report summarizes the findings of the 2018 Early Grade Reading and Mathematics Initiative (RAMP) Lot Quality Assurance Sampling Assessment, measuring impact between 2017 and 2018. The United States Agency for International Development (USAID) and UK Aid have funded RAMP as a national effort designed to improve the reading and mathematics skills and performance of students in Jordan from kindergarten 2 through grade 3 (K2–G3). This five-year program began on January 1, 2015, and is scheduled to end on December 31, 2019. Her Majesty Queen Rania Al-Abdullah formally launched RAMP as part of the broader Ministry of Education (MoE) initiative to improve education. The Research Triangle Institute (RTI) International leads implementation with its partners: Queen Rania Teacher’s Academy, ChangeAgent for Arab Development and Education Reform, We Love Reading, The Kaizen Company, Mercy Corps, Dajani Consulting, and Prodigy Consulting. The RAMP team and the MOE conducted a Lot Quality Assurance Sampling (LQAS) assessment in November 2018. Approximately 200 assessors (most of whom were MOE supervisors) were trained to collect reading and mathematics performance data across all 42 field directorates in the kingdom. For this activity, an approach was used at the school level, which led to a final sample of more than 39,000 Grade 2 and Grade 3 students in 2,076 schools. Performance comparisons made on three key indicators (reading comprehension, oral reading fluency, and mathematics) provides illustrative evidence of the gains made by RAMP schools over one school year. Large gains were seen on reading comprehension with the percent of students reaching the comprehension benchmark, increasing from 43% in 2017 to 55% in 2018. Gains in terms of oral reading fluency increased from 13% in 2017 to 19% in 2018. The smallest gains were in terms of mathematics (where the percent of students reaching the benchmark improved only slightly from 28% in 2017 to 30% in 2018).