This toolkit is the product of ongoing collaboration among a large community of scholars, practitioners, government officials, and education development professionals to advance the cause of early reading assessment and acquisition among primary school children in low-income countries. Extensive peer review comments for this toolkit and suggestions for instrument development were provided by Marcia Davidson, Sandra Hollingsworth, Sylvia Linan-Thompson, and Liliane Sprenger-Charolles. Development of EGRA would not have been possible without the support of the nongovernmental organization and Ministry of Education EGRA Evaluation Teams of Afghanistan, Bangladesh, Egypt, The Gambia, Guyana, Haiti, Honduras, Jamaica, Kenya, Liberia, Mali, Nicaragua, Niger, Peru, Senegal, and South Africa. Our deepest gratitude goes to the teachers, the students, and their families for their participation and continued faith in the benefits of education. In repayment we will diligently seek to improve reading outcomes for all children around the world. Amber Gove is responsible for primary authorship of the toolkit, with contributions from Luis Crouch, Amy Mulcahy-Dunn, and Marguerite Clarke; editing support was provided by Erin Newton. The opinions expressed in this document are those of the authors and do not necessarily reflect the views of the United States Agency for International Development or the World Bank. Please direct questions or comments to Amber Gove at agove@rti.org.

The Improving Learning Outcomes for Asia (ILOA) regional project works closely with USAID’s Asia Bureau and Missions across the region to identify key questions and challenges Mission staff face in their day-to-day work. An advisory group of USAID Mission colleagues raised an important question: how best to wade through the array of education data available? What are the types, how are they used, when are different data useful, etc.? Indeed, the use of different data to effectively partner with governments to make evidence-based decisions is a top priority. As a result, ILOA produced a brief summarizing the different sources and uses of data for basic education, youth and workforce development, and higher education. The brief recognizes how data sources and uses have evolved over time, enabling ministries, their partners, and stakeholders to measure performance, inform policy and plan interventions, and manage limited resources. The brief is designed to succinctly assist USAID staff and their partners in navigating the world of education data.

Over the last decade, USAID has been supporting the Government of Tajikistan (GOT) to improve learning outcomes in primary education. The GOT has not previously used a national objective assessment to measure those learning outcomes. USAID introduced the Early Grade Reading Assessment to measure the impact of its investments. An EGRA has been implemented about every two years since 2013.

The Ministry of Preschool and School Education (MoPSE) in Uzbekistan has set the goal of transforming the education system and improving English proficiency among secondary school graduates by 2030. To support this initiative, the Uzbekistan Education for Excellence Program, in collaboration with MoPSE, conducted a study in 2023 to assess the adoption and use of new English language teaching and learning materials in public schools during the 2022-2023 academic year. The study aimed to gather data to inform teacher professional development and effective utilization of the new textbooks for English language instruction in grades 1-11. To collect the necessary data, an online survey was administered from April 25 to May 20, 2023, targeting English teachers in grades 1-11 across all regions of Uzbekistan. The survey focused on teaching practices, instructional approaches, and the utilization of new materials and digital resources. The survey responses from 2,363 English teachers in public schools were analyzed using qualitative and quantitative descriptive statistics techniques. However, the survey process faced methodological challenges such as internet and computer access for some participants, varying levels of familiarity with responding to online surveys, and potential language barriers due to respondents' limited English proficiency. Additionally, the self-reported nature of the data introduced potential biases in the responses. The survey results revealed several important findings. Participating teachers expressed satisfaction with the new textbooks and reported positive changes in their teaching practices, as well as perceived improvements in student learning. However, challenges were identified, including limited textbook availability, time constraints in delivering certain activities suggested in the textbooks, technological barriers, and limited access to audio-visual equipment in classrooms. The integration of real-life contexts in the textbooks enhanced the overall learning experience. Based on these findings, recommendations were made to address the identified challenges and improve the adoption process, including providing guidance, addressing textbook availability, offering comprehensive teacher training, and establishing mechanisms for continuous review and student feedback. Implementing these recommendations might support the enhancement of English language instruction in Uzbekistan. In conclusion, the adoption of the Guess What! and Prepare series as new English language instructional materials in Uzbekistan's public schools has yielded positive results, as reported by participating teachers. The integration of these textbooks has brought about changes in teaching practices and perceived achievements of student learning outcomes. The survey results indicated a high level of teacher satisfaction with the Student's Books, Workbooks, and Teacher's Books, with the Workbooks receiving the highest satisfaction level at 83%. Moreover, over 67% of teachers acknowledged that the new textbooks had brought about a change in their approach to teaching English. Overall, the study highlights the positive influence of new instructional materials on English language instruction in the Republic of Uzbekistan. The successful integration of the Guess What! and Prepare series sets the stage for continuous progress in English language learning and teaching. It is crucial to build upon these findings and recommendations to further improve teaching practices, support teacher professional development, and ensure ongoing enhancement of English language instruction throughout the country.

Presentation showcases findings about specific social and emotional skills and their in individual relationships to academic achievement. Importantly, these findings highlight the possible link between inequalities in academic achievement being attributed to the inequalities in SEL. These findings will be published in UNESCO GEMR Spotlight Series 2024.

The twin crises of high dropout rates and weak foundational skills risk a lost generation of youth in Guatemala and Honduras. To respond to these crises, RTI is working with the Ministry of Education to support students to complete their education by strengthening system capacity to use data to identify students at risk of dropping out, to provide psychosocial support, and to address barriers to accessing secondary school. Motivating this effort is the belief that improved education outcomes will lead to secure employment and steady incomes in the future, weakening the primary drivers of irregular migration. Building on past efforts in dropout prevention (World Bank 2021; Unesco 2022), we have developed and deployed an open-source mobile application to teachers’ devices that will both facilitate data collection and display easily understandable information on the three pillars of dropout prevention: Attendance, Behavior and Coursework (ABC). The application enables teachers to track daily attendance, behavior and track and import coursework performance including test results and class grades. The data are used by the teacher to inform the need for additional intervention. Anonymized and aggregated data are shared at the school, municipal and ministry level, which we expect will reduce teacher fears of punitive accountability. The application works offline and syncs to the cloud once a WiFi or data connection is made. Free community Wi-Fi and school-based internet connectivity will improve teacher’s ability to access the application and other education data, resources and tools while also improving digital inclusion for students to access online learning opportunities and resources. At CIES, we hope to respond to Sub-theme question 3.3: How can school systems be better prepared to adapt to and to combat disruptions such as natural disasters and the COVID pandemic? The ongoing experience of both Guatemala and Honduras in managing COVID has been characterized by extended school closures, limited access to online materials, and increased dropout and irregular migration. We hope to learn from current and past NGO and Ministry experiences in creating digital tools that support teachers but can also be used to identify and respond to system-level challenges and improve system resilience. How have these digital tools helped teachers and system leaders to understand gaps in student learning and risk of drop-out? What level of anonymity has proved sufficient to overcome teacher accountability fears but adequate to inform system-level needs? Can improved digital inclusion and access to online learning help systems to become more resilient to disruptions? We anticipate a lively discussion on the potential and limitations of data-driven dropout prevention systems, several of which have been piloted by Ministries of Education in Latin America with the support of the World Bank, USAID and other organizations. By the time of the CIES presentation in March we expect to have piloted the tool in schools in 12 municipalities and have initial feedback from teachers and school leaders as to the user experience, feasibility and desirability of the tool.

The Numeracy at Scale study was designed to identify and examine aspects of successful numeracy programs, to provide policy makers and development practitioners with evidence-based strategies for improving numeracy instruction and learning outcomes across contexts. To this end, the study team identified and analyzed six programs across five countries that had rigorous evidence of impact on numeracy learning outcomes and which were operating at scale or which showed the potential for scale in an entire region or country. In each country, the study teams carried out a mixed-methods study including quantitative observations and interviews conducted in 80 to 130 schools per country; as well as qualitative observations and interviews in ten schools per country. The Numeracy at Scale study investigated two research questions addressed in this presentation: 1) What classroom ingredients (such as teaching practices and classroom environment) lead to learning in programs that are effective at scale? 2) What methods of training and support lead to teachers adopting effective classroom practices? The programs involved in this study are based in India, Jordan, El Salvador, Madagascar and South Africa. Two of the programs are government-led. The six Numeracy at Scale programs represent a variety of designs, from providing instruction to at-risk girls via interactive software to a national-scale numeracy initiative integrated into all public primary schools. Despite their differences, these programs share a large number of common elements. This presentation will provide an overview of the common pedagogical strategies found across these successful numeracy programs, such as use of multiple representations, discussion about mathematical concepts, and targeted support for students, as well as the approaches these programs used to support the development of these practices among teachers. Drawing from qualitative data, the paper will then discuss details of how these common elements were executed differently under different program models. Both the common, key elements and “differences in the details” that are found across these programs can generate helpful guidelines and ideas for how practitioners and governments can strengthen their own numeracy professional development approaches, across different operating contexts and program designs.

Too often, teachers are subject to top-down policies, procedures, and pedagogies that either bear little resemblance to their day-to-day experience or are so numerous as to be overwhelming in the face of their other responsibilities. When this occurs, teachers often resist these top-down approaches, instead opting to figure things out on their own, or creating their own hybrid approaches that are acceptable according to local social norms. For example, King and his colleagues (2022) found that while teachers adopted effective reading program content, they often retained their previous, less effective pedagogies; teachers utilized a heuristic short-cut requiring lower mental effort to implement the program while upholding social norms in the school. When teachers fail to adopt new and effective instructional reforms, learners don’t access the benefits of the improved instruction and the impact on learning outcomes is minimized. This situation may explain findings from Nepal, Nigeria, Uganda and Kenya, where 80% of the impact from early grade reading (EGR) interventions is explained by just 13% to 34% of schools, depending on the country context (King et al., 2022). What can be done to increase the uptake of interventions in LMICs? Research on educational change and the diffusion of innovation suggest peer-to-peer learning can be a powerful way to enhance the diffusion of information and provide the support teachers need to adopt new methodologies – and can be more effective than top-down approaches for changing behavior (Fullan, 2015; Daly et al., 2010). Through peer-to-peer interactions, individuals develop social capital, the resources through which information and trust are exchanged and can be called upon to support the successful adoption of innovation and new methodologies. We will present findings from a study (October 2022-September 2023) conducted in collaboration with USAID/Tanzania Jifunze Uelewe Project that seeks to better understand the ways in which teacher peer-to-peer transmission of information, ideas, and support in Tanzania harness that power of social capital to more efficiently diffuse effective pedagogies and support their application in the classroom. Utilizing social network analysis (SNA) combined with key informant interviews, we studied how teacher-influencers and the density of teacher social networks and formal school structures for teacher communication and collaboration (e.g., communities of practice) promote or impede adoption. In this presentation we will seek to accomplish the following objectives: Present findings on the role that teacher social networks and formal school structures for communication and collaboration can play in supporting or impeding uptake of education interventions. Provide a framework for practitioners to enhance teacher peer interactions within and across schools to improve the effectiveness and sustainability of education change innovations. By better understanding the mechanisms of teacher peer interactions and learning in LMICs – such as teacher social networks and formal structures for teacher communication and collaboration - the international education community will be in a better position to leverage these assets to advance the diffusion and support of education innovations in LMICs.

Presentation at CIES in March 2024.

Taken together, the case studies in this Report highlight the core components of an effective performance and accountability framework – a comprehensive system to optimize individual and system-wide performance through establishing outcome goals, tracking, and incentivizing progress against them The case studies show that effectiveness is not determined by implementing a set of individual policies, tools, and structures, but rather how they are collectively used to drive a culture that empowers its people to achieve a system’s ambitious agenda. The components of a performance and accountability framework that are featured in these case studies include: • System leadership that prioritizes a culture of high-performance around targets. • Outcome focused targets and supporting indicators that are well understood and communicated throughout the system, to define and quantify a system’s aspiration. • Quantitative data which is available and regularly shared across a system to gauge system performance, and to identify areas for additional focus or support. • Targeted and tailored support for system actors to help them improve performance, including a focus on specialized support for underperformers, driven by an understanding of data and evidence. • Performance routines and reporting with key system actors focused on reviewing progress, problem solving, and decision making to unlock barriers to improvement. • System engagement and site-visits/fieldwork that surfaces key challenges and opportunities to drive improvement. • Public engagement that keeps the public up to date on progress. Some of these components may require adaptation to different parts of the system. For example, targets may feature in performance agreements for senior leadership roles, but not for frontline staff who may be engaged in a more indirect way around targets (for example, communication of the reform with a focus on enhancing practice and improved outcomes). Similarly, formal performance routines that focus on a broader strategic reform are effective at driving a performance culture at senior levels, but not so for frontline staff who are rightly focused on teaching practice in their classroom. To be effective, embedding a performance and accountability culture across a system requires a nuanced and tailored application of these components to frontline staff, middle management, and senior levels.