PILOTING A NEW APPROACH - Teaching and Learning Materials Reach Uzbekistan's Classrooms

With a modern, robust new curriculum carefully prepared by local and international experts to meet the needs of Uzbekistan’s students, how would the Ministry of Preschool and School Education (MoPSE) ensure the effectiveness of textbooks and teacher guides in the classroom? The new teaching and learning materials (TLMs) created and customized by the USAID-funded Uzbekistan Education for Excellence Program in partnership with the MoPSE were developed through a multi-step, participatory process. Input from international experts and Uzbekistan primary teachers and academics grounded the modern methods and practices in the local context. To evaluate the use and value of these TLMs for students and educators, the Program led an extensive pilot initiative.

Education Reform Support Today

Traditional projects in education introduce innovations at the school level, sometimes improving learning in a defined number of schools. The hope is that somehow piloted successes can be replicated or taken to scale. But too often they are not. Dissatisfied with this, donors may choose policy-level interventions that promote resource reallocations, specific policy reforms, and investments in administrative and management capacity to effect system-wide change. But the record of policy reforms having impact on learning at the school level is disappointing. If we fund school-level projects, the challenge lies in how to create policy and institutional reforms that support replicable school-level success. If we support policy-level interventions, the challenge lies in how to ensure that national reforms lead to changes in the day-to-day practice of schools. Both approaches require effective programs of what we call reform support. Why is reform support needed? Ten years ago USAID published the Education Reform Support (ERS) series to answer just this question. ERS recognizes that the existing arrangements in the education sector—urban-rural inequities, management environments skewed by bureaucratic concerns, teaching improvements constrained by union prerogatives—are not accidental. Powerful political forces benefit from, shape, and defend the current situation. Changes within the system cannot realistically be implemented without first dealing with the preexisting institutional environment. Altering that environment means recognizing who stands to win or lose from pro-posed reforms, and what incentives signal them to either work for change or defend the status quo. The literature supporting such an understanding of education reform is rich. ERS draws on that literature and goes one step further to outline the tools and techniques for sup-porting and strategically managing the reform process.

Education system strengthening across Asia: a systematic review of USAID activities and critical discussion [CIES 2023 Panel Presentation]

The purpose of this formal group panel presentation is to hold an in-depth discussion on USAID’s investments into system strengthening across Asia over the past decade and how these efforts are situated within the broader global move to focus more intentionally and coherently on education system strengthening. The panel will discuss a 2022 empirical research study (the USAID System Strengthening Review, hereafter “the Review”) conducted by two international research organizations for the USAID Asia Bureau which reviews USAID system strengthening work in 11 Asian countries. This Review offers a qualitative evidence-based analysis relevant to the field of comparative and international education (CIE) and analyzes new data collected from a desk review of relevant project documents, reports, and evaluations, key informant interviews, multi-stakeholder survey, and three deep-dive case studies in Nepal, Cambodia, and the Philippines. The group panel will include three presentations on different aspects of the Review and include discussant commentary and critique to elicit group and audience discussion. The first panel presentation discusses a theoretical framework drawn from the RISE Programme (Pritchett 2015 and Spivak 2021) and recent analysis from the Brookings Institution’s Center for Universal Education. The Review’s central research questions are guided by these broader global trends, as well as its own analysis framework developed specifically for this study, discussed in Presentation 3. Conclusions are drawn based on this framework, and the overall discussion in Presentations 2 and 3 considers the context of USAID programming in Asia and how new knowledge provides new insights.

What have we learned about improving learning at the system level? [CIES 2023 Presentation]

This presentation, given at the CIES 2023 Annual Conference, highlights the global shift in measurement and improvement in learning outcomes since the adoption of SDG 4.1.1, under which countries are asked to report on the “the proportion of children and young people…achieving at least a minimum proficiency level in reading and mathematics”. Building on these results, the World Bank and UIS estimate that eighty percent of children in poor countries cannot read a simple sentence by the end of primary school. In reviewing the results of multiple regional and systems-level learning improvement programs to better understand the distribution of learning outcomes and system-level impact we find that: 1) while some progress has been made, the massive changes required to move the needle on the share of children reaching minimum proficiency remains elusive and 2) a small share of schools account for the majority of the gains. Finally, the panelist will create a link between this challenge and the theme of the panel; that education change will only be successful if work is undertaken to better understand and diminish the restraining forces of mindsets and education system social norms.

Sustaining and Extending Reading Improvements in Liberia

Read Liberia has had considerable positive impact on students’ reading performance. This success story outlines the key activities Read Liberia has undertaken with the MOE to sustain EGR results beyond the life of the Activity.

Doing Reform Differently: Combining Rigor and Practicality in Implementation and Evaluation of System Reforms

This paper brings together two promising intellectual trends in development: Doing Development Differently (DDD), and whole-system reform. In addition, it provides a framework for evaluating system reforms, as rigorously as possible. This paper adapts some concepts from the paper “A Practical Approach to In-Country Systems Research” written for the Research on Improving Systems of Education (RISE) Programme. This version turns more toward the Doing Development Differently movement rather than education systems reform. The original paper was presented at the first RISE conference in Washington, DC, June 18–19, 2015.

Strengthening institutional capacity to produce learning at scale: Case studies from Jordan, Malawi, Nepal, and Uganda

Case studies of RTI's work on strengthening institutional capacity in Nepal, Jordan, Malawi, and Uganda focusing on three core functions: (1) setting and communicating expectations; (2) monitoring against expectations; (3) providing targeted support to struggling schools.

Comprehensive Rapid Literacy Assessment [CIES Presentation]

The CRLA was initially conceived as a 5-minute start-up reading assessment designed to help teachers quickly determine the reading profiles of their G1-G3 learners, and develop appropriate reading instructional strategies. The main goal is to identify children who need additional support in reading. The CRLA was developed in response to the extended break that learners experienced over the summer of 2020 due to the pandemic. After 32 weeks of no class, teachers needed a rapid, easy to use tool, to determine what level of readiness and support the returning children needed. The beginning of school year tasks focused on letter sounds, isolated words and sentence in reading in MT (G1), Filipino (G1-G2) and English (G1-G3). In the Philippines, learners are expected to transition from their mother tongue (MT) to Filipino and English (L2 and L3 respectively) by grade 4. However, the earliest standardized assessment used in the Philippines is for Filipino starting in G3 and English starting in G4. Prior to the CRLA, there were no existing standardized tools or systems used to assess in the MT. It was also a tool that could be administered remotely (online or even over the phone) which proved critical for schooling in the new normal where face to face classes were not permitted. Thus, the CRLA met the needs of teachers who were missing such a tool in their early grade assessment toolbox. The CRLA was initially piloted in November 2020 with select schools. The experience of the pilot led DepEd to scale up the CRLA to all schools in the ABC+ Target Regions. The feedback from the schools and teachers who utilized the CRLA was encouraging. Many schools used the results of the CRLA to develop remedial and focused reading programs in the context of the new normal and identify the struggling readers to provide additional support. Based on the success of the beginning of school year RLA, the Department of Education requested ABC+ to help develop middle and end of year assessments that would align to their curricular competencies. Keeping to the same criteria (rapid and easy to administer and analyze), the team incorporated listening comprehension, oral reading fluency and reading comprehension tasks for end of year administration. At the request of DepEd, ABC+ is currently in the process of expanding the number of MT languages supported by the CRLA and incorporating it into their operations manual for mother tongue-based multi-lingual education.

System Supports for Effective Large-Scale Reading Interventions (Learning at Scale)

Learning outcomes are low and instruction is poor in many low- and middle-income countries (LMICs). These shortcomings are particularly concerning given the substantial learning loss due to COVID-19 from which many systems are suffering. The Learning at Scale study identified eight of the most effective large-scale education programs in LMICs and now is examining what factors contribute to successful improvements in learning outcomes at scale (see list of programs on last page of this brief). These programs were selected based on their demonstrated gains in reading outcomes at-scale, from either midline or endline impact evaluations. The study addresses three overarching research questions, focused on understanding (1) the components of instructional practices (Brief 1), (2) instructional supports (Brief 2), and (3) system supports (Brief 3) that lead to effective instruction. This brief focuses specifically on system supports. It addresses the following research question: What system supports are required to deliver effective training and support to teachers and to promote effective classroom practices?

Instructional Support for Effective Large-Scale Reading Interventions (Learning at Scale)

Learning outcomes are low and instruction is poor in many low- and middle-income countries (LMICs). These shortcomings are particularly concerning given the substantial learning loss due to COVID-19 from which many systems are suffering. The Learning at Scale study identified eight of the most effective large-scale education programs in LMICs and now is examining what factors contribute to successful improvements in learning outcomes at scale (see list of programs on last page of this brief). These programs were selected based on their demonstrated gains in reading outcomes at-scale, from either midline or endline impact evaluations. The study addresses three overarching research questions, focused on understanding (1) the components of instructional practices (Brief 1), (2) instructional supports (Brief 2), and (3) system supports (Brief 3) that lead to effective instruction. This brief focuses specifically on instructional supports. It addresses the following research question: What methods of training and support lead to teachers adopting effective classroom practices in successful, large-scale literacy programs?

Pages