The USAID Leading Through Learning Global Platform (LTLGP) and USAID Improving Learning Outcomes for Asia (ILOA) presented a panel at the 2024 CIES Conference on what each project has been learning about establishing and implementing learning networks. Presentations from three USAID learning networks (HELN, GRN, ECCN) and one regional hub managed by LTLGP along with a presentation from ILOA discuss how each learning network utilizes collaboration, learning, and adapting (CLA) to assess how well their networks are reaching and meeting the needs of their members and how they have adapted and adjusted their networks based on CLA fedback.

The theme of CIES asks our society of academics and practitioners to confront the ways in which education is a space of debate and contestation, and how stakeholders both internal and external to education systems seek to effect change (or maintain the status quo). The behavioral science perspective is not new to international education. It has often been presented from different research perspectives, including teacher mental models of teacher beliefs (Saberwal et. al., 2018), and the social aspects of educational change (Fullan, 2015). However, recent interest has shifted focus on the understanding of education systems change using a behavioral science lens (Ajani 2022). This perspective is important as education systems programming is frequently designed without a true understanding of how individuals will respond to change (Jeevan and Hwa, 2022). The presentations present studies which examine teachers, caregivers, and instructional practice and change within an education system. What new insights do we have and how might they influence policy and implementation for education systems change? This deck includes the following presentations and authors: From access to learning to nudging: Why behavioral science might be the next new best thing in education improvement programs (Amber Gove, RTI International), More of this and less of that: How a behavioral science lens suggests alternative approaches to education program design & implementation (Simon King, Creative Associates), Peer-to-Peer Learning: The Power of Social Networks in Adoption of New Pedagogies (Elizabeth Marsden, RTI International), and Supporting Caregivers of Young Children in South Africa to Engage in Play (Carolina Better, Ideas42).

The Mathematics Knowledge for Teaching (MKT) is a short survey (23 items) that measures primary grade teacher knowledge by a) math domains and b) pedagogical and content knowledge. Math domain included Number Sense, Operations, Geometry, and Measurement. Pedagogical knowledge was measured by problems that measured teacher understanding of Developmental Progression, Scaffolding, and Content knowledge. In this presentation, we will discuss the process of developing the MKT survey, highlight exemplary results from the Kyrgyz Republic, and then discuss the various uses of this survey. The MKT survey build from previous work in measurement of teachers’ MKT in the United States and other countries (Ball et.al., 2008; Cole, 2012). Our goal was to create an instrument that focused on the early primary grade and was easily adaptable to multiple contexts. To do this, we created an initial instrument, conducted cognitive interviews with math and learning experts form several countries, and then conducted a pilot in the Kyrgyz Republic and Nepal. In Kyrgyz Republic, the MKT test was administered to 323 primary grade teachers in 30 pilot schools as a pre-post training survey as part of the USAID Okuu Keremet! The survey was administered online in two languages. Analysis of pre-post test showed that the survey was effective in detecting changes in teacher knowledge across all math domains and pedagogical and content knowledge areas. In Nepal, we conducted cognitive interviews with teachers, providing additional insights into how teachers were thinking about early math knowledge. Finally, we conclude with the different potential uses for this survey, such as diagnosing and measuring changes in teacher knowledge over time and using it as professional development tool to develop teacher knowledge. We will discuss implications for the use of this tool for the wider development audience.

The purpose of this formal group panel presentation is to hold an in-depth discussion on USAID’s investments into system strengthening across Asia over the past decade and how these efforts are situated within the broader global move to focus more intentionally and coherently on education system strengthening. The panel will discuss a 2022 empirical research study (the USAID System Strengthening Review, hereafter “the Review”) conducted by two international research organizations for the USAID Asia Bureau which reviews USAID system strengthening work in 11 Asian countries. This Review offers a qualitative evidence-based analysis relevant to the field of comparative and international education (CIE) and analyzes new data collected from a desk review of relevant project documents, reports, and evaluations, key informant interviews, multi-stakeholder survey, and three deep-dive case studies in Nepal, Cambodia, and the Philippines. The group panel will include three presentations on different aspects of the Review and include discussant commentary and critique to elicit group and audience discussion. The first panel presentation discusses a theoretical framework drawn from the RISE Programme (Pritchett 2015 and Spivak 2021) and recent analysis from the Brookings Institution’s Center for Universal Education. The Review’s central research questions are guided by these broader global trends, as well as its own analysis framework developed specifically for this study, discussed in Presentation 3. Conclusions are drawn based on this framework, and the overall discussion in Presentations 2 and 3 considers the context of USAID programming in Asia and how new knowledge provides new insights.

In 2014, the Nepal Ministry of Education, Science, and Technology (MOEST) developed a National Early Grade Reading Program (NEGRP), aimed at improving the reading achievement of early-grade students throughout Nepal. USAID has supported the government’s efforts to improve early-grade reading under NEGRP through both Government-to-Government funding and through the Early-Grade Reading Program (EGRP) I & II from 2015-2022. The NEGRP focused on evidence-based pillars for foundational literacy: Curriculum and materials, Teacher training and ongoing support, Community Mobilization, Assessment, and Systems strengthening. This paper will focus on the teacher ongoing support pillar of NEGRP and describe how processes of Monitoring, Evaluation, Research, Learning and Adaptation informed the evolution of the Ministry’s Teacher Professional Support System. EGRP & EGRP II were implemented in the context of Nepal’s transition to federalism, which began following the ratification of its constitution in 2015. This resulted in a situation where roles and responsibilities within the education system were in flux and authority for decision-making and funding shifted to the local level. Thus, implementation decisions had to recognize and adjust to a context in-flux. From the outset of NEGRP, the model for ongoing teacher support was based on evidence in the field on what works, with a heavy reliance on external coaches who could provide feedback and support to teachers on a regular basis. Challenges in the Nepal context, including the diversity of contexts within Nepal, as well as the changes taking place due to federalism, made it apparent that adjustments would be needed. As a result, EGRP supported the MOEST to undertake the first implementation research study, which supplemented Monitoring and Evaluation data to identify the strengths and weaknesses of the teacher support model, as well as to identify possible alternatives. A second iteration of the government’s model for Teacher Professional Support was developed based on the findings from this learning and joint reflection by stakeholders, government officials, and project staff – together with the continuing evolution around teacher learning and support in the field more broadly. A second round of monitoring, learning, and operational research enabled EGRP and MOEST to further hone the model – as well as to provide needed further adjustments to align with the newly federalized system as it evolved. Based on those findings and joint reflection, GoN developed a Teacher Professional Support that incorporates a flexible menu of options that enables local authorities to determine the combination of approaches that will be most suitable for their local context and to address local challenges. This paper will briefly present the iterations to the NEGRP ongoing teacher support model, explore the MERLA approaches that were used in this adaptive process and discuss lessons learned. The authors would then seek to engage the audience in discussion around the broader implications and pose the question: how can program design build in opportunities for this type of iterative learning from the outset?

Since 2010, USAID has increased funding to partner country institutions by 50% [1], and the current administration’s localization agenda suggests that the government-to-government (G2G) modality may be increasingly frequent. Implementing partners operating in countries with a G2G arrangement, must pay careful attention to the meaning of technical assistance and system strengthening for scale and sustainability. This topic was covered by three presentations in a panel session, including: (1) Driving government ownership of a new language policy through a Government-to-Government partnership: The case of Senegal; (2) Government-to-Government programs to improve student learning: The case of Nepal; and (3) The case of Jordan

This presentation, given at the CIES 2023 Annual Conference, highlights the global shift in measurement and improvement in learning outcomes since the adoption of SDG 4.1.1, under which countries are asked to report on the “the proportion of children and young people…achieving at least a minimum proficiency level in reading and mathematics”. Building on these results, the World Bank and UIS estimate that eighty percent of children in poor countries cannot read a simple sentence by the end of primary school. In reviewing the results of multiple regional and systems-level learning improvement programs to better understand the distribution of learning outcomes and system-level impact we find that: 1) while some progress has been made, the massive changes required to move the needle on the share of children reaching minimum proficiency remains elusive and 2) a small share of schools account for the majority of the gains. Finally, the panelist will create a link between this challenge and the theme of the panel; that education change will only be successful if work is undertaken to better understand and diminish the restraining forces of mindsets and education system social norms.

This presentation was given at the Comparative and International Education Society (CIES) annual conference in Washington, DC on February 21, 2023. The presentation describes a systematic research method used in USAID's Early Grade Reading Program II (EGRP II) in Nepal to analyze the alignment between the early grade reading curriculum, teacher instruction, and student assessment. The file includes both the presentation slides and the explanatory notes.

Case studies of RTI's work on strengthening institutional capacity in Nepal, Jordan, Malawi, and Uganda focusing on three core functions: (1) setting and communicating expectations; (2) monitoring against expectations; (3) providing targeted support to struggling schools.

Policy linking is a standard-setting methodology, long used in many countries, to set benchmarks (or cut scores) on learning assessments that allow those countries to determine what percentage of students in their country are meeting minimum proficiency requirements for key skills such as reading and math. While it is an old standard-setting methodology, its use has been extended to help countries set benchmarks that will allow reporting against global standards. Policy linking allows countries to use their existing national and/or regional assessments to report against Sustainable Development Goal (SDG) 4.1.1: “Proportion of children and young people in Grade 2 or 3 (4.1.1a), at the end of primary education (4.1.1b), and at the end of lower secondary education (4.1.1c) who achieve at least a minimum proficiency level in reading and mathematics.” It works by linking assessments to the Global Proficiency Framework (GPF), a framework developed by global reading and math content experts based on current national content and assessment frameworks across more than 25 countries. The GPF provides performance expectations/ standards for learners in Grades 1-9 in reading and mathematics. By linking existing national and regional assessments to the GPF, countries and donors are able to compare learning outcomes across language groups in countries as well as across countries and over time, assuming all new assessments are subsequently linked to the GPF. In this roundtable, we will share learning from policy linking work that has taken place this past year. Following a brief introduction to Policy Linking for Measuring Global Learning Outcomes by Dr. Saima Malik, from USAID in Washington DC, Dr. Asumpta Matei from the Kenya National Examinations Council and Dr. Enos Radeny of USAID Kenya will present the model of a Policy Linking workshop that was designed and implemented in order to build ministry capacity as well as set benchmarks for grades 2 and 3 in English and Kiswahili in Kenya, Dr. Abdullah Ferdous and Dr. Jeff Davis of AIR (co-developers of the policy linking approach) will discuss the importance of feedback in establishing defensible global benchmarks during the policy linking process and Dr. Jodie Fonseca from RTI will share practical example from Nepal where policy linking was used to align the national assessment to the Global Proficiency Framework and proved to be a more cost-effective way to measure early grade reading outcomes than an EGRA. Melissa Chiappetta of Sage Perspectives will serve as discussant of the panel.