Peer-to-Peer Learning: The Power of Social Networks in Adoption of New Pedagogies [CIES 2024 Presentation]

Too often, teachers are subject to top-down policies, procedures, and pedagogies that either bear little resemblance to their day-to-day experience or are so numerous as to be overwhelming in the face of their other responsibilities. When this occurs, teachers often resist these top-down approaches, instead opting to figure things out on their own, or creating their own hybrid approaches that are acceptable according to local social norms. For example, King and his colleagues (2022) found that while teachers adopted effective reading program content, they often retained their previous, less effective pedagogies; teachers utilized a heuristic short-cut requiring lower mental effort to implement the program while upholding social norms in the school. When teachers fail to adopt new and effective instructional reforms, learners don’t access the benefits of the improved instruction and the impact on learning outcomes is minimized. This situation may explain findings from Nepal, Nigeria, Uganda and Kenya, where 80% of the impact from early grade reading (EGR) interventions is explained by just 13% to 34% of schools, depending on the country context (King et al., 2022). What can be done to increase the uptake of interventions in LMICs? Research on educational change and the diffusion of innovation suggest peer-to-peer learning can be a powerful way to enhance the diffusion of information and provide the support teachers need to adopt new methodologies – and can be more effective than top-down approaches for changing behavior (Fullan, 2015; Daly et al., 2010). Through peer-to-peer interactions, individuals develop social capital, the resources through which information and trust are exchanged and can be called upon to support the successful adoption of innovation and new methodologies. We will present findings from a study (October 2022-September 2023) conducted in collaboration with USAID/Tanzania Jifunze Uelewe Project that seeks to better understand the ways in which teacher peer-to-peer transmission of information, ideas, and support in Tanzania harness that power of social capital to more efficiently diffuse effective pedagogies and support their application in the classroom. Utilizing social network analysis (SNA) combined with key informant interviews, we studied how teacher-influencers and the density of teacher social networks and formal school structures for teacher communication and collaboration (e.g., communities of practice) promote or impede adoption. In this presentation we will seek to accomplish the following objectives: Present findings on the role that teacher social networks and formal school structures for communication and collaboration can play in supporting or impeding uptake of education interventions. Provide a framework for practitioners to enhance teacher peer interactions within and across schools to improve the effectiveness and sustainability of education change innovations. By better understanding the mechanisms of teacher peer interactions and learning in LMICs – such as teacher social networks and formal structures for teacher communication and collaboration - the international education community will be in a better position to leverage these assets to advance the diffusion and support of education innovations in LMICs.

Jordan - Arriving at a National Scale CPD Program [CIES 2024 Presentation]

It was only over a decade ago that data on dismal learning outcomes in low- and middle-income countries (LMICs) shook the international education field out of its complacency with rising enrollment rates. The organizations and researchers that led this protest catalyzed a global shift toward prioritizing effective learning as the ultimate goal of education. However, acts of protest or disruption occur in a single point in time, whereas the transformations they advocate for are the labor of many years. Such is the case of the call to action to address the learning crisis. In the past decade, donor agencies like USAID have partnered with ministries of education in LMICs to design and implement programs at scale based on evidence of what works to improve foundational skills. A recent retrospective on the past ten years of USAID early grade reading programming (EnCompass LLC & MCI [2021]. Ten Years of USAID Early Grade Reading Programming: A Retrospective) estimates that USAID programs have improved reading outcomes for more than 7 million children and acknowledges tangible progress in the agency and its partners’ understanding of effective early reading instruction. The study also found that despite significant accomplishments, even the best-designed programs were hindered in their effectiveness by factors related to education systems’ low capacity to implement best practices at scale. Similarly, the Learning at Scale study, funded by the Bill & Melinda Gates Foundation, is examining some of the most effective large-scale early learning programs of the last ten years to understand the elements of their success. Learning at Scale researchers point out that improving learning at scale is hard because it usually requires working through the complex realities of government systems. Therefore, while the first chapter of the “learning crusade” yielded important lessons on what works to improve learning, there is still a lot to be learned about how to apply this knowledge to build effective government systems that ensure learning for all children. Case in point are government systems for continuous teacher professional development (TPD). It is well-known that better teaching is one of the fundamental interventions for improved learning outcomes. There is also a growing evidence base on the characteristics of effective TPD programs, as curated through initiatives like Learning at Scale and The Science of Teaching, also funded by the Gates Foundation. Among these characteristics are trainings that emphasize practice over theory and coaching programs based on structured coaching tools and frequent interaction with teachers. Another teacher support element that can be important to program success is school-based teacher communities-of-practice, which enable peer-to-peer feedback and opportunities to reflect on the ongoing application of instructional approaches. Both Learning at Scale and the retrospective study on USAID early reading programming observe a trend toward shorter but more frequent teacher training events that take place at the local level, in contrast to the massive national trainings of the past. The use of online content for teacher training is also on the rise, though preliminary findings from Learning at Scale suggest that an initial face-to-face training event continues to be essential. However, being able to identify the ingredients of effective teacher support does not automatically equate with an understanding of how to build a continuous TPD system that incorporates them. Neither does it mean that a TPD system built entirely on evidence-based best practices is guaranteed to succeed in improving learning outcomes. As more LMICs advance toward instituting standards and structured career ladders for the teaching profession, and toward developing mechanisms to increase the equity and efficiency of teacher training and support, it becomes increasingly important to identify effective models for implementing continuous TPD at scale. the panel will feature a USAID program in Jordan that exemplifies the desired result: a national-scale, comprehensive TPD model that is aligned with a broader policy on the teacher career path and is linked to a robust assessment data system that reinforces accountability for learning. It is the only program with solid evidence of positive changes in teaching practices that led to significant improvements in student outcomes.

Implementing a new teacher professional development system in Tanzania: old habits die hard [CIES 2024 Presentation]

In Tanzania, learning outcomes in early grades have remained stubbornly below expectations. Over a decade ago, the Tanzanian Institute for Education recognized that the curriculum for foundational learning needed to change. Textbooks were updated to reflect a more phonics-based strategy and the existing teacher workforce needed to be re-skilled. The Ministry of Education developed a framework for Continuous Professional Development for Practicing Teachers which focused on close-to-school delivery of new professional content. Unfortunately, the framework was not fully implemented, and instead large-scale face-to-face trainings remained the norm. Two USAID early learning programs at scale in Tanzania (one implemented from 2016 to 2021 and one that is currently ongoing) have focused on implementing the Ministry’s teacher professional development (TPD) framework to overcome three significant challenges: (i) ensuring that content did not get diluted by face-to-face cascade training; (ii) providing an incentive for teachers to apply content; (iii) ensuring that content could be adapted to context. Change is disruptive; old habits die hard – more so when there are financial incentives to retain the status quo. Moving from large scale ineffective face-to-face programs to a more holistic localized approach to TPD was met with protest and it has taken time to overcome the resistance from teachers. The first program adopted cluster-based delivery of training, with 4-5 schools in a cluster and local administrators or head teachers delivering the abbreviated training. Teachers no longer received per diems for attending centralized training. The cluster-based training was extended down to school-based communities of learning. These sessions provided an opportunity for teachers to share how they implemented new strategies in their classrooms – they provided contextualization to the content. However, not all schools or clusters had teachers who were able to adapt the content. The program introduced the idea of coaching, initially by Ward Education Officers (WEO) and then by head teachers, exemplary teachers, and eventually, peers. This allowed more experienced and knowledgeable colleagues to observe a teacher and provide feedback through a constructive dialogue. Because coaching is unfamiliar to the administrative structure in Tanzania it had to be included in the job descriptions of administrators and included in staff annual performance assessments. Despite initial resistance, this process has provided a clear incentive for teachers to apply the content that is administered in the training. Finally, to ensure training is not diluted in the translation through cascades, the follow-on USAID program introduced virtual delivery of key messages. To accommodate teachers with feature phone capabilities only, teachers access content through interactive voice instruction, calling a toll-free number and selecting to listen to a 2 minute “lesson”. With WEO support, over 90% of teachers complete a 5-lesson course. The course is aligned to content discussed at the Community of Learning and is reinforced through classroom observations. Using data collected at the beginning and end of each school year for the past two years, we show how this holistic approach to delivering professional development content has led to improved teaching practice and this in-turn has contributed to improved learning outcomes.

Teacher’s Guide for Remote Learning During School Closures and Beyond (Filipino)

Over 91% of the total student population worldwide has been affected due to school closures caused by COVID-19, according to UNESCO. How can the system ensure education of the country that every student has equal access to quality education during the crisis? Important role of teachers. Help students cope with and understand the uncertainty caused by the pandemic. Encourage students to continue learning despite the closure of schools. This guide is for teachers. Support to students needs to continue while physical attendance at schools is completely or partially prohibited. Able to engage their students in various distance learning methods.

Improving Learning Outcomes for the Philippines - Strengthening performance management: Case studies and key insights

Taken together, the case studies in this Report highlight the core components of an effective performance and accountability framework – a comprehensive system to optimize individual and system-wide performance through establishing outcome goals, tracking, and incentivizing progress against them The case studies show that effectiveness is not determined by implementing a set of individual policies, tools, and structures, but rather how they are collectively used to drive a culture that empowers its people to achieve a system’s ambitious agenda. The components of a performance and accountability framework that are featured in these case studies include: • System leadership that prioritizes a culture of high-performance around targets. • Outcome focused targets and supporting indicators that are well understood and communicated throughout the system, to define and quantify a system’s aspiration. • Quantitative data which is available and regularly shared across a system to gauge system performance, and to identify areas for additional focus or support. • Targeted and tailored support for system actors to help them improve performance, including a focus on specialized support for underperformers, driven by an understanding of data and evidence. • Performance routines and reporting with key system actors focused on reviewing progress, problem solving, and decision making to unlock barriers to improvement. • System engagement and site-visits/fieldwork that surfaces key challenges and opportunities to drive improvement. • Public engagement that keeps the public up to date on progress. Some of these components may require adaptation to different parts of the system. For example, targets may feature in performance agreements for senior leadership roles, but not for frontline staff who may be engaged in a more indirect way around targets (for example, communication of the reform with a focus on enhancing practice and improved outcomes). Similarly, formal performance routines that focus on a broader strategic reform are effective at driving a performance culture at senior levels, but not so for frontline staff who are rightly focused on teaching practice in their classroom. To be effective, embedding a performance and accountability culture across a system requires a nuanced and tailored application of these components to frontline staff, middle management, and senior levels.

Uzbekistan Teacher Support System Study

In Year 2 (October 2020–September 2021), the Program designed and implemented a Status of Instruction Study (SIS) to shed light on teachers’ knowledge, attitudes and beliefs, skills, and behaviors; the resources available at the school level and for the targeted subjects; and how these resources are used. The Program also designed a Teacher Support System Study (TSSS) to examine the existing teacher support system and identify teacher support challenges and opportunities. The TSSS results will be used to create a Program TPD approach. The TSSS data collection process was integrated into the second phase of the SIS data collection process, which occurred in mid-2021. This was done because both studies targeted the same respondents: teachers, school directors, and methodologists. The TSSS, like the SIS, was originally intended to include in-person interviews. However, because of the prolonged difficulties caused by the coronavirus disease 2019 (COVID-19) pandemic, data collection was done remotely. This report presents the TSSS methodology and findings from online surveys administered to more than 4,100 teachers, 183 school directors, and 131 methodologists from all regions of Uzbekistan, including the Republic of Karakalpakstan and Tashkent City.

Uzbekistan Status of Instruction Study Round 1

The Status of Instruction Study (SIS) aims to shed light on teachers’ knowledge, attitudes and beliefs, and skills and behaviors; the resources available at the school level and for the targeted subjects; and how these resources are used. The SIS was designed to inform the customization and development of student textbooks, teacher guides, and TPD approaches. Originally, the SIS was to have a school-based data collection component that would include classroom observations and parent and teacher interviews. Given the protracted challenges resulting from the coronavirus disease 2019 (COVID-19) pandemic, data collection was conducted remotely and focused on garnering feedback directly from teachers. As such one limitation of this study is that all data are self-reported without additional means of triangulation or confirmation at this point in time. This report presents the SIS methodology and findings from online surveys administered to more than 9,400 teachers from all regions of Uzbekistan, including the Republic of Karakalpakstan and Tashkent City.

ICT and EFL Teacher Guide Uptake Study - Uzbekistan UEEP

The Uzbekistan Education for Excellence Program (the Program), funded by the United States Agency for International Development (USAID), designed the Information and Communication Technology (ICT) and English as a Foreign Language (EFL) Teacher Guide Uptake Study (TGUS) to determine teachers’ uptake of new teacher guides (TGs), teachers’ application of student-centered strategies, and the appropriateness of the design of the TGs themselves. The Program used the results and ensuing recommendations to inform the development and finalization of its teacher professional development efforts and TGs, respectively.

A Tool for Evaluating Teacher Performance for the First Three Grades in Arabic Language and Mathematics in Distance Education

A tool for evaluating teacher performance for grades 1-3 mathematics education in Arabic language in distance education.

A Classroom Observation Tool for the First Three Grades in Arabic and Mathematics

Classroom observation tool for grades 1-3 mathematics education in Arabic.

Pages