Reports

This reference document is a companion to the Language Complexity Study conducted by RTI International under the All Children Reading–Philippines project in 2020. The study was a secondary analysis of Early Grade Reading Assessment (EGRA) data at multiple time points, looking specifically at the effect of language complexity on reading acquisition of second and third languages (L2 and L3, respectively). The study used the 2013 and 2019 National EGRA data sets to analyze performance according to categories of language complexity based on syllabic complexity, orthographic depth, and other related items. The study was guided by the methodology described by Brunette et al. (2019), who studied the effects of language complexity on reading outcomes in Uganda. The languages selected for analysis were those among the officially supported mother tongue (MT) languages of instruction in the Philippines. Analysts assessed whether the level of complexity was in any way predictive of the average increase or decrease in L2 and L3 scores across schools as measured in 2019 (provided there were schools that reported using MT in 2019, which was not the case for three of the languages: Chavacano, Ivatan, and Sambal.

The purpose of this activity was to develop and pilot a CB-EGRA in the Khmer language for validation and use in Cambodia. The CB-EGRA is a paper-based assessment that can be administered with little training to a group of students at one time. It is therefore an arguably more efficient and cost-effective method of obtaining early grade reading data, compared to a traditional EGRA.

Taken together, the case studies in this Report highlight the core components of an effective performance and accountability framework – a comprehensive system to optimize individual and system-wide performance through establishing outcome goals, tracking, and incentivizing progress against them The case studies show that effectiveness is not determined by implementing a set of individual policies, tools, and structures, but rather how they are collectively used to drive a culture that empowers its people to achieve a system’s ambitious agenda. The components of a performance and accountability framework that are featured in these case studies include: • System leadership that prioritizes a culture of high-performance around targets. • Outcome focused targets and supporting indicators that are well understood and communicated throughout the system, to define and quantify a system’s aspiration. • Quantitative data which is available and regularly shared across a system to gauge system performance, and to identify areas for additional focus or support. • Targeted and tailored support for system actors to help them improve performance, including a focus on specialized support for underperformers, driven by an understanding of data and evidence. • Performance routines and reporting with key system actors focused on reviewing progress, problem solving, and decision making to unlock barriers to improvement. • System engagement and site-visits/fieldwork that surfaces key challenges and opportunities to drive improvement. • Public engagement that keeps the public up to date on progress. Some of these components may require adaptation to different parts of the system. For example, targets may feature in performance agreements for senior leadership roles, but not for frontline staff who may be engaged in a more indirect way around targets (for example, communication of the reform with a focus on enhancing practice and improved outcomes). Similarly, formal performance routines that focus on a broader strategic reform are effective at driving a performance culture at senior levels, but not so for frontline staff who are rightly focused on teaching practice in their classroom. To be effective, embedding a performance and accountability culture across a system requires a nuanced and tailored application of these components to frontline staff, middle management, and senior levels.

In Year 2 (October 2020–September 2021), the Program designed and implemented a Status of Instruction Study (SIS) to shed light on teachers’ knowledge, attitudes and beliefs, skills, and behaviors; the resources available at the school level and for the targeted subjects; and how these resources are used. The Program also designed a Teacher Support System Study (TSSS) to examine the existing teacher support system and identify teacher support challenges and opportunities. The TSSS results will be used to create a Program TPD approach. The TSSS data collection process was integrated into the second phase of the SIS data collection process, which occurred in mid-2021. This was done because both studies targeted the same respondents: teachers, school directors, and methodologists. The TSSS, like the SIS, was originally intended to include in-person interviews. However, because of the prolonged difficulties caused by the coronavirus disease 2019 (COVID-19) pandemic, data collection was done remotely. This report presents the TSSS methodology and findings from online surveys administered to more than 4,100 teachers, 183 school directors, and 131 methodologists from all regions of Uzbekistan, including the Republic of Karakalpakstan and Tashkent City.

The Status of Instruction Study (SIS) aims to shed light on teachers’ knowledge, attitudes and beliefs, and skills and behaviors; the resources available at the school level and for the targeted subjects; and how these resources are used. The SIS was designed to inform the customization and development of student textbooks, teacher guides, and TPD approaches. Originally, the SIS was to have a school-based data collection component that would include classroom observations and parent and teacher interviews. Given the protracted challenges resulting from the coronavirus disease 2019 (COVID-19) pandemic, data collection was conducted remotely and focused on garnering feedback directly from teachers. As such one limitation of this study is that all data are self-reported without additional means of triangulation or confirmation at this point in time. This report presents the SIS methodology and findings from online surveys administered to more than 9,400 teachers from all regions of Uzbekistan, including the Republic of Karakalpakstan and Tashkent City.

This first phase of this Teacher Guide Uptake Study (TGUS I) examines teachers’ use of TGs and application of student-centered teaching strategies to provide targeted feedback for the revision of the TGs. The second phase of the TGUS will continue to examine the adoption of the new ICT and EFL teaching materials as part of the pilot process. PURPOSE- The purpose of this first phase study is to determine what changes and adaptations, in terms of content, classroom instruction, and design, should be made to ICT and EFL TGs.

This report presents the findings of a deep dive impact evaluation of the United States Agency for International Development (USAID) Uzbekistan Education for Excellence Program (The Program), which was initiated on December 9, 2019, and originally scheduled to end on December 8, 2023, then extended through March 31, 2024. The Program is implemented by a consortium of partners including RTI International (RTI) as the consortium lead and Florida State University and Mississippi State University as partners. For this report, the Program used a comparative analysis of Early Grade Reading and Mathematics Assessments (EGRA and EGMA, respectively) administered at baseline in 2021 and at endline in 2023. The Program evaluation focused on students in grades 2 and 4. In November and December of the 2021-22 school year, the baseline EGRA and EGMA were administered to students who completed grades 2 and 4 and had been in grades 3 and 5 for three months. The endline assessments were administered to students in grades 2 and 4 in May of 2023, a few weeks prior to the end of that school year. This meant that students at endline were being assessed after having completed 68 fewer days of schooling than those who were assessed at baseline.

The United States Agency for International Development's (USAID's) Bureau for Asia conducted a strategic review to examine the depth and breadth of USAID higher education (HE) programming in Asia over the five-year period from 2016 through 2021. The review highlights ways in which USAID's HE programming has been a vehicle for all sectors, not only education, to achieve USAID development objectives. The review's findings and recommendations should inform continued USAID HE investment in Asia. USAID investments in HE support the 2022 lndo-Pacific Strategy (IPS). Within USAID and the interagency, there is a growing interest in HE programming opportunities. This recognition of the role of HE in driving economic development is reflected in its inclusion in the lndo-Pacific Strategy of the United States (White House, 2022), which highlights education as key to regional economic prosperity and security, as well as regional resilience to transnational threats. Unlike in previous strategies, HE is now explicitly noted in the 2022 version of the strategy as a vehicle to advance the United States Government's (USG's) vision for a "free and open lndo-Pacific" (p. 6). This review details examples of how USAID HE investments could support the IPS by countering malign influence, strengthening democratic systems, conducting cutting-edge research to fight the COVID-19 pandemic, and building diverse and equitable partnerships between U.S. and Asian partners. USAID is forging lasting transpacific partnerships through HE investments. In 2021, this engagement included partnerships among 270 higher education institutions (HEls) from across the region and with more than 20 HEls from across the U.S. Programs are aligned with USAID's Education Policy and achieving outcomes in all USAID sectors by "advancing knowledge and research; providing quality and relevant education and workforce training; and engaging and strengthening networks and communities" (Dockser et al., 2020, p. 5) in food security and agriculture; democracy, governance, and human rights; peace and security; economic growth and workforce development; and global health. These investments are advancing locally led development, producing the next generation of leaders, laying the groundwork for more resilient economies and future trade partners, and sustainably advancing American values in a region wary of malign influence.

The conventional ways that new pedagogies are taught and supported in low- and middle-income countries rarely leverage the social networks and relationships that are paramount for individuals to shift their beliefs and make positive decisions about adopting new methodologies, and for them to sustain these behavior changes in the long run. The purpose of this study was to apply social network analysis (SNA) and qualitative inquiry to understand the composition and structure of primary school teacher social networks to inform policy basic education programming about how to improve the diffusion and support for implementation of new pedagogies through these social networks. This study used a mixed model design to study the compositional and structural properties of teacher social networks in sub-district administrative areas or “wards” in Tanzania. Using data from completed socio-metric inventories, separate teacher social networks were generated for Mbawala, Madimba, Milangominne, and Nitekela wards in the Mtwara Region of Tanzania. Researchers used SNA to calculate quantitative measurements and generate teacher sociograms (i.e., network graphs) for each of the ward-level teacher social networks. We combined these data with data from teacher informant interviews that described the content, context, and benefit of educators’ interactions in the different wards and to help explain the SNA findings.