The Improving Learning Outcomes for Asia (ILOA) regional project works closely with USAID’s Asia Bureau and Missions across the region to identify key questions and challenges Mission staff face in their day-to-day work. An advisory group of USAID Mission colleagues raised an important question: how best to wade through the array of education data available? What are the types, how are they used, when are different data useful, etc.? Indeed, the use of different data to effectively partner with governments to make evidence-based decisions is a top priority. As a result, ILOA produced a brief summarizing the different sources and uses of data for basic education, youth and workforce development, and higher education. The brief recognizes how data sources and uses have evolved over time, enabling ministries, their partners, and stakeholders to measure performance, inform policy and plan interventions, and manage limited resources. The brief is designed to succinctly assist USAID staff and their partners in navigating the world of education data.

The Ministry of Preschool and School Education (MoPSE) in Uzbekistan has set the goal of transforming the education system and improving English proficiency among secondary school graduates by 2030. To support this initiative, the Uzbekistan Education for Excellence Program, in collaboration with MoPSE, conducted a study in 2023 to assess the adoption and use of new English language teaching and learning materials in public schools during the 2022-2023 academic year. The study aimed to gather data to inform teacher professional development and effective utilization of the new textbooks for English language instruction in grades 1-11. To collect the necessary data, an online survey was administered from April 25 to May 20, 2023, targeting English teachers in grades 1-11 across all regions of Uzbekistan. The survey focused on teaching practices, instructional approaches, and the utilization of new materials and digital resources. The survey responses from 2,363 English teachers in public schools were analyzed using qualitative and quantitative descriptive statistics techniques. However, the survey process faced methodological challenges such as internet and computer access for some participants, varying levels of familiarity with responding to online surveys, and potential language barriers due to respondents' limited English proficiency. Additionally, the self-reported nature of the data introduced potential biases in the responses. The survey results revealed several important findings. Participating teachers expressed satisfaction with the new textbooks and reported positive changes in their teaching practices, as well as perceived improvements in student learning. However, challenges were identified, including limited textbook availability, time constraints in delivering certain activities suggested in the textbooks, technological barriers, and limited access to audio-visual equipment in classrooms. The integration of real-life contexts in the textbooks enhanced the overall learning experience. Based on these findings, recommendations were made to address the identified challenges and improve the adoption process, including providing guidance, addressing textbook availability, offering comprehensive teacher training, and establishing mechanisms for continuous review and student feedback. Implementing these recommendations might support the enhancement of English language instruction in Uzbekistan. In conclusion, the adoption of the Guess What! and Prepare series as new English language instructional materials in Uzbekistan's public schools has yielded positive results, as reported by participating teachers. The integration of these textbooks has brought about changes in teaching practices and perceived achievements of student learning outcomes. The survey results indicated a high level of teacher satisfaction with the Student's Books, Workbooks, and Teacher's Books, with the Workbooks receiving the highest satisfaction level at 83%. Moreover, over 67% of teachers acknowledged that the new textbooks had brought about a change in their approach to teaching English. Overall, the study highlights the positive influence of new instructional materials on English language instruction in the Republic of Uzbekistan. The successful integration of the Guess What! and Prepare series sets the stage for continuous progress in English language learning and teaching. It is crucial to build upon these findings and recommendations to further improve teaching practices, support teacher professional development, and ensure ongoing enhancement of English language instruction throughout the country.

This presentation summarizes the achievements, challenges, and recommendations from previous studies conducted as part of the Uzbekistan Education for Excellence Program. These studies focused on teacher professional development (TPD) and the implementation of innovative teaching practices in Uzbekistan's public schools. The Program conducted a multi-phased Status of Instruction Study (SIS) to gain insights into instructional resources and practices. The study collected feedback from teachers on resource usage, lesson planning, available resources in schools and classrooms, instructional techniques, and engagement in school based communities of practice. The findings influenced the customization and development of student textbooks, teacher's guides, and TPD approaches. The study used the Framework for Teaching (FFT) developed by The Danielson Group to guide the research and ensure consistency across subjects (ULA, Math, ICT, and EFL). SIS2, conducted online via Telegram channels shared by the Ministry of Preschool and School Education (MoPSE), employed a descriptive quantitative design considering the impact of COVID-19. In addition, the Program undertook the Teacher Support System Study (TSSS). The TSSS examined the existing teacher support system in Uzbekistan, including self-directed and school-level professional development activities. The study focused on instructional coaching, peer-to-peer support, and training. The studies used a combination of online surveys and in-person training sessions. Data from teachers, school directors, and methodologists were analyzed through descriptive quantitative and qualitative content analysis. The effectiveness of virtual training programs, the teacher support system, and the implementation of student textbooks and teacher guides were examined. Finally, the Program undertook the Teacher Guide Uptake Study (TGUS) augmenting the online SIS and TSSS surveys with classroom observations over a school year. Findings indicated a shift towards student-centered teaching approaches, but highlighted the need for lesson planning support, creative adaptation of teaching materials, and opportunities for instructional coaching and peer support. Recommendations included providing comprehensive teacher guides and online courses, improving assessment guidance, enhancing coaching processes, and utilizing existing collaboration platforms. The studies offer valuable insights into TPD and instructional practices in Uzbekistan's public schools. The presentation highlights lessons learned from combining online with classroom observation data over time.

This presentation summarizes the achievements, challenges, and recommendations from previous studies conducted as part of the Uzbekistan Education for Excellence Program. These studies focused on teacher professional development (TPD) and the implementation of innovative teaching practices in Uzbekistan's public schools. The Program conducted a multi-phased Status of Instruction Study (SIS) to gain insights into instructional resources and practices. The study collected feedback from teachers on resource usage, lesson planning, available resources in schools and classrooms, instructional techniques, and engagement in school based communities of practice. The findings influenced the customization and development of student textbooks, teacher's guides, and TPD approaches. The study used the Framework for Teaching (FFT) developed by The Danielson Group to guide the research and ensure consistency across subjects (ULA, Math, ICT, and EFL). SIS2, conducted online via Telegram channels shared by the Ministry of Preschool and School Education (MoPSE), employed a descriptive quantitative design considering the impact of COVID-19. In addition, the Program undertook the Teacher Support System Study (TSSS). The TSSS examined the existing teacher support system in Uzbekistan, including self-directed and school-level professional development activities. The study focused on instructional coaching, peer-to-peer support, and training. The studies used a combination of online surveys and in-person training sessions. Data from teachers, school directors, and methodologists were analyzed through descriptive quantitative and qualitative content analysis. The effectiveness of virtual training programs, the teacher support system, and the implementation of student textbooks and teacher guides were examined. Finally, the Program undertook the Teacher Guide Uptake Study (TGUS) augmenting the online SIS and TSSS surveys with classroom observations over a school year. Findings indicated a shift towards student-centered teaching approaches, but highlighted the need for lesson planning support, creative adaptation of teaching materials, and opportunities for instructional coaching and peer support. Recommendations included providing comprehensive teacher guides and online courses, improving assessment guidance, enhancing coaching processes, and utilizing existing collaboration platforms. The studies offer valuable insights into TPD and instructional practices in Uzbekistan's public schools. The presentation highlights lessons learned from combining online with classroom observation data over time.

The challenges of conducting educational assessments in low- and middle-income environments during the pandemic can be eased by AI-powered speech recognition technology that offers a promising solution to enhance assessments. By utilizing advanced algorithms and machine learning techniques, this technology accurately transcribes spoken language into written text. Reading fluency and comprehension can be efficiently measured by integrating AI speech recognition into assessments, without the need for physical presence. From the safety of their homes, students can perform the assessments using their smartphones or computers, assisting schools in organizing complex logistics. AI speech recognition technology has a great edge in providing instant feedback, which is one of its main benefits. While students are speaking out loud, the AI system can swiftly assess their intonation, pronunciation, and tempo, rendering quick guidance and identifying areas for refinement. This personalized feedback effortlessly assists students in boosting their reading abilities, even in the absence of in-person teacher interactions. Moreover, AI-backed evaluations can be carried out on a wider scale, enabling educators to collect extensive data on reading patterns and tackle specific issues that are commonly seen among students. The objective of this presentation is to feature the self-administered AI Speech recognition Computer-based reading assessment that RTI developed at the request of the Philippines Department of Education (DepEd), under the USAID All Children Reading (ACR). Throughout the school years of 2020-2022, the COVID-19 pandemic posed significant challenges to conducting face-to-face assessments, particularly in remote learning environments. As a result, teachers faced constraints in terms of time and resources to individually assess learners' reading skills against crucial learning competencies. The proposed automated assessment technology offered a potential solution to alleviate this burden and streamline the evaluation process, allowing educators to efficiently gauge students' reading abilities remotely. In February 2022, ACR-Philippines initiated discussions with USAID and the Philippines Department of Education (DepEd) to produce a ‘proof of concept’ that explores the feasibility of a self-administered computer-based reading assessment (CoBRA) in English and Filipino for students in the Philippines. The concept found resonance with the DepEd leadership as the adoption of a computer-based format for assessments aligns with international practices and provides an excellent opportunity to ascertain students' preparedness to take computer-based tests, such as the Program for International Student Assessment (PISA). The result of this intervention generated a prototype solution piloted and tailored to fit DepED's existing platforms for supporting remote learning and delivery. The pilot provided insights on the feasibility of a computer-based assessment in the context of the Philippines for students in grades 4 -6. The research findings examined the performance, reliability, and results of the AI Speech recognition technology reading assessment, compared to the assessor-administered approach of the assessment. The research generated key design considerations, feedback from end users, recommendations regarding implementing similar approaches, and the future development of similar technology for other languages within and outside the Philippines.

On mainland Tanzania, most resource allocation decisions are centralized. The President’s Office - Regional Administration and Local Government (PO-RALG) recruits and assigns teachers, supplies teaching and learning materials and funds capital construction projects. Local Governments are provided limited funds for training support or redeployment of teachers among schools. Their main resource, therefore, is to provide management attention and support to schools. With an average of 140 schools in a District and a staff of 5 individuals, only a few schools can be supported. In 2016, The Ministry of Education and Sports developed a School Quality Assurance Framework to guide local administrators on key areas of focus and guidance for school support. The framework focuses on six areas: school inputs, teacher practice, student learning outcomes, school environment, school leadership and community engagement. To facilitate the monitoring of these areas, USAID Tusome Pamoja project piloted a data collection tool that allowed measurement of progress through indicators. Of particular interest was the use of a group administered learning assessment that established benchmarks for success for grade 2 learners across six sub-tasks for reading, writing and mathematics. Due to limited resources, this assessment was only applied to a sample of schools in each district. Districts could assess their overall performance against these indicators and as a result developed somewhat generic district level support plans.. This presentation will explore how initial challenges of vague district plans were overcome through the critical data collection process leading to the establishment of benchmarks for success. o Under a subsequent activity, USAID Jifunze Uelewe, software was developed that allowed districts to capture group administered learning data for every grade 2 student and to aggregate this information at the school level. Districts were then able to rank order all schools in the district by scores on learning sub-tasks and then select the lowest performing schools for additional management attention. At the same time, districts were able to pair high-performing and low performing schools. The result of the access to school specific data was to allow districts to direct their attention to the development of plans at the school level to address low learning performance, and the ability to track progress of these schools over time. Schools enter data on Government provided tablets and the data can be synched when headteachers have access to Government provided wifi. Decentralized administrators have long been seen as critical for translating national policy into local action. However, they are frequently hampered by a combination of distracted management attention and unclear targets or benchmarks for key inputs, which encourages a laissez-faire status quo. In Tanzania, local governments in four regions have been able to contextualize data to meet their needs and use simple technology to prioritize their attention and decision-making. Our presentation showcases the significance of data driven decision making and continuous improvement of the system. We further highlight the important of simple and meaningful change and fostering proactive decision making at the local level.

It was only over a decade ago that data on dismal learning outcomes in low- and middle-income countries (LMICs) shook the international education field out of its complacency with rising enrollment rates. The organizations and researchers that led this protest catalyzed a global shift toward prioritizing effective learning as the ultimate goal of education. However, acts of protest or disruption occur in a single point in time, whereas the transformations they advocate for are the labor of many years. Such is the case of the call to action to address the learning crisis. In the past decade, donor agencies like USAID have partnered with ministries of education in LMICs to design and implement programs at scale based on evidence of what works to improve foundational skills. A recent retrospective on the past ten years of USAID early grade reading programming (EnCompass LLC & MCI [2021]. Ten Years of USAID Early Grade Reading Programming: A Retrospective) estimates that USAID programs have improved reading outcomes for more than 7 million children and acknowledges tangible progress in the agency and its partners’ understanding of effective early reading instruction. The study also found that despite significant accomplishments, even the best-designed programs were hindered in their effectiveness by factors related to education systems’ low capacity to implement best practices at scale. Similarly, the Learning at Scale study, funded by the Bill & Melinda Gates Foundation, is examining some of the most effective large-scale early learning programs of the last ten years to understand the elements of their success. Learning at Scale researchers point out that improving learning at scale is hard because it usually requires working through the complex realities of government systems. Therefore, while the first chapter of the “learning crusade” yielded important lessons on what works to improve learning, there is still a lot to be learned about how to apply this knowledge to build effective government systems that ensure learning for all children. Case in point are government systems for continuous teacher professional development (TPD). It is well-known that better teaching is one of the fundamental interventions for improved learning outcomes. There is also a growing evidence base on the characteristics of effective TPD programs, as curated through initiatives like Learning at Scale and The Science of Teaching, also funded by the Gates Foundation. Among these characteristics are trainings that emphasize practice over theory and coaching programs based on structured coaching tools and frequent interaction with teachers. Another teacher support element that can be important to program success is school-based teacher communities-of-practice, which enable peer-to-peer feedback and opportunities to reflect on the ongoing application of instructional approaches. Both Learning at Scale and the retrospective study on USAID early reading programming observe a trend toward shorter but more frequent teacher training events that take place at the local level, in contrast to the massive national trainings of the past. The use of online content for teacher training is also on the rise, though preliminary findings from Learning at Scale suggest that an initial face-to-face training event continues to be essential. However, being able to identify the ingredients of effective teacher support does not automatically equate with an understanding of how to build a continuous TPD system that incorporates them. Neither does it mean that a TPD system built entirely on evidence-based best practices is guaranteed to succeed in improving learning outcomes. As more LMICs advance toward instituting standards and structured career ladders for the teaching profession, and toward developing mechanisms to increase the equity and efficiency of teacher training and support, it becomes increasingly important to identify effective models for implementing continuous TPD at scale. the panel will feature a USAID program in Jordan that exemplifies the desired result: a national-scale, comprehensive TPD model that is aligned with a broader policy on the teacher career path and is linked to a robust assessment data system that reinforces accountability for learning. It is the only program with solid evidence of positive changes in teaching practices that led to significant improvements in student outcomes.

Primary Mathematics Skills Assessment Tool: 2021 Stimulus Sheet.

Primary Mathematics Skills Assessment Tool: 2021 Assessor Protocol.

Primary Reading Skills Assessment Tool: 2021 stimulus sheet.