Country Code: 
KGZ

A Monitoring, Evaluation, and Learning (MEL) Framework for Technology-Supported Remote Trainings [CIES Presentation]

Existing research on the uptake of technologies for adult learning in the global South is often focused on the use of technology to reinforce in-person learning activities and too often involves an oversimplified “with or without” comparison (Gaible and Burns 2005, Slade et al. 2018). This MEL Framework for Technology-Supported Remote Training (MEL-Tech Framework) features a more nuanced perspective by introducing questions and indicators that look at whether the technology-supported training was designed based on a solid theory of learning; whether the technology was piloted; whether there was time allocated to fix bugs and improve functionality and user design; how much time was spent using the technology; and whether in-built features of the technology provided user feedback and metrics for evaluation. The framework presents minimum standards for the evaluation of technology-supported remote training, which, in turn, facilitates the development of an actionable evidence base for replication and scale-up. Rather than “just another theoretical framework” developed from a purely academic angle, or a framework stemming from a one-off training effort, this framework is based on guiding questions and proposed indicators that have been carefully investigated, tested, and used in five RTI monitoring and research efforts across the global South: Kyrgyz Republic, Liberia, Malawi, the Philippines, and Uganda (Pouezevara et al. 2021). Furthermore, the framework has been reviewed for clarity, practicality, and relevance by RTI experts on teacher professional development, policy systems and governance, MEL, and information and communications technology, and by several RTI project teams across Africa and Asia. RTI drew on several conceptual frameworks and theories of adult learning in the design of this framework. First, the underpinning theory of change for teacher learning was informed by the theory of planned behavior (Ajzen 1991), Guskey’s (2002) perspective on teacher change, and Clarke and Hollingsworth’s (2002) interconnected model of professional growth. Second, Kirkpatrick’s (2021) model for training evaluation helped determine many of the categories and domains of evaluation. However, this framework not only has guiding questions and indicators helpful for evaluating one-off training events focusing on participants’ reactions, learning, behavior, and results (as is the focus in Kirkpatrick’s model) but also includes guiding questions and indicators reflective of a “fit for purpose” investigation stage, a user needs assessment and testing stage, and long-term sustainability. Furthermore, this framework’s guiding questions and indicators consider participants’ attitudes and self-efficacy (based on the research underpinning the theory of planned behavior), as well as aspects of participants’ post-training, ongoing application and experimentation, and feedback (Clarke and Hollingsworth; Darling-Hammond et al. 2017; Guskey). Lastly, the framework integrates instructional design considerations regarding content, interaction, and participant feedback that are uniquely afforded by technology.

Digital transformation: An opportunity for long-lasting improvement of quality of education service delivery in Kyrgyz Republic, Tajikistan, and Uzbekistan [CIES Presentation]

Digital transformation: an opportunity for long-lasting improvement of quality of education service delivery in Kyrgyz Republic, Tajikistan, and Uzbekistan Over the past decade, Uzbekistan, Tajikistan, and Kyrgyz Republic have been consistently demonstrating their commitment to quality education, evidenced by the amount of GDP allocated to education. These education systems aim to produce world-class graduates capable of success both globally and at home. Various donors have stepped in to support these efforts in a coordinated way via direct funding of initiatives that enhance instructional skills, increase accountability for excellence, and improve formal and non-formal learning environments. In Uzbekistan, critical thinking, problem solving, and practical skills are at the forefront of the Ministry of Public Education (MPE)’s agenda. In the Kyrgyz Republic, performing well on the upcoming PISA survey in 2025 is a focal point for the Ministry of Education and Science (MOES) in recent years. And, in Tajikistan, COVID-19 provided an important opportunity to rethink the delivery of in-service teacher training from in-person to a blended learning format, resulting in impressive early grade learning gains. However, the COVID-19 crisis brought many education systems to a grinding halt, and these three countries were no exception. Nevertheless, the speed and efficiency with which their education systems adapted has been remarkable. It speaks to their resilience, rooted in the fact that these countries enjoy strong institutional, financial, and policy legacies that are strongly rooted and capable of weathering storms. Undoubtedly, the strongest driving force behind this change is the belief shared at all levels of their education systems – especially at the level of parents and teachers – that education is important. It comes as no surprise that when faced with the challenge of school closure due to a pandemic, their various systemic actors collaborated and adapted their approaches to continue delivering teacher professional development (TPD). In the Kyrgyz Republic, after less than a year following the outbreak of the pandemic, the majority of teachers reported accessing online learning resources, and 85% of teachers did so using smartphones. The USAID-funded Okuu Keremet! project had planned to deliver teacher training in person, but swiftly shifted to development of blended learning modules for reading and mathematics. It designed an online training platform that in a short period of time was accessed by 18,000 registered teachers and librarians. The online learning platform integrates Google Analytics that can allow the Ministry of Education and Science (MOES) to not only monitor progress towards certification of individual teachers, but to also detect, in real time, the teachers and schools that are lagging behind . In Uzbekistan, the Ministry of Public Education (MPE) has made significant investment in continuous professional development, and as part of its growth strategy, Avlonyi has created a Learning Management System (LMS) for teacher accreditation based on OECD teacher professional development standards. To aid Avlonyi in this significant undertaking, the USAID-funded Uzbekistan Education for Excellence Program (UEEP) project developed a blended TPD model comprised of synchronous and asynchronous in-person and online assessment-based learning events (with the focus to improve Information and Communication Technology (ICT) and English as a Foreign Language (EFL) instruction for grades 5–11 and 1-11, respectively). In addition to gaining skills through this opportunity, teachers will achieve career advancement through the accreditation of their efforts by Avlonyi. In Tajikistan, the impact evaluation data shows strong performance as a result of the USAID Read with Me project implemented in collaboration with the Ministry of Education. TPD in Tajikistan applies digital development principles, a multi-user coaching and training platform, which provides content and accountability for self-regulated learning, coaching, peer learning and performance monitoring, including uploading assignments and assessments, aligned with the National Teacher Competency Framework. The EGRA end line results clearly showed the benefit of effective teaching techniques correlating to oral reading fluency gains of more than thirteen correct words per minute. This panel brings together researchers and practitioners documenting the transformational change of Teacher Professional Development in the three Central Asian Republics – Kyrgyz Republic, Uzbekistan and Tajikistan. Panelists will discuss details about the effectiveness and utility of online learning platforms vis-à-vis TPD and student learning gains; the skills required to make this shift to digital, self-regulated learning; and lessons learned for getting these new platforms mainstreamed into educational systems.

MEL-Tech Case Studies: Lessons Learned from Technology-Supported Remote Trainings in Five Countries During the Pandemic

This report presents case studies of five remote training activities conducted by USAID-funded and RTI-implemented programs: the Advancing Basic Education Project (ABC+) in the Philippines, the Malawi Early Grade Reading Improvement Activity (MERIT), Read Liberia, Okuu Keremet! in the Kyrgyz Republic, and the Uganda Literacy Achievement and Retention Activity (LARA). The case studies seek to apply a more process-based and learning-oriented approach, drawing from the MEL-Tech Framework, to understand technology-supported remote teacher training introduced in response to COVID-19.

MEL Framework for Technology Supported Remote Teacher Training

This MEL Framework for Technology-Supported Remote Training seeks to help education program implementers, governments, and program evaluators more effectively design, implement, and learn lessons from remote training activities. It places special consideration on the unique characteristics of technology-supported interventions in the global South. The framework presents minimum standards for the evaluation of technology-supported remote training, which, in turn, facilitates the development of an actionable evidence base for replication and scale-up. Rather than “just another theoretical framework” developed from a purely academic angle, or a framework stemming from a one-off training effort, this framework is based on guiding questions and proposed indicators that have been carefully investigated, tested, and used in five RTI monitoring and research efforts across the global South: Kyrgyz Republic, Liberia, Malawi, the Philippines, and Uganda (Pouezevara et al. 2021). Furthermore, the framework has been reviewed for clarity, practicality, and relevance by several RTI project teams across Africa and Asia.

ACR-Asia Early Childhood Landscape Report [CIES 2019 Presentation]

CIES presentation of Early Childhood Education landscape report for the Asia region under All Children Reading - Asia.

Early Childhood Education: Considerations for Programming in Early Learning Assessment

Assessment of learning and the quality of early learning environments is an important component of early childhood education. This brief outlines the existing early learning assessments of children and environments used in the Asia region, excluding diagnostic and screening assessments.

Early Childhood Education: Considerations for Programming in Educator Quality

Training opportunities and appropriate teacher curriculum are often insufficient, and effective regulatory frameworks for preparing, staffing, and monitoring ECE teachers are often lacking. This brief presents selected country-by-country findings on policy relating to ECE teacher quality in six countries in Asia.

Early Childhood Education: Considerations for Programming in Sustainability

Governance and financing of early childhood education (ECE) are complex, involving multiple actors, levels, objectives, and approaches, from general expansion of education access to targeted coverage of the most underserved. Coordination of actors and local community engagement in ECE are important dimensions in the governance and sustainability of ECE, above and beyond specific financing sources and arrangements. More than policies or systems alone, the quality and nature of governance is directly linked to a program’s chances for sustainability.

Early Childhood Education: Considerations for Programming in Asia

This report examines available evidence from the Asia region on the current state of ECE interventions, focusing on the 10 countries in the region3 that currently benefit from US Agency for International Development (USAID) education programming. In Asia, many national governments have prioritized the expansion of access and quality improvements of pre-primary education (Sun, Rao, & Pearson, 2015). USAID will support those efforts as part of a coherent approach to improved learning outcomes in primary school.

Pages