Uzbekistan is on an upward trajectory of digital transformation. Its Digital Uzbekistan 2030 Strategy includes ambitious policy goals to modernize and increase the competitiveness of a range of sectors, from telecommunications to healthcare and public services. For example, in the education sector, Uzbekistan has already achieved 100% coverage of high-speed Internet connections in preschool institutions and facilitated trainings for tens of thousands of students in technology-oriented skills. The USAID-funded Uzbekistan Education for Excellence Program supported the Government of Uzbekistan to accelerate digital transformation in education. In partnership with Florida State University (FSU) and the Ministry of Preschool and School Education (MoPSE) Republican Education Center (REC), RTI led two initiatives to support students and teachers with access to essential and supplementary resources.

This report summarizes the findings of an effort to develop and validate tablet-based, self-administered assessments of English-language foundational literacy and numeracy in the early grades. The tools described in the report were developed at the request of Imagine Worldwide with the support of the Jacobs Foundation. RTI carried out field testing and a pilot study to assess the tools' internal consistency, test-retest reliability, and concurrent validity with respect to "traditional" EGRA and EGMA. RTI International developed the two assessments, known respectively as the Self-Administered Early Grade Reading Assessment (SA-EGRA) and the Self-Administered Early Grade Mathematics Assessment (SA-EGMA), with the support and at the direction of Imagine Worldwide. The assessments are deemed “self-administered,” because children complete the assessments independently in response to instructions and stimuli imbedded in the tablet-based software. However, adults typically supervise the organization and conduct of the assessment as well as the collection of individual data from the tablets for analysis. The tools have been developed under an open-source license. The code can be viewed and downloaded for reuse or modification at https://github.com/ICTatRTI/SE-tools/blob/main/README.md. Users of RTI's Tangerine software may request that the SA-EGRA and SA-EGMA tools be added to their Tangerine groups via https://www.tangerinecentral.org/contact

In February 2022, ACR–Philippines initiated conversations with USAID and the Philippines Department of Education (DepEd) on developing a prototype technology to enable automated assessment and scoring of learners’ oral reading fluency, listening, and reading comprehension skills. The idea resonated with DepEd leadership for several reasons. During the school years of 2020-2022, the COVID-19 Pandemic made face-to-face assessments challenging, particularly in remote learning settings. Teachers were stretched in time and resources to assess learners one-on-one their reading skills against the most essential learning competencies. Further, other international assessments like PISA use a computerbased format, and this will be an opportunity to understand how well-prepared students are to take computer-based tests. In response, ACR-Philippines sought to produce a ‘proof of concept’ that explores the feasibility of a self-administered computer-based reading assessment (CoBRA) in English and Filipino for students in the Philippines. The technology would incorporate voicerecognition software to enable students to read directly into their device. The software would automate the score of the students’ reading scores through an artificial-intelligence (AI) algorithm designed to calculate words-per-minute (wpm) and reading accuracy rate. The platform will produce reports providing students, parents, and/or teachers immediate feedback on their performance. This is a report of that pilot experience.

This material discusses the various technological innovations the USAID/Read Liberia Activity employed for data collection, teacher training, assessment, coaching and even virtual support to teachers during COVID.

In 2019, Read Liberia transitioned to the use of mobile money to remit per diem payments to teachers upon completion of twice-yearly trainings. Mobile money had a significant impact on Read Liberia's operations, training continuity, and its teachers. Read this brief to find out how.

DepEd ICTS requested support from the USAID/All Children Reading Philippines activity for evaluating the recently-launched DepEd Commons online resource portal to ensure that it could live up to its potential as a key strategy for giving all Filipino learners access to educational resources. In response to this request, RTI in collaboration with the DepEd ICTS EdTech Unit, designed a process for reviewing the DepEd Commons to identify evidence-based recommendations for a fully sustainable and impactful DepEd Commons. Although we use the term ‘evaluation’, this is a formative exercise, recognizing that the platform is in a nascent stage and would benefit most from forward-looking and actionable recommendations for living up to its potential, not a backward-looking judgment of implementation quality or completeness at a certain point in time. In line with the approach stated above—that the evaluation of the DepEd Commons would be a formative exercise designed to provide actionable recommendations for improvement, given the early stage of development of the platform—we chose a SWOT analysis methodology to frame the exercise. SWOT analyses are conducted to identify strengths, weaknesses, opportunities, and threats. The study team carried out key informant interviews with stakeholders from the implementing department in DepEd and in other departments with similar systems; a quantitative analysis of platform statistics containing usage data; and a self-administered survey focusing on usage and usability of the platform.

Existing research on the uptake of technologies for adult learning in the global South is often focused on the use of technology to reinforce in-person learning activities and too often involves an oversimplified “with or without” comparison (Gaible and Burns 2005, Slade et al. 2018). This MEL Framework for Technology-Supported Remote Training (MEL-Tech Framework) features a more nuanced perspective by introducing questions and indicators that look at whether the technology-supported training was designed based on a solid theory of learning; whether the technology was piloted; whether there was time allocated to fix bugs and improve functionality and user design; how much time was spent using the technology; and whether in-built features of the technology provided user feedback and metrics for evaluation. The framework presents minimum standards for the evaluation of technology-supported remote training, which, in turn, facilitates the development of an actionable evidence base for replication and scale-up. Rather than “just another theoretical framework” developed from a purely academic angle, or a framework stemming from a one-off training effort, this framework is based on guiding questions and proposed indicators that have been carefully investigated, tested, and used in five RTI monitoring and research efforts across the global South: Kyrgyz Republic, Liberia, Malawi, the Philippines, and Uganda (Pouezevara et al. 2021). Furthermore, the framework has been reviewed for clarity, practicality, and relevance by RTI experts on teacher professional development, policy systems and governance, MEL, and information and communications technology, and by several RTI project teams across Africa and Asia. RTI drew on several conceptual frameworks and theories of adult learning in the design of this framework. First, the underpinning theory of change for teacher learning was informed by the theory of planned behavior (Ajzen 1991), Guskey’s (2002) perspective on teacher change, and Clarke and Hollingsworth’s (2002) interconnected model of professional growth. Second, Kirkpatrick’s (2021) model for training evaluation helped determine many of the categories and domains of evaluation. However, this framework not only has guiding questions and indicators helpful for evaluating one-off training events focusing on participants’ reactions, learning, behavior, and results (as is the focus in Kirkpatrick’s model) but also includes guiding questions and indicators reflective of a “fit for purpose” investigation stage, a user needs assessment and testing stage, and long-term sustainability. Furthermore, this framework’s guiding questions and indicators consider participants’ attitudes and self-efficacy (based on the research underpinning the theory of planned behavior), as well as aspects of participants’ post-training, ongoing application and experimentation, and feedback (Clarke and Hollingsworth; Darling-Hammond et al. 2017; Guskey). Lastly, the framework integrates instructional design considerations regarding content, interaction, and participant feedback that are uniquely afforded by technology.

This case study examines a training targeting 18,000 head teachers and subject heads over seven days using IVR accompanied by electronic materials shared via WhatsApp conducted by the USAID-funded and RTI-implemented Malawi Early Grade Reading Improvement Activity (MERIT). While the training was conducted in June of 2020, this case study includes findings from a follow up study one conducted year later, to see what training content and skills participants retained, and the training elements that were most effective in their delivery. The case study applies a process-based and learning-oriented approach, drawing from the MEL-Tech Framework (Paper 1), to understand technology-supported remote teacher training introduced in response to COVID-19.

This presentation was delivered as part of the 2022 Comparative and International Education Society (CIES) conference as part of a panel describing the Education Futures research activity undertaken by the Philippines Department of Education, with support from USAID/Philippines through the All Children Reading-Philippines program managed by RTI International. Under this activity, leaders in DepEd are engaging in a range of courses and workshops to learn and apply futures thinking methodologies for reimagining how education can be delivered differently to address recurring shortcomings. The authors are Maricel Fernandez (Research Officer, RTI International) and Mark Sy (Manager of EdTech Unit, Department of Education).

This report presents case studies of five remote training activities conducted by USAID-funded and RTI-implemented programs: the Advancing Basic Education Project (ABC+) in the Philippines, the Malawi Early Grade Reading Improvement Activity (MERIT), Read Liberia, Okuu Keremet! in the Kyrgyz Republic, and the Uganda Literacy Achievement and Retention Activity (LARA). The case studies seek to apply a more process-based and learning-oriented approach, drawing from the MEL-Tech Framework, to understand technology-supported remote teacher training introduced in response to COVID-19.