RTI’s latest mobile EdTech product, "Loquat", uses language-agnostic speech activity detection to determine when someone is talking. It then passes the detected speech to a voice type classifier to establish who is currently speaking. This allows the app to be used in different countries and settings, regardless of the instructional language. The mobile app, built for Android devices, is designed to be easy and intuitive. It provides timely classroom support for teachers located in rural or urban areas who may not have access to a mentor or coach. The app can also be used as part of a standard coaching session where the coach helps the teacher with techniques in improving their talk time balance in the classroom.  To use Loquat, the teacher records the audio of the entire lesson or choses a particular activity to be recorded. Then, they upload the recording through the app, to the Loquat server. After the audio recording of a lesson or activity is fully processed and analyzed, there are various reports available to the teacher. Each of these reports aims to aid the teacher in initiating self-reflection, applying immediate corrective actions, and improving talk time balance in their classroom (e.g., proportion of teacher talk time versus student talk time, individual talk time versus group talk time). Loquat is designed as a tool that empowers the teacher to take immediate action thus allowing students to grow and improve their learning outcomes. The app uses modern cloud architecture and serverless, scalable infrastructure, to process the audio. It only saves the data files used for building the graphs and charts used on the device reports. All classroom recordings are removed from the servers after analysis. There is no identification of voice or voice to text transcription. We have the Loquat application interface and user documentation in 3 languages, English, French, and Spanish. We want to present results and summary of the collected feedback from user testing in Guatemala and Senegal. There are three other pilots scheduled for 2023. Those include testing pilots in Ghana, Bangladesh, and Tanzania. Our vision for Loquat is that it experiences future iterations to include language detection but also provide additional functionality, like voice models identification or affective models that help not only assess talk time but also time on task, classroom climate, language, and content. We are also interested in exploring other uses of the application with emphasis on inclusivity in parent teacher meetings and communities of practice.

This invited presentation was delivered for the workshop on best practices in education and protection in early childhood (l'éducation et la protection de la petite enfance [EPPE]) organized by UNESCO and Senegal's Department of Preschool Education. It presents the support RELIT provides to development of teaching and learning materials under the new bilingual curriculum.

The research on first language learning is the premise for the Philippines Mother-Tongue-based Multi-Lingual Education (MTB-MLE) Policy which requires schools to deliver the Kindergarten to Grade 3 curriculum in the mother tongue (home language) of the school’s community (Corder, 1983; Walter & Dekker, 2011. Salmona, 2014; Yadav, 2014). Considering that the national curriculum requires children to transition to and learn in Filipino and English at the start of Grade 4, the question of mother tongue’s effect on second and third language acquisition is not academic, but central to the policy debate on MTB-MLE efficacy. The MTB-MLE policy consists of five discrete areas: curriculum, learning resources, assessment, teacher recruitment and training, and community support. MTB-MLE has proven challenging with respect to the myriad languages and dialects. Out of the 180 plus languages spoken, only 19 have been formally supported with an official orthography, standard learning resources and teacher professional development materials. In communities with non-supported languages, teachers contextualize the teaching and learning materials, often translating and adapting from the linguistically nearest mother tongue to their own. In a 2019 study on MTB-MLE, the Philippines Institute of Development Studies found inconsistent implementation across schools, including teachers’ negative attitudes toward MTB-MLE, linguistic diversity of learners and classrooms, and lack of teaching and learning materials being key factors hindering its implementation (PIDS, 2019). The Bicol Region poses a particular challenge. In an area slightly larger than Connecticut with a population of just under 4 million, thirteen different languages plus numerous dialects are spoken in the various provinces, cities and towns that dot this volcanic region (Lobel, 2019). The standard language of Central Bikol, which is the mother tongue of approximately half the population consists of six different local dialects depending on the locale. Wedged in the middle of the Central Bikol-speaking area is a cluster of five distinct languages: Rinconada, Buhi-non, Bikol Libon, West Albay Bikol, and Miraya, with only one or two municipal communities each that speak these languages. Under the USAID Advancing Basic Education in the Philippines (ABC+), RTI conducted a longitudinal study that provides new evidence on the efficacy of MTB-MLE. The study tracked the language and literacy acquisition of four groups of learners: those Central Bikol learners who are learning in a fully supported language; Buhi-non speaking learners who are learning in an unsupported language (ie, Buhi-non); Central Bikol speakers who’s language of instruction is Tagalog and Tagalog learners who’s language of instruction is Tagalog. The findings show evidence that the Central Bikol learners whose LOI is Tagalog are performing at par or worse in nearly all domains of reading in their first (Central Bikol), second (Tagalog/Filipino) and third languages (English). The findings show a flattening of their trajectory in terms of the pace of language and literacy acquisition, as well as significant equity gaps in comparison to their Tagalog peers. The evidence points toward continued support to MTB-MLE, despite the challenges in implementation.

The rise in popularity of the Nurturing Care Framework, which describes the enabling conditions for a child to thrive in the first several years of life, has resulted in an increase in global attention on parenting and child development. The Framework includes children’s need for good health, adequate nutrition, safety and security, opportunities for early learning, and responsive caregiving. While this holistic approach to nurturing young children is surely beneficial, the implementation of Nurturing Care should be considered through a cultural lens. According to McGillicuddy-De Lisi and Subramanian (1996), beliefs about parenting and child development are developed through three means: (1) beliefs come directly (and unquestioned) through the culture; (2) beliefs are formed through the holder’s own childhood, family, and parenting experiences; and (3) beliefs are influenced by the exchange of ideas and assumptions of people from different cultures. Since these beliefs inform parenting behaviors (Bornstein, 2012), we must be thoughtful in any efforts to change parenting and caregiver behaviors which are the result of the culture and the childhood experiences of parents. Changing behavior without an adequate consideration of the underlying cultural beliefs could be at risk of perpetuating colonial legacies and destabilizing cultural ways of being. This presentation focuses on the risks and rewards of taking an approach to shaping caregiving behaviors that considers the importance of cultural continuity. The presentation will use cross-national examples from work with two Native American tribes, the Blackfeet and the Lac Courte Oreilles Ojibwe, as well as traditional international development work in Senegal and Liberia to illustrate opportunities and challenges of foreign technical “expertise.” The differences between efforts to shape parental behaviors, which are clearly culturally-influenced, versus teacher or ECE caregiver behaviors, which may be more subtly cultural, will be examined. Finally, this presentation will offer some practical considerations for other individuals seeking to further Nurturing Care outside their own communities.

The changes in the labor market, the re-organization of work worldwide, the increasing pressure to improve economic competitiveness in a context of global inter-connectedness, less job security and stagnant or dropping standards of living alongside accelerating climate change have led many countries to rethink education. A common starting point is to consider the relevance of curricular content against this backdrop of complexity, with particular attention to social-emotional skills, competencies and flexibility. Curriculum is fundamental to teaching and learning processes. Its various components have wide-ranging consequences on the quality of education. Over time, a range of successful educational systems have prioritized competence-based curricula, learner-centered pedagogy, and continuous assessment. Other countries, including Kyrgyz Republic, are looking to learn from these ‘global education policies’ in order to update their educational systems. With a competence-based educational framework already in place, Kyrgyz Republic used this as the starting point for reform. A competence-based curriculum was introduced in Kyrgyzstan in 2014 in the form of a State Standard Framework. However, primary grade standards were not revised afterwards to align with the framework. As part of its Okuu Keremet! project (2019-2024), USAID supported the Ministry of Education and Science (MOES) to develop a Road Map that would outline the process for arriving at robust standards. The process would then be used to actually revise primary grade subject standards. This presentation will cover: 1. The government-led collaboration that took place to develop subject standards, including data analysis, the broad-ranging discussions in the working group and the involvement of practitioners. 2. The process of using a Road Map to arrive at the standards that were ultimately approved by MOES 3. The lessons learned with respect to fostering institutional capacity, creating an institutional memory for future reference, and cultivating government ownership. 4. Next steps: how the standards will be put in practice and monitored; the need to develop textbooks aligned with standards; orienting teacher education and in-service teacher training in line with the standards. During 2021-2022, MOES and Okuu Keremet – together with various multi-stakeholder technical groups – revised four primary subject standards: Mathematics, Kyrgyz and Russian Language and Reading, and “Me and the World” (basic science). The process followed the Road Map plan through four stages: 1) analysis of existing educational standards in the country and international trends; 2) review of primary level learning outcomes; 3) alignment with the country’s competence-based educational framework, and 4) consultation with diverse education experts and a community of specialists. The subject standards define the expected learning outcomes and how they relate to competencies. Subsequently, a curriculum map was formulated which depicts how these competencies will shape and prepare students for the real world, such as the job market and life skills. The Kyrgyz Academy of Education – responsible for standards among other things – organized a series of working meetings among a range of stakeholders to arrive at the first four subject standards. It then followed the overall Road Map to develop standards for the remaining six primary school subjects. All of the standards produced were approved in October 2022 and slated for implementation in the 2023-2024 academic year. One of the challenges that arose during the process was related to the lack of experience among the KAE experts in the analysis of assessment data. Understanding the outcome of learning assessment is necessary to setting a level of standards that is ambitious yet feasible for where students currently are in terms of learning per grade. Assessment results also enable KAE staff to understand international and national trends in a context where the country explicitly aims to perform better with respect to international assessments such as PISA. The formulation of measurable and achievable learning outcomes per grade was also a challenge. One of the important decisions made by the working group was to define expected outcomes at the end of the primary cycle. as a starting point. There was attention given to ensuring consistency in the transition from preschool to primary school and from primary to secondary school. Subject standards are only the starting point for changing the content of education. It needs to be accompanied by a range of key components that support the competences, such as appropriate teaching materials, the education of new teachers and the training of existing teachers, and the importance of both formative and summative assessment to know if learning outcomes are going in the desired direction. Moreover, the learning outcomes need to be made clear to communities of parents in every-day language so that they can support the process at home. So far, this has not been done in Kyrgyz Republic. As outlined in the Road Map, once standards are developed, a plan of implementation is needed, followed by assessment and, if necessary, adjustments. This cycle is expected to take a five years before the next round of review according the MOES regulation. CONCLUSIONS The collaboration of the KAE together with Okuu Keremet! and a spectrum of actors and individuals over the past three years to liberate learning shows that: 1) learning outcomes are at the core of the competency-based curriculum and these outcomes need to be clear and achievable for teachers, students, and parents; 2) standards development, revision, implementation and assessment form a unified cycle in leveraging change in the primary education system hence all parts of the cycle must be aligned. Other parts of the education system will also need to be aligned over time with competences forming the core reference point. Continuing fragmentation and incoherence will not achieve the change that Kyrgyz Republic hopes for its students, even if one piece or another is well-designed on its own.

The small, landlocked mountainous nation of Kyrgyzstan occupies an important space in Post Soviet Central Asia – as the only parliamentary democracy in the region since independence in 1992. While the country has admirably maintained near-universal enrollment rates in primary and lower-secondary levels, these important gains in educational access have not been accompanied by adequate learning outcomes. As evidenced by the 2017 National Sample Based Student Assessment, about 60% of grade 4 students in Kyrgyzstan lagged in age-appropriate comprehension level. By all estimates, these learning gaps have worsened due to school closures and economic disruptions caused by COVID-19. While improvements are necessary in many aspects of Kyrgyz school education, few issues are as pressing or as consequential as strengthening the system that prepares and supports the 75,000 public school teachers in the country. In this paper we present innovative models of teacher support structures that hold promise for creating an enabling environment for public school teachers in Kyrgyzstan to grow and succeed in their profession. Specifically, the paper will present insights from two complementary on-going initiatives (each led by one of the co-presenters) that focus on structured observation, feedback, and mentoring mechanisms, and creatively use simple technology applications to promote instructional quality in the classrooms and a community of practice across the system. Our paper will situate the scope of these initiatives in the ecosystem of teacher development practices in Kyrgyzstan and discuss their broader policy applicability. We submit that these insights would be relevant for other resource-constrained education contexts that are aspiring to improve support systems for teachers. The first initiative in focus is the technology-enhanced mentoring model of the Master of Arts in Teaching (MAT) program of the Institute of Education (IOE) at the American University of Central Asia. Launched in 2018, the program – open to both aspiring and in-service teachers – embeds digital pathways in its structure, curricular content, and delivery processes. At the core of the program is a web-video based mentoring model that assigns experienced teachers as mentors for the MAT candidates (mentees). Both mentors and mentees use a lesson observation rubric and simple digital tools (YouTube, Google Form, Google Classroom, Zoom, etc.) to observe, analyze, and reflect on classroom instruction videos, all under the watchful guidance of a dedicated Faculty Advisor from the MAT program. The teaching observation rubric used is a modified version of the evidence-based Danielson Framework for Teaching. Besides providing constructive feedback to the mentees, the mentors are encouraged to model good practice for their mentees and help them identify possible areas of focus and improvement in the subsequent lessons. In other words, these non-hierarchical dialogs are meant to be both evaluative and generative, specific, yet holistic – attentive to mentees’ relative strengths and weaknesses in the context of the specific classroom where they need to perform. Evidence from the assessments by mentors over four cohorts of MAT practicum indicates that thanks to the video-based observation-reflection-feedback loop, the mentees are able to take ownership of their own growth and demonstrate qualitative improvements in their classroom instruction by the end of the practicum. Internal program evaluation data also suggest that the mentors themselves are appreciating benefits of their engagement in the IOE model. Additionally, having dedicated Faculty Advisors overseeing the mentoring program has not only created a support structure for the mentors, but the entire program has also resulted in a broader community of practice. While these are promising results, the scope and scale of a university-based selective program is limited when compared to the needs of the broader education system. This is where the second initiative of this paper - Okuu Keremet! (Learning is Awesome! in Kyrgyz language) is particularly significant. The ongoing USAID funded Okuu Keremet project (2019 – 2024) is designed to help improve learning outcomes in reading and mathematics of more than 450,000 students in Grades 1‒4 in 1,682 target schools in Kyrgyzstan. The project is implemented by RTI (Research Triangle International) in partnership with the Ministry of Education and Sciences of Kyrgyzstan. To date, around 15,000 teachers have completed special pedagogical training in teaching read and math in the primary grades. An important way the project has integrated technology in the improvement of instructional practice is by creation of a Coaching app that is contextualized for easy access and usage by Kyrgyz school teachers and teacher educators. This app assists methodologists to mentor teachers through classroom observations. The program uses a classroom observation rubric / checklist that is easy to interpret, and to update, using the app interface and based on country’s teacher professional standards. Around 3,500 school administrative staff and methodologists of district education departments were trained to mentor teachers in primary schools. The app is being used in 1,682 target schools. Both the IOE model and the Okuu Keremet project underscore the significance of technology-enhanced mentoring in improving instructional practices of classroom teachers in Kyrgyzstan. Data from both initiatives will be presented at the CIES Conference. As leaders of these respective initiatives, we recognize that the promise of our approaches derives from leveraging the power of digital technologies in learning-rich professional development processes for current and aspiring teacher in ways that are evidence-based, context-informed, cost-effective, sustainable, and scalable. Ongoing implementation and refinement of our respective initiatives have uncovered strong levers and weak links in the broader teacher development structures of Central Asia. One critical area is the importance of framing mentoring as a holistic approach to teacher development that goes beyond benchmarking against a rubric and attends to the intersecting concerns of teachers by promoting an ethos of growth mindset and social-emotional support. We submit that developing such holistic mentoring skills and attitudes among skilled and experienced teachers is a policy priority that must be attended to by the Ministry of Education of Kyrgyzstan and its development partners.

The ability of citizens to think critically and take a well-considered position in life is influenced by their ability to read with comprehension and by the content of what they read. WordCalc is an instrument that contributes to a body of children’s literature that is an important step to building this skill. This abstract introduces WordCalc, an advanced computer program designed to analyze linguistic features of texts. It was developed and improved in the context of two USAID-funded reading projects in the Kyrgyz Republic – Time to Read and Okuu Keremet! The very first version was produced as an Excel program under another USAID reading project in Georgia. The program addresses the lack of children’s books written in local languages, specifically Kyrgyz, Russian, and Uzbek, in the Kyrgyz Republic. By analyzing large amounts of text, WordCalc provides local authors and publishers with language patterns that are attractive and engaging to young readers, leveled according to reading ability. The project conducted a market analysis of children’s books in 2020, revealing the scarcity of modern, locally inspired storybooks for children in schools, libraries, the market, and elsewhere. The available books predominantly consisted of outdated fairy tales and folklore, lacking consideration for the local context and culture as well as contemporary realities and topics. The majority of existing books were imported from Russia and other countries. The limited spectrum of topics highlighted the urgent need for accessible and age-appropriate literature that resonates with children’s interests, language preference and social background. Using WordCalc entails collecting as much text as possible, in different languages and for different age groups, in order to analyze text size, word and sentence counts, word length, high-frequency words and phrases for each language. Through these analyses, the program provides insight into the linguistic characteristics of text read by readers at different levels. The patterns per language and reading level enable authors to tailor their writing to the various reading levels of young readers so that children have a variety of text at the right level for them to develop their reading skill. The refinement of WordCalc resulted in the creation of a comprehensive dictionary comprised of the most frequently used words for grades 1-4 in Kyrgyz, Russian, and Uzbek, totaling 10,000 unique words. This dictionary serves as a foundational resource for creating age-appropriate content that appeals to young readers. In collaboration with linguists, the project team identified and incorporated difficult and rare words specific to grades 1-4, ensuring comprehensive coverage of a rich vocabulary. The Kyrgyz and Uzbek languages in particular face a shortage of text-based resources, including scientific papers, articles, and standardized textbooks for grades 1-4. Therefore, the project team employed a meticulous approach to creating the dictionary, leveraging the expertise of linguists to compensate for the limited resources available for compiling the dictionary. The aim was to ensure that the final product was accurate and useful. To validate the effectiveness of WordCalc as an instrument, the team conducted several reviews of more than 1,000 texts in the three languages. In Okuu Keremet!, around 40 authors and illustrators were trained to use WordCalc, and so far, it has facilitated the production of more than 1,200 new titles, specifically tailored to children’s reading levels and their linguistic context. Moving forward, WordCalc will be introduced to a wider audience, including educators, authors, publishers, and the general public. Its usefulness for creating leveled literature for children will be encouraged among other players such as publishers, textbook writers and others. For example, two big local publishing companies want to use WordCalc as a tool for quality assurance and are already using it in the book production process. WordCalc also serves as a valuable resource for analyzing existing literature for children. By applying the program to previously published books, authors and publishers can gauge whether the books are appropriately aligned with specific ages or grades; they can refine their storytelling techniques and enhance the cultural authenticity of their work. This ensures that the existing literature is adapted to meet the needs and expectations of young readers in the Kyrgyz Republic. In conclusion, WordCalc has proven to be a valuable tool to create new texts for grade 1-4 children that builds not just reading skill but comprehension and critical thinking skills which have been consistently weak in the reading assessment of children. The expansion of genres among children’s books, including information books which are very popular, expands the range of topics that children are thinking about and exposes them to new knowledge, ideas, and feelings. By redressing the lack of literature in local languages such as Kyrgyz and Uzbek, WordCalc is also contributing to the strength of these languages as it codifies a rich vocabulary among young readers across an expanding range of topics. Engaging stories in mother tongue foster a love for reading among young readers. WordCalc’s ability to sift through and analyze text in different languages is a gift to local authors and publishers who can now create “just right” books for children in the Kyrgyz Republic.

The USAID Leading Through Learning Global Platform (LTLGP) and USAID Improving Learning Outcomes for Asia (ILOA) presented a panel at the 2024 CIES Conference on what each project has been learning about establishing and implementing learning networks. Presentations from three USAID learning networks (HELN, GRN, ECCN) and one regional hub managed by LTLGP along with a presentation from ILOA discuss how each learning network utilizes collaboration, learning, and adapting (CLA) to assess how well their networks are reaching and meeting the needs of their members and how they have adapted and adjusted their networks based on CLA fedback.

he Sustainable Development Goals (SDGs) include a commitment to ensure that by 2030, all girls and boys complete free, equitable, and quality primary and secondary education leading to relevant and effective learning outcomes (SDG 4.1). Performance on this goal is reported as the proportion of learners: “(a) in grades 2/3; (b) at the end of primary; and (c) at the end of lower secondary achieving at least a minimum proficiency level in (i) reading and (ii) mathematics, by sex” (M. Gustafsson, 2019, p. 6). These SDG indicators are based on global research that highlights the critical contribution of foundational skills in reading and mathematics to learners’ overall academic performance (Juel, 1988; Wharton-McDonald et al., 1988; Duncan et al., 2007; Duncan & Magnuson, 2011; Watts et al., 2014; Claessens & Engel, 2013). They also apply research from health and development sectors indicating that foundational skills are essential to reducing social inequality and improving individuals’ social and economic security and well-being (OECD, 2010; UNESCO, 2016). The recent COVID-19 pandemic further underscored the importance of focusing on foundational skills. Studies show the pandemic has resulted in a 17 percent global increase in the number of ten-year-olds lacking basic skills to 70 million learners in 2021 alone (ONE Campaign, 2021). There is an urgent need to reverse this trend so every learner develops the foundational skills required to participate fully in their community’s social and economic life. That means using evidence-based approaches to identify where resources are most needed, both across countries and within a country, to address learning inequities and ensure that learners are able to demonstrate minimum proficiency levels. This panel presentation will show how the Align Learning Inputs to Global Norms (ALIGN) for Minimum Proficiency process can help address these needs. The ALIGN process is an evidence-based gap analysis that uses the Global Proficiency Framework (GPF) as a reference to determine if a country’s education system will enable learners to meet global norms in reading and mathematics. An ALIGN process focuses on four components: curriculum and standards, teaching and learning materials, teacher training, and assessment. The ALIGN process identifies potential gaps or misalignments in each of these four components and actions to address them. The ALIGN process was successfully piloted in four countries, Djibouti, Nigeria, and Uzbekistan.

The Ministry of Preschool and School Education (MoPSE) in Uzbekistan has set the goal of transforming the education system and improving English proficiency among secondary school graduates by 2030. To support this initiative, the Uzbekistan Education for Excellence Program, in collaboration with MoPSE, conducted a study in 2023 to assess the adoption and use of new English language teaching and learning materials in public schools during the 2022-2023 academic year. The study aimed to gather data to inform teacher professional development and effective utilization of the new textbooks for English language instruction in grades 1-11. To collect the necessary data, an online survey was administered from April 25 to May 20, 2023, targeting English teachers in grades 1-11 across all regions of Uzbekistan. The survey focused on teaching practices, instructional approaches, and the utilization of new materials and digital resources. The survey responses from 2,363 English teachers in public schools were analyzed using qualitative and quantitative descriptive statistics techniques. However, the survey process faced methodological challenges such as internet and computer access for some participants, varying levels of familiarity with responding to online surveys, and potential language barriers due to respondents' limited English proficiency. Additionally, the self-reported nature of the data introduced potential biases in the responses. The survey results revealed several important findings. Participating teachers expressed satisfaction with the new textbooks and reported positive changes in their teaching practices, as well as perceived improvements in student learning. However, challenges were identified, including limited textbook availability, time constraints in delivering certain activities suggested in the textbooks, technological barriers, and limited access to audio-visual equipment in classrooms. The integration of real-life contexts in the textbooks enhanced the overall learning experience. Based on these findings, recommendations were made to address the identified challenges and improve the adoption process, including providing guidance, addressing textbook availability, offering comprehensive teacher training, and establishing mechanisms for continuous review and student feedback. Implementing these recommendations might support the enhancement of English language instruction in Uzbekistan. In conclusion, the adoption of the Guess What! and Prepare series as new English language instructional materials in Uzbekistan's public schools has yielded positive results, as reported by participating teachers. The integration of these textbooks has brought about changes in teaching practices and perceived achievements of student learning outcomes. The survey results indicated a high level of teacher satisfaction with the Student's Books, Workbooks, and Teacher's Books, with the Workbooks receiving the highest satisfaction level at 83%. Moreover, over 67% of teachers acknowledged that the new textbooks had brought about a change in their approach to teaching English. Overall, the study highlights the positive influence of new instructional materials on English language instruction in the Republic of Uzbekistan. The successful integration of the Guess What! and Prepare series sets the stage for continuous progress in English language learning and teaching. It is crucial to build upon these findings and recommendations to further improve teaching practices, support teacher professional development, and ensure ongoing enhancement of English language instruction throughout the country.