Longitudinal Study of Literacy and Language Acquisition in the Philippines [CIES 2024 Presentation]

The research on first language learning is the premise for the Philippines Mother-Tongue-based Multi-Lingual Education (MTB-MLE) Policy which requires schools to deliver the Kindergarten to Grade 3 curriculum in the mother tongue (home language) of the school’s community (Corder, 1983; Walter & Dekker, 2011. Salmona, 2014; Yadav, 2014). Considering that the national curriculum requires children to transition to and learn in Filipino and English at the start of Grade 4, the question of mother tongue’s effect on second and third language acquisition is not academic, but central to the policy debate on MTB-MLE efficacy. The MTB-MLE policy consists of five discrete areas: curriculum, learning resources, assessment, teacher recruitment and training, and community support. MTB-MLE has proven challenging with respect to the myriad languages and dialects. Out of the 180 plus languages spoken, only 19 have been formally supported with an official orthography, standard learning resources and teacher professional development materials. In communities with non-supported languages, teachers contextualize the teaching and learning materials, often translating and adapting from the linguistically nearest mother tongue to their own. In a 2019 study on MTB-MLE, the Philippines Institute of Development Studies found inconsistent implementation across schools, including teachers’ negative attitudes toward MTB-MLE, linguistic diversity of learners and classrooms, and lack of teaching and learning materials being key factors hindering its implementation (PIDS, 2019). The Bicol Region poses a particular challenge. In an area slightly larger than Connecticut with a population of just under 4 million, thirteen different languages plus numerous dialects are spoken in the various provinces, cities and towns that dot this volcanic region (Lobel, 2019). The standard language of Central Bikol, which is the mother tongue of approximately half the population consists of six different local dialects depending on the locale. Wedged in the middle of the Central Bikol-speaking area is a cluster of five distinct languages: Rinconada, Buhi-non, Bikol Libon, West Albay Bikol, and Miraya, with only one or two municipal communities each that speak these languages. Under the USAID Advancing Basic Education in the Philippines (ABC+), RTI conducted a longitudinal study that provides new evidence on the efficacy of MTB-MLE. The study tracked the language and literacy acquisition of four groups of learners: those Central Bikol learners who are learning in a fully supported language; Buhi-non speaking learners who are learning in an unsupported language (ie, Buhi-non); Central Bikol speakers who’s language of instruction is Tagalog and Tagalog learners who’s language of instruction is Tagalog. The findings show evidence that the Central Bikol learners whose LOI is Tagalog are performing at par or worse in nearly all domains of reading in their first (Central Bikol), second (Tagalog/Filipino) and third languages (English). The findings show a flattening of their trajectory in terms of the pace of language and literacy acquisition, as well as significant equity gaps in comparison to their Tagalog peers. The evidence points toward continued support to MTB-MLE, despite the challenges in implementation.

Harnessing AI Speech Recognition Technology for Educational Reading Assessments amid the COVID-19 Pandemic in the Philippines [CIES 2024 Presentation]

The challenges of conducting educational assessments in low- and middle-income environments during the pandemic can be eased by AI-powered speech recognition technology that offers a promising solution to enhance assessments. By utilizing advanced algorithms and machine learning techniques, this technology accurately transcribes spoken language into written text. Reading fluency and comprehension can be efficiently measured by integrating AI speech recognition into assessments, without the need for physical presence. From the safety of their homes, students can perform the assessments using their smartphones or computers, assisting schools in organizing complex logistics. AI speech recognition technology has a great edge in providing instant feedback, which is one of its main benefits. While students are speaking out loud, the AI system can swiftly assess their intonation, pronunciation, and tempo, rendering quick guidance and identifying areas for refinement. This personalized feedback effortlessly assists students in boosting their reading abilities, even in the absence of in-person teacher interactions. Moreover, AI-backed evaluations can be carried out on a wider scale, enabling educators to collect extensive data on reading patterns and tackle specific issues that are commonly seen among students. The objective of this presentation is to feature the self-administered AI Speech recognition Computer-based reading assessment that RTI developed at the request of the Philippines Department of Education (DepEd), under the USAID All Children Reading (ACR). Throughout the school years of 2020-2022, the COVID-19 pandemic posed significant challenges to conducting face-to-face assessments, particularly in remote learning environments. As a result, teachers faced constraints in terms of time and resources to individually assess learners' reading skills against crucial learning competencies. The proposed automated assessment technology offered a potential solution to alleviate this burden and streamline the evaluation process, allowing educators to efficiently gauge students' reading abilities remotely. In February 2022, ACR-Philippines initiated discussions with USAID and the Philippines Department of Education (DepEd) to produce a ‘proof of concept’ that explores the feasibility of a self-administered computer-based reading assessment (CoBRA) in English and Filipino for students in the Philippines. The concept found resonance with the DepEd leadership as the adoption of a computer-based format for assessments aligns with international practices and provides an excellent opportunity to ascertain students' preparedness to take computer-based tests, such as the Program for International Student Assessment (PISA). The result of this intervention generated a prototype solution piloted and tailored to fit DepED's existing platforms for supporting remote learning and delivery. The pilot provided insights on the feasibility of a computer-based assessment in the context of the Philippines for students in grades 4 -6. The research findings examined the performance, reliability, and results of the AI Speech recognition technology reading assessment, compared to the assessor-administered approach of the assessment. The research generated key design considerations, feedback from end users, recommendations regarding implementing similar approaches, and the future development of similar technology for other languages within and outside the Philippines.

Pakistan Basic Education Sector Assessment: Climate Resilience [CIES 2024 Presentation]

The rapidly changing climate is a threat that sees no borders and its impact on the education sector is severe. Yet, often in the wake of climate disasters, the education sector is widely overlooked and underfunded. The purpose of this group panel presentation is thus to explore different examples of research and programming which aim to improve the education sector’s resilience to the impacts of climate change. The panel is comprised of stakeholders from USAID and international educational research and implementing organizations from around the globe which have experience with how education systems can become more resilient to such disasters. This panel will draw from new global frameworks and strategies on climate resilience, as well as research and implementation examples from the case study of Pakistan, where unprecedented 2022 flooding severely impacted an already beleaguered education system. Further, the panel will explore the intersection of climate change impact and marginalized communities.

2019 Language Usage Study in Bahasa Sug, Chavacano, Magindanawn, and Mëranaw Mother Tongue Schools (USAID ACR Asia Philippines)

In 2009 the Philippines Department of Education issued Order No. 74, “Institutionalizing Mother Tongue-Based Multilingual Education (MTB-MLE),” calling for the use of the learners’ mother tongues (MTs) in the early primary grades for improving learning outcomes. In 2012, the MTB-MLE policy was rolled out nationally in all Grade 1 (G1) classrooms. By the 2014– 2015 school year, all public schools were expected to be using one of 19 mother tongues as the medium of teaching and learning (MoTL) from Kindergarten (KG) through G3. The objective of this study was to provide insight into the relationships between the teachers’ and students’ language usage, the MTB-MLE policy implementation, and student reading outcomes, especially in areas with linguistically heterogeneous populations. It sought to examine how language usage in the classroom conforms to or diverges from the MTB-MLE policy after six years of implementation, which factors are associated with higher policy implementation, and how language usage by teachers and students relates to student learning outcomes.

Characteristics of Select Philippine Mother Tongue Languages Used in Basic Education Teaching and Learning (USAID ACR Asia)

This reference document is a companion to the Language Complexity Study conducted by RTI International under the All Children Reading–Philippines project in 2020. The study was a secondary analysis of Early Grade Reading Assessment (EGRA) data at multiple time points, looking specifically at the effect of language complexity on reading acquisition of second and third languages (L2 and L3, respectively). The study used the 2013 and 2019 National EGRA data sets to analyze performance according to categories of language complexity based on syllabic complexity, orthographic depth, and other related items. The study was guided by the methodology described by Brunette et al. (2019), who studied the effects of language complexity on reading outcomes in Uganda. The languages selected for analysis were those among the officially supported mother tongue (MT) languages of instruction in the Philippines. Analysts assessed whether the level of complexity was in any way predictive of the average increase or decrease in L2 and L3 scores across schools as measured in 2019 (provided there were schools that reported using MT in 2019, which was not the case for three of the languages: Chavacano, Ivatan, and Sambal.

Reading achievement in the Philippines: The role of language complexity (USAID ACR Asia)

This study looks at the impact of first language (L1, or “mother tongue”) complexity on reading achievement in the Philippines using Grade 3 Early Grade Reading Assessment (EGRA) data collected in 2013 and 2019. EGRA data were collected from 232 schools in 2013, when students learned to read in the national languages of Filipino and English. These data on English and Filipino performance were collected again in the same schools in 2019, when students would have, according to policy, learned to read first in their mother tongue.

The Role of Mother Tongue Language Complexity in Determining L2 and L3 Reading Outcomes in the Philippines (USAID ACR Asia)

This study uses national Grade (G) 3 Early Grade Reading Assessment (EGRA) data from 2013, when G3 students learned to read in Filipino and English rather than a mother tongue, and comparable data from 2019, when G3 students would have, according to policy, first learned to read in their mother tongue. The data were used to better understand the role of L1 complexity in L2 and L3 reading acquisition. Sample: 241 schools; 232 schools were the same in 2013 and 2019. Final sample used for analysis: 2,264 G3 students in 2019 and 2,267 G3 students in 2013. Children were assessed in Filipino (L2) and English (L3). Secondary analysis of the data set looked at reading performance and changes in reading performance according to language complexity.

Classroom-Based Early Grade Reading Assessment— Cambodia

The purpose of this activity was to develop and pilot a CB-EGRA in the Khmer language for validation and use in Cambodia. The CB-EGRA is a paper-based assessment that can be administered with little training to a group of students at one time. It is therefore an arguably more efficient and cost-effective method of obtaining early grade reading data, compared to a traditional EGRA.

Uzbekistan EGRA and EGMA Deep Dive Analysis

This report presents the findings of a deep dive impact evaluation of the United States Agency for International Development (USAID) Uzbekistan Education for Excellence Program (The Program), which was initiated on December 9, 2019, and originally scheduled to end on December 8, 2023, then extended through March 31, 2024. The Program is implemented by a consortium of partners including RTI International (RTI) as the consortium lead and Florida State University and Mississippi State University as partners. For this report, the Program used a comparative analysis of Early Grade Reading and Mathematics Assessments (EGRA and EGMA, respectively) administered at baseline in 2021 and at endline in 2023. The Program evaluation focused on students in grades 2 and 4. In November and December of the 2021-22 school year, the baseline EGRA and EGMA were administered to students who completed grades 2 and 4 and had been in grades 3 and 5 for three months. The endline assessments were administered to students in grades 2 and 4 in May of 2023, a few weeks prior to the end of that school year. This meant that students at endline were being assessed after having completed 68 fewer days of schooling than those who were assessed at baseline.

EGRA-EGMA Baseline Briefer (Uzbekistan UEEP)

The Uzbekistan Education for Excellence Program(the Program) is a 4-year program (December 9, 2019–December 8, 2023) funded by the United States Agency for International Development (USAID) and implemented by the RTI International Consortium1 in collaboration with the Uzbekistan Ministry of Public Education. The Program conducted baseline Early Grade Reading and Mathematics Assessments (EGRA and EGMA, respectively) in November and December 2021. The purpose of the baseline was to measure the pre-intervention levels of mathematics and Uzbek language reading achievement for students at the end of grade 2 and grade 4. The baseline was originally planned to assess students completing grades 2 and 4 at the end of the 2019–2020 school year in May 2020. However, the baseline was postponed to the beginning of the following school year—November–December 2021—because of COVID-19, and grades 3 and 5 students were assessed as proxies for students completing grades 2 and 4, respectively.

Pages