In 2009 the Philippines Department of Education issued Order No. 74, “Institutionalizing Mother Tongue-Based Multilingual Education (MTB-MLE),” calling for the use of the learners’ mother tongues (MTs) in the early primary grades for improving learning outcomes. In 2012, the MTB-MLE policy was rolled out nationally in all Grade 1 (G1) classrooms. By the 2014– 2015 school year, all public schools were expected to be using one of 19 mother tongues as the medium of teaching and learning (MoTL) from Kindergarten (KG) through G3. The objective of this study was to provide insight into the relationships between the teachers’ and students’ language usage, the MTB-MLE policy implementation, and student reading outcomes, especially in areas with linguistically heterogeneous populations. It sought to examine how language usage in the classroom conforms to or diverges from the MTB-MLE policy after six years of implementation, which factors are associated with higher policy implementation, and how language usage by teachers and students relates to student learning outcomes.

This report summarizes the findings of additional analyses conducted to delve deeper and develop more insight into the piloting of the Self-Administered Early Grade Reading Assessment (SA-EGRA) and the Self-Administered Early Grade Mathematics Assessment (SA-EGMA). These tools were developed and tested by RTI International with the support and direction of Imagine Worldwide. Children complete these assessments independently on tablet-based software while in a classroom with their peers. An adult supervises the process.

This report summarizes the findings of an effort to develop and validate tablet-based, self-administered assessments of Chichewa-language foundational literacy and numeracy in the early grades in Malawi. RTI International developed the two assessments, known respectively as the Self-Administered Early Grade Reading Assessment (SA-EGRA) and the Self-Administered Early Grade Mathematics Assessment (SA-EGMA), with the support and at the direction of Imagine Worldwide. The assessments are deemed “self-administered,” because children complete the assessments independently in response to instructions and stimuli embedded in the tablet-based software. However, adults typically supervise the organization and conduct of the assessment as well as the collection of individual data from the tablets for analysis.

The purpose of this paper is to present a methodology for understanding materials usage in primary classrooms in Sub-Saharan Africa that centers teachers’ actions and voices. The United Nation’s Sustainable Development Goal 4 focuses on improved primary education around the world. To meet this goal, many large, donor-funded interventions aim to improve education through provision of teacher’s guides and student textbooks. However, what many of these interventions lack is a systematic way to understand how and why teachers are making pedagogical decisions while using materials. There is a large body of work that seeks to understand how teachers make decisions as they teach, and the ways these decisions are influenced by their knowledge and beliefs. Drawing from this work, we describe a methodology and set of tools that uses observations and interviews to identify key decisions that teachers make in the classroom and why teachers made those decisions. We piloted and iteratively refined this methodology over the course of three studies and use examples from these studies to illustrate the methodology. By closely observing and listening to teachers, we gain insights that allow us to continually refine and improve materials to ultimately improve the quality of classroom instruction.

In 2009 the Philippines introduced a mother tongue-based multilingual education language policy requiring the “mother tongue” as the language of instruction (LOI) in kindergarten through grade 3. Using teacher classroom language data collected from four LOI groups in 2019, we compared the frequency of teachers’ use of the target LOI in different contexts, including urban versus rural classrooms, classrooms with relatively homogeneous student language backgrounds versus more heterogeneous classrooms, and classrooms with materials in the target language versus classrooms without. We also examined language usage against characteristics of the teacher populations, including language background, years of experience, training, and beliefs about the best language for initial literacy. The results strongly suggest that the most influential levers for increasing teacher usage of a designated LOI in these contexts are ensuring that teachers are assigned to schools where the LOI matches their own first language and providing teaching and learning materials in the target LOI, especially teacher’s guides. These two factors were more strongly and more consistently correlated with teacher use of the LOI than all other variables examined. The linguistic homogeneity of the student population also showed a statistically significant though lower impact on teacher language usage. This document was developed with support from the American people through the United States Agency for International Development.

This report summarizes the findings of an effort to develop and validate tablet-based, self-administered assessments of English-language foundational literacy and numeracy in the early grades. The tools described in the report were developed at the request of Imagine Worldwide with the support of the Jacobs Foundation. RTI carried out field testing and a pilot study to assess the tools' internal consistency, test-retest reliability, and concurrent validity with respect to "traditional" EGRA and EGMA. RTI International developed the two assessments, known respectively as the Self-Administered Early Grade Reading Assessment (SA-EGRA) and the Self-Administered Early Grade Mathematics Assessment (SA-EGMA), with the support and at the direction of Imagine Worldwide. The assessments are deemed “self-administered,” because children complete the assessments independently in response to instructions and stimuli imbedded in the tablet-based software. However, adults typically supervise the organization and conduct of the assessment as well as the collection of individual data from the tablets for analysis. The tools have been developed under an open-source license. The code can be viewed and downloaded for reuse or modification at https://github.com/ICTatRTI/SE-tools/blob/main/README.md. Users of RTI's Tangerine software may request that the SA-EGRA and SA-EGMA tools be added to their Tangerine groups via https://www.tangerinecentral.org/contact

The Research for Effective Education Programming – Africa (REEP–A) Task Order, awarded in September 2016, is a five-year project within the United States Agency for International Development (USAID) Africa Bureau. The primary objective of REEP–A is to generate and effectively disseminate Africa regional and country-specific education data, analysis, and research to inform the prioritization of needs and education investment decisions. One research focus under REEP–A is to explore how teachers’ language proficiency and literacy in the language of instruction (LOI) influence students’ learning outcomes. It is hypothesized that the teachers’ level of language proficiency and literacy in the LOI can either facilitate student learning, if high; or impede learning, if low. However, limited data are available on how teacher language and literacy skill levels precisely relate to student outcomes. Exploring this relationship requires having a valid and reliable tool to measure teachers’ language and literacy skills. USAID therefore commissioned the development of the Teacher Language and Literacy Assessment (TLLA) to assess teachers’ language proficiency and literacy in the required LOI. The TLLA, adaptable to any language, consists of subtasks assessing speaking, listening, reading, and writing, as well as vocabulary and grammar, in the language(s) used for teaching and learning at the primary school level in a given context. It is envisioned that policymakers, researchers, and other education stakeholders can use the TLLA to collect data on teachers’ linguistic assets and gaps in the languages that their role requires them to use. These data could be useful for identifying factors contributing to student learning outcomes, informing teacher training and professional development needs, designing teacher deployment policies, and evaluating the impact of interventions aimed at improving teachers’ or students’ language and literacy skills. The aim of this report is to present the new tool and disseminate the initial findings around its technical adequacy. The international community has directed considerable effort to assessing and understanding the impact of language on students’ literacy and language skills, and the TLLA is a complementary tool that shows promise for understanding teachers’ language assets and needs.

The purpose of this session is to articulate a research framework that centers teachers’ voices when trying to understand how teachers use curriculum materials in the classroom. Operating in the context of highly structured lesson plans, the approach identifies ways in which teachers exercise their professional discretion to modify the lesson and frames conversations to elaborate the motivations driving the teachers’ choices. The approach has been iteratively refined across three studies; taken together, the studies provide evidence for the value of listening to teachers and being responsive to their voices during implementation. The research framework uses the lens of modifications, or changes to the intended lesson plan implemented within one class period. Modifications can be large or small, additive or subtractive. For example, in a lesson with a section for independent student practice, a large modification might be skipping the practice section entirely. Or, during a lesson focused on blending of initial sounds using 3 example words, a small modification might be extending the exercise by adding extra words. Researchers observe the lesson, noting any modifications; after the lesson, the researchers select some of the modifications and ask the teachers why they made the choices they did. Analyses of teachers’ explanations highlight the importance of understanding why teachers make the choices they do. For example, a teacher who skipped the independent practice section because they don’t think their students are ready to do the skill on their own suggests that the teacher is exercising agency and using her knowledge of her students to inform her decision-making. Insights such as this one can guide decisions on projects. It may be that while the intention of the teacher was guided by knowledge of students, the end result is not desirable from the project’s point of view. Understanding why the teacher made this choice provides implementers with better and targeted ways to address choices that impact the overall goals of the project. In this presentation, we draw on data from an exploratory case study to understand use of new mathematics materials in Liberia, a more in-depth case conducted in Malawi on teacher use of reading materials, and finally, a systematic study examining how reading teachers use materials across four Sub-Saharan African countries. We use each case to highlight both an aspect of the research framework and instances of modifications to project implementation driven by teachers’ voices. By focusing on teacher voices, we disrupt the deficit notion that teachers are “resistant” to change, or do not “understand” new pedagogies. Instead, we aim to value teacher voices and integrate their insight into implementation programs. By doing this, we not only raise the likelihood of successful use of new materials and pedagogies, but we also develop more responsive pedagogy that better matches existing classroom cultures.

This presentation highlights some of the results and implications of a 2019 study on fidelity of implementation of the language of instruction policy in the Philippines. In 2009 the Philippines Department of Education issued Order No. 74 calling for the use of the learners’ mother tongue (MT) as the main medium of teaching and learning (MoTL) in kindergarten through grade 3. The policy introduces Filipino and English as additional languages of instruction, gradually increasing their usage until they take over as the primary MoTL in grade 4. Successfully navigating students through three languages in the early grades is a daunting task. Building on previous studies of MTB-MLE policy implementation in the Philippines, this study examined how teacher assignment, class sectioning (grouping learners by MT), materials provisioning and usage, and teachers’ language usage in the classroom conforms to or diverges from the policy, especially across locations with different contextual factors. It also looked at the factors associated with higher implementation.

The objective of this study was to provide insight into the relationships between the teachers’ and students’ language usage, the MTB-MLE policy implementation, and student reading outcomes, especially in areas with linguistically heterogeneous populations. It sought to examine how language usage in the classroom conforms to or diverges from the MTB-MLE policy after six years of implementation, which factors are associated with higher policy implementation, and how language usage by teachers and students relates to student learning outcomes.