Manual para la evaluación inicial de la lectura en niños de educación primaria (EGRA Toolkit in Spanish)

Este manual es el producto de una colaboración en curso entre una gran comunidad de académicos, profesionales, funcionarios gubernamentales y profesionales del desarrollo educativo, para promover la causa de una temprana evaluación y adquisición de la lectura entre los niños de la escuela primaria en países de bajos ingresos.

Learning to Thrive: Education, opportunity and foundational skills in El Salvador [CIES 2021]

The El Salvador Early Grade Reading Assessment (EGRA) was conducted in 2018 in late June and early July 2018 (toward the end of the El Salvador school year, which runs from January to October). The objective was to provide the Government of El Salvador with information on the reading performance of public school students in second and third grades. The sample was designed to represent government schools at the national level with a minimum enrollment of six students in each of the second and third grades and all of the second and third grade students in these grades. EGRA is an individually administered oral assessment of foundational reading skills; in Spanish, the skills tested include letter sound identification, familiar word reading, and oral reading fluency, among others. Closing early learning deficits in contexts like El Salvador is critical to improving economic development. According to a World Bank review of the causes of dropout in Central America, skills gaps that are not corrected through additional support and remediation compound over time. Students with weak foundational skills are more likely to struggle and become disinterested as content becomes more complex. As students age, they also face rising direct and opportunity costs and increased risk of teenage pregnancy and violence. Together these factors are associated with higher levels of grade repetition and school dropout. Analyzing El Salvador household survey data, the same report indicated that 40% of youth who had left school cited lack of interest while 25% reported economic causes as the main reasons for dropping out of school. Among girls, personal reasons, including pregnancy and caring for younger siblings, are the highest reported cause at 32%. The EGRA results indicate that 49% of second graders and 40% of third graders are reading at or below a rate of one correct word per second. Students performing at this level for oral reading fluency are identified as “At Risk” for developing later reading difficulties, and potentially school failure. This means that additional remediation steps, such as intensive instruction and frequent progress monitoring, are needed to increase the chances that these students catch up with their peers. Early skills gaps are associated with higher levels of grade repetition and in contexts like El Salvador, where primary completion is not universal, school dropout. On nearly every component of the assessment, boys, students in rural schools, students from lower-income groups, and students with some form of self-reported disability all scored lower than their more advantaged peers. Income disparities were especially noteworthy: Students in the lowest income group were more than three times as likely to score zero on the oral reading fluency passage relative to students in the highest income group (20% versus 6%).

Teacher Language and Literacy Assessment: Final Report

The Research for Effective Education Programming – Africa (REEP–A) Task Order, awarded in September 2016, is a five-year project within the United States Agency for International Development (USAID) Africa Bureau. The primary objective of REEP–A is to generate and effectively disseminate Africa regional and country-specific education data, analysis, and research to inform the prioritization of needs and education investment decisions. One research focus under REEP–A is to explore how teachers’ language proficiency and literacy in the language of instruction (LOI) influence students’ learning outcomes. It is hypothesized that the teachers’ level of language proficiency and literacy in the LOI can either facilitate student learning, if high; or impede learning, if low. However, limited data are available on how teacher language and literacy skill levels precisely relate to student outcomes. Exploring this relationship requires having a valid and reliable tool to measure teachers’ language and literacy skills. USAID therefore commissioned the development of the Teacher Language and Literacy Assessment (TLLA) to assess teachers’ language proficiency and literacy in the required LOI. The TLLA, adaptable to any language, consists of subtasks assessing speaking, listening, reading, and writing, as well as vocabulary and grammar, in the language(s) used for teaching and learning at the primary school level in a given context. It is envisioned that policymakers, researchers, and other education stakeholders can use the TLLA to collect data on teachers’ linguistic assets and gaps in the languages that their role requires them to use. These data could be useful for identifying factors contributing to student learning outcomes, informing teacher training and professional development needs, designing teacher deployment policies, and evaluating the impact of interventions aimed at improving teachers’ or students’ language and literacy skills. The aim of this report is to present the new tool and disseminate the initial findings around its technical adequacy. The international community has directed considerable effort to assessing and understanding the impact of language on students’ literacy and language skills, and the TLLA is a complementary tool that shows promise for understanding teachers’ language assets and needs.

Early Grade Reading in Uganda Analytic Report: Contextual Factors that Impact Reading Outcomes

In 2020, LARA undertook an analytic research into the contextual factors impacting reading outcomes. This research involved a review of the existing literature on the contextual factors affecting reading outcomes and a secondary analysis of existing datasets collected as part of the monitoring and evaluation activities of LARA and SHRP. The study team conducted multi-variate analyses to determine what contextual factors predict student learning outcomes. These were grouped into the three categories: (1) school, classroom, and system; (2) teacher characteristics and instructional practices; and (3) learners and home environment. Although the analyses included demographic factors, such as socioeconomic status, the focus in the report is on predictors of learning outcomes that could be controlled by education programs. The report also provides implications of the findings and recommendations for future education programming.

2019 National Early Grade Reading Assessment (EGRA): English and Filipino, Grade 3 Findings Report

This study explores the extent to which mother-tongue-based multilingual education (MTB-MLE), as implemented at scale in the Philippines, is having an impact on students’ reading and writing skills in English and Filipino at the end of Grade 3. This 2019 study repeats a 2013 study that evaluated the reading skills of a representative sample of students from across the Philippines using an Early Grade Reading Assessment (EGRA) carried out by RTI, the Philippines Department of Education (DepEd), and a local research firm. In both cases, the study was administered by RTI-trained assessors made up of local education authorities and professional survey researchers. For the 2013 study, the Grade 3 students assessed had completed lower primary under the pre-MTB-MLE curriculum, which used only English and Filipino as the medium of instruction. For this 2019 study, the Grade 3 students had 3 years of learning under the MTB-MLE curriculum, which was designed to teach lower primary students in their mother-tongue language before transitioning into learning in Filipino and English as mediums of instruction in upper primary. [508 Compliant version to be updated].

Uganda/LARA: EGR Action Research Tools

LARA developed action research tools to measure the level of fidelity of implementation of the EGR methods and generate lessons learned to inform adaptations in EGR programming. The action research tools gather both historical and real-time data at the school. They include the EGR core methodologies action research tool; the remedial instruction action research tool and the intensive coaching action research tool (subdivided into two tools i.e. head teacher coaching event log and school based community of practice event log). The EGR core methodologies action research tool assesses the teacher’s perception of the Teacher Guide usability, level of macro pacing, implementation of lesson plan elements, implementation of core EGR methodologies and tracking of instructional adaptations by the teacher. The remedial instruction research tool tracks the teacher’s perception to remedial instruction, the implementation of group-based instruction as well as in-class assessment. The intensive coaching action research tool tracks teacher’s perception of intensive coaching and keeps a log of head teacher instructional coaching events in addition to school-based community of practice activities. The action research tools are designed to be deployed electronically in order to seamlessly incorporate extra data quality standards and innovations like the Stalling’s classroom observation snapshot (Stallings and Kaskowitz, 1974 ). The project also developed the action research process flow guidelines to guide data collection activities.

Uganda/LARA EGR Monitoring and Support Supervision Tools

There are two sets of monitoring and support supervision (MSS) tools that the project has been using throughout the implementation period. These are; (i) the Lesson Observation Tools; and (ii) the Head teacher/CCT Coaching Tool. The lesson observation tools are used by the support supervision actors (e.g., school inspectors, CCTs, head teachers and project staff) during support supervision visits to schools. Specifically, the tools gather monitoring data on the uptake of EGR instructional methods by teachers to understand what teachers are doing well and areas where they need support. LARA developed a lesson observation tool for every grade (P1 – P4). Each tool has a section to assess the teacher’s preparedness for the lesson they are going to teach; a check list to assess the teacher’s instructional practices during the lesson; and the post observation section where the support supervision actor summarizes what the teacher did well and areas that the teacher needs to improve. The lesson observation tool for each grade is accompanied by a learner check which is administered to a sample of 4-6 learners per grade. The purpose of a learner check is to quickly show the classroom teacher and or head teacher the reading abilities of the learners present in the observed EGR lesson. The learner checks are designed from the content of the previous weeks and the teacher is able to gauge and determine the areas to prioritize when carrying out revision or remedial sessions. The Head teacher/CCT Coaching Tool is used by the zonal head teachers and CCTs to support head teachers so that they can in turn effectively support teachers in their schools. The zonal head teachers and CCTs observe and support head teachers to provide effective instructional support to teachers. The tool has a pre-observation section which assesses how the head teacher is prepared to support the teacher in class; a lesson observation section used by the zonal head teachers and CCTs to evaluate the actions of the head teacher while in the class observing the lesson; and post observation section to appraise how the head teacher conducts the post observation discussion with the teacher.

Uganda/LARA : EGRA and supplementary data collection instruments

The Early Grade Reading Assessment (EGRA) is a diagnostic instrument designed to quickly assess foundational skills for literacy acquisition of pupils in Early Grades of primary school. This diagnostic tool, whose content has been adapted for Uganda and Ugandan local languages, can include a number of subtasks depending on the grade being assessed. EGRA is administered to pupils both in their local language and in English via tablets using a software application (for example Tangerine) designed specifically to collect data on mobile devices. EGRA data can also be gathered manually using paper forms. Each instrument is administered by trained assessors in one-on-one sessions with individual pupils, and requires approximately fifteen minutes. The sub tasks in the English EGRA tools used by LARA include letter sound knowledge, oral passage reading, reading comprehension and vocabulary. LARA administers the English sub-tasks mainly to the P3 and P4 pupils. The subtasks in the local language (Luganda, Runyankore/Rukiga and Runyoro/Rutooro) EGRA tools include orientation to print, letter sound knowledge, segmenting, oral passage reading, reading comprehension, and listening comprehension. Apart from orientation to print that is administered to only P1 pupils, the rest of the local language sub-tasks are administered to P1-P4 pupils. The EGRA tools are accompanied by a pupil stimuli packet used to administer the letter sound knowledge and oral passage reading sub tasks. The subtasks used by LARA were adopted from the EGRA tools developed for the School Health and Reading Program (SHRP). SHRP adapted and vetted the tools to the three languages during a series of weeklong workshops that included researchers, primary school teachers, language board members, Coordinating Center Tutors (CCTs) and MoES staff. The adaptation workshop for Luganda was held in December, 2012, Runyankore/Rukiga tools were adapted in January, 2013 and Runyoro/Rutooro tools were adapted in August 2013. The tools were also piloted in each of the three language areas during the workshops. As part of EGRA data collection, LARA administers supplementary data collection tools to assess pupil context and instructional leadership. The tools also provide important contextual information on the teachers and schools participating in EGRA. These tools include; the pupil context interview, a head teacher interview, teacher interview and school inventory. The following provides a summary of each of the tool. Pupil context interview: Used to gather information on pupils’ preschool attendance, language spoken at home, possessions in the household, and support for reading in the home. Head Teacher Questionnaire: Used to gather information from head teachers regarding their instructional leadership, including their training and education background and their support to the teaching of reading at lower grades. Data from this instrument is used to inform training and targeted corrective actions intended to improve the managerial skills of head teachers and their support to the teaching of reading. Teacher Questionnaire: Used to gather information on the teachers’ education and experience and demographics, support and supervision received, and the availability of teaching materials. The information provides the basis of training and the provision of teaching materials to teachers to help them improve their pedagogical skills. School Inventory Form: Used to gather information on school basic infrastructure (for example water source, latrines and electricity) as well as the presence and use of a school library.

Measurement of Inequality in Learning Levels [Conference Presentation]

The presentation summarizes a paper by Tim Slade and Luis Crouch on the measurement of learning inequality before and after a successful reading project. The paper concludes that at least for the case studied, the project improved not only the averages but also reduced the inequality. The paper was prepared under the auspices of a conference on "Learning at the Bottom of the Pyramid" organized by IIEP and Dan Wagner of U Penn. This is the presentation that was delivered at vCIES 2020.

Implementing Malawi’s National Reading Program: Opportunities, Achievements, and Challenges [Conference Presentations]

The Malawi National Reading Program (NRP) is the country's flagship education program aimed at improving the reading skills of all Malawian learners in Standards 1 to 4. USAID supports the NRP by providing finance and technical assistance through several activities including MERIT: Malawi Early Grade Reading Improvement Activity (MERIT), Yesani Ophunzira (YESA), Strengthening Early Grade Reading in Malawi (SEGREM) and Reading for All Malawi (REFAM). MERIT focuses on teacher professional development and support, YESA on continuous assessment and remediation, REFAM on inclusive education, and SEGREM on materials development. Since 2016, the NRP has reached over 56,000 teachers and 4.6 million students in all public schools in Malawi. In addition, results from the 2018 Early Grade Reading Assessment shows that the NRP has had some success in improving reading skills of students in Chichewa and English, and especially for those students in the Standard 4. Implementing successfully at a national scale requires that all partners have had to coordinate and collaborate with each other, with the Ministry of Education, Science and Technology (MoEST) in the lead. This panel includes representatives from the MoEST and NRP implementation partners discussing their roles in supporting the NRP and sharing lessons around their approach, achievements, and challenges as they collaborate to get all children learning. The combined experiences of the different partners will be useful for other projects, organizations, and governments who are looking to make a wide-scale change in their education systems.

Pages