Using EGRA data for differentiated instruction: Learning profiles and instructional needs in Uganda

Presentation delivered at CIES2017 (Atlanta). A challenge of large-scale education research projects in international development is determining the most appropriate way to effectively report findings for a wide variety of audiences (e.g., researchers, ministry officials, donors, and other relevant stakeholders). It is important to consider technical rigor and accessibility, while ultimately providing results that can be used to inform policy and instruction. Using Early Grade Reading Assessment (EGRA) data from Uganda in two languages, we are replicating an approach for categorizing students into learning profiles, which are directly tied to their particular instructional needs. We have conducted this analysis previously with data from Indonesia. We had conceptualized on the framework to be used across different context This study reports on the efficacy of using the same method with this sample with Luganda speakers. We divided students into five learning profiles based on their reading ability (Next Grade Ready, Fluent, Instructional, Beginner, and Nonreader) and then examined the relationship among these profiles and their reading skills on a variety of EGRA subtasks to determine the instructional need required to promote students from one profile to the next. Our learner profile method has been used with data in two countries and two languages. EGRA has been used in over 70 countries and in more than 100 languages. This study is an initial attempt to explore the value in this method.

The opportunities and challenges of collaborating with government and other partners on the Ethiopia READ program

Presentation delivered at CIES 2017 (Atlanta). As the READ TA project’s main focus is on providing technical assistance to and building the capacity of the Ethiopian Ministry of Education and its Regional Education Bureaus to develop and conduct the foundational components of a reading program (i.e., curriculum development, in-service and pre-service teacher training, and teacher support), the project has had to work through government systems to accomplish its objectives. This has provided great opportunities along with challenges. While there are some activities in which the project has direct involvement in the inputs and outcomes (curriculum development workshops, training of trainers, incorporating technology), there are others which are largely outside of the control of the project (printing of textbooks, training of teachers, government approvals). But all activities are necessary for the reading program to be successful. This requires establishing strong collaborative relationships with government counterparts and having the flexibility to adjust to the ever-changing situation.

Revising English Curriculum in Ethiopia

Presentation delivered at CIES 2017 (Atlanta). In Ethiopia, English as a second language has been taught as a subject in primary schools for many years. At the same time, English has been used as the medium of instruction (MOI) beginning in the upper primary school level. Although the English curriculum has been reviewed and revised a number of times, early grade reading assessments of English indicate that students’ performance continues to be very low in Ethiopia. Other research indicates that one of the major obstacles for providing quality education in secondary and higher education in Ethiopia is the lack of English language proficiency in most students. This presentation will discuss how the USAID-funded READ TA Project is working with the Ethiopian Ministry of Education (MOE) to address this problem by revising the English curriculum to more explicitly focus on preparing students to use English as a MOI for all subjects in the upper primary years. By treating English as a future MOI rather than merely as a second language the MOE hopes to make improvements in English proficiency and the quality of education. In order to understand how to best improve the English curriculum the project worked with the MOE to conduct a desk review of the current curriculum along with a nationally representative field study to learn how English is being implemented in schools. As a result, major gaps were identified related to challenges in transition to English as medium of instruction, language content, the teaching-learning approach, alignment of mother tongue and English, and teacher training. To address these gaps READ TA has followed an innovative approach, which was not practiced in previous years, in revising English curriculum materials. This starts from understanding that the English curriculum should be revised comprehensively from kindergarten to grade 12 to have a very clear picture of the progression and ensure cohesion across the grades. It also is based on the understanding that children learn to read and write best in their mother tongue which allows them to bridge to learning to read and write in an additional language (such as English). With this understanding a diverse team of professionals was compiled including reading experts, curriculum experts, gender experts, inclusive education experts, developmental psychologists, assessment experts, and representatives from each of the regions and the MOE.. Quality assurance was taken as a key issue, by making quality assurance at different levels: quality assurance via the support and follow up of lead consultants, quality enhancement through inclusion of high level experts in each team, establishment of an internal quality assurance team which reviews the final product of the development team and provides feedback before the curriculum documents are presented for a wider group, and the formal validation with representatives from the regions and MOE. Another innovative aspect of the revision process is the deliberate attempt made to align the mother tongue and English language curriculum in terms of theme, language content and teaching-learning approach. Alignment of the English school curriculum and college curriculum for English teacher training is also a new experience in the country. By doing so READ TA is enhancing the experience and capacity of diverse professionals while producing quality English curriculum materials and contributing to enhancing the quality of education in Ethiopia.

The extended impact of READ TA’s support for minority MT languages in Ethiopia

Presentation delivered at CIES 2017 (Atlanta). Ethiopia is a diverse country, with a population of over 90 million, and over 83 local languages. Many of the mother tongue languages (MTs) are taught in schools and used as instructional languages in primary schools. However, it is an enormous challenge to address all local languages in the education system as studies indicate that students are struggling to read and write in their mother tongue. While the USAID-funded READ TA Project has been working over the past four years on improving the reading and writing skills of students in seven Ethiopian MT languages it has also seen the effects of its work extending to other local languages with smaller populations of speakers. The seven languages under READ TA were chosen by Ethiopian Ministry of Education (MoE) as they have the largest populations of students. READ TA has been providing technical assistance for the MoE and Regional State Education Bureaus (RSEBs) on revising the grades 1-8 curriculum materials for the seven MTs, in the provision of in-service training for MT teachers, in revising the pre-service teacher training curriculum materials, and in building the capacity of leaders and experts working in the general education system. In providing this technical assistance, READ TA has been creating a collaborative environment where a large number of experts with diverse background and professional experience work together throughout the process. Among the major actors are international literacy/reading experts, local reading/language experts working in teacher training colleges and universities, primary school teachers, MoE and RSEB language experts, experts in cross-cutting issues (gender, inclusive education, ICT), curriculum and instruction experts. There was huge capacity building through the provision of a number of trainings, through professional dialogues and collaborative engagements, and from engaging in the different activities. Observing the MT curriculum revision process and seeing products, speakers of other, less commonly spoken MT languages which were not included in the READ TA project are now demanding the MoE and RSEBs for a similar opportunity. Some regions have to respond to the requests and are taking their own initiatives to revise the curriculum materials of minority languages. These engagements are reflections of the developed technical capacity as well as the impact of the quality of work READ TA has been doing. Projects like READ TA may not address every need a country has; however, the local capacity built enables countries to fill those untouched gaps.

Tayari’s Longitudinal Evaluation Midline Results

Presentation delivered at CIES 2017 (Atlanta). The Tayari intervention’s randomized controlled trial design is structured to allow for causal inference of Tayari’s impact on school readiness. Previous research has shown how similar ECD programs have affected learning outcomes, but the literature remains silent on how individual children’s skills transition over time. The Tayari longitudinal research design allows us to estimate growth trajectories of individual children. This is particularly salient as the literature lacks models for how literacy and numeracy skills interact with the executive functioning and socioemotional skills that Tayari investigates interact with each other over time. The Tayari longitudinal study follows more than 3100 learners across three rounds of data collection and a wider range of sills than is available in the Tayari impact evaluation. Given how little is known about how children’s core ECD skills grow, the Tayari longitudinal intervention estimates first how the skills grow in the normal control condition, and then how the Tayari program affects growth rates and relationships between learning elements. Finally, the Tayari longitudinal study will continue to develop an understanding of how children transition skills between the two levels of pre-primary in Kenya to the primary education sector where the Tusome literacy program is being implemented at national scale.

Complex Data Analysis: Improve your data analytic abilities using Stata and Early Grade Reading and Mathematics Assessment Data

Workshop delivered at CIES 2017 (Atlanta). The workshop will begin with introducing participants to accessible online educational survey data from EGRA and EGMA. Participants will be introduced to two different early grade reading surveys and the data sets associated with them. They will be given the opportunity to review the original research questions, sample methodology, and instruments in order to understand the context of the survey. Participants will then explore the data to better acquaint themselves with the data’s: structure, content, abilities, and limitations.

Examination of Over-Enrollment, Repetition, and ECD Access in Uganda [Presentation]

[Presentation delivered at CIES 2017]. Education system data has indicated a pattern of over-enrollment in the early grades in some low-income countries. One factor that may influence the observed enrollment bulge is access to pre-primary education programs, as children who do not enter school prepared could be more likely to repeat leading to more children enrolled than are of enrollment-age. This presentation reports on a research study undertaken in Uganda to better understand pupil enrollment and repetition in Primary 1 as it relates to pre-primary access. Data was collected from schools in a district with high reported repetition, lack of or low preprimary access, and high apparent dropout between grade 1 and 2, and a district with low reported repetition, high preprimary access, and low apparent grade 1 dropout. School records were reviewed to collect ages of enrolled pupils and repeater status, in order to calculate age patterns and repetition rates in Primary 1 for each district. In addition, parents of randomly sampled pupils were interviewed about their child’s preprimary attendance, repetition of primary one or other grades, and access to preprimary education programs. Teachers of the sampled pupils were also interviewed regarding pupil age and repetition history. Overall, data was collected on 1,909 pupils in 80 schools, and 1,792 parents were interviewed. The presentation will focus on the following research questions: 1) What are the estimated repetition rates as reported by parents and schools in Primary 1 in schools in the sampled low- and high-risk districts in Uganda; 2) What are the ages of the pupils attending Primary 1 in our sample of Uganda schools and how does this relate to repetition; 3) How do the reported repetition rates relate to parent report of ECD attendance and access; and 4) What is the discrepancy between school-reported and parent-reported repetition rates. Data collection methods, measurement of repetition and ECD attendance and access, and policy conclusions will also be discussed.

Theory based evaluation in Kenya: Using research to inform national scale implementation

Presentation delivered at CIES 2017 (Atlanta).

Malawi Early Grade Reading Activity: Scripting Study Report (Presentation)

Presentation delivered at CIES 2017 (Atlanta). The Malawi Early Grade Reading Activity (EGRA), funded by the United States Agency for International Development (USAID) and implemented by RTI International, is designed to support the Malawi Ministry of Education, Science and Technology (MoEST) in improving the reading performance of Malawian learners in Standards 1–3. One of the primary goals of the Activity is improving the quality and availability of pedagogical materials for early grade reading; to do so, EGRA developed a teacher’s guide with scripted lessons plans (SLPs) for classroom teachers to follow when teaching lessons in both Chichewa and English. A goal of this study was to investigate teacher use of the SLPs in Standard 1 and 2 classrooms. EGRA included teacher training and in-class support for teachers as they used the SLPs. Teachers received several days of specific, targeted training each year regarding phonics-based reading instruction and the gradual release of responsibility model (I do, We do, You do). They also received theory- and practice-based training in the use of the SLPs to deliver high-quality instruction and practicum sessions during which they delivered lessons to groups of current Standard 1–3 learners. The purpose of this study was to shed light on how teachers were using the SLPs in their classrooms to better understand the ways in which the trainings and the materials themselves were supporting teachers, and the ways in which the trainings could be modified.

Low-cost, familiar tech for teacher support: Evidence from a SMS campaign for early grade teachers in Malawi

Presentation delivered at CIES2017 (Atlanta). Providing teachers guidance, mentorship and encouragement in between formal, face-to-face trainings or coaching sessions is challenging. While school directors and other peers may offer teachers support in some contexts, others may experience difficulties, isolation or discouragement in incorporating new practices into their classroom instruction. This paper presents new research from a controlled study in Malawi that sought to extend in-person professional development trainings with a targeted communication campaign over a familiar, low-cost and ubiquitous medium: SMS text messages.

Pages