CIES 2018 Presentation, given by Ben Piper. Tusome is supporting the Ministry’s systems to increase the utilization of monitoring data, and to expand the accountability structures of the government using the data provided by the national literacy program. Of particular interest is the classroom observation data collected by government-paid coaches, in Kenya these officers are called Curriculum Support Officers (CSOs). The data presented in this panel shows how the instructional support structures in Kenya have worked over time, with particular interest in the availability and usage of classroom support data.

CIES 2018 Presentation, given by Ben Piper. The Tusome national literacy program has been implemented in each of Kenya’s more than 22,000 public primary schools and 1500 low cost private schools in the slums since 2015. In addition to showing the comparisons between before and after Tusome’s implementation, this presentation will examine Tusome implementation data to reveal key characteristics of the scale-up framework that Tusome was designed to respond to. In particular, we share the extent of classroom utilization of the Tusome materials, the size of the classroom observational structures that Tusome tried to revitalize, and the responses of the community to the Tusome intervention. The findings suggest that Tusome had a substantial impact on literacy outcomes in both Kiswahili and English, in both Grade 1 and 2, in both public and low cost private settings, and in both urban and rural settings. This means that the program’s effect meant that nearly 1 million more children were able to be considered readers by the midterm intervention.

CIES 2018 Presentation, given by Sam Ngaruiya. This study explores the role of the Tayari program in promoting a viable and quality ECDE system that county governments in Kenya can sustainably deliver. Tayari is a three year pilot implemented by the national Ministry of Education and four county governments. The program is designed to help the government develop a cost effective and scalable ECDE model. The pilot program is implemented in public schools and ECDE centers in low resource settings. Utilizing data from a qualitative study conducted in 4 pilot and 3 non-pilot counties’ decision-making, the presentation outlines three key aspects of sustainability: the extent to which collaborative implementation has improved ownership and resource allocation and how the Tayari instructional approach has impacted on process quality and teacher retention in the program. The findings and discussion are critical in helping county governments prioritize investment in a quality and sustainable ECDE model for improved school readiness.

CIES 2018 presentation, given by Luis Crouch on behalf of Hank Healey. The EGR Sustainability Framework emanates from a) a general understanding of evidence-based EGR programs, b) the notion of a “learning coherent” education system (Pritchett, 2015), c) the notion of a “bare bones” or “core functions” system (Crouch and Destefano, 2015); and effective curriculum implementation. To this end, our proposed EGR sustainability framework maintains that one must a) map the existing education system’s institutional, systemic, cultural, and attitudinal capacity to function as an effective learning coherent core functions curriculum implementation system, b) identify the various gaps and barriers that prevent the system from working in this manner, c) develop a plan to address those gaps and barriers, and d) help the MOE to implement that plan.

Management Systems International (MSI) led the Tusome baseline study using multiple data collection methods, including an early grade reading assessment (EGRA); surveys of pupils, teachers, head teachers, curriculum support officers (CSO) and households; and classroom observation. The EGRA assessment tool was developed during the baseline and includes eight subtasks in English and six subtasks in Kiswahili. The midline included developing additional data collection tools, revising the baseline surveys, recruiting and training supervisors and enumerators, administering the tool and surveys in the same sample schools as the baseline, ensuring quality control, establishing the reliability of the assessment tool and analyzing the data. For the midline, the evaluation team assessed pupils from the same 204 schools sampled for the baseline. Through discussions with USAID, MOE and RTI, the evaluation team created the sampling frameworks and set up the design for a national sample in 2015. Using a three-stage cluster sampling procedure from a sampling frame of 22,154 formal public schools and 1,000 non-formal (or Alternative Provision of Basic Education and Training – APBET) schools, the evaluation team drew a clustered, random sample, resulting in a target of 4,896 total pupils comprising 2,448 boys and 2,448 girls divided equally between Class 1 and Class 2. The evaluation team reached the following conclusions: • The Tusome approach is having a strong, positive influence on reading outcomes, with relationships between project implementation and reading outcomes. • Reading outcomes for Class 1 and 2 pupils greatly improved during the one-year period between the baseline and midline evaluations. While impressive gains have been made, continuing with the Tusome approach will be critical to sustaining or improving on those gains. The Tusome project has achieved a high level of national implementation of the activities at each level of the education system. Given that project activities such as CSO observations, in-service training and access to materials are associated with higher ORF scores, the high level of implementation across all schools appears to be a key part of its success. The effect sizes seen during the PRIMR pilot have been at least sustained, and in most cases strengthened, in the national scale-up of Tusome. • The evaluation methodology and implementation resulted in valid, reliable data for the midline evaluation, including the changes from baseline to midline.

Presentation delivered at the ICT4D 2017 Conference in Hyderabad. Taking successful pilot projects to scale should be the goal of any pilot program; yet often projects address scale only as an afterthought. The challenges of realizing large-scale impact, and of seeing that impact sustained, are not new to development. However, they are being approached with renewed interest and attention in the education sector. This presentation examines the issue of scale up in basic education programs in seven countries where interventions to improve early grade reading are being taken to scale--some with project support, some through government initiative. Management Systems International's framework for taking projects to scale, and the framework defined in the Brookings Institute's Millions Learning report are used to examine how scale has been and is occurring in selected countries, and we look at how scale is achieved in ICT projects. The presenter invites participants to be active discussants in this presentation, sharing their experiences and providing feedback on the relevancy of the proposed frameworks for ICT at scale

A collection of articles on Improvement Science, published in a special issue (Volume 25 Issue 1) of the journal "Quality Assurance in Education". Each article describes one of seven improvement methods, presents its history, and gives at least one example of it employed in the education sector. The seven improvement methods covered by these articles are: - Networked improvement communities - Design-based implementation research - Implementation science - Lean - Six Sigma - Positive Deviants - Deliverology

Presentation delivered at CIES 2017 (Atlanta). As the READ TA project’s main focus is on providing technical assistance to and building the capacity of the Ethiopian Ministry of Education and its Regional Education Bureaus to develop and conduct the foundational components of a reading program (i.e., curriculum development, in-service and pre-service teacher training, and teacher support), the project has had to work through government systems to accomplish its objectives. This has provided great opportunities along with challenges. While there are some activities in which the project has direct involvement in the inputs and outcomes (curriculum development workshops, training of trainers, incorporating technology), there are others which are largely outside of the control of the project (printing of textbooks, training of teachers, government approvals). But all activities are necessary for the reading program to be successful. This requires establishing strong collaborative relationships with government counterparts and having the flexibility to adjust to the ever-changing situation.

Presentation delivered at CIES 2017 (Atlanta). Ethiopia is a diverse country, with a population of over 90 million, and over 83 local languages. Many of the mother tongue languages (MTs) are taught in schools and used as instructional languages in primary schools. However, it is an enormous challenge to address all local languages in the education system as studies indicate that students are struggling to read and write in their mother tongue. While the USAID-funded READ TA Project has been working over the past four years on improving the reading and writing skills of students in seven Ethiopian MT languages it has also seen the effects of its work extending to other local languages with smaller populations of speakers. The seven languages under READ TA were chosen by Ethiopian Ministry of Education (MoE) as they have the largest populations of students. READ TA has been providing technical assistance for the MoE and Regional State Education Bureaus (RSEBs) on revising the grades 1-8 curriculum materials for the seven MTs, in the provision of in-service training for MT teachers, in revising the pre-service teacher training curriculum materials, and in building the capacity of leaders and experts working in the general education system. In providing this technical assistance, READ TA has been creating a collaborative environment where a large number of experts with diverse background and professional experience work together throughout the process. Among the major actors are international literacy/reading experts, local reading/language experts working in teacher training colleges and universities, primary school teachers, MoE and RSEB language experts, experts in cross-cutting issues (gender, inclusive education, ICT), curriculum and instruction experts. There was huge capacity building through the provision of a number of trainings, through professional dialogues and collaborative engagements, and from engaging in the different activities. Observing the MT curriculum revision process and seeing products, speakers of other, less commonly spoken MT languages which were not included in the READ TA project are now demanding the MoE and RSEBs for a similar opportunity. Some regions have to respond to the requests and are taking their own initiatives to revise the curriculum materials of minority languages. These engagements are reflections of the developed technical capacity as well as the impact of the quality of work READ TA has been doing. Projects like READ TA may not address every need a country has; however, the local capacity built enables countries to fill those untouched gaps.

This presentation describes the USAID/Indonesia PRIORTIAS program (2012-2017), including the development of leveled reading books for 13,000 schools.