Article published in the IJEDICT, Vol. 13, No. 3 (2017). Published Abstract: "Previous large-scale education technology interventions have shown only modest impacts on student achievement. Building on results from an earlier randomized controlled trial of three different applications of information and communication technologies (ICTs) on primary education in Kenya, the Tusome Early Grade Reading Activity developed the National Tablets Program. The National Tablets Program is integrated into the Tusome activity by providing tablets to each of more than 1,200 instructional coaches in the country to use when they visit teachers. This enables a national database of classroom instructional quality, which is used by the education system to monitor overall education quality. The tools provided on the tablets are designed to help coaches increase the quality of their instructional support to teachers, and deepen the shallow accountability structures in Kenya’s education system. Using results of a national survey, we investigated the ability of the National Tablets Program to increase the number of classroom observations done by coaches and to improve student learning outcomes. Survey results showed high levels of tablet program utilization, increased accountability, and improvements in learning outcomes. We share recommendations regarding large-scale ICT interventions and literacy programs.

Limited rigorous evidence is available from sub-Saharan Africa regarding whether children who learn to read in their mother tongue will have higher learning outcomes in other subjects. A randomised controlled trial of mother-tongue literacy instruction, the Primary Math and Reading (PRIMR) Initiative, was implemented in Kenya from 2013 to 2014. We compared the impacts of the PRIMR mother-tongue treatment group in two languages with those of another group that did not use mother tongue, but utilised the same instructional components. Results showed that assignment to the mother-tongue group had no additional benefits for English or Kiswahili learning outcomes beyond the non-mother-tongue group, and that the mother-tongue group had somewhat lower mathematics outcomes. Classroom observational analysis showed that assignment to the mother-tongue group had only small impacts on the usage of mother tongue in other subjects. Advocates for mother-tongue programmes must consider such results alongside local implementation resistance in programme design.

USAID's Education Data for Decision Making (EdData II) was implemented over a 12 year period beginning in 2004. EdData II had at its core the goal of improving access to data for USAID Missions and host country ministries, to use for making informed policy decisions. The tools and research developed under EdData II whelped to inform the development of learning metrics under the Sustainable Development Goals (2015); provide evidence to support the design and monitor the implementation of USAID's 2011-2017 Education strategy, and provide actionable, high-quality data to inform policy and practice in around 35 countries. The report reflects on EdData II and the project's impact, providing a summary of the most salient and impactful project activities, and drawing key lessons from their development and implementation.

Midterm evaluation of longitudinal study conducted through the Tayari Early Childhood Development and Education Programme. Tayari is an intervention implemented by the Kenyan Ministry of Education and four counties, with technical support from RTI International and funding from the Children’s Investment Fund Foundation (CIFF). Tayari is focused on designing, piloting and testing the cost effectiveness of investments to increase school readiness for children in Early Childhood Development and Education (ECDE) centres in Uasin Gishu, Siaya, Laikipia and Nairobi counties.

Management Systems International (MSI) led the Tusome baseline study using multiple data collection methods, including an early grade reading assessment (EGRA); surveys of pupils, teachers, head teachers, curriculum support officers (CSO) and households; and classroom observation. The EGRA assessment tool was developed during the baseline and includes eight subtasks in English and six subtasks in Kiswahili. The midline included developing additional data collection tools, revising the baseline surveys, recruiting and training supervisors and enumerators, administering the tool and surveys in the same sample schools as the baseline, ensuring quality control, establishing the reliability of the assessment tool and analyzing the data. For the midline, the evaluation team assessed pupils from the same 204 schools sampled for the baseline. Through discussions with USAID, MOE and RTI, the evaluation team created the sampling frameworks and set up the design for a national sample in 2015. Using a three-stage cluster sampling procedure from a sampling frame of 22,154 formal public schools and 1,000 non-formal (or Alternative Provision of Basic Education and Training – APBET) schools, the evaluation team drew a clustered, random sample, resulting in a target of 4,896 total pupils comprising 2,448 boys and 2,448 girls divided equally between Class 1 and Class 2. The evaluation team reached the following conclusions: • The Tusome approach is having a strong, positive influence on reading outcomes, with relationships between project implementation and reading outcomes. • Reading outcomes for Class 1 and 2 pupils greatly improved during the one-year period between the baseline and midline evaluations. While impressive gains have been made, continuing with the Tusome approach will be critical to sustaining or improving on those gains. The Tusome project has achieved a high level of national implementation of the activities at each level of the education system. Given that project activities such as CSO observations, in-service training and access to materials are associated with higher ORF scores, the high level of implementation across all schools appears to be a key part of its success. The effect sizes seen during the PRIMR pilot have been at least sustained, and in most cases strengthened, in the national scale-up of Tusome. • The evaluation methodology and implementation resulted in valid, reliable data for the midline evaluation, including the changes from baseline to midline.

Presentation delivered at CIES 2017 (Atlanta). The Tayari intervention’s randomized controlled trial design is structured to allow for causal inference of Tayari’s impact on school readiness. Previous research has shown how similar ECD programs have affected learning outcomes, but the literature remains silent on how individual children’s skills transition over time. The Tayari longitudinal research design allows us to estimate growth trajectories of individual children. This is particularly salient as the literature lacks models for how literacy and numeracy skills interact with the executive functioning and socioemotional skills that Tayari investigates interact with each other over time. The Tayari longitudinal study follows more than 3100 learners across three rounds of data collection and a wider range of sills than is available in the Tayari impact evaluation. Given how little is known about how children’s core ECD skills grow, the Tayari longitudinal intervention estimates first how the skills grow in the normal control condition, and then how the Tayari program affects growth rates and relationships between learning elements. Finally, the Tayari longitudinal study will continue to develop an understanding of how children transition skills between the two levels of pre-primary in Kenya to the primary education sector where the Tusome literacy program is being implemented at national scale.

Workshop delivered at CIES 2017 (Atlanta). The workshop will begin with introducing participants to accessible online educational survey data from EGRA and EGMA. Participants will be introduced to two different early grade reading surveys and the data sets associated with them. They will be given the opportunity to review the original research questions, sample methodology, and instruments in order to understand the context of the survey. Participants will then explore the data to better acquaint themselves with the data’s: structure, content, abilities, and limitations.

Presentation delivered at CIES 2017 (Atlanta).

Presentation delivered at CIES 2017 (Atlanta). Instructional support is essential in the process of creating and supporting instructional change. Educational quality improvement is the elusive goal for many recent literacy improvement programs and strategies. Many programs focus on the inputs of improved textbook ratios, rapid and massive teacher professional development provision, and the provision of ICT support for this system. The Tusome Early Grade Reading Activity, implemented in Kenya from 2014 through 2019, is designed to fundamentally depend on the power and quality of the existing government personnel that were ostensibly assigned to provide instructional support to teachers. The Curriculum Support Officer function, in place in Kenya for decades, was structured to help teachers improve the quality of teaching by providing classroom based support, cluster based training, and ongoing instructional feedback. As is common in many countries in the region who suffer from limited human resources at the local level, these officers are often assigned administrative duties both at odds and distracting from their core instructional support function. Tusome’s work to support the Government of Kenya to revitalize this function and do so in a national manner was both ambitious and somewhat risky. This presentation share the results of Tusome’s efforts with the government to utilize the curriculum support officers as coaches within Tusome with a frank assessment of what process was most effective and which strategies were less effective. It also shares the experiences in Tusome of how a targeted ICT investment in tablets and a structured tool for the officers to use in classrooms created an environment where instructional support was both possible but also more exciting than it previously was. The Tusome National Tablet Program, utilized on a daily basis by these coaches, was designed over several years to integrate within government systems, to be easily implementable by coaches, but also to provide actionable real time data to the education system’s leadership on how teachers were implementing Tusome. The coaching system has provided each of Kenya’s more than 1200 coaches and curriculum support officers with tablets and training how to use them, to support classroom observation and feedback. The presentation shares the results of this over the 2015 and 2016 academic years. Not only have these officers supported up to 20,000 classrooms in a month, but they have also collected structured literacy assessment data from up to 60,000 students at a national level on a monthly basis. This data is collected on an interactive dashboard that Kenyan education leadership is able to use on a consistent basis to change behavior and support large scale instructional reform. The presentation focuses on the possibilities that this instructional support system has for Tusome, increased accountability within the system, and overall quality improvement at the national level for Kenya.

This report explores teacher issues and policies in sub-Saharan African countries via three interrelated questions and methods, each of which is discussed in turn. First, the paper presents the state of issues related to teaching and learning in sub-Saharan African countries. Recent data and evidence, obtained from international, regional, and national databases for numerous sub-Saharan African countries are presented that speak to the state of teacher issues and conditions of service for teachers. Second, the paper outlines national policies and educational plans germane to teaching and learning in 11 sub-Saharan African countries. A third section of the paper highlights reasons why educational policies and plans may not be sufficiently salient to substantially influence the classroom practice of teachers.