Tayari's Longitudinal Endline Results: Program Impact and Implementation Decisions- CIES 2018 Presentation

CIES 2018 Presentation, given by Ben Piper. The Kenyan Ministry of Education (MoE) in collaboration with RTI International and the county Governments of Laikipia, Nairobi, Siaya and Uasin Gishu have been piloting the Tayari Early Childhood Development and Education (ECDE) model since 2014. Built on a Randomized Controlled Trial (RCT), RTI has been tracking a cohort of learners from both treatment 2 and control schools over the last two years: The baseline data was collected in January 2016; midline in October 2016, at the end of the academic school year; and endline a year later in October 2017. The overall effect of Tayari showed a larger effect at midline – after ten months of implementation – than was expected at end line, i.e. after two years of implementation. The gains in the Tayari group was about 50% higher than in the control group.

Is ‘summer’ reading loss universal? Using ongoing literacy assessment in Malawi to estimate the loss from grade-transition breaks

Published abstract: "Summer learning loss – decreased academic performance following an extended school break, typically during the period after one grade ends and before another grade starts – is a well-documented phenomenon in North America, but poorly described in sub-Saharan African contexts. In this article, we use the term ‘grade-transition break’ loss in lieu of ‘summer’ loss to refer to the period after one grade ends and before another grade starts. This study analyses data from early grade reading assessments in Malawi, estimating statistically significant average reductions of 0.38 standard deviations (SD) across several measures of reading and pre-reading skills during two grade-transition breaks. The data show the loss in reading skills during the extended breaks between grades 1 and 2 and between grades 2 and 3 in two consecutive years. The study found no gender-based differences in loss. The findings suggest a need for early grade reading interventions to develop and evaluate mitigation strategies lest significant proportions of within-year performance gains be lost over the break between academic years."

Implementing large-scale instructional technology in Kenya: Changing instructional practice and developing accountability in a National Education System

Article published in the IJEDICT, Vol. 13, No. 3 (2017). Published Abstract: "Previous large-scale education technology interventions have shown only modest impacts on student achievement. Building on results from an earlier randomized controlled trial of three different applications of information and communication technologies (ICTs) on primary education in Kenya, the Tusome Early Grade Reading Activity developed the National Tablets Program. The National Tablets Program is integrated into the Tusome activity by providing tablets to each of more than 1,200 instructional coaches in the country to use when they visit teachers. This enables a national database of classroom instructional quality, which is used by the education system to monitor overall education quality. The tools provided on the tablets are designed to help coaches increase the quality of their instructional support to teachers, and deepen the shallow accountability structures in Kenya’s education system. Using results of a national survey, we investigated the ability of the National Tablets Program to increase the number of classroom observations done by coaches and to improve student learning outcomes. Survey results showed high levels of tablet program utilization, increased accountability, and improvements in learning outcomes. We share recommendations regarding large-scale ICT interventions and literacy programs.

Examining the secondary effects of mother-tongue literacy instruction in Kenya: Impacts on student learning in English, Kiswahili, and mathematics

Limited rigorous evidence is available from sub-Saharan Africa regarding whether children who learn to read in their mother tongue will have higher learning outcomes in other subjects. A randomised controlled trial of mother-tongue literacy instruction, the Primary Math and Reading (PRIMR) Initiative, was implemented in Kenya from 2013 to 2014. We compared the impacts of the PRIMR mother-tongue treatment group in two languages with those of another group that did not use mother tongue, but utilised the same instructional components. Results showed that assignment to the mother-tongue group had no additional benefits for English or Kiswahili learning outcomes beyond the non-mother-tongue group, and that the mother-tongue group had somewhat lower mathematics outcomes. Classroom observational analysis showed that assignment to the mother-tongue group had only small impacts on the usage of mother tongue in other subjects. Advocates for mother-tongue programmes must consider such results alongside local implementation resistance in programme design.

Cambodia Teacher Professional Development Policy Brief Options

Cambodia’s teacher professional development (PD) system is at a crossroads. There is a growing realization that the lower than expected learning outcomes in Cambodia are directly related to lower than desirable classroom teaching. To respond to this reality, Cambodia aims to put in place improved systems for pre-service teacher preparation (moving to a 12+4 system and introducing a new Bachelor of Arts in Education (BA [Ed.]) degree, intensive upgrading of existing teachers, and continuous professional development and mentoring. A working group organized by the Teacher Training Department is bringing together stakeholders to assist in the design and implementation of an improved in-service training (INSET) system. The present document aims to bring together pertinent information and evidence on effective continuous professional development (CPD) to support the work of this group.

Longitudinal Midterm Report for the Tayari Early Childhood Development and Education Programme

Midterm evaluation of longitudinal study conducted through the Tayari Early Childhood Development and Education Programme. Tayari is an intervention implemented by the Kenyan Ministry of Education and four counties, with technical support from RTI International and funding from the Children’s Investment Fund Foundation (CIFF). Tayari is focused on designing, piloting and testing the cost effectiveness of investments to increase school readiness for children in Early Childhood Development and Education (ECDE) centres in Uasin Gishu, Siaya, Laikipia and Nairobi counties.

Tayari’s Longitudinal Evaluation Midline Results

Presentation delivered at CIES 2017 (Atlanta). The Tayari intervention’s randomized controlled trial design is structured to allow for causal inference of Tayari’s impact on school readiness. Previous research has shown how similar ECD programs have affected learning outcomes, but the literature remains silent on how individual children’s skills transition over time. The Tayari longitudinal research design allows us to estimate growth trajectories of individual children. This is particularly salient as the literature lacks models for how literacy and numeracy skills interact with the executive functioning and socioemotional skills that Tayari investigates interact with each other over time. The Tayari longitudinal study follows more than 3100 learners across three rounds of data collection and a wider range of sills than is available in the Tayari impact evaluation. Given how little is known about how children’s core ECD skills grow, the Tayari longitudinal intervention estimates first how the skills grow in the normal control condition, and then how the Tayari program affects growth rates and relationships between learning elements. Finally, the Tayari longitudinal study will continue to develop an understanding of how children transition skills between the two levels of pre-primary in Kenya to the primary education sector where the Tusome literacy program is being implemented at national scale.

Theory based evaluation in Kenya: Using research to inform national scale implementation

Presentation delivered at CIES 2017 (Atlanta).

International education is a broken field: Can ubuntu education bring solutions?

Article published in the International Review of Education. February 2016, Volume 62, Issue 1, pp 101–111. Published abstract: "Ubuntu is an African philosophy of human kindness; applying it in the Global South would fundamentally alter the design of the education sector. This essay argues, however, that the field of international educational development is not, in fact, structured to support an education influenced by ubuntu ideals. Specifically, the educational development milieu includes donors, implementers and academicians who do not sufficiently question the power dynamics which underpin education development. This creates a field where the power imbalances between donors and host governments are not interrogated, where development workers place too much faith in their own knowledge rather than that of local education experts, and where development practitioners rarely appreciate the privilege of working in countries which are not their own. An ubuntu education would alter the educational development field in myriad critical ways, a few of which are suggested in this essay. Educational development programmes in universities and intake programmes for implementers and donors should teach officers humility, appreciating existing local talent and expertise. Donor programmes should incentivise reflective practice which formally embeds appreciation for local culture and expertise, thereby supporting structures which help educational development experts to review their metacognitive processes. The field should also dramatically increase the numbers of local, minority and female educational development practitioners and provide more avenues for advancement for those groups. These are activities which are critical to supporting the education development field, but require a fundamental change of attitude by practitioners to ensure the right kind of relationships between the West and the Global South."

What Have We Learned? Improving Development Policy through Impact Evaluation (Presentation)

From the CGD Website on the event: "Please join the Center for Global Development (CGD) and the Abdul Latif Jameel Poverty Action Lab (J-PAL) to take stock of the evidence and impact evaluation movement and its promise for improving social policy in developing countries. In 2006, CGD released a working group report titled “When Will We Ever Learn? Improving Lives Through Impact Evaluation.” It described an evaluation gap and proposed an international effort to systematically build evidence on “what works” in development with the aim of improving the effectiveness of social programs. Ten years later, we will reflect on progress toward these goals. Despite a host of challenges, hundreds of millions of people across the world have benefited from programs that have been rigorously evaluated and scaled up. Impact evaluation has generated knowledge about poverty and public policy leading to better programs. At the event, policymakers and evaluators will discuss examples of how evaluation has helped enhance effectiveness, and a panel of evaluation funders will reflect on lessons learned and the way forward. In a time of political transition, we seek to re-energize the movement for increased evidence and value for money in public and aid spending. Among others, the event will feature: Abhijit Banerjee (MIT), Amanda Glassman (CGD), Rachel Glennerster (J-PAL), Markus Goldstein (World Bank), Amber Gove (RTI International), Rema Hanna (Harvard), Emannuel Jimenez (3ie), Michael Kremer (Harvard), Darius Mogaka (Government of Kenya), Santhosh Mathew (Government of India), William Savedoff (CGD), and Bambang Widianto (Government of Indonesia)." Download the presentation slides from the Kenya case study using the "Download" link, or click on the external website link for more information on the event.

Pages