The Numeracy at Scale study was designed to identify and examine aspects of successful numeracy programs, to provide policy makers and development practitioners with evidence-based strategies for improving numeracy instruction and learning outcomes across contexts. To this end, the study team identified and analyzed six programs across five countries that had rigorous evidence of impact on numeracy learning outcomes and which were operating at scale or which showed the potential for scale in an entire region or country. In each country, the study teams carried out a mixed-methods study including quantitative observations and interviews conducted in 80 to 130 schools per country; as well as qualitative observations and interviews in ten schools per country. The Numeracy at Scale study investigated two research questions addressed in this presentation: 1) What classroom ingredients (such as teaching practices and classroom environment) lead to learning in programs that are effective at scale? 2) What methods of training and support lead to teachers adopting effective classroom practices? The programs involved in this study are based in India, Jordan, El Salvador, Madagascar and South Africa. Two of the programs are government-led. The six Numeracy at Scale programs represent a variety of designs, from providing instruction to at-risk girls via interactive software to a national-scale numeracy initiative integrated into all public primary schools. Despite their differences, these programs share a large number of common elements. This presentation will provide an overview of the common pedagogical strategies found across these successful numeracy programs, such as use of multiple representations, discussion about mathematical concepts, and targeted support for students, as well as the approaches these programs used to support the development of these practices among teachers. Drawing from qualitative data, the paper will then discuss details of how these common elements were executed differently under different program models. Both the common, key elements and “differences in the details” that are found across these programs can generate helpful guidelines and ideas for how practitioners and governments can strengthen their own numeracy professional development approaches, across different operating contexts and program designs.

*** This is the Russian translation of the Science of Teaching Structured Pedagogy Guide Literature Review *** Результаты обучения в странах с низким и средним уровнем дохода являются катастрофически низкими. Задача улучшения результатов в области базовой грамотности и счета (FLN) зависит от повышения качества преподавания и поддержки принятия методических решений отдельными учителями - их десятки тысяч во многих странах. Программы структурированной педагогики показали их способность оказывать поддержку учителям в принятии таких индивидуальных педагогических решений в широком масштабе, и, что такие изменения могут оказать значительное влияние на результаты обучения.

Своевременные данные, поступающие в систему, необходимы для обеспечения подотчетности основных действующих лиц за осуществление структурированной педагогической деятельности, для оценки воздействия данной деятельности на педагогическую деятельность учителей, для определения и обоснования коррекции содержания программы и, что наиболее важно, какое воздействие, если таковое вообще имеет место, оказывает данная деятельность на ключевые целевые результаты программы (например, базовые навыки учащихся в области грамотности и счета).

This presentation focused on learning through play-based pedagogies in Kenya, Rwanda and Ghana. Some key findings discussed are: (1) Teachers in general support the concept of play and employing play-based teaching in the classroom, but far fewer are okay with students directing their own learning. (2) In practice, teachers spend the most time explaining/lecturing and monitoring the class. (3) At midline, significant changes were detected in some aspects of teacher practice in Kenya and Ghana, but overall, the frequency of play-based approaches is low.

This brief presents findings on what worked to improve learning outcomes at scale under 8 successful early grade literacy programs, with a focus on findings from the Tusome program in Kenya.1 These findings were generated as part of the Learning at Scale study, conducted by RTI International with the Center for Global Development and funded by the Bill and Melinda Gates Foundation.

Existing research on the uptake of technologies for adult learning in the global South is often focused on the use of technology to reinforce in-person learning activities and too often involves an oversimplified “with or without” comparison (Gaible and Burns 2005, Slade et al. 2018). This MEL Framework for Technology-Supported Remote Training (MEL-Tech Framework) features a more nuanced perspective by introducing questions and indicators that look at whether the technology-supported training was designed based on a solid theory of learning; whether the technology was piloted; whether there was time allocated to fix bugs and improve functionality and user design; how much time was spent using the technology; and whether in-built features of the technology provided user feedback and metrics for evaluation. The framework presents minimum standards for the evaluation of technology-supported remote training, which, in turn, facilitates the development of an actionable evidence base for replication and scale-up. Rather than “just another theoretical framework” developed from a purely academic angle, or a framework stemming from a one-off training effort, this framework is based on guiding questions and proposed indicators that have been carefully investigated, tested, and used in five RTI monitoring and research efforts across the global South: Kyrgyz Republic, Liberia, Malawi, the Philippines, and Uganda (Pouezevara et al. 2021). Furthermore, the framework has been reviewed for clarity, practicality, and relevance by RTI experts on teacher professional development, policy systems and governance, MEL, and information and communications technology, and by several RTI project teams across Africa and Asia. RTI drew on several conceptual frameworks and theories of adult learning in the design of this framework. First, the underpinning theory of change for teacher learning was informed by the theory of planned behavior (Ajzen 1991), Guskey’s (2002) perspective on teacher change, and Clarke and Hollingsworth’s (2002) interconnected model of professional growth. Second, Kirkpatrick’s (2021) model for training evaluation helped determine many of the categories and domains of evaluation. However, this framework not only has guiding questions and indicators helpful for evaluating one-off training events focusing on participants’ reactions, learning, behavior, and results (as is the focus in Kirkpatrick’s model) but also includes guiding questions and indicators reflective of a “fit for purpose” investigation stage, a user needs assessment and testing stage, and long-term sustainability. Furthermore, this framework’s guiding questions and indicators consider participants’ attitudes and self-efficacy (based on the research underpinning the theory of planned behavior), as well as aspects of participants’ post-training, ongoing application and experimentation, and feedback (Clarke and Hollingsworth; Darling-Hammond et al. 2017; Guskey). Lastly, the framework integrates instructional design considerations regarding content, interaction, and participant feedback that are uniquely afforded by technology.

This qualitative case study describes the experiences of young refugee children and their families accessing early childhood development (ECD) services in Uganda in late 2019. The study team collected data through key informant interviews with representatives of the Ugandan government, national non-governmental organizations, humanitarian agencies and service providers. Focus group discussions were held with refugee families living in Bidi Bidi and Nakivale settlements. The study team supplemented key informant interviews and focus group with policy document review. Analysis is presented along the lines of policy and practice, with a focus on the respective roles of the government and international agencies in delivering ECD services to refugee families.

To measure the impact of SHRP on reading achievement, EGRA data were collected at the beginning of Primary 1 (P1) and then at the end of every school year through Primary 3, 4 or 5 depending on when the local language entered the program. Though there was little difference in local language cwpm at the end of P1, differences started to emerge at the end of P2 and by the end of P3, significant positive differences were found in 10 of the 12 languages.

Has reading achievement increased as a result of the USAID/Uganda School Health and Reading Program? Early Grade Reading Assessment (EGRA) data collected for Cluster 2 at the end of P3 suggests improved progress towards reading proficiency in all 4 program languages. In all C2 languages, more learners in program schools are reading more words than learners in control schools in both English and Local Language.

Has reading achievement increased as a result of the USAID/Uganda School Health and Reading Program? Is classroom teacher behavior improving based on program interventions? Early Grade Reading Assessment (EGRA) data collected for Cluster 2 shows that Leb Acӧli, Lugbarati, and Runyoro-Rutooro schools receiving the SHRP intervention are continuing to make small but significant progress towards reading proficiency. • All 4 Cluster 2 languages started out with very low levels of reading readiness at the beginning of P1. At the end of P2, Leb Acӧli and Runyoro-Rutooro schools receiving program interventions are performing significantly better than control schools in local language reading fluency, local language reading comprehension and in English reading fluency, with a medium to large effect size. • Teachers in program classrooms are teaching more from lesson plans that employ early grades reading methodology. Learners in program classrooms are more likely to read from printed material. • While teachers are receiving some classroom support from head teachers, follow up support by CCTs is insufficient • In general, there were no differences in reading scores for boys and girls, but they are noted in the report when they do occur.