The Numeracy at Scale study was designed to identify and examine aspects of successful numeracy programs, to provide policy makers and development practitioners with evidence-based strategies for improving numeracy instruction and learning outcomes across contexts. To this end, the study team identified and analyzed six programs across five countries that had rigorous evidence of impact on numeracy learning outcomes and which were operating at scale or which showed the potential for scale in an entire region or country. In each country, the study teams carried out a mixed-methods study including quantitative observations and interviews conducted in 80 to 130 schools per country; as well as qualitative observations and interviews in ten schools per country. The Numeracy at Scale study investigated two research questions addressed in this presentation: 1) What classroom ingredients (such as teaching practices and classroom environment) lead to learning in programs that are effective at scale? 2) What methods of training and support lead to teachers adopting effective classroom practices? The programs involved in this study are based in India, Jordan, El Salvador, Madagascar and South Africa. Two of the programs are government-led. The six Numeracy at Scale programs represent a variety of designs, from providing instruction to at-risk girls via interactive software to a national-scale numeracy initiative integrated into all public primary schools. Despite their differences, these programs share a large number of common elements. This presentation will provide an overview of the common pedagogical strategies found across these successful numeracy programs, such as use of multiple representations, discussion about mathematical concepts, and targeted support for students, as well as the approaches these programs used to support the development of these practices among teachers. Drawing from qualitative data, the paper will then discuss details of how these common elements were executed differently under different program models. Both the common, key elements and “differences in the details” that are found across these programs can generate helpful guidelines and ideas for how practitioners and governments can strengthen their own numeracy professional development approaches, across different operating contexts and program designs.

*** This is the Russian translation of the Science of Teaching Structured Pedagogy Guide Literature Review *** Результаты обучения в странах с низким и средним уровнем дохода являются катастрофически низкими. Задача улучшения результатов в области базовой грамотности и счета (FLN) зависит от повышения качества преподавания и поддержки принятия методических решений отдельными учителями - их десятки тысяч во многих странах. Программы структурированной педагогики показали их способность оказывать поддержку учителям в принятии таких индивидуальных педагогических решений в широком масштабе, и, что такие изменения могут оказать значительное влияние на результаты обучения.

Мероприятия по обучению учителей для программ структурированной педагогики (СП), описание которых приводится в Руководстве 5, имеют важное значение для внедрения новых методов и подходов, ознакомления учителей с новыми материалами, а также их подготовки к испытанию этих новых подходов в своей педагогической практике. Однако одноразовое проведение обучения или даже серия отдельных тренингов, как правило, не приводит к значительным изменениям в практике учителей. После проведения мероприятий по обучению учителей, целенаправленная постоянная поддержка учителей (т.е. наставничество извне или внутри школы, сообщества учителей-практиков, дистанционная поддержка с помощью цифровых технологий) помогает обеспечить надлежащее использование учителями материалов, а также повышает точность их применения. Постоянная поддержка также способствует повышению мотивации учителей к внедрению новых методов, укрепляя их уверенность в том, что они будут применять их на практике, поскольку последующая деятельность со стороны директоров школ или должностных лиц, занимающихся вопросами образования, свидетельствует об инициативности и ожидаемых результатах в отношении реализации новых практик; а также потому, что учителя зачастую чувствуют себя более сплоченными и вдохновленными, когда видят улучшение академической успеваемости своих учащихся.

Учебно-методические материалы, включая руководство для учителя и учебники, являются основой структурированной педагогической программы. Эти материалы должны быть разработаны для поддержки навыков в соответствии с учебной программой и объемом и последовательностью, обсуждаемыми в подробно в Руководство 3 из этой серии Структурированной педагогики. Здесь мы обсудим решения, которые необходимо принять, и шаги, которые следует предпринять при разработке УММ. Несмотря на то, что в этом кратком документе не рассматривается подробно, пилотирование материалов перед широкомасштабным внедрением имеет важное значение, равно как и планирование пересмотра материалов на основе отзывов учителей и проблем, обнаруженных во время внедрения. Важно также отметить, что этот процесс разработки, начиная с объема и последовательности и заканчивая готовыми к печати копиями, обычно занимает 6-12 месяцев. Попытки ускорить процесс неизбежно приводят к снижению качества материалов и чревата задержками в доставке книг учащимся.

Children need a strong foundation in learning to succeed in their education and life. Yet, by the age of 10 years, nearly 9 out of 10 children in SSA cannot do basic mathematics. There is an urgent need to learn from success stories like the TAFITA program in Madagascar to accelerate results in numeracy to ensure that every child is ready to succeed at school. This short brief highlights some of the key successes from the program to provide policy makers and development practitioners with evidence-based strategies for improving instruction and learning in numeracy.

While there has been substantial investment in early-grade reading in low- and middle-income country contexts (LMICs) in the last 15 years, and a concomitant increase in evidence around what works to improve reading outcomes, there has been much more limited investment in early-grades mathematics. As a result, the body of evidence on what works to improve mathematics teaching and learning in LMICs is more limited. This study has identified six government- and program-led interventions in LMICs that have evidence of impact on students’ numeracy outcomes and are working at scale, to understand how and why they are effective and consolidate that evidence for the international education community. In order to examine the target programs, the study team has developed a suite of instruments designed to examine the programs and to identify common elements that these successful numeracy may have in common. The goal in designing these instruments was to be able to examine a range of potential factors, based on the evidence that we have on mathematics teaching and learning from research in high-income country contexts, as well as the limited research evidence we have from LMICs. This suite of instruments includes: (1) a quantitative classroom observation instrument, based on multiple frameworks for high-quality math instruction, including work by The Danielson Group (2019), The University of Michigan’s High Leverage Teaching practices, and a cross-institutional working group of math education experts working in LMICs (co-author, 2019); (2) a student cognitive interview instrument intended to provide insight into students’ development of higher order, conceptual understanding of basic mathematics concepts; (3) a qualitative classroom observation instrument and accompanying lesson-based teacher interview; (4) a survey of teachers’ Mathematical Knowledge for Teaching, based on work by Deborah Ball (2011). Focusing primarily on the quantitative classroom observation and student cognitive interview instruments, this paper will present the theoretical foundations of the instrument and the processes for developing, piloting, and adapting the instruments for different country and program contexts. Preliminary findings and lessons learned from utilizing the tools for data collection across country contexts will also be shared. Given the need to expand the body of evidence around what works to improve math teaching and learning, these instruments represent potentially valuable resources for research in this area – and the authors look forward to discussing the potential for use and further development/adaptation.

The Mathematics Knowledge for Teaching (MKT) is a short survey (23 items) that measures primary grade teacher knowledge by a) math domains and b) pedagogical and content knowledge. Math domain included Number Sense, Operations, Geometry, and Measurement. Pedagogical knowledge was measured by problems that measured teacher understanding of Developmental Progression, Scaffolding, and Content knowledge. In this presentation, we will discuss the process of developing the MKT survey, highlight exemplary results from the Kyrgyz Republic, and then discuss the various uses of this survey. The MKT survey build from previous work in measurement of teachers’ MKT in the United States and other countries (Ball et.al., 2008; Cole, 2012). Our goal was to create an instrument that focused on the early primary grade and was easily adaptable to multiple contexts. To do this, we created an initial instrument, conducted cognitive interviews with math and learning experts form several countries, and then conducted a pilot in the Kyrgyz Republic and Nepal. In Kyrgyz Republic, the MKT test was administered to 323 primary grade teachers in 30 pilot schools as a pre-post training survey as part of the USAID Okuu Keremet! The survey was administered online in two languages. Analysis of pre-post test showed that the survey was effective in detecting changes in teacher knowledge across all math domains and pedagogical and content knowledge areas. In Nepal, we conducted cognitive interviews with teachers, providing additional insights into how teachers were thinking about early math knowledge. Finally, we conclude with the different potential uses for this survey, such as diagnosing and measuring changes in teacher knowledge over time and using it as professional development tool to develop teacher knowledge. We will discuss implications for the use of this tool for the wider development audience.

In 2014, the Nepal Ministry of Education, Science, and Technology (MOEST) developed a National Early Grade Reading Program (NEGRP), aimed at improving the reading achievement of early-grade students throughout Nepal. USAID has supported the government’s efforts to improve early-grade reading under NEGRP through both Government-to-Government funding and through the Early-Grade Reading Program (EGRP) I & II from 2015-2022. The NEGRP focused on evidence-based pillars for foundational literacy: Curriculum and materials, Teacher training and ongoing support, Community Mobilization, Assessment, and Systems strengthening. This paper will focus on the teacher ongoing support pillar of NEGRP and describe how processes of Monitoring, Evaluation, Research, Learning and Adaptation informed the evolution of the Ministry’s Teacher Professional Support System. EGRP & EGRP II were implemented in the context of Nepal’s transition to federalism, which began following the ratification of its constitution in 2015. This resulted in a situation where roles and responsibilities within the education system were in flux and authority for decision-making and funding shifted to the local level. Thus, implementation decisions had to recognize and adjust to a context in-flux. From the outset of NEGRP, the model for ongoing teacher support was based on evidence in the field on what works, with a heavy reliance on external coaches who could provide feedback and support to teachers on a regular basis. Challenges in the Nepal context, including the diversity of contexts within Nepal, as well as the changes taking place due to federalism, made it apparent that adjustments would be needed. As a result, EGRP supported the MOEST to undertake the first implementation research study, which supplemented Monitoring and Evaluation data to identify the strengths and weaknesses of the teacher support model, as well as to identify possible alternatives. A second iteration of the government’s model for Teacher Professional Support was developed based on the findings from this learning and joint reflection by stakeholders, government officials, and project staff – together with the continuing evolution around teacher learning and support in the field more broadly. A second round of monitoring, learning, and operational research enabled EGRP and MOEST to further hone the model – as well as to provide needed further adjustments to align with the newly federalized system as it evolved. Based on those findings and joint reflection, GoN developed a Teacher Professional Support that incorporates a flexible menu of options that enables local authorities to determine the combination of approaches that will be most suitable for their local context and to address local challenges. This paper will briefly present the iterations to the NEGRP ongoing teacher support model, explore the MERLA approaches that were used in this adaptive process and discuss lessons learned. The authors would then seek to engage the audience in discussion around the broader implications and pose the question: how can program design build in opportunities for this type of iterative learning from the outset?

This presentation was delivered by Wendi Ralaingita at the Open Learning Exchange (OLE) conference in Kathmandu, Nepal (November 2017). It provides an overview of RTI's evidence-based approach to ICT integration, based largely on the Improvement Science literature, particularly Edward Deming. Describes uses of Tangerine open-source software for teacher coaching (Tangerine:Tutor) and classroom continuous assessment (Tangerine:Class) as well as hearing and vision screening tools integrated with EGRA and EGMA assessments.

In March 2011, a research team evaluated the skills of 420 P4 and 420 P64 students with an Early Grade Mathematics Assessment (EGMA) instrument adapted to the Rwandan curriculum and context. An English-language Early Grade Reading Assessment (EGRA) instrument was adapted to the Rwandan context, while a Kinyarwanda-language instrument was developed based on the linguistic structure of the Kinyarwanda language.5 We gathered a diverse range of information using the Snapshot of School Management Effectiveness (SSME) instruments developed by the EdData II project and customized for the Rwandan context. A random selection of districts and non-private schools in Rwanda were included in the survey, and therefore students from a range of socioeconomic backgrounds are represented.