Early Grade Math Assessment (EGMA)

Core EGMA instrument in English

This report summarizes the findings of the 2018 Early Grade Reading and Mathematics Initiative (RAMP) Lot Quality Assurance Sampling Assessment, measuring impact between 2017 and 2018. The United States Agency for International Development (USAID) and UK Aid have funded RAMP as a national effort designed to improve the reading and mathematics skills and performance of students in Jordan from kindergarten 2 through grade 3 (K2–G3). This five-year program began on January 1, 2015, and is scheduled to end on December 31, 2019. Her Majesty Queen Rania Al-Abdullah formally launched RAMP as part of the broader Ministry of Education (MoE) initiative to improve education. The Research Triangle Institute (RTI) International leads implementation with its partners: Queen Rania Teacher’s Academy, ChangeAgent for Arab Development and Education Reform, We Love Reading, The Kaizen Company, Mercy Corps, Dajani Consulting, and Prodigy Consulting. The RAMP team and the MOE conducted a Lot Quality Assurance Sampling (LQAS) assessment in November 2018. Approximately 200 assessors (most of whom were MOE supervisors) were trained to collect reading and mathematics performance data across all 42 field directorates in the kingdom. For this activity, an approach was used at the school level, which led to a final sample of more than 39,000 Grade 2 and Grade 3 students in 2,076 schools. Performance comparisons made on three key indicators (reading comprehension, oral reading fluency, and mathematics) provides illustrative evidence of the gains made by RAMP schools over one school year. Large gains were seen on reading comprehension with the percent of students reaching the comprehension benchmark, increasing from 43% in 2017 to 55% in 2018. Gains in terms of oral reading fluency increased from 13% in 2017 to 19% in 2018. The smallest gains were in terms of mathematics (where the percent of students reaching the benchmark improved only slightly from 28% in 2017 to 30% in 2018).

In cooperation with the MOEHE Training Technical Working Group (TWG), EGR developed training modules in the five basic reading skills: phonemic awareness, phonics, fluency, vocabulary, and reading comprehension as well as a comprehensive module in writing skills. The project initially planned to introduce one module at each training session conducted throughout the academic year. However, when EGR learned that the project would close prematurely due to legislative restrictions and funding issues, project staff compressed the trainings on the five basic skills into four over a period of four months. The shortened timeframe did not allow EGR to offer training in the four basic writing skills, but the project developed one comprehensive writing module, which was provided to the coaches in January 2019. EGR supplemented the training modules with additional instructional resources. Project specialists developed three instructional videos to reinforce the strategies introduced in the training modules. Additional activities to support the five basic reading skills were compiled in one resource book. EGR provided four interactive posters for teachers to use in their classrooms and a variety of complementary reading materials. The project’s goal was to equip coaches and teachers with the tools needed to implement a quality early grade reading program.

This paper explores an innovative assessment framework for measuring children’s formal and informal mathematical knowledge. Many existing standardized measures, such as the Early Grade Mathematics Assessment, measure children’s performance in early primary grade skills that have been identified by researchers and policy makers as foundational and predictive of later academic achievement (Platas, Ketterlin-Geller, & Sitabkhan, 2016; RTI International, 2014). However, these standardized assessments only provide information on children’s mathematical ability as it pertains to skills and concepts that are a focus of school instruction, referred to as formal mathematics. While valuable, they leave unmeasured the mathematics that children use and develop as part of their everyday life, such as the strategies they use to solve simple arithmetical problems that arise as they move through their day (Khan, 1999; Saxe, 1991; Taylor, 2009). In this article, we draw from mixed methods studies which focus on capturing the informal mathematical skills that children develop outside of school in various contexts (Guberman, 1996; Nasir, 2000; Sitabkhan, 2009; Sitabkhan, 2015). We describe how the use of observations of children’s mathematical activities in natural settings and in subsequent cognitive interviews using mathematical tasks derived from those observations, can illuminate mathematical knowledge and skills that may otherwise remain hidden. We found that an assessment framework that focuses on both standardized measures of formal mathematical learning and contextualized measures of children’s everyday mathematics can provide a more complete and nuanced picture of children’s knowledge, and taken together can inform the development of curricular materials and teacher training focused on early learning.

Jordan RAMP, funded by USAID and UKAID, is a nationwide initiative of the Jordanian Ministry of Education (MoE) designed to improve the reading and mathematics skills of students in kindergarten 2 through grade 3 (K2–G3). RAMP, which is being carried out over five years (2015 to 2019), expects to deliver improved reading and mathematics instruction to all public school students in Jordan in grades K2–G3—about 400,000 students. This CIES 2018 presentation, given by Aarnout Brombacher, Senior Technical Advisor on the RAMP initiative, shares findings from the midline study of the project, which was conducted at the end of the 2016–2017 academic year (May 2017). The study included the EGRA and EGMA assessments as well as a range of teacher and pupil questionnaires.

Final, validated instruments used in the 2017 Tanzania National EGRA. The EGRA and SSME were made possible with funding from USAID. The EGMA component was made possible by funding from Global Affairs Canada. The Life Skills component was funded by UNICEF Tanzania.

USAID's Education Data for Decision Making (EdData II) was implemented over a 12 year period beginning in 2004. EdData II had at its core the goal of improving access to data for USAID Missions and host country ministries, to use for making informed policy decisions. The tools and research developed under EdData II whelped to inform the development of learning metrics under the Sustainable Development Goals (2015); provide evidence to support the design and monitor the implementation of USAID's 2011-2017 Education strategy, and provide actionable, high-quality data to inform policy and practice in around 35 countries. The report reflects on EdData II and the project's impact, providing a summary of the most salient and impactful project activities, and drawing key lessons from their development and implementation.

The National Education Assessment Unit (NEAU) of the Ghana Education Service (GES) conducted a national Early Grade Reading Assessment (EGRA) and Early Grade Mathematics Assessment (EGMA) in July 2015. This was the second administration of EGRA and EGMA in Ghana; the first took place in 2013, and both were conducted as part of the USAID Partnership for Education: Testing activity. This report describes the findings.

Dissemination of the results from the 2015/2016 round of the Early Grade Reading Assessment (EGRA), the Early Grade Mathematics Assessment (EGMA), the Snapshot of School Management Effectiveness (SSME), and Life Skills occurred at four forums. First, a National Dissemination Workshop for education stakeholders, government representatives, and development partners occurred in mid-June 2016 in Dar es Salaam, Tanzania. This workshop was followed by three locally led, Regional Dissemination Workshops held in late October 2016 in three central regions and attracted practitioners and education representatives from surrounding districts and regions. Third, a Directors’ Meeting was held in mid-November 2016 in Dodoma, Tanzania. The Directors’ Meeting attracted high-level representatives from relevant branches of the Ministry of Education, Science, and Technology (MoEST) and key stakeholders to discuss the findings and their implications for education policy and planning for Tanzania. The final event was a two-hour presentation to the Ministry of Education in Zanzibar to present findings specific to the Zanzibar context. The four events are further discussed in the remainder of this report.

Findings report from the Tanzania National EGRA, EGMA, SSME, and Life Skills.