Jordan Early Grade Assessment Framework The Early Grade Reading and Math Initiative (RAMP)

In 2021, Jordan’s Ministry of Education (MOE) is committed to modernizing education assessment and enhancing learning outcomes. The Early Grades Reading and Mathematics Initiative (RAMP) played a crucial role in conceptualizing the early grade assessment framework. The MOE recognized the need for a more effective and cohesive assessment system. it highlights the issues of misalignment and lack of coordination between national and international assessments, resulting in an inability to accurately measure student performance across different grades. It emphasizes the need for a comprehensive assessment system and policies to ensure consistency and monitor the quality of education in MOE's schools. As part of the RAMP sustainability plan, a comprehensive framework for early-grade assessment was developed to incorporate the latest trends in student learning assessment and enhance educational outcomes. The Directorate of Tests, in collaboration with RAMP experts, conducted an analysis of the current early-grade assessment system, identifying areas requiring improvement. A joint Ministry and RAMP team, in consultation with international evaluation experts from the RTI organization, created the framework and provided recommendations to address existing gaps. Subsequently, this framework was shared with MOE's technical departments and the National Curriculum Development Center for final approval. The Early Grades Assessment Framework has significantly benefited the MOE at both the central and field levels, including schools and field districts, by: 1. Defining and communicating clear learning expectations at all levels, including learning standards and indicators. 2. Preventing excessive evaluation practices. 3. Offering capacity-building programs for supervisors and teachers related to formative and summative assessments. 4. Utilizing assessment data to enhance student learning and promote inclusive teaching and learning for all children. 5. Formulating regulations and procedural guidelines for national assessments in early grades, thereby ensuring their sustainability and securing financial resources for implementation. The MOE introduced a structured assessment process, incorporating the Early Grade Reading Assessment (EGRA/EGMA) and the Lot Quality Assurance Sampling (LQAS) methodology to gauge students' foundational knowledge and skills. This approach helped identify areas where students needed additional support. Extending foundational learning assessment to the classroom level allowed for tailored support to students in need, fostering inclusivity. The revamped assessment approach brought about positive changes. LQAS results informed support strategies for districts, individual schools, and teachers. Classroom-level assessments allowed differentiated support to students. The Ministry of Education's (MOE) commitment to aligning the assessment framework with expected learning outcomes has yielded positive results and has paved the way for further improvements in Jordan's education system. As evidence of this commitment, the results of the EGRA/EGMA end-line survey conducted in May 2023 demonstrate significant improvements in the reading and mathematics skills of Grade 2 (G2) and Grade 3 (G3) students compared to 2019 and 2021. For example, G2 students in traditional MoE schools have shown remarkable progress, with their reading proficiency increasing from 10.7% in 2021 to 42.4%, while G3 students improved from 39.4% to 60.3%. The MOE's unwavering commitment to aligning assessment with learning outcomes has yielded tangible, positive results. As Jordan continues its journey towards educational excellence, the comprehensive assessment framework for early grades stands as a testament to the dedication and innovation of the MOE and its partners. By placing learning outcomes at the forefront, Jordan is not just shaping a brighter future for its students but also setting a remarkable example for education systems worldwide. Stay tuned for more updates as Jordan's education transformation unfolds. The future looks promising, indeed.

Early Grade Reading and Mathematics Initiative RAMP-KG Data for Decision-Making: Phase II National Survey of Families

This study, conducted in collaboration with the USAID Early Grade Reading and Mathematics Initiative (RAMP) and the Ministry of Education between December 2017 and August 2018, aims to identify types of kindergarten services, providers, and factors influencing parental enrollment decisions. It also emphasizes the need to reevaluate KG2 expansion policies in Jordan. The study's sample included 520 schools, encompassing both rural and urban areas per governorate, along with "vulnerable districts" as designated by UNICEF/Jordan and UNRWA schools. The study surveyed 10,500 parents of grade 1 children from across Jordan regarding their children’s school participation in the previous year. Findings showed a significant gap between reported attendance rates (84%) and official enrollment statistics (60%), indicating substantial unrecognized KG provision. KG2 attendees were primarily enrolled in full-time formal classes, with cost identified as a major enrollment factor. Discrepancies in KG access between urban and rural areas were observed, with public provision being more prevalent in rural regions. Syrian children exhibited lower KG2 attendance rates, attributed to financial constraints. Proposed strategies include offering affordable KG options in areas with a concentration of Syrian families. The study highlights a strong demand for KG services in Jordan, particularly among urban families with limited access to public KG. The study underscores the necessity of strategies that promote affordable, high-quality KG choices, encourage private sector involvement, and provide customized solutions. Its insights can inform policy decisions aimed at improving KG services, contributing to the goal of achieving universal KG access aligned with national development objectives.

Early Grade Reading and Mathematics Initiative (RAMP) Time-on-Task Study Report

The Time on Task study was completed as part of the USAID Jordan Reading and Mathematics Project (RAMP), RAMP was a 7-year project aimed at improving foundational learning skills. The time on task study aims to understand how time is allocated throughout the school day, how that time is used to teach various subjects, and the effectiveness of instructional approaches used to teach Arabic. The study examined grades 1-3 classrooms in schools that were selected as high-growth and low-growth schools based on the results of the 2019 RAMP endline survey. In high-growth schools, students demonstrated growth in reading skills based on reading comprehension and zero scores. Conversely, in low-growth schools where there was a decline in reading comprehension and/or an increase in zero scores. The sample included a total of 34 schools: 16 high-growth schools and 18 low-growth schools. The study utilized classroom observations, teacher and principal interviews, and innovative instructional methods to identify teaching strategies associated with higher student engagement and better learning outcomes. The time on task study took place between October 2022 and March 2023. The results show that while there are existing good practices in terms of effective Arabic instructional pedagogies in early-grade classrooms, there remains a need for adjustments to diversify and expand teachers’ pedagogical skills, along with increasing opportunities for students to engage in reading and writing. Teachers need to provide effective reading instruction that aligns with students' developmental progression of skills incorporating diverse materials and extending Arabic lesson time. Additionally, teachers should design high-quality tasks that foster better understanding and learning. The study was undertaken to inform Arabic literacy instruction and decisions that can be made by Jordan's Ministry of Education (MoE) decision-makers.

Early Grade Reading and Mathematics Initiative (RAMP) The Decodable Levelled Reading Books Study Report

The Decodable Levelled Reading Books Study Report- Jordan/RAMP Discover the Power of Decodable Books: Bridging the Reading Gap in Jordan's Education System Introducing the groundbreaking Reading and Mathematics Program (RAMP), a USAID-funded initiative with a mission to transform early-grade education in Jordan's government primary schools. It addresses the need for enhanced foundational abilities in reading and math among early-grade students, particularly those facing challenges. The program emerged from a 2019 survey indicating that while national scores improved, struggling students, especially those in refugee camps, did not progress as desired. The survey underscored the need for tailored reading materials to master phonics, crucial for fluency and comprehension. Consequently, RAMP analyzed Arabic reading textbooks and identified gaps, primarily in grade 2, prompting the introduction of decodable leveled reading books. The study's central objective is to gauge the effectiveness of these books in classrooms. Designed to bolster phonics skills, they aim to bridge proficiency gaps among different-performing students. The literature review discusses decodable and leveled reading books, highlighting their benefits. The study employs a mixed-methods approach, using pre-tests, post-tests, and questionnaires to measure changes in reading fluency, comprehension, and perceptions. The results showed a significant improvement in first-grade emergent readers using decodable books, while struggling third-grade readers exhibited enhanced oral reading proficiency. Second-grade results were less clear. Students reported increased interest and faced challenges, underscoring the need for tailored resources. Teachers largely endorsed the books and recommended wider implementation. In conclusion, the study seeks to advance the "all children reading" goal by enhancing foundational skills for struggling students.

Can the Middle Tier Drive Foundational Learning at Scale?

An integral part of a decentralized education system hierarchy is the “middle tier” comprising subnational actors in charge of education delivery at the regional, provincial, state, district, municipality, city, or circuit and cluster levels. The general roles and responsibilities of the middle tier are described in research on district leadership in OECD countries. Their responsibilities range from planning, monitoring, and implementing reforms at the subnational and school levels, to ensuring school-based accountability through data and evidence, to innovating, supporting, and monitoring improvements in teaching and learning in schools through instructional leadership and fostering professional learning communities at the district and school levels. While rigorous academic evidence may be lacking on the ability of middle managers to bring about improvements in foundational literacy and learning outcomes at scale in LMICs, we have theoretical and programmatic evidence on (1) their role in instructional leadership, (2) the importance of building their capacity to drive teaching and learning, and (3) the importance of trust and support within the education system that fosters learning at scale. Thumbnail Credit: Pakistan Reading Program/IRC

Jordan reflective approach builds a more resilient education system [CIES 2023 Presentation]

The USAID-FCDO Jordan Early Grades Reading & Mathematics Initiative (RAMP) started in 2015 with the goal to improve Kg-Gr.3 students reading and mathematics skills through improving curriculum system coherency, teacher professional development and coaching, increasing parental involvement, and improving standards, evaluation, monitoring, and accountability systems. The presentation is about how RAMP built a resilient MOE early grades system that could mitigate the learning loss caused after the school closure as a measure of the spread of COVID-19. It was notable the early grades school system was more resilient than the upper levels, administrators and teachers were more ready to cope with a new context where children reading and mathematics skills were varying widely: the MOE was able to rapidly implement a national survey (EGRA/EGMA) to measure learning losses and design a remedial program; teachers were able to use diagnostic assessment tools and identified individual students actual learning needs; teachers were familiar with differentiated instruction and remedial strategies for vulnerable children; and a system was already in place to regularly coach teachers in under-served schools/areas.

Using teaching and learning materials in Uzbekistan: Lessons from observations and interviews [CIES 2023 Presentation]

The purpose of this panel presentation is to present the results of two uptake studies to understand how mathematics, Uzbek language arts, ICT, and EFL teachers in Uzbekistan are using and applying newly developed teaching and learning materials in the classroom.

Early Grade Reading and Mathematics Initiative: KG Data for Decision-Making: Phase II National Survey of Families

The Kingdom of Jordan’s Human Resource Development (HRD) Strategy mandates the universal provision of kindergarten (KG2) by 2025. The HRD Strategy emphasizes using partnerships between the Ministry of Education (MoE) and other governmental and nongovernmental actors to assure expanded provision of kindergarten services. The strategy further emphasizes the need to improve the quality of kindergarten services, while reaching every child. To fully understand how the MoE can increase access, improve quality, and assure equitable provision of KG1 services, more accurate information is needed, especially about other, as yet unrecognized service providers who may be offering KG or KG-similar services to five-year-old children. The MoE needs a more complete picture of the current provision of KG2 to determine the best strategy to achieve the HRD goal that every child in Jordan receives a high-quality kindergarten experience.

Multi-Language Assessment (MLA) for young children: A screener to understand language assets [CIES 2023 Presentation]

The lack of information about children’s oral language skills limits our understanding of why some children do not respond to literacy instruction. Even though native language oral language skills are not strong predictors of native language decoding (Durgunoglu et al., 1993; Lesaux et al., 2006), oral language skills have been shown to have a small role in non-native word reading for non-native speakers (Geva, 2006; Quiroga et al., 2002). Yet, understanding that threshold of language skills is not understood. Cross-linguistic studies show that some literacy skills transfer between languages (Abu-Rabia & Siegel, 2002; Bialystok, McBride-Chang, & Luk, 2005; Cisero & Royer, 1995; Comeau, Cormier, Grandmaison, & Lacroix, 1999; Denton et al., 2000; Durgunoglu, 2002; Durgunoglu et al., 1993; Genesee & Geva, 2006; Gottardo, Yan, Siegel, & Wade-Woolley, 2001; Koda, 2007; Wang et al., 2006). This includes letter knowledge, print concepts, and language skills (phonological awareness and vocabulary). The transfer of these skills is considered a resource (Genesee, Geva, Dressler, & Kamil, 2006) that assists reading in the additional languages. Children learning to read in a non-native language bring their first language (i.e., mother tongue) to the instructional setting. Yet, its use will depend on the teacher’s use translanguaging between the language of instruction and children’s home language (s). The presence of two or more languages contributes to children having domains of knowledge in specific languages. For example, domains of knowledge children learn at school such as shapes, might only be known in the language of instruction. Relatedly, domains of knowledge they learn at home from family interactions, such as cooking, might only be known in the mother-tongue. And domains of knowledge that children learn on the playground, are likely to be learned in a lingua franca, or a common language to the area. Even though mixing languages is common, most language assessments do not capture this knowledge. Even in samples with multi-lingual students, for reasons of reliability and consistency, most language assessments assess children in just one language and describe results for that language. The results are used to help to explain results on reading assessments. But measuring language skills in just one language overlooks the concepts that a multilingual child may have in other languages and describe them from a deficit approach opposed to the asset of being multi-lingual. To address this problem, we developed a tool, the Multi-Language Assessment (MLA), to measure children’s expressive language across multiple languages to understand the skills they have to support their learning. The tool is intended to be reliable, valid, and child friendly. It is our hypothesis that children’s expressive language scores across multiple languages can help to explain their success or struggles in the early years of formal schooling. We conceptualized and developed the Multi-Language Assessment (MLA) to capture children’s language skills across multiple languages in a 7-minute interaction with a trained assessor. The MLA measures expressive language of 36 concepts shown in 36 images that children would be exposed to through family and community interactions, conversations, media, books, or school. The items included in the assessment yield variable distribution; they are not intended to be items that would yield ceiling effects. A child’s utterance is coded to one of nine categories of varying weights. Furthermore, the items are intended to have levels of a familiarity. For example, for an image of a coconut tree, some children might call it that, while other children describe it by its domain, a tree, not identifying the specific type. Both utterances would earn a child points but of varying weight. Research Problem 1. Many children in low- and middle-income contexts do not learn to read in lower primary efficiently. 2. Some people hypothesize that the reason for children’s poor performance is language related. 3. When children’s language skills are assessed it is usually in one language and describes their abilities as deficits as opposed to considering their assets of being multi-lingual. 4. Assessing language requires time and young children’s attention spans are short, reducing data quality if the assessment is too long. 5. The MLA was created to understand expressive language use across multiple languages and to be brief Study: The paper presents results from a recent longitudinal study that collected child level results at two time points in government school in rural Kenya. It includes the aforementioned multi-language assessment and measures of reading achievement (e.g., letter knowledge and spelling) at Time 1 when all children were in kindergarten and again at Time 2 when they had advanced to either a higher Kindergarten or to Grade 1. An existing measure of expressive language was used to explore concurrent validity of the MLA. The Time 1 sample (n=215) was large enough to examine the technical properties of the tool and the Time 2 sample (n=200) had only 7% attrition so there was sufficient power to describe individual changes. The features of the language assessment suggest that it is reliable and sensitive. The following analysis been conducted: 1) Sample demographics; 2) Distributions by subtasks; 3) Measures of association between subtasks; 4) Item analysis The following research questions are addressed: 1. How does expressive language use evolve for children who use three languages as they progress from kindergarten into first grade? For example, do they shift from using the home language for some items at Time 1 to a language of instruction at Time 2? 2. How does children’s overall expressive language knowledge (as measured in three languages) contribute to their reading achievement (letter sound knowledge and spelling) as measured in two languages over time?

Teaching by the book: Teacher decision-making while using structured lesson plans

The purpose of this paper is to present a methodology for understanding materials usage in primary classrooms in Sub-Saharan Africa that centers teachers’ actions and voices. The United Nation’s Sustainable Development Goal 4 focuses on improved primary education around the world. To meet this goal, many large, donor-funded interventions aim to improve education through provision of teacher’s guides and student textbooks. However, what many of these interventions lack is a systematic way to understand how and why teachers are making pedagogical decisions while using materials. There is a large body of work that seeks to understand how teachers make decisions as they teach, and the ways these decisions are influenced by their knowledge and beliefs. Drawing from this work, we describe a methodology and set of tools that uses observations and interviews to identify key decisions that teachers make in the classroom and why teachers made those decisions. We piloted and iteratively refined this methodology over the course of three studies and use examples from these studies to illustrate the methodology. By closely observing and listening to teachers, we gain insights that allow us to continually refine and improve materials to ultimately improve the quality of classroom instruction.

Pages