An integral part of a decentralized education system hierarchy is the “middle tier” comprising subnational actors in charge of education delivery at the regional, provincial, state, district, municipality, city, or circuit and cluster levels. The general roles and responsibilities of the middle tier are described in research on district leadership in OECD countries. Their responsibilities range from planning, monitoring, and implementing reforms at the subnational and school levels, to ensuring school-based accountability through data and evidence, to innovating, supporting, and monitoring improvements in teaching and learning in schools through instructional leadership and fostering professional learning communities at the district and school levels. While rigorous academic evidence may be lacking on the ability of middle managers to bring about improvements in foundational literacy and learning outcomes at scale in LMICs, we have theoretical and programmatic evidence on (1) their role in instructional leadership, (2) the importance of building their capacity to drive teaching and learning, and (3) the importance of trust and support within the education system that fosters learning at scale. Thumbnail Credit: Pakistan Reading Program/IRC

The CRLA was initially conceived as a 5-minute start-up reading assessment designed to help teachers quickly determine the reading profiles of their G1-G3 learners, and develop appropriate reading instructional strategies. The main goal is to identify children who need additional support in reading. The CRLA was developed in response to the extended break that learners experienced over the summer of 2020 due to the pandemic. After 32 weeks of no class, teachers needed a rapid, easy to use tool, to determine what level of readiness and support the returning children needed. The beginning of school year tasks focused on letter sounds, isolated words and sentence in reading in MT (G1), Filipino (G1-G2) and English (G1-G3). In the Philippines, learners are expected to transition from their mother tongue (MT) to Filipino and English (L2 and L3 respectively) by grade 4. However, the earliest standardized assessment used in the Philippines is for Filipino starting in G3 and English starting in G4. Prior to the CRLA, there were no existing standardized tools or systems used to assess in the MT. It was also a tool that could be administered remotely (online or even over the phone) which proved critical for schooling in the new normal where face to face classes were not permitted. Thus, the CRLA met the needs of teachers who were missing such a tool in their early grade assessment toolbox. The CRLA was initially piloted in November 2020 with select schools. The experience of the pilot led DepEd to scale up the CRLA to all schools in the ABC+ Target Regions. The feedback from the schools and teachers who utilized the CRLA was encouraging. Many schools used the results of the CRLA to develop remedial and focused reading programs in the context of the new normal and identify the struggling readers to provide additional support. Based on the success of the beginning of school year RLA, the Department of Education requested ABC+ to help develop middle and end of year assessments that would align to their curricular competencies. Keeping to the same criteria (rapid and easy to administer and analyze), the team incorporated listening comprehension, oral reading fluency and reading comprehension tasks for end of year administration. At the request of DepEd, ABC+ is currently in the process of expanding the number of MT languages supported by the CRLA and incorporating it into their operations manual for mother tongue-based multi-lingual education.

USAID's Education Data for Decision Making (EdData II) was implemented over a 12 year period beginning in 2004. EdData II had at its core the goal of improving access to data for USAID Missions and host country ministries, to use for making informed policy decisions. The tools and research developed under EdData II whelped to inform the development of learning metrics under the Sustainable Development Goals (2015); provide evidence to support the design and monitor the implementation of USAID's 2011-2017 Education strategy, and provide actionable, high-quality data to inform policy and practice in around 35 countries. The report reflects on EdData II and the project's impact, providing a summary of the most salient and impactful project activities, and drawing key lessons from their development and implementation.

Presentation delivered at CIES 2017 (Atlanta). CIES Panel title: Measuring regional progress toward early grade reading and mathematics targets in a national application of LQAS as part of the RAMP Initiative in Jordan. RTI International (RTI) and its partners are implementing the United States Agency for International Development (USAID) and United Kingdom’s Agency for International Development (UKAID) funded Early Grade Reading and Mathematics Initiative (RAMP). RAMP is a nationwide initiative of the Jordanian Ministry of Education (MoE) designed to improve the reading and mathematics skills of students in kindergarten 2 through grade 3 (K2–G3). RAMP, which will be carried out over five years, expects to deliver improved reading and mathematics instruction to all public school students in Jordan in grades K2–G3—about 400,000 students. Central to the RAMP approach is developing reflective practice at all levels of the education system. At the classroom level, teachers use screening and diagnostic tools developed by the initiative for reading and mathematics to gain a better sense of the developmental level(s) of the students in their class and in response, to use research based pedagogical approaches and materials to respond to these needs. At the national level the MoE uses biannual national surveys that include the Early Grade Reading Assessment (EGRA) and Early Grade Mathematics Assessment (EGMA) to measure progress toward national benchmarks. RAMP is exploring the efficiency of the Lot Quality Assurance Sampling (LQAS) methodology in providing regional structures (Field Directorates) with regular information on the progress by schools and Field Directorates toward achieving the national benchmarks for early grade reading and mathematics. In addition, the LQAS based assessments will also contribute to the development of school reports. This panel will discuss the first national implementation of the LQAS based assessment conducted in May 2016 (Brombacher, 2016). The first presentation will provide background to the RAMP initiative, the centrality of reflective practice at all levels of the system to improving performance in early grade reading and mathematics, and the role that the LQAS based assessments will play in providing regional structures with the information that they need to monitor and support progress toward the national benchmarks. The second presentation will describe the development of the instruments used in the LQAS assessment activity, the implementation of the first national LQAS based assessment, the findings of the study, and a range of important lessons learned. The third and final presentation will describe the response of the MoE to the national implementation. The presentation will also deal with the anticipated institutionalization of the approach into the roles and responsibilities of the ministry supervisors. The panel contributes to the conference theme, “Problematizing (In)Equality: The Promise of Comparative and International Education”, as it examines the implementation of an efficient and cost-effective mechanism for national and regional education structures to identify the schools and regions that are in greatest need of support – allowing the structures to deploy limited resources in a cost effective way.

This report summarizes main findings and lessons learned from the piloting of the lot quality assurance sampling (LQAS) methodology in the education sector in Ethiopia. It also suggests next steps for applying the LQAS methodology more broadly for education program monitoring.

This manual was created at the request of the United States Agency for International Development (USAID). It is a tool to guide individuals who are implementing a pilot application in locations that have not previously tested it. The assumption is that they will be gauging the appropriateness and effectiveness of using the method within that context as a routine monitoring tool. LEMA is an adaptation of a monitoring approach known as Lot Quality Assurance Sampling. (LQAS). LQAS uses small sample sizes and binary indicators to classify local areas as meeting or not meeting minimum performance standards. This approach was first developed in the 1920s as a way to monitor the quality of manufacturing production. A small sample of items would be randomly selected from a production lot and examined for any imperfections. If the number of defective items within the lot was greater than a pre-set threshold level, then the entire lot was rejected (Robertson et al., 1997, p. 199). Rejected lots were then “examined more closely and either repaired or discarded” (MEASURE Evaluation Project 1998, p. 5). The downloads link to the toolkit (3000 kb) and a related presentation (7000 kb).

This report summarizes main findings and lessons learned from the piloting of lot quality assurance sampling (LQAS) in the education sector in Ghana. It also suggests next steps for applying LQAS more broadly for education program monitoring.

EdData II, sponsored by the United States Agency for International Development (USAID), provided survey expertise to help national and local governments as well as the donor community assess education status in low income countries. The period of performance for EdData II Task Order 7, Learning Outcomes Research and Assessment-Related Projects, was October 2009–October 2013. Its purpose was to build on the measurement instruments developed and piloted under other EdData II task orders and to coordinate data, analysis, and reporting on learning outcomes with specific attention to early grade reading proficiency, early grade numeracy, and conditions of learning as indicated by school management effectiveness measures in a number of priority countries. This report summary gives a history of the effort in each country, including its purpose, various challenges encountered, and in-country reactions to the study findings.

This final report summarizes main findings and lessons learned from the piloting of lot quality assurance sampling (LQAS) in the education sector in Tanzania. It also suggests next steps for applying LQAS more broadly for education program monitoring.