Uganda/LARA: Journeys Impact Qualitative Assessment instruments

LARA developed a set of qualitative tools to learn about the successes and challenges related to the implementation of Journeys and to understand what changes staff and pupils had observed since Journeys started in the program schools. The qualitative tools include individual interviews and focus group discussion (FGD) guides with head teachers, teaching and non-teaching staff, change agents and students. There are two individual interviews, one for the teachers and another for the head teachers. The individual interview for teachers investigates the value the Journeys program has brought to the teachers personally, to the school and the classroom, for example changes in the way teachers relate and interact with pupils and changes in disciplinary practices at the school. The individual interview for head teachers on the other hand investigate what has gone well and what the head teachers are struggling with regarding the implementation of Journeys for School Staff and Journeys for Pupils (the Uganda Kids Unite [UKU] Program). There are three FGD guides; (i) FGD guide for teaching and non-teaching staff provides information about the changes (for example interactions among students, teacher attendance, extent of SRGBV) in the school as a result of Journeys, initiatives undertaken by the school to make the school safe and positive and how the initiatives improved the school and/or reduced violence; (ii) FGD guide for head Teachers and school change agents (SCA) that gathers feedback on the successes and challenges associated with the implementation of Journeys program for the school staff and Journeys program for pupils as well as improvements needed to for the continuity of the Journeys program in the schools; and (iii) FGD guide for students that focuses mainly on what pupils enjoyed most about the UKU program and the specific UKU activities they loved. It also asks about what pupils did not enjoy in the UKU meetings, initiatives that UKU teams developed to improve the school, what pupils learned through the UKU program and how the school and classroom have changed since Journeys began.

Uganda/LARA: EGR Action Research Tools

LARA developed action research tools to measure the level of fidelity of implementation of the EGR methods and generate lessons learned to inform adaptations in EGR programming. The action research tools gather both historical and real-time data at the school. They include the EGR core methodologies action research tool; the remedial instruction action research tool and the intensive coaching action research tool (subdivided into two tools i.e. head teacher coaching event log and school based community of practice event log). The EGR core methodologies action research tool assesses the teacher’s perception of the Teacher Guide usability, level of macro pacing, implementation of lesson plan elements, implementation of core EGR methodologies and tracking of instructional adaptations by the teacher. The remedial instruction research tool tracks the teacher’s perception to remedial instruction, the implementation of group-based instruction as well as in-class assessment. The intensive coaching action research tool tracks teacher’s perception of intensive coaching and keeps a log of head teacher instructional coaching events in addition to school-based community of practice activities. The action research tools are designed to be deployed electronically in order to seamlessly incorporate extra data quality standards and innovations like the Stalling’s classroom observation snapshot (Stallings and Kaskowitz, 1974 ). The project also developed the action research process flow guidelines to guide data collection activities.

Uganda/LARA : EGRA and supplementary data collection instruments

The Early Grade Reading Assessment (EGRA) is a diagnostic instrument designed to quickly assess foundational skills for literacy acquisition of pupils in Early Grades of primary school. This diagnostic tool, whose content has been adapted for Uganda and Ugandan local languages, can include a number of subtasks depending on the grade being assessed. EGRA is administered to pupils both in their local language and in English via tablets using a software application (for example Tangerine) designed specifically to collect data on mobile devices. EGRA data can also be gathered manually using paper forms. Each instrument is administered by trained assessors in one-on-one sessions with individual pupils, and requires approximately fifteen minutes. The sub tasks in the English EGRA tools used by LARA include letter sound knowledge, oral passage reading, reading comprehension and vocabulary. LARA administers the English sub-tasks mainly to the P3 and P4 pupils. The subtasks in the local language (Luganda, Runyankore/Rukiga and Runyoro/Rutooro) EGRA tools include orientation to print, letter sound knowledge, segmenting, oral passage reading, reading comprehension, and listening comprehension. Apart from orientation to print that is administered to only P1 pupils, the rest of the local language sub-tasks are administered to P1-P4 pupils. The EGRA tools are accompanied by a pupil stimuli packet used to administer the letter sound knowledge and oral passage reading sub tasks. The subtasks used by LARA were adopted from the EGRA tools developed for the School Health and Reading Program (SHRP). SHRP adapted and vetted the tools to the three languages during a series of weeklong workshops that included researchers, primary school teachers, language board members, Coordinating Center Tutors (CCTs) and MoES staff. The adaptation workshop for Luganda was held in December, 2012, Runyankore/Rukiga tools were adapted in January, 2013 and Runyoro/Rutooro tools were adapted in August 2013. The tools were also piloted in each of the three language areas during the workshops. As part of EGRA data collection, LARA administers supplementary data collection tools to assess pupil context and instructional leadership. The tools also provide important contextual information on the teachers and schools participating in EGRA. These tools include; the pupil context interview, a head teacher interview, teacher interview and school inventory. The following provides a summary of each of the tool. Pupil context interview: Used to gather information on pupils’ preschool attendance, language spoken at home, possessions in the household, and support for reading in the home. Head Teacher Questionnaire: Used to gather information from head teachers regarding their instructional leadership, including their training and education background and their support to the teaching of reading at lower grades. Data from this instrument is used to inform training and targeted corrective actions intended to improve the managerial skills of head teachers and their support to the teaching of reading. Teacher Questionnaire: Used to gather information on the teachers’ education and experience and demographics, support and supervision received, and the availability of teaching materials. The information provides the basis of training and the provision of teaching materials to teachers to help them improve their pedagogical skills. School Inventory Form: Used to gather information on school basic infrastructure (for example water source, latrines and electricity) as well as the presence and use of a school library.

Supporting SEL in Uganda Primary Schools: What have we learned after one year.

This presentation summarizes the findings from Occasion 2 of the Uganda/Literacy Achievement and Retention Activity longitudinal study of the impact of the Journeys intervention that aims to reduce SRGBV, strengthen student's SEL, and improve school climate. The presentation focuses on qualitative findings. According to these findings, both teacher and pupil social and emotional competencies are strengthened in schools participating in Journeys. Teachers interact with their peers more often than in the past and their relationships with their pupils are more welcoming and positive. The prevalence of corporal punishment has declined. Pupils are free to open up to their teachers, report issues they encounter in school and express themselves more in the classroom. Pupil relationships have improved, resulting in less bullying and fighting on the school grounds.

USAID/Uganda School Health and Reading Program Cluster 1 Baseline: Ateso, Luganda, Leblango, Runyunkore-Rukiga

This report summarizes the findings from a baseline assessment that was conducted in February and March, 2013 to determine the current status of reading achievement in the schools in which the School Health and Reading Program will be working, as well as achievement in “control” schools that will be used as a basis for comparison in assessing the effectiveness of the interventions.

Insights about how cultural differences condition student response on a survey of student perception of school climate- CIES 2018 Presentation

CIES 2018 Presentation, given by Peter Muyingo. Education programming worldwide is beginning to include dedicated activities to support a positive school culture. There is evidence, mostly from high income countries, that a positive school climate is associated with improved learning outcomes and attendance, and reduced violence prevalence. In this presentation we will discuss some of the challenges we faced in adapting a school climate survey from the United States for use in an impact study for a program in Uganda that has a dedicated focus on building a positive school climate. The school climate survey was adapted as one of a variety of instruments to be used in the impact evaluation of the USAID/Uganda funded Literacy Achievement and Retention Activity. This Activity, a working partnership with the Uganda Ministry of Education, focuses on improving early grade reading and retention in 28 districts and 2698 schools in Uganda.