Country Code: 
PHL

Formative Evaluation of the DepEd Commons

DepEd ICTS requested support from the USAID/All Children Reading Philippines activity for evaluating the recently-launched DepEd Commons online resource portal to ensure that it could live up to its potential as a key strategy for giving all Filipino learners access to educational resources. In response to this request, RTI in collaboration with the DepEd ICTS EdTech Unit, designed a process for reviewing the DepEd Commons to identify evidence-based recommendations for a fully sustainable and impactful DepEd Commons. Although we use the term ‘evaluation’, this is a formative exercise, recognizing that the platform is in a nascent stage and would benefit most from forward-looking and actionable recommendations for living up to its potential, not a backward-looking judgment of implementation quality or completeness at a certain point in time. In line with the approach stated above—that the evaluation of the DepEd Commons would be a formative exercise designed to provide actionable recommendations for improvement, given the early stage of development of the platform—we chose a SWOT analysis methodology to frame the exercise. SWOT analyses are conducted to identify strengths, weaknesses, opportunities, and threats. The study team carried out key informant interviews with stakeholders from the implementing department in DepEd and in other departments with similar systems; a quantitative analysis of platform statistics containing usage data; and a self-administered survey focusing on usage and usability of the platform.

Strengthening MTB-MLE Policy and Capacity in Mother Tongue Supplementary Reading Materials Provisioning in the Philippines

Describes the development of mother tongue supplementary materials to support the implementation of the MTB-MLE approach to language education.

A Monitoring, Evaluation, and Learning (MEL) Framework for Technology-Supported Remote Trainings [CIES Presentation]

Existing research on the uptake of technologies for adult learning in the global South is often focused on the use of technology to reinforce in-person learning activities and too often involves an oversimplified “with or without” comparison (Gaible and Burns 2005, Slade et al. 2018). This MEL Framework for Technology-Supported Remote Training (MEL-Tech Framework) features a more nuanced perspective by introducing questions and indicators that look at whether the technology-supported training was designed based on a solid theory of learning; whether the technology was piloted; whether there was time allocated to fix bugs and improve functionality and user design; how much time was spent using the technology; and whether in-built features of the technology provided user feedback and metrics for evaluation. The framework presents minimum standards for the evaluation of technology-supported remote training, which, in turn, facilitates the development of an actionable evidence base for replication and scale-up. Rather than “just another theoretical framework” developed from a purely academic angle, or a framework stemming from a one-off training effort, this framework is based on guiding questions and proposed indicators that have been carefully investigated, tested, and used in five RTI monitoring and research efforts across the global South: Kyrgyz Republic, Liberia, Malawi, the Philippines, and Uganda (Pouezevara et al. 2021). Furthermore, the framework has been reviewed for clarity, practicality, and relevance by RTI experts on teacher professional development, policy systems and governance, MEL, and information and communications technology, and by several RTI project teams across Africa and Asia. RTI drew on several conceptual frameworks and theories of adult learning in the design of this framework. First, the underpinning theory of change for teacher learning was informed by the theory of planned behavior (Ajzen 1991), Guskey’s (2002) perspective on teacher change, and Clarke and Hollingsworth’s (2002) interconnected model of professional growth. Second, Kirkpatrick’s (2021) model for training evaluation helped determine many of the categories and domains of evaluation. However, this framework not only has guiding questions and indicators helpful for evaluating one-off training events focusing on participants’ reactions, learning, behavior, and results (as is the focus in Kirkpatrick’s model) but also includes guiding questions and indicators reflective of a “fit for purpose” investigation stage, a user needs assessment and testing stage, and long-term sustainability. Furthermore, this framework’s guiding questions and indicators consider participants’ attitudes and self-efficacy (based on the research underpinning the theory of planned behavior), as well as aspects of participants’ post-training, ongoing application and experimentation, and feedback (Clarke and Hollingsworth; Darling-Hammond et al. 2017; Guskey). Lastly, the framework integrates instructional design considerations regarding content, interaction, and participant feedback that are uniquely afforded by technology.

Collaborating For Sustainable Teacher Development in the Early Primary Grades [CIES Presentation]

Description of collaborative process used ensure coherence and alignment of curricular content of preservice teacher preparation and in-service teacher professional development.

Comprehensive Rapid Literacy Assessment [CIES Presentation]

The CRLA was initially conceived as a 5-minute start-up reading assessment designed to help teachers quickly determine the reading profiles of their G1-G3 learners, and develop appropriate reading instructional strategies. The main goal is to identify children who need additional support in reading. The CRLA was developed in response to the extended break that learners experienced over the summer of 2020 due to the pandemic. After 32 weeks of no class, teachers needed a rapid, easy to use tool, to determine what level of readiness and support the returning children needed. The beginning of school year tasks focused on letter sounds, isolated words and sentence in reading in MT (G1), Filipino (G1-G2) and English (G1-G3). In the Philippines, learners are expected to transition from their mother tongue (MT) to Filipino and English (L2 and L3 respectively) by grade 4. However, the earliest standardized assessment used in the Philippines is for Filipino starting in G3 and English starting in G4. Prior to the CRLA, there were no existing standardized tools or systems used to assess in the MT. It was also a tool that could be administered remotely (online or even over the phone) which proved critical for schooling in the new normal where face to face classes were not permitted. Thus, the CRLA met the needs of teachers who were missing such a tool in their early grade assessment toolbox. The CRLA was initially piloted in November 2020 with select schools. The experience of the pilot led DepEd to scale up the CRLA to all schools in the ABC+ Target Regions. The feedback from the schools and teachers who utilized the CRLA was encouraging. Many schools used the results of the CRLA to develop remedial and focused reading programs in the context of the new normal and identify the struggling readers to provide additional support. Based on the success of the beginning of school year RLA, the Department of Education requested ABC+ to help develop middle and end of year assessments that would align to their curricular competencies. Keeping to the same criteria (rapid and easy to administer and analyze), the team incorporated listening comprehension, oral reading fluency and reading comprehension tasks for end of year administration. At the request of DepEd, ABC+ is currently in the process of expanding the number of MT languages supported by the CRLA and incorporating it into their operations manual for mother tongue-based multi-lingual education.

Creating Learning Spaces for the Future of Filipino Early Grade in 2040:The Past, The Present and the Future [CIES Presentation]

This presentation was delivered as part of the 2022 Comparative and International Education Society (CIES) conference as part of a panel describing the Education Futures research activity undertaken by the Philippines Department of Education, with support from USAID/Philippines through the All Children Reading-Philippines program managed by RTI International. Under this activity, leaders in DepEd are engaging in a range of courses and workshops to learn and apply futures thinking methodologies for reimagining how education can be delivered differently to address recurring shortcomings. The authors are Maricel Fernandez (Research Officer, RTI International) and Mark Sy (Manager of EdTech Unit, Department of Education).

Teacher well-being as a critical element to success of remote learning during the pandemic [Presentation]

This presentation describes findings from a study of the remote learning experience of school actors; school heads, teachers, parents and other HLPs, and learners during the first year of COVID-19 school closures in the Philippines. The focus of this presentation is only on one aspect of remote learning and that is how teacher well-being supported the success of schools in their pivot to remote learning. This presentation was delivered at the 2022 CIES Conference.

MEL Framework for Technology Supported Remote Teacher Training

This MEL Framework for Technology-Supported Remote Training seeks to help education program implementers, governments, and program evaluators more effectively design, implement, and learn lessons from remote training activities. It places special consideration on the unique characteristics of technology-supported interventions in the global South. The framework presents minimum standards for the evaluation of technology-supported remote training, which, in turn, facilitates the development of an actionable evidence base for replication and scale-up. Rather than “just another theoretical framework” developed from a purely academic angle, or a framework stemming from a one-off training effort, this framework is based on guiding questions and proposed indicators that have been carefully investigated, tested, and used in five RTI monitoring and research efforts across the global South: Kyrgyz Republic, Liberia, Malawi, the Philippines, and Uganda (Pouezevara et al. 2021). Furthermore, the framework has been reviewed for clarity, practicality, and relevance by several RTI project teams across Africa and Asia.

Online Training on Formative Assessment for Early Language, Literacy, and Numeracy (ELLN) in the Philippines

This report describes findings and lessons learned from an online teacher training course in the Philippines. "Becoming a Learning Detective" is a 5-day online course that focuses on the design and use of formative assessment to improve literacy and numeracy outcomes in Kindergarten to Grade 3 (K–3) classrooms. The emphasis is on classroom-based assessment strategies that are embedded within daily teaching and learning experiences, involving an active partnership between teacher and students. The course brings together asynchronous and synchronous elements, as well as whole group, small group, and individual learning experiences. The course was implemented for the first time among a small cohort of participants across 17 regions in the Philippines. Findings and recommendations of this initial training are being applied toward strengthening the course prior to offering it at a larger scale in the Philippines.

All Children Reading - Philippines: Project Background Brief

ACR–Philippines falls under All Children Reading–Asia, a broader program implemented by RTI International across multiple countries in the Asia Region. The activities directly contribute to USAID’s education goal to improve early grade reading (EGR) skills for 100 million children worldwide. There are two main areas of activity in support of the overall goals and objectives: EGR instruction and assessment in support of mother-tongue based multilingual education (MTB-MLE), and the use of educational technologies to support improved instruction in early grade reading, especially during school closures. Key achievements and activities through July 2021 are summarized in these briefs--one broad and one specific to the COVID-19 response.

Pages