Assessing Soft Skills in Youth Through Digital Games

The acquisition and use of so-called “soft skills”, including problem solving, resilience, and self-regulation have been associated with better performance at school and in the workplace [1], [2]. Problem-solving is defined as the ability to acquire or use prior knowledge in order to solve new problems. Strengthening this skill is a concern to educators and employers as the 21st century labor market is increasingly unpredictable and requires skills that go beyond mastering and executing familiar processes. Students need to identify and solve problems that they have never encountered before, formulate a solution plan specific to that problem, and execute the plan. Thus far, the body of research that has measured these relationships relies on traditional self-reporting measurement questionnaires. This methodology is prone to bias since youth may respond in a way they know is desirable, rather than the way they actually behave [3]. Stealth assessment attempts to gather more authentic measurement of skills by asking children to demonstrate them in a structured environment where data collection is unobtrusive [4]. Digital games can be used for stealth assessment, with data on decisions and strategies collected in the application during game play. Since 2017, RTI has been developing games that target a range of soft skills by simulating real-world tasks in a virtual environment. The game designed to measure problem-solving skills gathers metrics on task completion, time management, accepting instruction, problem identification, solution identification, and self-regulation. This paper describes the multi-year process of development and testing of this game, the results obtained from pilots in the Philippines and Morocco, and the implications for strengthening problem-solving skills among youth worldwide. Cite this paper: Pouezevara, S., Powers, S. Strigel, C., McKnight, K. (2019). Assessing soft skills in youth through digital games. ICERI2019 Proceedings. 12th Annual International Conference on Education, Research and Innovation (ICERI), Seville, Spain. p. 3057-3066. https://doi.org/10.21125/iceri.2019.0774

Learning to Read: The Power of the 5T's

Learning to read is a critical foundational skill in the early grades. The Government of Uganda in partnership with the Literacy Achievement and Retention Activity funded by the United States Agency for International Development (USAID) is working to improve early grade reading. This activity is implemented by RTI International, an independent, nonprofit research institute dedicated to improving the human condition.

What works in early reading materials

Access to books is key to learning to read and sustaining a love of reading. Yet many low- and middle-income countries struggle to provide their students with reading materials of sufficient quality and quantity. In this paper, we seek to capture the practices RTI has developed and refined since 2008, particularly in response to the challenges inherent in contexts with high linguistic diversity and low operational capacity for producing and distributing instructional materials. These practices constitute our approach to developing and producing instructional materials for early grade literacy. We also touch upon effective planning for printing and distribution procurement, but we do not consider the printing and distribution processes in depth in this paper. We expect this volume will be useful for donors, policymakers, and practitioners interested in improving access to cost-effective, high-quality teaching and learning materials for the early grades.

USA Country Report: Scaling Access and Impact - Realizing the Power of EdTech

This series of reports was produced by Omidyar Network’s Education initiative, whose mission is to unlock human potential through learning by catalyzing people, ideas, and systems – so every individual thrives and contributes in a changing and interdependent world. The Omidyar Network team included Eliza Erikson, Erin Simmons, Rebecca Hankin, and Eshanthi Ranasinghe. The data underpinning this report come from interviews, surveys, site visits, and desk research by a team of researchers and EdTech practitioners led by RTI International, drawing on local expertise in each of the case study countries. The team conducted more than 100 interviews with teachers, school principals, education administrators, policymakers, and EdTech experts. This study sought to understand the conditions that have thus far enabled EdTech initiatives to scale in the USA. This case study involved interviewing and surveying more than 20 EdTech stakeholders in the US. These experts provided recommendations on which states or districts could serve as examples of effective EdTech scale-up (at the access, use, or impact level). Suggestions included Utah, California, Maine, Rhode Island, New York, North Carolina, and Florida. Two specific ‘deep dives’ are included in this report: the state of North Carolina and the Miami-Dade County public school district in the state of Florida. Both North Carolina and Florida have, in the past decade, aggressively transformed education and implemented policies and initiatives to improve education opportunities for all students with the help of EdTech.

China Country Report: Scaling Access and Impact - Realizing the Power of EdTech

This series of reports was produced by Omidyar Network’s Education initiative, whose mission is to unlock human potential through learning by catalyzing people, ideas, and systems – so every individual thrives and contributes in a changing and interdependent world. The Omidyar Network team included Eliza Erikson, Erin Simmons, Rebecca Hankin, and Eshanthi Ranasinghe. The data underpinning this report come from interviews, surveys, site visits, and desk research by a team of researchers and EdTech practitioners led by RTI International, drawing on local expertise in each of the case study countries. The team conducted more than 100 interviews with teachers, school principals, education administrators, policymakers, and EdTech experts. This study sought to understand the conditions that have thus far enabled EdTech initiatives to scale in China. The study found that there is a multibillion dollar business opportunity for EdTech entrepreneurs that leverage widespread access to mobile internet and performance pressure generated by cultural values and government standards. Reaching rural and ethnic minority schools with equal access to high quality lessons through virtual teaching and blended models of instruction.

Chile Country Report: Scaling Access and Impact - Realizing the Power of EdTech

This series of reports was produced by Omidyar Network’s Education initiative, whose mission is to unlock human potential through learning by catalyzing people, ideas, and systems – so every individual thrives and contributes in a changing and interdependent world. The Omidyar Network team included Eliza Erikson, Erin Simmons, Rebecca Hankin, and Eshanthi Ranasinghe. The data underpinning this report come from interviews, surveys, site visits, and desk research by a team of researchers and EdTech practitioners led by RTI International, drawing on local expertise in each of the case study countries. The team conducted more than 100 interviews with teachers, school principals, education administrators, policymakers, and EdTech experts. This study sought to understand the conditions that have thus far enabled EdTech initiatives to scale in Chile. This case study is the result of more than 20 interviews and site visits and a document review conducted in Chile over a 2-month period in 2018. The case demonstrates that long-term, top-down vision implemented in partnership with university networks or other NGOs who specialize in adaptive management, active learning and knowledge sharing.

Indonesia Country Report: Scaling Access and Impact - Realizing the Power of EdTech

This series of reports was produced by Omidyar Network’s Education initiative, whose mission is to unlock human potential through learning by catalyzing people, ideas, and systems – so every individual thrives and contributes in a changing and interdependent world. The Omidyar Network team included Eliza Erikson, Erin Simmons, Rebecca Hankin, and Eshanthi Ranasinghe. The data underpinning this report come from interviews, surveys, site visits, and desk research by a team of researchers and EdTech practitioners led by RTI International, drawing on local expertise in each of the case study countries. The team conducted more than 100 interviews with teachers, school principals, education administrators, policymakers, and EdTech experts. This study sought to understand the conditions that have thus far enabled EdTech initiatives to scale in Indonesia. Focusing on K–12 education, and drawing on interviews with 22 practitioners in the field, we found that Indonesia is paving the way for modern learning using digital and connected technology. As Indonesia overcomes the challenge of access to EdTech, the near future will require greater attention to its impact through research, evaluation, and evidence-based product design.

Guiding Teachers Rather than Scripting Them

It is difficult to imagine an effective teacher who does not have mastery of the content nor command of the pedagogical skills needed to teach literacy. Yet many teachers, particularly in low- and middle-income countries, lack these very skills. In those same countries, students exit school without the essential capabilities they need. How can we help teachers to teach more effectively?

USAID Early Grade Reading Program in Nepal - Impact evaluation midline results (2018)

NORC at the University of Chicago is conducting a quasi- experimental impact evaluation of the NEGRP. Using early grade reading assessments, the evaluation measures the extent to which the NEGRP improved the reading outcomes of students with Nepali as their first language and students with a non-Nepali mother tongue. This is the report of the 2018 midterm evaluation.

USAID Uganda School Health and Reading Program, Systemic, Sustained Reading Achievement

Briefer: Final Early Grade Reading Assessment Results from the USAID/Uganda School Health and Reading Program. This briefer compares English and local language reading fluency and comprehension among program and control learners from Primary 1 to Primary 4 (when the program ended) and beyond to Primary 5. It also goes back and compares Primary 2 results for later cohorts. Major findings: • By the end of Primary (P4), program learners were more than twice as likely to be reading 60 or more words per minute in English than learners from control schools. • P4 Program learners were also able to answer almost twice as many comprehension questions correctly in English than control learners. • Program results are proving to be sustainable. P2 learners in subsequent cohorts registered reading gains similar to those found in the initial cohort, and control schools brought into the program also registered gains. Furthermore, these gains are being maintained into P5 (though the program ended in P4)

Pages