Serious Games for Assessment: Welcome to the Jungle

Serious Games for Assessment: Welcome to the Jungle

Authors

  • Pamela M. Kato
     Coventry University Serious Games Institute, Faculty of Engineering, Environment and Computing, Coventry
  • Sebastiaan de Klerk
     University of Twente/eX:plain, Amersfoort

Keywords:

Applied Games, Assessment, Evaluation, Game Based Assessment, Game Based Learning, Serious Games, Simulations.

Abstract

Serious games are increasingly being explored for use as assessment tools in broad domains. Drawing from research in these domains, we present important advantages and challenges that arise when using games for assessment. In light of this context and as an introduction to this special issue on Serious Games and Assessments, we introduce the experts’ contributions on using games for processes integrating agile game development approaches with psychometric validation processes and designing and developing games for formative assessments.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Downloads

Published

2017-10-03

How to Cite

Kato, P. M., & de Klerk, S. (2017). Serious Games for Assessment: Welcome to the Jungle. Journal of Applied Testing Technology, 18(S1), 1–6. Retrieved from http://www.jattjournal.net/index.php/atp/article/view/118669

Issue

Volume 18, Special Issue 1, 2017

Section

Articles

References

Alvarez, J., & Michaud, L. (2008). Serious Games: Advergaming, Edugaming, Training and More. Montpellier, France.

Bellotti, F., Kapralos, B., Lee, K., Pablo Moreno-Ger, & Berta, R. (2013). Assessment in and of serious games: An overview. Advances in Human-Computer Interaction, 2013 doi:10.1155/2013/136864 https://doi.org/10.1155/2013/136864

Buday, R., Baranowski, T., & Thompson, D. (2012). Fun and games and boredom. Games For Health. Research, Development, and Clinical Applications, 1(4), 257–261. https:// doi.org/10.1089/g4h.2012.0026 PMid:24761316 PMCid: PMC3833369

Cassady, J. C. (2004). The impact of cognitive test anxiety on text comprehension and recall in the absence of external evaluative pressure. Applied Cognitive Psychology, 18(3), 311–325. https://doi.org/10.1002/acp.968

de Klerk, S., Veldkamp, B. P., & Eggen, T. J. (2015). Psychometric analysis of the performance data of simulation-based assessment: A systematic review and a Bayesian network example. Computers & Education, 85, 23–34. https://doi.org/10.1016/j.compedu.2014.12.020

Delisle, J., & Braun, C. M. (2011). A context for normalizing impulsiveness at work for adults with attention deficit/ hyperactivity disorder (combined type). Archives of Clinical Neuropsychology. The Official Journal of the National Academy of Neuropsychologists, 26(7), 602–613. doi:10.1093/arclin/acr043 https://doi.org/10.1093/arclin/ acr043

Egloff, B., & Schmukle, S. C. (2002). Predictive validity of an implicit association test for assessing anxiety. Journal of Personality and Social Psychology, 83(6), 1441. https://doi.org/10.1037/0022-3514.83.6.1441 PMid:12500823

Faria, A. J. (1987). A survey of the use of business games in academia and business. Simulation and Games, 18(2), 207–224. doi:10.1177/104687818701800204 https://doi.org/10.1177/104687818701800204

Girard, C., Ecalle, J., & Magnan, A. (2013). Serious games as new educational tools: How effective are they? A metaanalysis of recent studies. Journal of Computer Assisted Learning, 29(3), 207–219. https://doi.org/10.1111/j.13652729.2012.00489.x

Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009). Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity.Journal of Personality and Social Psychology, 97(1), 17–41. DOI: http://dx.doi.org/10.1037/a0015575 https://doi.org/10.1037/a0015575

Hernández, J. A. C., Duarte, M. P., & Beardo, J. M. D. (2017). Skill assessment in learning experiences based on serious games: A systematic mapping study. Computers and Education, 113(October), 42–60. DOI: https://doi.org/10.1016/j.compedu.2017.05.008 https://doi.org/10.1016/j.compedu.2017.05.008

Horwitz, E. K. (1986). Preliminary evidence for the reliability and validity of a foreign language anxiety scale. Tesol Quarterly, 20(3), 559–562. https://doi.org/10.2307/3586302

Kato, P. M. (2010). Video games in health care: Closing the gap.Review of General Psychology, 14(2), 113–121. https://doi.org/10.1037/a0019441

Kato, P. M. (2012). Evaluating efficacy and validating games for health. Games for Health: Research, Development, and Clinical Applications, 1(1), 74-76. https://doi.org/10.1089/ g4h.2012.1017 PMid:26196436

Kraemer, H. C. (1992). Evaluating medical tests: Objective and quantitative guidelines. Newbury Park, CA: Sage Publications.

Levy, L. M., Solomon, R., Johnson, J., Wilson, J., Lambeth, A. J., Gandy, M., Liu, R. (2016). Grouches, extraverts, and jellyfish: Assessment validity and game mechanics in a gamified assessment. Proceedings of 1st International Joint Conference of DiGRA and FDG, Dundee, Scotland, UK.

Lumsden, J., Skinner, A., Woods, A. T., Lawrence, N. S., & Munafò, M. (2016). The effects of gamelike features and test location on cognitive test performance and participant enjoyment.

Peer J, 2016 (7)DOIdoi:10.7717/peerj.2184 https:// doi.org/10.7717/peerj.2184

Lumsden, J., Edwards, E. A., Lawrence, N. S., Coyle, D., & Munafò, M. R. (2016). Gamification of cognitive assessment and cognitive training: A systematic review of applications and efficacy. JMIR Serious Games, 4(2), e11. DOI: 10.2196/ games.5888 https://doi.org/10.2196/games.5888

Maes, K., De Haes, S., & Van Grembergen, W. (2016). A Business Case Process for IT-Enabled Investments: Its Perceived Effectiveness from a Practitioner Perspective. In S. De Haes, & W. Van Grembergen (Eds.), Strategic IT Governance and Alignment in Business Settings (pp. 1–23). Hershey, PA: IGI Global. DOI: 10.4018/978-1-5225-0861-8 https://doi.org/10.4018/978-1-5225-0861-8

Mislevy, R. J., Behrens, J. T., Dicerbo, K. E., Frezzo, D. C., & West, P. (2012). Three things game designers need to know about assessment. In D. Ifenthaler, D. Eseryel & X. Ge (Eds.), Assessment in Game-Based Learning: Foundations, Innovations, and Perspectives (pp. 59-84). New York, NY: Springer. https://doi.org/10.1007/978-1-4614-3546-4_5

Mislevy, R. J., Corrigan, S., Oranje, A., DiCerbo, K., Bauer, M.I., von Davier, A., Drasgow, F. (2016). Psychometrics and game-based assessment. In F. Drasgow (Ed.), Technology and Testing: Improving Educational and Psychological Measurement (pp. 23–48). New York, NY: Routledge.

Parsons, T. D., & Reinebold, J. L. (2012). Adaptive virtual environments for neuropsychological assessment in serious games. IEEE Transactions on Consumer Electronics, 58(2), 197-204. doi:10.1109/TCE.2012.6227413 https://doi.org/10.1109/TCE.2012.6227413

Pasquier, P., Mérat, S., Malgras, B., Petit, L., Queran, X., Bay, C., Mignon, A. (2016). A serious game for massive training and assessment of French soldiers involved in forward combat casualty care (3D-SC1): Development and deployment. JMIR Serious Games, 4(1), e5. doi:10.2196/games.5340 https://doi.org/10.2196/games.5340

Rahkila, M., & Karjalainen, M. (1999). Evaluation of learning in computer based education using log systems. ASEE/IEEE 29th Annual Frontiers in Education Conference, San Juan, Puerto Rico. 12A3/16-12A3/21. https://doi.org/10.1109/ FIE.1999.839266

Ramos-Quiroga, J., Montoya, A., Kutzelnigg, A., Deberdt, W., & Sobanski, E. (2013). Attention deficit hyperactivity disorder in the European adult population: prevalence, disease awareness, and treatment guidelines. Current Medical Research and Opinion, 29(9), 1093-1104. DOI: 10.1185/03007995.2013.812961 https://doi.org/10.1185/0 3007995.2013.812961

Rotherham, A. J., & Willingham, D. T. (2010, “21st-Century†skills: Not new but a worthy challenge. American Educator, Spring, 17-20. Rupp, A. A., Gushta, M., Mislevy, R. J., & Shaffer, D. W. (2010). Evidence-centered design of epistemic games: Measurement principles for complex learning environments. Journal of Technology, Learning, and Assessment, 8(4), 1-48.

Schwaber, K. (2004). Agile Project Management with Scrum. Redmond, Washington: Microsoft Press.

Shekelle, P. G., Morton, S. C., & Keeler, E. B. (2006). Costs and benefits of health information technology. Evidence Report/ Technology Assessment, (132), 1-71.

Shute, V. J., Leighton, J. P., Jang, E. E., & Chu, M. (2016). Advances in the science of assessment. Educational Assessment, 21(1), 34-59. doi:10.1080/10627197.2015.1127752 https://doi.org/10.1080/10627197.2015.1127752

Shute, V. J., & Ventura, M. (2013). Stealth Assessment: Measuring and Supporting Learning in Video Games. Cambridge, MA: MIT Press.

Shute, V. J., & Rahimi, S. (2017). Review of computer-based assessment for learning in elementary and secondary education. Journal of Computer Assisted Learning, 33(1), 1-19. doi:10.1111/jcal.12172 https://doi.org/10.1111/jcal.12172

Shute, V. J., Ventura, M., Bauer, M. I., & Zapata-Rivera, D. (2009). Melding the power of serious games and embedded assessment to monitor and foster learning: Flow and grow. In U. Ritterfeld, M. Cody & P. Vorderer (Eds.), Serious Games: Mechanisms and Effects (pp. 295-321). Mahwah, NJ: Routledge, Taylor and Francis.

Volkow, N. D., Wang, G., Newcorn, J. H., Kollins, S. H., Wigal, T. L., Telang, F., . . . Logan, J. (2011). Motivation deficit in ADHD is associated with dysfunction of the dopamine reward pathway. Molecular Psychiatry, 16(11), 1147-1154. https://doi.org/10.1038/mp.2010.97 PMid:20856250 PMCid: PMC3010326

Vos, L. (2015). Simulation games in business and marketing education: How educators assess student learning from simulations. The International Journal of Management Education, 13(1), 57-74. doi:http://dx.doi.org/10.1016/j.ijme.2015.01.001 https://doi.org/10.1016/j.ijme.2015.01.001

Whitten, P. S., Mair, F. S., Haycox, A., May, C. R., Williams, T. L., & Hellmich, S. (2002). Systematic review of cost effectiveness studies of telemedicine interventions. BMJ (Clinical Research Ed.), 324(7351), 1434-1437. https:// doi.org/10.1136/bmj.324.7351.1434 PMid:12065269 PMCid: PMC115857

Wiloth, S., Lemke, N., Werner, C., & Hauer, K. (2016). Validation of a computerized, game-based assessment strategy to measure training effects on motor-cognitive functions in people with dementia. JMIR Serious Games, 4(2), e12. DOI: 10.2196/games.5696 https://doi.org/10.2196/ games.5696

Wolfe, J. (1997). The effectiveness of business games in strategic management course work. Simulation & Gaming, 28(4), 360-376. https://doi.org/10.1177/1046878197284003

Yule, S., Flin, R., Paterson-Brown, S., & Maran, N. (2006). Non-technical skills for surgeons in the operating room: A review of the literature. Surgery, 139(2), 140-149. https://doi.org/10.1016/j.surg.2005.06.017 PMid:16455321