Building the Evidentiary Argument in Game-Based Assessment
Authors
-
Chandler, AZ 85226, Pearson
Kristen E. DiCerbo
Keywords:
Evidence-Centered Design, Game-based Assessment, Iterative DesignAbstract
While game-based assessment offers new potential for understanding the processes students use to solve problems, it also presents new challenges in uncovering which player actions provide evidence that contributes to understanding about students’ knowledge, skill, and attributes that we are interested in assessing. A development process that combines the agile methodology common in game design with the principles from Evidence-Centered Design can provide a means by which to develop game-based assessments with clear assessment arguments. This paper presents an example of such an approach using four iterations that result in an increasingly more refined evidence model linking game activities to a student model.Downloads
Metrics
Downloads
Published
How to Cite
Issue
Section
References
Baker, R. S., D’Mello, S. K., Rodrigo, M. M. T., & Graesser, A. C. (2010). Better to be frustrated than bored: The incidence, persistence, and impact of learners’ cognitive–affective states during interactions with three different computerbased learning environments. International Journal of Human-Computer Studies, 68(4), 223–241. https://doi.org/10.1016/j.ijhcs.2009.12.003
Barrett, J. E., Cullen, C., Sarama, J., Clements, D. H., Klanderman, D., Miller, A. L., & Rumsey, C. (2011). Children’s unit concepts in measurement: a teaching experiment spanning grades 2 through 5. ZDM, 43(5), 637–650. https://doi.org/10.1007/s11858-011-0368-8
Battista, M. T. (2004). Applying cognition-based assessment to elementary school students’ development of understanding of area and volume measurement. Mathematical Thinking and Learning, 6(2), 185–204. https://doi.org/10.1207/ s15327833mtl0602_6
Battista, M. T., Clements, D. H., Arnoff, J., Battista, K., & Borrow, C. V. A. (1998). Students’ spatial structuring of 2D arrays of squares. Journal for Research in Mathematics Education, 503–532. https://doi.org/10.2307/749731
Behrens, J. T., Frezzo, D. C., Mislevy, R. J., Kroopnick, M., & Wise, D. (2008). Structural, Functional, and Semiotic Symmetries in Simulation-Based Games and Assessments. In
E. Baker, J. Dickieson, W. Wulfeck, & O’Neil, H. F. (Eds.), Assessment of Problem Solving Using Simulations (pp. 59– 80). New York: Earlbaum.
Collins, A., Joseph, D., & Bielaczyc, K. (2004). Design research: Theoretical and methodological issues. The Journal of the Learning Sciences, 13(1), 15–42. https://doi.org/10.1207/ s15327809jls1301_2
Common Core Standards Writing Team (CCSWT).(2012). Progressions documents for the common core math standards,
Draft K-5, Progression on Geometry. Revtrieved from http://ime.math.arizona.edu/progressions/#products
DiCerbo, K. E. (2015). Assessment of task persistence. In Y. Rosen, S. Ferrara, & M. Mosharraf (Eds.) Handbook of Research on Computational Tools for Real-World Skill Development (pp. 780–806). Hershey, PA: IGI Global.
DiCerbo, K. E., Ferrara, S., & Lai, E. (in press). Principled design and development for embedding assessment for learning in games and simulations.
DiCerbo, K. E., Shute, V., & Kim, Y. J. (in press). The future of assessment in technology rich environments: Psychometric considerations of ongoing assessment. In J. M. Spector, B.
Lockee, & M. Childress (Eds.), Learning, design, and technology: An international compendium of theory, research, practice, and policy. New York, NY: Springer.
Gobert, J. D., Kim, Y. J., Sao Pedro, M. A., Kennedy, M., & Betts, C. G. (2015). Using educational data mining to assess students’ skills at designing and conducting experiments within a complex systems microworld. Thinking Skills and Creativity, 18, 81–90. https://doi.org/10.1016/j.tsc.2015.04.008
Lenhart, A. Kahne, J., Middaugh, E., Macgill, A., Evans, C., & Vitak, J. (2008). Teens, Video Games, and Civics. Washington D.C.: Pew Resarch. Available: http://www.pewinternet.org/~/media//Files/Reports/2008/PIP_Teens_Games_and_Civics_Report_FINAL.pdf
Mislevy, R. J. (2003). Substance and structure in assessment arguments.Law, Probability and Risk, 2(4), 237–258. https:// doi.org/10.1093/lpr/2.4.237
Mislevy, R. J., Oranje, A., Bauer, M. I., von Davier, A., Hao, J., Corrigan, S., Hoffman, E., DiCerbo, K. & John, M. (2014). Psychometric considerations in game-based assessment. [white paper] Retrieved from Institute of Play website: http://www.instituteofplay.org/work/projects/glasslab-research/
Mislevy, R. J., Steinberg, L. S., & Almond, R. G. (2003). Focus Article: On the Structure of Educational Assessments. Measurement: Interdisciplinary Research and Perspectives, 1(1), 3–62. https://doi.org/10.1207/S15366359MEA0101_02
Toulmin, S. E. (1958). The uses of argument. Cambridge: Cambridge University Press.