Data Visualizations for Polytomous Items
Keywords:
Polytomous Model; Data Visualizations; Data AnalysisAbstract
The use of polytomous items for operational exams is continuing to spread due to the growing utilization of innovative and technology-enhanced items with computer-based testing. While much is known and many common methods are available for providing feedback to test development professionals e.g., psychometricians, content matter experts, etc, there has not been a widespread discussion of useful methods for providing feedback for polytomous items. This research provides a starting point for investigating the use of data visualizations to provide effective and efficient statistical information for all levels of test development professionals. All visualisations can be developed with commonly used programming languages and dashboard methodologies.
Downloads
Metrics
Downloads
Published
How to Cite
Issue
Section
References
Ames, A. J., & Penfield, R. D. (2015). An NCME instructional module on item-fit statistics for item response theory models. Educational Measurement: Issues and Practice, 34(3), 39-48. https://doi.org/10.1111/emip.12067
Betts, J., Muntean, W., Kim, D., & Kao, S. (2022). Evaluating different scoring methods for multiple response items providing partial credit. Educational and Psychological Measurement, 82(1), 151-176. https://doi.org/10.1177/0013164421994636 PMid:34992310 PMCid:PMC8725057
Carr, D. B. (2005). Some recent graphics templates and software for showing statistical summaries. In C. R. Rao, E. J. Wegman, & J. L. Solka (Eds.), Handbook of statistics, 24 (pp. 415-436). Elsevier. https://doi.org/10.1016/S01697161(04)24015-9
Cohen, J. (1988). Statistical power analysis for behavioral sciences (2nd ed.). Academic Press.
Friendly, M. (2008). A brief history of data visualizations. In C. Chen, W. Hӓrdle, & A. Unwin (Eds.), Handbook of Data Visualization (pp. 15-56). Springer. https://doi.org/10.1007/978-3-540-33037-0_2
Friendly, M., & Wainer, H. (2021). A history of data visualization and graphic communication. Harvard University Press: Cambridge, MA. https://doi.org/10.2307/j.ctv31xf66n.14
Masters, G. N. (1982). A Rasch model for partial credit scoring. Psychometrika, 47, 149-174.
https://doi.org/10.1007/BF02296272
Samejima, F. (1997). Graded response model. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory (pp. 85-100). Springer-Verlag. https://doi.org/10.1007/978-1-4757-2691-6_5
Setzer, J. C., & Cui, Z. (2022). Communicating measurement outcomes with (better) graphics. Educational Measurement: Issues and Practice, 41(3), 5-13. https://doi.org/10.1111/emip.12519
Tufte, E. R. (2001). The visual display of quantitative information, 2nd ed. Graphic Press: Cheshire, CT.
Unwin, A., Chen, C., & Hӓrdle, W. (2008). Introduction. In C. Chen, W. Hӓrdle, & A. Unwin (Eds.), Handbook of Data Visualization (pp. 3-12). Springer. https://doi.org/10.1007/978-3-540-33037-0_1
Wainer, H. (2005). Graphic discovery: A trout in the milk and other visual adventures. Princeton University Press. https://doi.org/10.1515/9781400832897
Wainer, H. (2009). Picturing the uncertain world: How to understand, communicate, and control uncertainty through graphical display. Princeton University Press.
Wilhelm, A. (2005). Interactive statistical graphics: The paradigm of linked views. In C. R. Rao, E. J. Wegman, & J. L. Solka (Eds.), Handbook of Statistics, 24 (pp. 437-537). Elsevier. https://doi.org/10.1016/S0169-7161(04)24016-0