Online Remote Proctored Delivery of High Stakes Tests: Issues and Research
Keywords:
Candidate Experience, Online Remote Proctoring, Modality Effects, Test Fraud, Technology Disruption of Testing, Test Score Comparability, Test SecurityAbstract
Online administration of high stakes tests has been an increasing trend since the turn of the millennium, as assessment design and delivery have been undergoing a digital transformation. In 2020, the pandemic heightened the need for safe and socially distanced practices in education, work, and life activities. As a result, online Live Remote Proctored (LRP) testing rapidly became a necessary practice to enable credentialing to continue for professionals in essential occupations, and has continued as testing organizations adopt mixed modes of delivery for assessments in all markets. And while limited published research has been promising in support of LRP, there remain unanswered questions and a need for additional research. This special issue of the Journal of Applied Testing Technology includes several articles describing empirical studies that examine key measurement issues, including comparability of LRP and Test Center Proctored (TCP) scores on high stakes exams, detection of score anomalies and potential cheating for LRP and TCP exams, potential impact of testing modality on candidate experience ratings, and relationships between technology disruptions, candidate experience and test scores. A methodological article is included outlining an approach to quantifying candidate response similarity that may be indicative of cheating or other test fraud; and a literature review article is included providing background on the evolution of online testing and research in different assessment contexts.
Downloads
Metrics
Downloads
Published
How to Cite
Issue
Section
References
Hurtz, G. M., & Weiner, J. A. (2022). Comparability and integrity of online remote vs. onsite proctored credentialing exams. Journal of Applied Testing Technology, Vol 23(Special Issue), 36-45.
Langenfeld, T. (2022). Online remote high stakes testing: A solution for the new normal. Journal of Applied Testing Technology. Vol 23(Special Issue), 5-14.
Meng, H., & Becker, K.A. (2022). Identifying statistically actionable collusion in remote proctored exams. Journal of Applied Testing Technology. Vol 23(Special Issue), 54-61.
Morin, M., Alves, C., & De Champlain, A. (2022). The show must go on: Lessons learned from using remote proctoring in a high-stakes medical licensing exam program in response to severe disruption. Journal of Applied Testing Technology, Vol 23(Special Issue), 15-35.
Muckle, T., Meng, Y., & Johnson, S. (2022). Quantitative evaluation of a live remote proctoring Pilot. Journal of Applied Testing Technology. Vol 23(Special Issue), 46-53.
Spence, D., Ward, R., Wooden, S., Browne, M., Song, H., Hawkins, R., Wojnakowski, M. (2019). Use of resources and method of proctoring during the NBCRNA continued professional certification assessment: Analysis of outcomes. Journal of Nursing Regulation, 10(3), 37-46.
Weiner, J.A., & Foster, D. (2018). Ch 2. Licensing and Certification. In Scott, Bartram, & Reynolds, Eds., Next Generation technology-enhanced Assessment. Cambridge University Press.
Weiner, J. A., & Hurtz, G. M. (2022). A comparative study of online remote proctored versus onsite proctored highstakes exams. Journal of Applied Testing Technology, Vol 23(Special Issue), 36-45.