Online Remote Proctored Delivery of High Stakes Tests: Issues and Research

Online Remote Proctored Delivery of High Stakes Tests: Issues and Research

Authors

  • Chief Science Officer, PSI Services LLC, 611 N. Brand Blvd, 10th Floor Glendale, CA 91203
  • Vice President, Research, ACT, Iowa City, IA 52243

Keywords:

Candidate Experience, Online Remote Proctoring, Modality Effects, Test Fraud, Technology Disruption of Testing, Test Score Comparability, Test Security

Abstract

Online administration of high stakes tests has been an increasing trend since the turn of the millennium, as assessment design and delivery have been undergoing a digital transformation. In 2020, the pandemic heightened the need for safe and socially distanced practices in education, work, and life activities. As a result, online Live Remote Proctored (LRP) testing rapidly became a necessary practice to enable credentialing to continue for professionals in essential occupations, and has continued as testing organizations adopt mixed modes of delivery for assessments in all markets. And while limited published research has been promising in support of LRP, there remain unanswered questions and a need for additional research. This special issue of the Journal of Applied Testing Technology includes several articles describing empirical studies that examine key measurement issues, including comparability of LRP and Test Center Proctored (TCP) scores on high stakes exams, detection of score anomalies and potential cheating for LRP and TCP exams, potential impact of testing modality on candidate experience ratings, and relationships between technology disruptions, candidate experience and test scores. A methodological article is included outlining an approach to quantifying candidate response similarity that may be indicative of cheating or other test fraud; and a literature review article is included providing background on the evolution of online testing and research in different assessment contexts.

Downloads

Download data is not yet available.

Metrics

Metrics Loading ...

Downloads

Published

2022-03-19

How to Cite

Weiner, J. A., & Henderson, D. (2022). Online Remote Proctored Delivery of High Stakes Tests: Issues and Research. Journal of Applied Testing Technology, 23, 1–4. Retrieved from http://www.jattjournal.net/index.php/atp/article/view/167811

Issue

Section

Articles

References

Hurtz, G. M., & Weiner, J. A. (2022). Comparability and integrity of online remote vs. onsite proctored credentialing exams. Journal of Applied Testing Technology, Vol 23(Special Issue), 36-45.

Langenfeld, T. (2022). Online remote high stakes testing: A solution for the new normal. Journal of Applied Testing Technology. Vol 23(Special Issue), 5-14.

Meng, H., & Becker, K.A. (2022). Identifying statistically actionable collusion in remote proctored exams. Journal of Applied Testing Technology. Vol 23(Special Issue), 54-61.

Morin, M., Alves, C., & De Champlain, A. (2022). The show must go on: Lessons learned from using remote proctoring in a high-stakes medical licensing exam program in response to severe disruption. Journal of Applied Testing Technology, Vol 23(Special Issue), 15-35.

Muckle, T., Meng, Y., & Johnson, S. (2022). Quantitative evaluation of a live remote proctoring Pilot. Journal of Applied Testing Technology. Vol 23(Special Issue), 46-53.

Spence, D., Ward, R., Wooden, S., Browne, M., Song, H., Hawkins, R., Wojnakowski, M. (2019). Use of resources and method of proctoring during the NBCRNA continued professional certification assessment: Analysis of outcomes. Journal of Nursing Regulation, 10(3), 37-46.

Weiner, J.A., & Foster, D. (2018). Ch 2. Licensing and Certification. In Scott, Bartram, & Reynolds, Eds., Next Generation technology-enhanced Assessment. Cambridge University Press.

Weiner, J. A., & Hurtz, G. M. (2022). A comparative study of online remote proctored versus onsite proctored highstakes exams. Journal of Applied Testing Technology, Vol 23(Special Issue), 36-45.

Loading...