A Quantitative Evaluation of a Live Remote Proctoring Pilot

Abstract

The COVID-19 pandemic has witnessed a renewed interest in Live Remote Proctoring (LRP), not only as a test availability measure but as a necessity to maintain business continuity. Many certification organizations have correspondingly provided LRP as an option for candidates. This study describes a retrospective, observational pilot study evaluating modality effects for three high-stakes certification examination programs administered concurrently in test center and LRP conditions. Also reported are summaries of a post-examination survey assessing drivers for selection of testing condition and candidate satisfaction, particularly with aspects of the LRP experience. Significant differences were observed in both distributions of test scores and test duration (both higher for test center candidates). Although explanatory variables are not completely understood, the authors offer insights as to factors influencing these outcomes. While satisfaction levels with LRP were reasonably positive, significant technical issues were reported by LRP candidates. The primary drivers for the selection of LRP were safety concerns related to the pandemic, simple convenience, and lack of test center availability.