Understanding Performance Differences Based on Computer Experience in Technology Enhanced Assessments

Abstract

Assessment centers can provide valuable insight into predicted job performance. In-basket assessments are utilized to simulate a day in the job for candidates. Through increased technological abilities, organizations have shifted to using in-baskets in a computerized manner. Practice is moving more rapidly than the research to support the transition. Multiple studies have concluded there are performance differences between paper-and-pencil assessments and computerized assessments. Due to the conflicting findings, the current study examines whether prior computer experience moderates the relationship between method of assessment and performance. Participants were recruited from introductory computer classes at a local public library, a university, and a rural community. Participants completed both a computerized and paper-and-pencil in-basket; the order was randomized. The results demonstrated that there was no significant difference in performance between the in-basket on the computer or paper-and-pencil.