Will the Number of Behavioral Anchors Increase Rater Accuracy in Performance Evaluations?

dc.contributor.advisorFrame, Mark
dc.contributor.authorByerly, Kelsey Rene
dc.contributor.committeememberHein, Michael
dc.contributor.committeememberJackson, Alexander
dc.date.accessioned2021-05-29T01:03:36Z
dc.date.available2021-05-29T01:03:36Z
dc.date.issued2021
dc.date.updated2021-05-29T01:03:36Z
dc.description.abstractThis research study sought to determine whether the number of behavioral anchors/examples on a behaviorally anchored rating scaled increased rater accuracy in performance evaluations. Specifically, it examined whether a behavioral anchor rating scale (BARS) with five behavioral anchors/examples yielded more accurate performance evaluation ratings compared to BARS with three behavioral anchors/examples when used to rate the performance of different people performing different teaching assignments. The accuracy of the ratings was assessed in terms of scale alphas, absolute differences between ratings and true score estimates, and over- and under-ratings. In addition, this study explored whether rating accuracy varied among raters with different degrees of conscientiousness. All participants were recruited from Middle Tennessee State University and Amazon’s MTurk. Participants were randomly assigned to evaluate the performance of six (6) University professors using either BARS with five behavioral anchors/examples or BARS with three behavioral anchors/examples. Overall, the results demonstrated no significant differences in accuracy between BARS with five behavioral anchors/examples and BARS with three behavioral anchors/examples. Additionally, accuracy did not significantly differ among raters with varying degrees of conscientiousness.
dc.description.degreeM.A.
dc.identifier.urihttps://jewlscholar.mtsu.edu/handle/mtsu/6450
dc.language.rfc3066en
dc.publisherMiddle Tennessee State University
dc.source.urihttp://dissertations.umi.com/mtsu:11450
dc.subjectBehavioral anchored rating scales
dc.subjectPerformance evaluations
dc.subjectRater accuracy
dc.subjectPsychology
dc.thesis.degreelevelmasters
dc.titleWill the Number of Behavioral Anchors Increase Rater Accuracy in Performance Evaluations?

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
Byerly_mtsu_0170N_11450.pdf
Size:
1.43 MB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
0 B
Format:
Item-specific license agreed upon to submission
Description:

Collections