Reviews research that is concerned with evaluating the psychometric qualities of data in the form of ratings (rating errors) and that has been plagued with conceptual and operational confusion and inconsistency.

Following a brief historical survey, inconsistencies in definitions, quantifications, and methodologies are documented in a review of more than 20 relevant articles published in Journal of Applied Psychology, Organizational Behavior and Human Performance, and Personnel Psychology (1975^–₂1977_47ya).

Empirical implications of these inconsistencies are discussed, and a revised typology of rating criteria, combined with a multivariate analytic approach, is suggested.

See Also:

Halo effect: A constant error in psychological ratings
Revisiting Meta-Analytic Estimates of Validity in Personnel Selection: Addressing Systematic Overcorrection for Restriction of Range
Job Performance: Assessment Issues in Personnel Selection
Fact and Fiction in Cognitive Ability Testing for Admissions and Hiring Decisions
The Problem of Bias in Psychological Assessment
Critical Analysis of the Statistical and Ethical Implications of Various Definitions of ‘Test Bias’
Grit and Conscientiousness: Another jangle fallacy
Reliability: A Review of Psychometric Basics and Recent Marketing Practices