“Reputation Inflation”, Apostolos Filippas, John J. Horton, Joseph M. Golden2022-05-03 (economics, statistical comparison; backlinks)⁠:

We show that average buyer ratings of sellers have grown substantially more positive over time in 5 online marketplaces. Although this increase could by explained by (1) marketplace improvements that increased rater satisfaction, it could also be caused by (2) “reputation inflation”, with raters giving higher ratings without being more satisfied.

We present a method to decompose the growth in average ratings into components attributable to these 2 reasons.

Using this method in one marketplace where we have extensive transaction-level data, we find that much of the observed increase in ratings is attributable to reputation inflation.

We discuss the negative informational implications of reputation inflation and consider the likely causes.

[Keywords: online marketplaces, reputation systems, market design]

Backlinks: