Changes to Route Consensus Ratings

Each route in MP has an "official" rating (5.9 for example), as well as a "consensus" rating, which has been defined as the AVERAGE of all the ratings that people have given it. So if 3 people rated a climb 5,9, 5.9, 5.10b, we would average that to be 5.10a and call that the consensus.

After some discussion among Admins who know more statistics than I, the consensus is now being defined as the MEDIAN rating instead of the average. As I'm sure you remember from your statistics class, if you arrange all values in order, the median value is the one in the middle of the list. In this example, the median value is 5.9, and we will display 5.9 as the consensus instead of 5.10a.

The consensus rating for all routes has been recalculated and route pages should be showing this new data. About 10% of all routes have a changed consensus because of this change.

Another interesting measure to use here is the trimmed mean.

Or heck, give us box plots of the suggested ratings. Even better! ;-)

Is a similar method used for star ratings? This would be helpful for when someone comes along and bombs a route that others give 3/4 stars.

How about a bot that tracks the ratings of individual users. If their ratings are consistently above the median, 3 gunks climbers are dispatched to their door to endlessly lecture about kids these days.

If their ratings are consistently below the median, a not so well sealed bag of my own personal excrement will be mailed to the user.

I'm happy to donate my part.

nicelegs wrote:How about a bot that tracks the ratings of individual users. If their ratings are consistently above the median, 3 gunks climbers are dispatched to their door to endlessly lecture about kids these days. If their ratings are consistently below the median, a not so well sealed bag of my own personal excrement will be mailed to the user. I'm happy to donate my part.

histogram!