Hey everybody... I hadn't really been aware of this when it was going on, but BBWTT mentioned that you all were discussing the review showcasing methods. I had written this over in
this thread, but if the decisionmakers are over here, I wanted to share it with you and hear your thoughts too.
-----------
I'm curious... I know I've briefly mentioned this a couple of times, but other than Selective Sensualist and P'Gell worrying that reviewers will start awarding products more 5 and 1 star ratings, I don't think anyone else has. Does this make sense to others, or am I barking up a tree with nothing in it?
The current algorithm is using simple means---I think we all agree that this is less useful than using weighted means would be.
The current algorithm also gives precedence to 5-star or 1-star reviews, and I don't think that's very helpful for customers. Personally, before I ever became a reviewer, I noticed that 2, 3, and 4 star reviews were more likely to have meaty information than 1 and 5 star reviews. Of course, on Eden, the baseline review is much better than the baseline on someplace like Amazon, but I still find myself preferring to read 2, 3, and 4 star reviews much of the time.
And then, even more than my own personal preference for middlin' reviews, showcasing the 5 and 1 star reviews preferentially means that we're hiding some of the most useful reviews.
Take the hibiscus swirl vibe (because that one has a *lot* of reviews, and they're well-spread in the histogram.)
The negative review currently showcased is this review:
1 star review (there is only one 1 star review):
-1 EU, 1 U, 4 SU votes.
Other negative reviews possible:
2 star reviews (there are 7, I'm just showing the top 3):
- 1 EU vote
- 6 EU, 1 SU votes
- 4 EU, 2 U votes
3 star reviews (there are 6, I'm just showing the top 3):
- 16 EU votes
- 7 EU votes
- 7 EU, 2 U votes
So if I was a customer wanting to see a negative perspective on the Hibiscus Swirl vibe, would I want the 1 star review to be showcased, or would I want the 3 star review with 16 EU votes? Bear in mind of course that anybody who wants to take more than a cursory glance can still go and see the 1 star, 2 star, or 3 star reviews with a little diligent clicking. But if our intent is to give the casual browser the most useful positive and negative reviews without having to do extra clicking?
What do you guys think?