How to avoid ratings users give just for gaining points
-
[quote author="lyuts" date="1284646464"]danilocesar: I'm probably not getting the percentage limit. I treated them as a day limit and "a user can get not more than 10% * N, where N is his number of points"[/quote]
Ok, let suppose you never rated a page before. In that case, lets call your points as "real contribution points", or CP.
CP = 345.
So, lets say you stop doing that kind of points and start just to rate pages. You can reach, at maximum 34 more points. Doesn't matter how many pages you've rated, or days you spent doing it. In the final score, you can't make more points until you make more CPs. -
[quote author="danilocesar" date="1284647184"][quote author="lyuts" date="1284646464"]danilocesar: I'm probably not getting the percentage limit. I treated them as a day limit and "a user can get not more than 10% * N, where N is his number of points"[/quote]
Ok, let suppose you never rated a page before. In that case, lets call your points as "real contribution points", or CP.
CP = 345.
So, lets say you stop doing that kind of points and start just to rate pages. You can reach, at maximum 34 more points. Doesn't matter how many pages you've rated, or days you spent doing it. In the final score, you can't make more points until you make more CPs.[/quote]Oh, I finally got what you meant. The percent-limit is permanent until you get more points by posting.
-
Once you start giving points, tokens and titles as a way to reward users for their contributions, you turn it into a kind of game. Users, even subconsciously, start competing with each other and with themselves. This is something good and healthy for the community as a whole.
The problem is that if there's a trivial way of gaining points, some users will exploit it and the overall value of the ranking system will decrease.
In this case it's particularly bad: users get points for ranking articles. As a consequence, not so well intentioned users (and they always exist) will promote articles not because of their quality, but just to get points.
It may sound as a minor bug or misfeature, but the fact that this thread is already two pages long shows that users do pay attention to this kind of ranking system and you should try calibrating it as much as you can to make sure the real contributors get the points. There are a couple of solutions proposed in this thread which appear to be easy to implement.
Just my 2 cents.
-
[quote author="MariusG" date="1284643823"]I can confirm the "100 points a day from rating"-limitation, to prevent simple hacks.
And we have a feature request for "max % amount of points from rating".
[/quote]Why not also introduce a "Max % amount of points from tagging"
-
[quote author="MariusG" date="1284644671"]I am, but I was busy launching the "new labs":http://labs.qt.nokia.com/ :) (hope you like it!)
[/quote]It looks great. Why even my old labs.trolltech.com links are now automatically redirected ! :)
-
[quote author="Alexandra Leisse" date="1284647086"]Maybe it's a good idea to explain the thinking behind those points and actions. :)
The system we have in place right now only rewards activity. It does not look at quality, only quantity. We want to see who spends time on the site and provide instant gratification. It has its flaws like most systems. With the number of users we're aiming at possible misuse of features like rating will even out over time.[/quote]
I doubt it, especially with actions like project Elf. I think ratings, but also points, are less useful because of this. In a "post":http://developer.qt.nokia.com/forums/viewthread/2944/#18552 that should have been a reaction to this thread, I pointed out a "forum posting":http://developer.qt.nokia.com/forums/viewthread/2926/ that had no real value (yet, for lack of information), but still was rated up four times already. How is that helpful for anyone?I think rating content should either not yield points, or it should be possible to rate "average" and "poor" too. The current way, added to the "abuse" Tobias described, just makes the signal/noice ratio too low to yield a useful topic rating IMHO.
-
A more sophisticated rating system seems to be thought about at the moment:
- "Closing threads":http://developer.qt.nokia.com/forums/viewthread/2673/
- Alexandra's answer in "Please stop write +1 comments":http://developer.qt.nokia.com/forums/viewreply/15428/
-
I'd just remove this scoring system entirely, because it simply encourages spam (of tags/ratings/whatever). Instead, I'd go on community-based ranking: I rank other users because of their work (replies, articles on the wiki, etc.), eventually with something like "you have X points each day to rank other people" where X depends on your current score.
-
[quote author="peppe" date="1294062682"]I'd just remove this scoring system entirely, because it simply encourages spam (of tags/ratings/whatever). Instead, I'd go on community-based ranking: I rank other users because of their work (replies, articles on the wiki, etc.), eventually with something like "you have X points each day to rank other people" where X depends on your current score.[/quote]
Something like that is expected to come up in future.
-
I hope that I not duplicated stuff in this discussion, but I've just not enough time.
Please have a look on
"[=b Rate this up] - Cannot rate your own content":http://developer.qt.nokia.com/forums/viewthread/3057/