Gaming the system: leaks in a seal — Edition 2

Jeff Atwood on the gaming of the voting system at Stack Overflow:

I was pleasantly surprised to find that the vast, vast majority of Stack Overflow users do not engage in revenge downvoting. Unfortunately, for those users that do, the pattern was quite clear. As of today, we have several queries that look for unusual downvote patterns. If we discover these patterns in a given user’s voting history, we view all their downvotes for that user as suspect. They’re all silently deleted, and any lost reputation is restored to the unfortunate target of these downvotes.

While working on this code, I also realized that we should be checking for the inverse of this behavior — unusual upvote patterns. To game the reputation system, unscrupulous users might create alternate user accounts that vote up their main account. Again, this is a bit tougher on Stack Overflow than other sites, because we don’t allow any user account to upvote at all until they’ve earned 15 reputation first. And then of course there’s the aformentioned 30 vote per day limit.

I reformulated my queries, and I found that there were many, many more suspicious upvote patterns than downvote patterns. More than five times as many! I guess I shouldn’t be surprised, since the value of a single +10 upvote is fairly high. In parallel with the downvote validation, we now use several daily heuristics to detect strange user upvoting patterns; if we decide the upvotes are questionable, they will all be removed.

Anyway, if you find that your reputation has changed overnight, it might be because we now check for, and remove, any suspicious upvote or downvote patterns.

I thought about doling out reputation penalties to the users involved, but I figured it’s better to err on the side of forgiveness. I want to be clear that the “problem” voters are a very, very small part of the Stack Overflow community. Most people use the voting system the way it was intended. Our policy on this is simple: we’ll silently remove any vote fraud we detect. Please don’t do it. In the long run, it will be easier to earn reputation by posting great answers and questions than gaming the system.

Take a look!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s


%d bloggers like this: