The Rating System is going to be changing..

Tuesday, January 27, 2004 by Frogboy | Discussion: WinCustomize Talk

Okay, we've made posts and news items trying to get people to rate things in a reasonable manner but all have failed.

As someone else correctly wrote, the rating system here is a JOKE.

There are basically two problems: People who rate everything high and griefers who go around sabotaging other people's ratings.

The new system WILL work as follows. Yes, most of you will be ticked off for different reasons. Tough. The system is broken, we're going to fix it. Play time is over. It will work this way:

There will be a WEIGHT used to calculate the ratings. A rating by a citizen will counts a 1Xtheir rating. An apprentice 2X their rating, Master Apprentice 3X their rating and so on.

So when an admin or moderator rates a skin, it matters.  Now, the default rating from moderation will still only count as a weight of 1. But as people deliberately put in the effort to rate something, it will matter. 

Yes, it's unfair. It's unequal, whatever.  But the current system has become meaningless.

I have seen excellent ObjectDock icons get ratings of 4 because some griefer comes along and gives a bunch of them 1 totally counter balancing an admin rating of 7 (where the admin in question makes icons for a living).

I'm not sure when we'll get to this. It's pretty high on the priority list. This will probably result in a more skins going down in rating than skins going up in rating. A rating of 5 is an average looking skin. NOT 8. Some people seem to rate things as if anything under an 8 is bad. No, 5 is AVERAGE. Most skins should be rated at around a 5. Not 8.

First Previous Page 2 of 5 Next Last
Kevin_C
Reply #21 Tuesday, January 27, 2004 11:03 PM
Well, I'm not a skinner but I have seen some pretty ridiculous ratings given out simply to make the person who made the skin feel better. And I've seen far too many debates about whether it is out of spite or out of honesty when someone rates a skin lower than the skinner would have preferred. Hopefully this will address these issues and people will see a rating as something to work for and not something that they deserve just because they spent the time to make a skin.. And while I don't really like the idea of being told my opinion is less important than someone else's I completely understand why it has to be that way..

crosses fingers and hopes for the best!!
I.R. Brainiac
Reply #22 Tuesday, January 27, 2004 11:13 PM
Jafo,I'm not talking about a mathematical avg...merely a conceptual avg of the artistic abilities of the 'avg' skinner.For some reason,the concept of avg here(wincustomise) seems to be a 6 usually.I see a 7 here as just above avg.

Give people a test or a task to perform with the worst they can do is 1 and the best they can do is 10 and most people will get a 7(not a 5)
[Message Edited]
Jafo
Reply #23 Tuesday, January 27, 2004 11:19 PM

Give people a test or a task to perform with the worst they can do is 1 and the best they can do is 10 and most people will get a 7(not a 5)

Only if the difficulty of the test or task is slanted to record that result.

I can give you a task that 'could' result in that kind of 'average' being close to zero.

Try this.....name the survivors of the Titanic and give their home addresses....

Jafo
Reply #24 Tuesday, January 27, 2004 11:21 PM

In apportioning marks or ratings, if they start at 1 and end at 10 then the REAL average is 5.5 which in the case of this site is rounded up to 6.

It's as simple as that....

Sugaree
Reply #25 Tuesday, January 27, 2004 11:21 PM
I.R. Brainiac
Reply #26 Tuesday, January 27, 2004 11:25 PM
there were survivors?
Tiggz
Reply #27 Tuesday, January 27, 2004 11:26 PM
5.5 is the numerical mean of the numbers 1-10, but I must agree that I think in alot of people's minds 7 represents an average effort in a given endeavour. They obviously should all be rounded up in a large pen and forced to study statistical analysis.
goodmorphing
Reply #28 Tuesday, January 27, 2004 11:27 PM
Well I hope this takes some pressure away from rating. I used to download and rate and comment a lot and then everything got so intense. Mostly these days I only rate things that I have tested for people (or for people I have tested things for previously) and I know I am probably a little biased. I always feel guilty about the pieces I don't dl and test... that never seemed fair either (that a person more well-known might get more ratings in general than an unknown -- but there are only so many skins you can dl and test) I do plan to start being more diligent, though, when things are settled down more here. Still, I feel guilty when I rate one thing and not another.

It is hard to know what is right. I have found Paxx's skin evaluation guide a great help. http://pax.gslcom.com/ratings/rating.html

Actually, this may be silly but evaluating things, balancing the social pressure with the desire to be fair and feeling like I was failing miserably at that really took a lot of the fun away from WC. Then again, it only feels a little better downloading, using, enjoying stuff without commenting and rating.
Gear7
Reply #29 Tuesday, January 27, 2004 11:29 PM
As of now the casual non-registered user can only see 8 ratings or higher in the wallpaper section. This may be true in other sections, but i havent payed attention. Will this be lowered after the ratings change?
I.R. Brainiac
Reply #30 Tuesday, January 27, 2004 11:30 PM
hehe,sounds like we are all in agreement then...5.5 is a 6, which is avg here.
Tiggz
Reply #31 Tuesday, January 27, 2004 11:33 PM
ahhhhhh it all becomes clear

Tiggz wanders away muttering "5.5=6, 5.5=6, 5.5=6..."

jarget
Reply #32 Tuesday, January 27, 2004 11:36 PM
Yup. I think I've been rating wrongly now that I think of it. Not that I rate all the time. I mostly forget to rate. But I always seemed to think a 5 is low and I try to be fair. And get this if I like something I rate high, and if I don't I rate low.

FEEDBACK PLEASE: What all should we take into consideration whenn rating. Skin complexity? Skinner skill level? What?

Or am I just nuts.
joetheblow
Reply #33 Tuesday, January 27, 2004 11:40 PM
#24 by Admin Jafo - 1/27/2004 11:21:39 PM In apportioning marks or ratings, if they start at 1 and end at 10 then the REAL average is 5.5 which in the case of this site is rounded up to 6.


at first I was like:
Jafo... not you! Are you loosing it???

but I just realized that in order for the average to be 5 the ratings would have to go down to 0

Average between 0 and 10.



anyway, I guess this is the way to go. we will see if the weighted system is better than the system we have now.
Jafo
Reply #34 Tuesday, January 27, 2004 11:42 PM

I think that a '1' is something you consider impossible to live with, and a '10' is something you believe is impossible to better.

Everything [approved] falls between these two extremes.

How an individual determines where a work fits between these is down to personal preference and opinion....

Jafo
Reply #35 Tuesday, January 27, 2004 11:43 PM
Joe....I 'may' be 'losing' it but nothing is really 'loose' at all....Spell checker
Koasati
Reply #36 Tuesday, January 27, 2004 11:44 PM
jarget........ check out the link in goodmorphing comment......... a very good guide to rating. Notice you'll have to actually use a skin to use the guide. This is not directed at you, but at anyone that rates based on the screenshot.



Powered by SkinBrowser!
kona0197
Reply #37 Tuesday, January 27, 2004 11:47 PM
funny it is that TSF has almost ALL 10's

I love their work!
[Message Edited]
kongit
Reply #38 Tuesday, January 27, 2004 11:50 PM
travis shall use paxx's little system more often. it is very nice
joetheblow
Reply #39 Tuesday, January 27, 2004 11:51 PM
@ Jafo
voo
Reply #40 Tuesday, January 27, 2004 11:52 PM
SkinsFactory have the best of the best designer team though Kona.

Please login to comment and/or vote for this skin.

Welcome Guest! Please take the time to register with us.
There are many great features available to you once you register, including:

  • Richer content, access to many features that are disabled for guests like commenting on the forums and downloading skins.
  • Access to a great community, with a massive database of many, many areas of interest.
  • Access to contests & subscription offers like exclusive emails.
  • It's simple, and FREE!



web-wc01