Spyke
lemmy.world

I blame management metrics that punish anyone for getting less than 5-star reviews

253
foggyreply
lemmy.world

In the US.

God, I literally was told by my manager at my first job to tell customers, when they got a random survey, that anything less than a 10 is a 0.

Japan does 5 star ratings proper.

121
[deleted]reply
lemmy.world

"If you go a minute without making a mistake then you can go a lifetime without making a mistake."

45
lemmy.world

I don't know why, but that gave me a similar visceral reaction to hearing "if you have time to lean, you have time to clean"

39

A three-star restaurant on Tabelog is life-changing cuisine. I’m not sure what you’d have to do to earn four, but it’s probably illegal.

7

Had to deal with similar surveys. Rating was 1-10, 8-9 was "just OK", 10 was "your ratings better be here", and anything 7 or lower was a serious issue.

7

That's how our state scores conditions for learning surveys that factor into our school district "report cards." I just flat out tell kids that I proctor for "if you ACTUALLY agree with the statement, choose strongly agree." All other answers are scored as negative.

6

Germany (does it correctly) too. Although depending on us influence it depends.

3
realitistareply
lemmus.org

Yeah this is why I almost always give 5* reviews to any sort of thing that's traced back to a worker unless I really feel like they need to be reprimanded for something, and how badly they should be reprimanded is how many stars I take off. This is only for the 1% who really need a talking to.

When it comes to product reviews on Amazon for example, or business reviews, I feel a lot more free to give my real opinion to help the next person.

29
lemmy.world

Every time I have to do an after call/chat survey I try to add a comment along the lines of "Your representative was very helpful, but I had to deal with too much waiting and too many chatbots to reach them. Please hire more staff."

18
lemmy.world

Everyone I've ever dealt with who thought the employee needed reprimanded was either

  • A huge asshole

  • completely wrong

  • didn't like a policy that the employee had no say in

  • was dealing with a reversible error that required training not reprimand

1
realitistareply
lemmus.org

The times I've done it were for:

  • One guy who had his phone in his steering wheel and was playing some sort of online gambling the whole drive and didn't look directly at the road once
  • One guy who was driving around on a spare tire (doughnut) on the highway at speeds way above those it said on the tire.

I mean I can look the other way on just about anything (I've given 5* to a lot of questionable driving decisions and shitty cars) but when you are putting my life at risk, that's where I draw the line.

1

Yep perfectly justified but you can't actually couch gambling guy you really just need to fire him because he'll continue to be a moron.

1

Nevertheless I gave 5 stars to the management because they might find out.

2
fedia.io

Don't care how many stars it is; if it's like 4.5 stars out of 1000+ reviews, I'll take it over something that's 5 stars with 100 reviews.

53

What it is now:

  • 5 stars = it was fine
  • 5 stars plus glowing review = it was great
  • 4 stars = it could have been better
  • 1 star = terrible
  • 1 star plus review = so terrible that I had to write something OR I'm a gigantic gaping asshole that likes to complain
49
socsareply
piefed.social

"One star, the restaurant was fully booked and the hostess calmly explained that there was no room to seat me and my seventeen crying infants."

23

"Three stars, the kitchen was actively on fire, a opossum was living in the cash register, and the server only spoke Norwegian, great Italian food though will be back next week."

11
Boshtreply
lemmy.world

What I love is when it's a one star with review and it's some asinine shit they failed at or something like a missing piece from a 1000 piece puzzle.

7
semreply
lemmy.blahaj.zone

That would be terrible to miss that one piece after doing all that work.

But how could you ever prove it wasn't you who lost it?

3

Exactly! There just outstanding and crap. 1 or 5. Fuck those pinko neutralist., "non-binary" numbers inbetween. In your face, libtards!

3
feddit.nu

what about using thumbs up/down and computing a five-star rating from the average?

35
shneancyreply
lemmy.world

this system can skew the average towards negative

say someone found a hair in their soup but otherwise the experience was amazing - even if they're peak karen they'd still probably give something like 3 stars, but if faced with a binary choice they'd probably pick the negative option

unless you mean up/down vote per each quality like atmosphere, food, hygine, service etc then that'd preserve the nuance imo

14

alternatively it skews the average towards positive: shit i found a hair in my soup! that indicates bad hygiene it the service was so good and i don’t want the wait staff to suffer! i’d probably go 3 stars but this is a thumbs down

it all comes out in the wash: 1 hair in 1 soup, doesn’t matter… many hairs in many soups, place deserves a 0 not a 3

1
lemmy.zip

Now i don't know if i should upvote fpor thinking outside the box or downvote for the faults in it. Maybe if we had 3 options? But then, what if the idea only has one fault and more positives? Maybe 5 options...?

4
lime!reply
feddit.nu

compromise: you need to write a 1000 word review at at least a 12th grade level and we use automated sentiment analysis to set the score.

still only as thumbs up or down though.

8

You just described the entirety of my career on ePinions back in the day. I made bank off of that stupid website even though commenters with short attention spans constantly complained I was too verbose. Many dumb early 2000s computer parts were paid for via that avenue.

I made the top 100 at one point. I still have the hat they sent me someplace.

1
slstreply
lemmy.blahaj.zone

On steam it makes it so that universally good but not exceptional games get overwhelmingly positive reviews, but like a 3.5 star average on backloggd

4
Pennomireply
lemmy.world

I like a three point rating. Disappointing, As Expected, Awesome.

0

add a second rating, 1 for service, 1 for management. that way server 5* management 1*

3
lemmy.world

Every single person that I get requested to rate gets five stars plus a positive comment because fuck you gig economy.

32

This is the issue. I am more concerned about the real impact a rating has on a real person's life than whether some future rider will be slightly bothered by a dirty floor mat.

18

Right if it's for corp always 5/5 but if it's on like bookworm or my blog, I feel like I can be honest, because no one is getting dinged based on my stars.

12
skisnowreply
lemmy.ca

I don’t think this is actually having the effect you think it does. The people running these things still need the same number of workers in total, so all you’re really doing is contributing to the effect that OP is describing, where the gig workers getting marked down becomes arbitrary and random rather than related to whether they do their job.

The way to protest gig work is not to do business with companies that use it.

3

In theory, sure. However in the real world there is no escaping neither the ratings or the gig economy. Every single delivery company here does it. When it is possible to choose the delivery I pick the postal service. They too asking for ratings, but at least they have regular employees though some delivery points that are stores and kiosks have a suspiciously high rotation of staff. Not every vendor uses the postal service and sometimes the only option is to order from them or be without.

I don't have any grandiose ideas of it having any effect, but I will not participate in rating the performance of my fellow humans that are service workers. They do the job to do the job and the job is not to suck up to me. And everybody has the right to have a bad day or whatever without some manager making it even worse.

Realistically it is better to support political parties that legislate wages and working conditions and such so that people working any jobs have a decent wage and are protected from abuse.

1
lemmy.world

For hr or Uber or similar the scale is this:

5 stars = meh, expected experience

4 stars or lower = your employee literally tried to kill me

32

I usually save 4 stars for attempted kidnappings, its important to distinguish these things.

6

I mean, this is a good idea, I’ll give it four stars.

⭐️⭐️⭐️⭐️

29
lemmy.world

For real, the fact that the former is how people have started using the five start system is crazy. Uber driver has less than a 4.8 rating? Cancel that ride, he must be a monster.

26

ratings are not objective, no matter how hard we try we are not creatures of objectivity. when it comes to rating other people most of us want to be nice

9

The Internet is to blame for a lot of it. We have all these amalgumated ratings visible, and people want their review to impact that total score. The most impact they can have is putting a review at either extreme.

5

ratings systems are dehumanizing for employees while re-enforcing entitled consumerism for the public.

I wanna rate the managers.

21
Owl
mander.xyz

This doesn’t work unless everybody agrees to use it

19
blarghlyreply
lemmy.world

Correct.

With most things, like Ubers for example, there really is not a substantial dofference between an average job and an exceptional job. Like, sometimes someone really stands out as exceptional - but almost always, the one and only standard is "completed job without incident". By giving your Uber driver 4/5 stars because they didn't offer you bottled water or whatever, all you are doing is punishing some random person who did a perfectly fine job, possibly significantly impacting their ability to make money and pay their rent.

What should really happen is that these companies switch to a one star system. 1 star = completed job without major incidents. 0 stars = major incident.

4
lemmy.world

We do net promoter scores, out of 10. 9 and 10 are positive, 6-8 are neutral, 1-5 are negative. We get scores like "Good job, no complaints, 5 points" or "Best service ever, but my internet went down, so I knocked it down to 8 points."

19
Proxreply
lemmy.world

This is literally just a 3-option ranking with extra steps.

18

fully agreed but trying to treat it any other way punishes the people at the bottom and does nothing to the people who set up and use the system

4

Sure.

However, assuming two exceptional employees rated consistently 7-10, there's a measurable difference between an 8.2 and an 8.6.

The alternative is 3 vs. 3.

People also like to have options. Having a sad face, a neutral face and a smiley doesn't really cut it for pretty much anything.

Having the option of 1 being "utter shit" and 4 being "bad but workable" seems like it has benefits.

1

I worked for AWS for a few years and one of our performance targets was customer correspondence rating, we had a target of 4.67. That means anything below a 5 brought you under the target. You also got to have a meeting with a team lead and quality lead for anything rated 3 and below.

19
lemmy.world

Except it isn't even an objective scale other folks are rating something a 5 for not being complete POS and being 5 dollars treating it as an objective scale and using a different one from planet Earth is less than useful.

2

Yeah which is why I pretty much ignore stars unless someone has a rubric in their profile, or an actual review attached.

Solely numeric reviews are basically no better than up and down votes. Good for automation or algorithms, but largely useless to humans.

1
lemmy.world

4 does not meet corporate expectations and some minimum wage person who dealt with you is going to get shouted at.

3
lemmy.world

Actually to be clear normally it's the average weight of reviews that is relevant nobody has time to actually speak to every review and most people don't actually shout at people

1

If your target is 4.7, every asshole who gives you 4 stars because "there's always room for improvement" or "5 means excellent and I wasn't that excited about it" has to be balanced by at least three more who give it 5 because they recognise that the wage slave has no power to make it better than they did and it's unreasonable to expect the wage slave to inject joy into their day.

most people don’t actually shout at people

Depends on the company. Some companies give people a ten cents raise, an hour's training and lots of stress and targets for being a supervisor. I don't know whether shouting at the other wage slaves is the intended behaviour, but it's frequently the outcome.

It's great that you don't have experience working for places where the fear is used for control, but that doesn't mean it doesn't happen a lot.

You may say "if you don't like it, feel free to get a different job", but that's exactly what management say, and there are plenty of people on whom that fear works.

2
lemmy.world

The out of 10 is the worst. People rate okay at a 7 and good at 8

13
[deleted]reply
lemmy.world

That is consistent with US grading scales where 70% is a C and 80% is a B.

It is stupid, but it tracks.

16

Wasted numbers that inflate the rating, no one uses 0 1 2 3 or even 4. bad is at 6 and horrible is 5

2
wewbullreply
feddit.uk

...and very good at a 9 and exceptional at a 10.

Sounds like a good scale to me. You need headroom for a really good experience.

2

It also allows a lot of room for bad experiences, which is important.

"They tried their best but failed" could be a 5. "This is a scam and I am lucky I wasn't caught" could be a 1. "It was bad, plus they had a bad attitude" could be a 3.

1

The lower scheme is how I rate media, for service it's unfortunately the upper one because I don't want to fuck anybody over who's just doing their job.

13

It always seems like, for most people, the middle three stars might as well not exist. Was it acceptable? Five stars. Do I want to complain? One star. There is no in-between.

13

No I had emotional bad time and so that means 1 star always 😡

12
lemmy.ml

I think old and current newgrounds rating give a pretty clear representation of what each star mean.

It's old tho.

12
lemmy.world

I have a very similar system only from a subjective personal angle:

  1. I hated it
  2. I didn't like it
  3. It was fine
  4. I really liked it
  5. I loved it

So most get 3, some get 2 or 4, only the few special ones get 1 or 5.

11
lemmy.blahaj.zone

If you're rating people, then it's better that you just don't rate if they did a good job. Because corporations only see 4 and 5 as good, everything else is bad. So you rating someone's good performance as 3 just hurts them for doing a good job.

5
ladytatersreply
lemmy.world

Some corporations don't even see 4 as acceptable, let alone good. If I get a 4 star rating instead of a 5 at work, it's essentially the same as the person not giving me a rating. 1-3 are bad, 4 is neutral, only 5 is good.

9
lemmy.world

Oh I should have specified, this is just my own system. I agree, it wouldn't be fair to apply it to public 5-star systems no matter how strongly I feel like this is the proper way to rate things.

4

A few times in my life I encountered a system where 1 is labled "Satisfactory" or something similar and 5 is "Perfect" or similar.

In those cases I either refuse to rate or rate a 1 no matter how it went.

I think the system should always be so that 1 is absolute dog shit, 3 is no complaints, 5 is exceptional

I hate that 5 is anywhere from "just okay" to "amazingly exceptional" and you just can't know which it is

10

This is working as intended, though. In most cases, nobody cares how stoked you are about the product, people mostly care which flaws the product has. With a target average of, say, 4.5, the 5-star system gives you options to give +0.5 stars all the way down to -3.5, giving negative reviews significantly more weight.

relevant xkcd

10

Absolutely right! To somehow make sense of the current system, I tried to do statistics of reviews and see how a product or a business fairs in comparison to equivalent products or nearby businesses. The problem is that now there are so many fake reviews in addition to unhelpful human review.

10

Often not able to be chosen. My company has us review the company on a 1 question survey. CEO told us anything below 7 is bad, anything above 8 is good, and 7-8 is just ignored as "fine" when they review it.

7

Remember boys and girls, a 4 out of 5 star review on any platform that doesn't allow a zero star, is only a 75% grade. Not an 80% like these hucksters imply. Thats a solid C, not a B. Let's not give in to this corporate delusion anymore

3-5 = 50% =/= 60%

2-5 =25% =/= 40%

It's a false show of satisfaction in the very least. A rotting manifestation of the soulless corporation not allowing any amount of transparency stop them from pulling the curtain closed tighter, on the, "oh fuck," side.

I think they are actually aware the curtains are silk and quite see through. I think we can all agree we've crossed the event horizon. Everything is going to get pulled in soon.

9

Hm. Probably a decent idea. I’m sure people view ratings very differently amongst themselves.

I almost never give 3 stars. If it’s 3, it should probably be a 2 or 1.

5-excellent, no problems.

4-some very minor concerns, but otherwise the product does what it’s supposed to.

3-?

2-Issues interfering with the expected/full use of the product. Failure of product right out of warranty. Likely seeking tech help or a refund.

1-DOA/not as described/died soon/immediate RMA

8

No problems isn't excellent.

No problems is what I expect. It should be ordinary. Excellence means they went over and above.

3

It’s not the rating that’s flawed. It’s that reviews are bought now. There’s minimal real reviews.

8

This is how it works in Japan. An average of 4 stars on Google Map (for food places, at least) is considered pretty good. There's also another Japanese site dedicated for restaurants (Tabelog), where restaurants with more than 3.5 stars only make up 3%. Only 0.07% restaurants have more than 4 stars.

7

Give 5 stars to this comment or I report You for any other score as harassment!

Also I add extra gifts for any 5 star ratings!

Corrupted, it is all corrupted.

7
pawb.social

When it comes to rating products, it seems like there's an expectation to give 5 stars. I guess because there's a sense of not only rating the product, but also the seller - and you'd feel guilty not giving full marks if the product arrived ok and did what it was advertised to do.

In terms of movies/books/games, 4 stars is my default for a piece of media I really enjoyed. 5 stars I'd only give to stuff I believe is near perfect. If I see a book that averages 3.8 to 4 stars online I know it's gonna be great. Anything beyond that is either incredible, or just hasn't had enough reviews yet!

6

People use it like the one on the top? Never knew about it and never realized. These kind of ratings kinda have personal definitions in each ones head, so not like people even talk about it. I'm pretty sure I rarely gave anything 5 stars in my life.

6

Honestly I wish rating systems just gave me a vertical line to place somewhere on a bell curve. Make it obvious I'm comparing against the average.

But as it is, because drivers etc. get punished for anything less than a 5, it's 5 stars

6

Small secret.

When companies compare performances they see only three categories. 0-1 star reviews are bad. 2-3 are okay. 4-5 are great.

This is because in the end the well written review you gave to the product after testing it for 100 hours and gave the product 4 stars because of the minor flaws is pretty much the same as some randomass teens hype review 5 stars.

In the end you both liked it and there is no urgent need to fix anything.

As a consumer you should just trust to the wisdom of the crowd to tell truth.

5
lemmy.ml

Ratings are engagement traps, nothing more nowadays.

5

Capitalism tries to get as much out of their employees as possible. Meaning employees fear of losing your job of you don't get the highest rating. And if you are in the USA that means losing benefits and quickly running out of money. Give employees the highest rating, unless it actually bad, because they are forced to live in capitalism.

5

Four stars always just means some people gave one star for shipping issues unrelated to the product.

5

The problem is that most people rate the first way. If a place has a rating of a 4.5 and I thought they were pretty good, but not perfect, so they deserve 4 stars, I am not going to rate them. Having 4 stars is usually considered not that good, so lowering their score is not what I want to accomplish as 4.5 is pretty fitting in the context most people have. That leads me to giving 5 stars relativley often and not rating ok or just good places at all.

4

5 point scales are dumb because there's too much ambiguity with 2s and 4s. Since everyone has an inconsistent definition of what those mean, they don't really mean anything. Knowing that intuitively, people spam 5s and 1s because those are unambiguous.

3 or even 2 point scales are better. Dislike, Neutral, Like / would not recommend, would maybe recommend, would always recommend or just removing the middle option to push people off the fence.

4

Yeah, that makes sense actually. Looking at it again, that's not really the problem. "Bad" is the direct opposite of "Good", they should be at symmetrical spots of the spectrum. Both versions have it wrong. If Bad is the worst rating, Good should be the best. I still say get rid of "some issues," it just sounds too benign to me for the second-worst possible rating, change it to "bad" and make 1/5 stars Terrible or something equally inversely comparable with "Exceptional".

3

Be careful with it, though, because if someone on minimum wage is somehow linked with your less than perfect rating, corporate are going to be on their case to improve their numbers.

0

If I get asked to rate something it's probably going to be a 4 or a 3 unless it's bad, 5 means as good as it can be and unless a 6 gets added then it's unrealistic to give a 5

4
lemmy.world

This is actually dumber. Rating is about how well the person felt about spending the money whereas everyone really wants to know how good of a whatever it is

So you really want to know it's an 85 out of a hundred on an absolute scale but all you know is how people felt about spending a certain amount of money which may not even be the amount of money the merchant is changing.

So 4 might mean people felt pretty good about spending $10 but you are being asked by Joe Bob merchant to pay 20

1

I mean if I'm being asked to rate something then it's likely they're asking for a rating of the actual service and by asking they've degraded the quality of the service.

1
lemmy.world

Not everywhere! This fucks over anybody who depends on ratings for job evals.

3

A long time ago I adopted the Jinx's Rating For All Things system and it's served me very well. It is very similar to OPs suggestion.

  • ⭐️⭐️⭐️⭐️⭐️: This thing is core to who I am. I don't want to live in a world without it. The experience was life changing.
  • ⭐️⭐️⭐️⭐️: I really like this thing! This will be in my rotation for along time. I had an amazing time!
  • ⭐️⭐️⭐️: I like it. Perfect in the background. If it's on, I probably will watch/listen, but I probably won't seek it out. Inoffensive. This meets but doesn't exceed my expectations.
  • ⭐️⭐️: Not my thing, but I see why people like it. It has value, just not to me. I was slightly annoyed.
  • ⭐️: Why would anyone like this thing?!?!?!?

I personally think the 5-star rating system is perfect. Any more than that and a lot of the mid-tier ratings become arbitrary and everything is subject to immediacy bias. Tastes change over time and how much you like stuff changes, but I've found that they rarely change buckets in this system.

I don't understand why someone cares if they like one thing "just a little bit more" than another. It doesn't have to be a competition. Do you like it or do you love it? Is it core to understanding you as a person? Did you have an amazing time?

3

I also struggle with people liberally handing out "11/10" for "great" and go up to 12 for "awesome".

My scale for "great" is 8, "awesome" is 9 and 10 is reserved for really special things (greay by itself + some additional bonus).

I always feel weird, like I'm overly critical, when someone else says "Oh this is great, I love this, 11/10" and I feel the same but only hand out 8.7/10.

3

YMMV. Every person has their own internal mental scheme and will keep using it, no matter what. That's why I usually (a) trust large numbers (b) read very carefully detailed reviews if they are available.

3

⭐ ⭐ ⭐ ⭐ ⭐ Timely delivery of my 1972 Volkswagon clutch plates, will order again

Sir, this is a USB cable...

3
lemmy.blahaj.zone

I just don't provide ratings. You shouldn't either. Reviewing is a job. Some people are professional reviewers. Don't do free labor for corporations. Do not rate products or services.

2
noridereply
lemmy.zip

Involving money in reviews undermines the whole foundation of honest unbiased feedback.

11

asking for reviews does that too. The company can choose who they ask. Reviewers being paid for their work is fine.

-1

my rating system is relative… 5 stars? only if i think its worth it… a star less that its score means i dont think it deserved that score (even for 3s etc); a star more, i think it deserved more… generally wont go less than 2 stars less unless they really deserved it

1

So for the instead rating, what would a dildo server under when only 2 stars? Like what would people try to even put down at that point?

-1

Dildo shared your usage data. 1 stars would be it electrocuted or poisoned you.

2
lemmy.world

I'm not giving 5 stars unless I get a free blowjob with my order.

-4

Ahh...but the blowjob is just rolled into the cost of the rest of the order. No such thing as a free blowjob.

1