Script Reviews - An Open Discussion
ByOwain Owjoat 9th of January 2018 20:33:52
It can meet your expectations and still not be amazing. If anything, 5 stars should be for those times it beats your expectations.
Fully agree with this and I have only ever given 5 stars to a couple of addons, the rest got 4 stars or less not all of them had a review description.
If we have to put a detailed review then put a minimum character check in before a review can be submitted, but then the down side to this is that people won't bother to give reviews or just spam random crap.
ByThe Commanderat 9th of January 2018 20:46:42
If we have to put a detailed review then put a minimum character check in before a review can be submitted, but then the down side to this is that people won't bother to give reviews or just spam random crap.
The whole char limit thing is kinda eh, it's like when you have an essay that requires a minimum word count. The reality is, us humans are actually really quite good at making our sentences, paragraphs and more very wordy to meet the mentioned prerequisite without actually adding any new meaning or value to the same statement, that was just as easily achievable in a much shorter sentence. Like the example you just read which could be as short as; People can just make their sentences more wordy to meet the word count.
One nice trick that trustpilot do is require users review both the product & service - and only the product & service, without mentioning names, other companies (or addons in this case), etc. These guidelines prevent unreasonable reviews - while allowing the reasonable ones to almost effortlessly check all the required boxes.
Most bullshit reviews here either focus entirely on service or the product (or just something they didn't understand with the product). A policy like this would have the net result that people are intrinsically required to reach out to support before making a negative review.
I think another good policy would be disallowing reviews on the install process unless the addon requires something more complex than just placing it in the addons folder & editing the config file (eg. DRM configuration through some online portal).
Personally, I feel like the user should be able to write a review based on personal experience. While I agree that certain reviews like "I don't know how to set it up" or "I thought it was something else" should be removed, I believe that if a person gives a low review because they tried it out and they didn't like it, then the review should stay. In that case, a support ticket should not have to be opened. Support tickets are for SUPPORT, not OPINIONS.
In summary:
Reviews based on something being broken when there was no request for help = removed. Reviews based on a REAL opinion or a REAL overall experience with the addon = stay (Not all cases should be kept, but a majority).
Bytypad 👑at 10th of January 2018 01:14:57
Personally, I feel like the user should be able to write a review based on personal experience. While I agree that certain reviews like "I don't know how to set it up" or "I thought it was something else" should be removed, I believe that if a person gives a low review because they tried it out and they didn't like it, then the review should stay. In that case, a support ticket should not have to be opened. Support tickets are for SUPPORT, not OPINIONS.In summary:Reviews based on something being broken when there was no request for help = removed.Reviews based on a REAL opinion or a REAL overall experience with the addon = stay (Not all cases should be kept, but a majority).
So i can buy all your addons, and just say i don't like them without giving any other reason than "it's ugly".
Even if i was able to see it in the screenshot.
2/5, i don't like it, it's ugly
Seriously, the whole opinion argument is dumb, you're supposed as a dev to show exactly what the client will get, there is no way he should expect something else, the price/how it looks/what it does cannot be used in the review since he knew what he would get by buying it.
By🎄🐇🎄at 10th of January 2018 05:49:01
So i can buy all your addons, and just say i don't like them without giving any other reason than "it's ugly".Even if i was able to see it in the screenshot.2/5, i don't like it, it's uglySeriously, the whole opinion argument is dumb, you're supposed as a dev to show exactly what the client will get, there is no way he should expect something else, the price/how it looks/what it does cannot be used in the review since he knew what he would get by buying it.This is exactly my point, you knew what you're buying beforehand so why complain about it after if it works as expected without issue
ByThreebowat 10th of January 2018 06:11:16
This is exactly my point, you knew what you're buying beforehand so why complain about it after if it works as expected without issue
Or maybe it could be valid if the addon would not have enough medias , but since most of the addons are small and have medias...
As it's been mentioned a few times before in this thread, an alternative "Do you recommend this addon? YES/NO" with a FORCED COMMENT would probably be a good alternative. That way there's no iffy 4 stars that (although considered good) is often seen as bad by some devs. Also excluding a neutral option (in current case 3 stars). That way everyone's happy.
I'm aware that Nooky doesn't want Marcuz/Matt changing any of the current site and working full time on gms3 instead, but this could be a better review system for when gms3 is released.
I'm with people who say that having 4/5 only because nothing is perfect is an idiot way of being. Everything related to the script can be seen through the description page, the medias and eventually a video provided with: people know what they are buying so they can't put a negative review except, of course, if the script doesn't work. In this case they should open a support ticket before creating an illiterate review.
That's why I'm also entirely for a "Do you recommend this script?" / "YES/NO" without a star system. Also you should not be able to put a NO if you didn't open a support ticket before (because basically the only reason for putting a no should be if the script doesn't work).
Also from what I know Marcuz said the review feature was a pain in the ass to code so it will allow us to have a +1/-1 REP directly without make complex calcs. By this way maybe the reps will be added for additional authors when the script will be reviewed one time?
Anyway, the review system as this should be abandoned: we loose our times by removing every review of children who want to put the minimal note and it more acts like a fight of the best ratings than the script functionality.
My main issue that I have with the "They can see everything about the script before they purchase it" is that it may not have been exactly what they wanted, or just wasn't as great as they'd have wanted. Amazon you can see exactly what you bought/are ordering, but you still get people who rate 4/5 even though they liked it, same with Google Play Store.
Owain is correct with the fact that we are not making any production changes like that, since all the time is being spent on the development of the new site, so don't expect anything major to change for the time being. However adjusting the rules is possible and at least I want to make sure they're all clarified.
ByNookyavaat 10th of January 2018 13:43:07
My main issue that I have with the "They can see everything about the script before they purchase it" is that it may not have been exactly what they wanted, or just wasn't as great as they'd have wanted. Amazon you can see exactly what you bought/are ordering, but you still get people who rate 4/5 even though they liked it, same with Google Play Store.Owain is correct with the fact that we are not making any production changes like that, since all the time is being spent on the development of the new site, so don't expect anything major to change for the time being. However adjusting the rules is possible and at least I want to make sure they're all clarified.
every time i rated something less than 5/5 on amazon it was linked to the quality.
here that's much different.
this is why i compared script with AAA games and not amazon physical stuff
Edited why not doing like ebay
differents fields where you can put neutral positive or negative
By🎄🐇🎄at 10th of January 2018 13:47:16
every time i rated something less than 5/5 on amazon it was linked to the quality.here that's much different.this is why i compared script with AAA games and not amazon physical stuffEditedwhy not doing like ebaydifferents fields where you can put neutral positive or negative
I don't see how it's much different. If you're talking about quality then you don't know how well something was coded, or how well it all interacts with everything. Plus you'd be more likely to relate scripts to Indie games, not AAA games that have multiple developers over the course of a few years.
ByNookyavaat 10th of January 2018 13:49:51
I don't see how it's much different. If you're talking about quality then you don't know how well something was coded, or how well it all interacts with everything. Plus you'd be more likely to relate scripts to Indie games, not AAA games that have multiple developers over the course of a few years.
Even indies games have trailers, on my addons i only show it working live, no trailer bullshit
how well it all interacts with everything
if it doesn't interact well, it's a bug, which need to be fixed, which is have to be handeled in support tickets, not in the review
By🎄🐇🎄at 10th of January 2018 14:59:56
Even indies games have trailers, on my addons i only show it working live, no trailer bullshitif it doesn't interact well, it's a bug, which need to be fixed, which is have to be handeled in support tickets, not in the review
I disagree. I could be shown the hottest thing on the market through a trailer which could only highlight "good" and "working" features, and it makes it look amazing. Even if you show it working live it could be cherry picking moments.
If it doesn't interact well it doesn't mean it's a bug, it just could not function as well as they'd like, or maybe it just wasn't what they expected.
What if I refuse to do it, does it protect me from "opinions" reviews ?
All the videos i show are guides to use the addon, it's raw footage
By🎄🐇🎄at 10th of January 2018 15:33:39
What ifIrefuse to do it, does it protect me from "opinions" reviews ?All the videos i show are guides to use the addon, it's raw footage
My point being is that the user experience is going to be different than even a tutorial video. The user may not have found it fitted their needs as well as they initially thought, or that it didn't work as well as they wanted.
By🎄🐇🎄at 10th of January 2018 15:33:39
What ifIrefuse to do it, does it protect me from "opinions" reviews ?All the videos i show are guides to use the addon, it's raw footage
If the author left out any information that would have deterred a potential customer from purchasing but they do anyway and leave a bad review because of it, that's on them.
By🎄🐇🎄at 10th of January 2018 05:49:01
So i can buy all your addons, and just say i don't like them without giving any other reason than "it's ugly".Even if i was able to see it in the screenshot.2/5, i don't like it, it's uglySeriously, the whole opinion argument is dumb, you're supposed as a dev to show exactly what the client will get, there is no way he should expect something else, the price/how it looks/what it does cannot be used in the review since he knew what he would get by buying it.I said overall experience with addon, not it being "ugly." Screenshots do give the buyer an idea of how it looks, but it does not give them the experience. Sometimes, users purchase an addon and don't like the way it feels using it. It's just like any other physical product. It may function as intended, but sometimes you just don't like things.
Also, the "opinion" argument is not dumb, and it's how reviews should be. That's the whole point of a review. Also, according to this, opinion reviews are allowed and I think they always should be.