Introduction and Variations in Ratings

Introduce yourself to the community or chat with other users about whatever is on your mind
Djzimm
Posts: 8
Your TCI: na
Joined: Sat Jan 29, 2022 5:31 pm

Introduction and Variations in Ratings

Post by Djzimm »

Hey everyone! I'm new here and enjoying the system quite a bit. To cut to the chase, does anyone know (as I'm not a statistician and am too impatient to invest more time) how much skewness affects the PSIs?? I don't seek out and watch a lot of bad films to balance my ratings, so I definitely skew positive. I've also noticed with Criticker that there's four specific numerical ratings I've probably or possibly used too often: 55, 65, 75 and 80. Would anyone recommend I go back and tweak some of these ratings so I could possibly make more of a bell curve, or does this not really make all that much of a difference??

Oh, and I've rated over 1,000 films, with a tiny amount of TV series.

Cheers.

snallygaster
Posts: 562
Your TCI: na
Joined: Sat Oct 09, 2010 6:15 pm

Re: Introduction and Variations in Ratings

Post by snallygaster »

I think the general consensus is that it's best not to overthink it. Just watch what you want to watch and rate films in a way that makes sense to you; the system will figure it out.

Telemecus
Posts: 22
Your TCI: na
Joined: Thu May 27, 2010 9:14 pm

Re: Introduction and Variations in Ratings

Post by Telemecus »

even if your ratings are skewed to the positive that should not affect your recommendations. The films you are more likely to like will still appear ontop and vice versa. I personally made a big effort to remember a lot of the films I hated and marked them down and it was probably a waste of effort as well as bringing back unnecessary bad memories.

tpbradbury
Posts: 7
Your TCI: na
Joined: Sun Nov 07, 2021 12:22 pm

Re: Introduction and Variations in Ratings

Post by tpbradbury »

hiya, a couple of threads you may find relevant:
viewtopic.php?f=6&t=7859&p=67551&hilit= ... lms#p67551
viewtopic.php?f=6&t=3153&hilit=selection+bias&start=30

most users will be subject to the skew you talk about. most people generally work out what they like and then watch that kind of stuff, so i assume a strong positive skew. this site works by matching us to users who rate stuff similarly to us, so the skew shouldn't distort that if we're skewed the same way?

in terms of ratings, my instinct would be yes, be as accurate as you can and use the full range of 0-100. this site converts all your ratings to percentiles, i.e. the full 0-100, to do matching, in any case. so why not help it by being more accurate? grateful for good counter arguments from anyone

Ramy
Posts: 103
Your TCI: na
Joined: Sat Aug 08, 2015 5:46 pm

Re: Introduction and Variations in Ratings

Post by Ramy »

Also, don't be afraid to use the entire scale. For some reason, I used to give 5s and 6s to films I didn't like. Then I did a batch edit of all my ratings with this scale:

10- Best I've ever seen. My absolute favorites.
9- Masterful
8- Great
7- Solid
6- Pretty good
5- So-so. Neither good nor bad.
4- Ehhh could be better
3- Poor
2- Very bad
1- Atrocious
0- No redeemable quality whatsoever

Djzimm
Posts: 8
Your TCI: na
Joined: Sat Jan 29, 2022 5:31 pm

Re: Introduction and Variations in Ratings

Post by Djzimm »

Thanks everyone for the quick replies! I've decided to go over my ratings to give much more variation. A Criticker team member also got back to me and said yes, more variation is better. I know we're here because of movies, but I also love ratings and a somewhat numerophile. I already knew about the quips and colors, and I've had a 0-10 scale like one of these posts on Letterboxd for years. I use this scale, and yet I don't make full use of it. Only a small number of movies are under 5/10 that I saw as objectively pretty bad or awful. Knowing that here, where a movie is placed on your list of percentiles is more important than the score you give a film, I'll look to break up ratings that have too many movies assigned to them. I think the highest is a rating of 65 with something like 70 movies assigned to it!

CriticalCat
Posts: 7
Your TCI: na
Joined: Sun Nov 19, 2017 12:53 am

Re: Introduction and Variations in Ratings

Post by CriticalCat »

What I did is rate my first batch of about 100 movies, then went to this site to check my distribution and manually edited my ratings until I had an even distribution from 0 to 100. When I rate a new movie I compare it to already-rated ones and decide where it fits in the spectrum, then give it that number.

https://kalafut.net/critigram/

Doesnt matter considering how the system works, but I find it the most aesthetically pleasant.

Djzimm
Posts: 8
Your TCI: na
Joined: Sat Jan 29, 2022 5:31 pm

Re: Introduction and Variations in Ratings

Post by Djzimm »

Oh great! Thanks @MaxD ;)

potatopaisan
Posts: 4
Your TCI: na
Joined: Tue Jan 14, 2014 11:12 pm

Re: Introduction and Variations in Ratings

Post by potatopaisan »

I wrote an article about my rubric and even included a public link to the calculator in google sheets! https://potatopaisan.medium.com/my-movi ... 1e7482a0db

Check it out and let me know what you think...

Djzimm
Posts: 8
Your TCI: na
Joined: Sat Jan 29, 2022 5:31 pm

Re: Introduction and Variations in Ratings

Post by Djzimm »

potatopaisan wrote:
Tue Feb 15, 2022 3:03 pm
I wrote an article about my rubric and even included a public link to the calculator in google sheets! https://potatopaisan.medium.com/my-movi ... 1e7482a0db

Check it out and let me know what you think...
I haven't even read it yet, but I know I'll probably love it after just clicking on the link haha.

Post Reply