Hey everyone! I'm new here and enjoying the system quite a bit. To cut to the chase, does anyone know (as I'm not a statistician and am too impatient to invest more time) how much skewness affects the PSIs?? I don't seek out and watch a lot of bad films to balance my ratings, so I definitely skew positive. I've also noticed with Criticker that there's four specific numerical ratings I've probably or possibly used too often: 55, 65, 75 and 80. Would anyone recommend I go back and tweak some of these ratings so I could possibly make more of a bell curve, or does this not really make all that much of a difference??
Oh, and I've rated over 1,000 films, with a tiny amount of TV series.
Cheers.
Introduction and Variations in Ratings
- Djzimm
- Posts: 8
- Your TCI: na
- Joined: Sat Jan 29, 2022 5:31 pm
- snallygaster
- Posts: 562
- Your TCI: na
- Joined: Sat Oct 09, 2010 6:15 pm
Re: Introduction and Variations in Ratings
I think the general consensus is that it's best not to overthink it. Just watch what you want to watch and rate films in a way that makes sense to you; the system will figure it out.
-
- Posts: 22
- Your TCI: na
- Joined: Thu May 27, 2010 9:14 pm
Re: Introduction and Variations in Ratings
even if your ratings are skewed to the positive that should not affect your recommendations. The films you are more likely to like will still appear ontop and vice versa. I personally made a big effort to remember a lot of the films I hated and marked them down and it was probably a waste of effort as well as bringing back unnecessary bad memories.
-
- Posts: 7
- Your TCI: na
- Joined: Sun Nov 07, 2021 12:22 pm
Re: Introduction and Variations in Ratings
hiya, a couple of threads you may find relevant:
viewtopic.php?f=6&t=7859&p=67551&hilit= ... lms#p67551
viewtopic.php?f=6&t=3153&hilit=selection+bias&start=30
most users will be subject to the skew you talk about. most people generally work out what they like and then watch that kind of stuff, so i assume a strong positive skew. this site works by matching us to users who rate stuff similarly to us, so the skew shouldn't distort that if we're skewed the same way?
in terms of ratings, my instinct would be yes, be as accurate as you can and use the full range of 0-100. this site converts all your ratings to percentiles, i.e. the full 0-100, to do matching, in any case. so why not help it by being more accurate? grateful for good counter arguments from anyone
viewtopic.php?f=6&t=7859&p=67551&hilit= ... lms#p67551
viewtopic.php?f=6&t=3153&hilit=selection+bias&start=30
most users will be subject to the skew you talk about. most people generally work out what they like and then watch that kind of stuff, so i assume a strong positive skew. this site works by matching us to users who rate stuff similarly to us, so the skew shouldn't distort that if we're skewed the same way?
in terms of ratings, my instinct would be yes, be as accurate as you can and use the full range of 0-100. this site converts all your ratings to percentiles, i.e. the full 0-100, to do matching, in any case. so why not help it by being more accurate? grateful for good counter arguments from anyone
- Ramy
- Posts: 103
- Your TCI: na
- Joined: Sat Aug 08, 2015 5:46 pm
Re: Introduction and Variations in Ratings
Also, don't be afraid to use the entire scale. For some reason, I used to give 5s and 6s to films I didn't like. Then I did a batch edit of all my ratings with this scale:
10- Best I've ever seen. My absolute favorites.
9- Masterful
8- Great
7- Solid
6- Pretty good
5- So-so. Neither good nor bad.
4- Ehhh could be better
3- Poor
2- Very bad
1- Atrocious
0- No redeemable quality whatsoever
10- Best I've ever seen. My absolute favorites.
9- Masterful
8- Great
7- Solid
6- Pretty good
5- So-so. Neither good nor bad.
4- Ehhh could be better
3- Poor
2- Very bad
1- Atrocious
0- No redeemable quality whatsoever
- Djzimm
- Posts: 8
- Your TCI: na
- Joined: Sat Jan 29, 2022 5:31 pm
Re: Introduction and Variations in Ratings
Thanks everyone for the quick replies! I've decided to go over my ratings to give much more variation. A Criticker team member also got back to me and said yes, more variation is better. I know we're here because of movies, but I also love ratings and a somewhat numerophile. I already knew about the quips and colors, and I've had a 0-10 scale like one of these posts on Letterboxd for years. I use this scale, and yet I don't make full use of it. Only a small number of movies are under 5/10 that I saw as objectively pretty bad or awful. Knowing that here, where a movie is placed on your list of percentiles is more important than the score you give a film, I'll look to break up ratings that have too many movies assigned to them. I think the highest is a rating of 65 with something like 70 movies assigned to it!
-
- Posts: 7
- Your TCI: na
- Joined: Sun Nov 19, 2017 12:53 am
Re: Introduction and Variations in Ratings
What I did is rate my first batch of about 100 movies, then went to this site to check my distribution and manually edited my ratings until I had an even distribution from 0 to 100. When I rate a new movie I compare it to already-rated ones and decide where it fits in the spectrum, then give it that number.
https://kalafut.net/critigram/
Doesnt matter considering how the system works, but I find it the most aesthetically pleasant.
https://kalafut.net/critigram/
Doesnt matter considering how the system works, but I find it the most aesthetically pleasant.
- Djzimm
- Posts: 8
- Your TCI: na
- Joined: Sat Jan 29, 2022 5:31 pm
Re: Introduction and Variations in Ratings
Oh great! Thanks @MaxD
- potatopaisan
- Posts: 4
- Your TCI: na
- Joined: Tue Jan 14, 2014 11:12 pm
Re: Introduction and Variations in Ratings
I wrote an article about my rubric and even included a public link to the calculator in google sheets! https://potatopaisan.medium.com/my-movi ... 1e7482a0db
Check it out and let me know what you think...
Check it out and let me know what you think...
- Djzimm
- Posts: 8
- Your TCI: na
- Joined: Sat Jan 29, 2022 5:31 pm
Re: Introduction and Variations in Ratings
I haven't even read it yet, but I know I'll probably love it after just clicking on the link haha.potatopaisan wrote: ↑Tue Feb 15, 2022 3:03 pmI wrote an article about my rubric and even included a public link to the calculator in google sheets! https://potatopaisan.medium.com/my-movi ... 1e7482a0db
Check it out and let me know what you think...