Glicko ranking bugs

News and announcements from the worldwide Blood Bowl players' association

Moderator: TFF Mods

Anubis
Rookie
Rookie
Posts: 4
Joined: Sat Jun 24, 2017 5:06 am

Re: Glicko ranking bugs

Post by Anubis »

mubo wrote:But I guess from your perspective you'd rather see mu/phi than last month's change in mu/phi?
That’s right. Since it’s changed to last month, I totally lost the feeling for comparison with “dead” teams. For example Floridaboy (NAF #6636) has1396.4 Elven Union Ranking with a decay of -0.8. He played 6 matches March 2007! Over 12.5 years ago! Shouldn’t his rating be rock bottom?

And could change “Elves” to Elven Union to separate them from the 3 other Elven teams?

Reason: ''
User avatar
mubo
Star Player
Star Player
Posts: 749
Joined: Mon Dec 22, 2008 7:12 pm
Location: Oxford, UK

Re: Glicko ranking bugs

Post by mubo »

Anubis wrote:
mubo wrote:
That’s right. Since it’s changed to last month, I totally lost the feeling for comparison with “dead” teams. For example Floridaboy (NAF #6636) has1396.4 Elven Union Ranking with a decay of -0.8. He played 6 matches March 2007! Over 12.5 years ago! Shouldn’t his rating be rock bottom?

And could change “Elves” to Elven Union to separate them from the 3 other Elven teams?
Just to be clear- the rankings themselves haven't changed- just what I choose to display on the NAF site. The decay is points lost in the last month.

Re: your example- it is rock bottom. The player is unranked (phi > 100).

And, yes I could change elves to Elven Union, will do that next release.

Reason: ''
Glicko guy.
Team England committee member
User avatar
besters
Ex-Mega Star, now just a Super Star
Ex-Mega Star, now just a Super Star
Posts: 1559
Joined: Thu Jun 16, 2005 7:37 pm
Location: Wandering in East Anglia

Re: Glicko ranking bugs

Post by besters »

sann0638 wrote:Great - thanks. Worth a line in the page that says top 25000 are shown, or similar? Saves people like me asking the queson :)
I don't know if this was actioned, I didn't see it, but I was going to ask the same question.

Reason: ''
straume
Emerging Star
Emerging Star
Posts: 364
Joined: Fri Mar 28, 2014 9:21 am

Re: Glicko ranking bugs

Post by straume »

Can we expect an update on this ranking, post WC?




(and Nick; If Jim is keeping you captive in his basement to avoid any ranking updates, just give the secret signal so we can get you out of there!)

Reason: ''
User avatar
mubo
Star Player
Star Player
Posts: 749
Joined: Mon Dec 22, 2008 7:12 pm
Location: Oxford, UK

Re: Glicko ranking bugs

Post by mubo »

Yes- apologies. There was a delay in uploading the NAF results to the database, and I have to lag a few days behind that. Should be with us very soon.

Reason: ''
Glicko guy.
Team England committee member
User avatar
mubo
Star Player
Star Player
Posts: 749
Joined: Mon Dec 22, 2008 7:12 pm
Location: Oxford, UK

Re: Glicko ranking bugs

Post by mubo »

Done! Congrats by the way :)

Reason: ''
Glicko guy.
Team England committee member
User avatar
Purplegoo
Legend
Legend
Posts: 2259
Joined: Mon Jan 14, 2008 1:13 pm
Location: Cambridge

Re: Glicko ranking bugs

Post by Purplegoo »

Sorry to poke my nose in, but for those glicko enthusiasts among us, mubo and latterly Ketil have fixed it so that [see kyrre post below].

Well done, chaps!

Reason: ''
User avatar
besters
Ex-Mega Star, now just a Super Star
Ex-Mega Star, now just a Super Star
Posts: 1559
Joined: Thu Jun 16, 2005 7:37 pm
Location: Wandering in East Anglia

Re: Glicko ranking bugs

Post by besters »

I really don't understand how Glicko ratings work compared to the ELO ratings. An example close to my own heart is in the High Elf rankings where Dirold and I are the top two in both rankings at present, in ELO I am top by the slimmest of margins, in Glicko I am second by over 100 points, we have similar phi ratings, I would really like to understand why this is different?

I thought that if the phi was similar and the ELO similar it would produce a similar glicko ranking, but this doesn't seem to be the case, is this a basic misunderstanding on my part?

Reason: ''
User avatar
Purplegoo
Legend
Legend
Posts: 2259
Joined: Mon Jan 14, 2008 1:13 pm
Location: Cambridge

Re: Glicko ranking bugs

Post by Purplegoo »

Hi Jim,

There are three explanations as to how glicko works (and hence why you are where you are) that we could offer:

First - Nick's answer, which will doubtless follow. This should be considered correct and render this post moot. ;)

Second - the overview page on thenaf.net.

Third - my pigeon / simplistic understanding. In short, glicko seems to care more about who and when your numbers have come from than ELO does.

Under ELO, a 200 coach is a 200 coach. An active, good player doing well over years with a couple of recent whiffy games. A six game, one hit wonder at a NAFC. Maybe someone that hasn't played since 1985. Who knows how they got 200. You will get the same numerical boost for beating all three, as the formula doesn't care. Glicko is a touch more discerning, in that phi (confidence in how well you're doing lately) and mu (how well you're doing) of you and your opponents all matters when it comes to rolling up your final figure. If you're playing the one hit wonder or the old hand, glicko won't be too sure about him, and his poor (high) phi will reduce his overall number and your respective gain relative to beating the good player, who will have a lower phi (and likely higher mu, I suppose). The formula also makes it harder to amass a big number over time by beating a series of (in ELO money) 150-170 players over a long period. Conversely, it is fast to reward you if you go on a run against the big cheeses; reacting relatively quickly to hone in on what it considers your real ability. If you are an ELO 250 player, glicko will get you to the equivalent number far more quickly than ELO will.

So - without checking the games in question, I would gamble that the difference you're seeing is one / more of:

- Your ELO performance being boosted by major championship multipliers (not present in glicko. It cares about opponents, not tournament gravitas)

- Your glicko suffering decay (appreciate that's unlikely if you're interested, but that's present in glicko but not ELO)

- Your opponents not being considered as good as dirold's according to the formula (not a criticism, people are just judged differently as noted above. And of course, you have little choice in who you play unless you're deliberately travelling larger distances to meet better opponents. A particular issue in less densely populated areas, where glicko is a bit meaner to coaches than it would ideally be. Watch this space for 'something else' that may help there)

Er - that's a probably nonsense ramble. Perhaps should have left it to Nick. ;)

Reason: ''
kyrre
Experienced
Experienced
Posts: 156
Joined: Sun Aug 28, 2016 7:44 am

Re: Glicko ranking bugs

Post by kyrre »

The cut off for the calculation is still the last day of the last month. So only games played before January 1st 2020 when this reply was written. In that way, it is still a monthly thing. Late tournament results could still change the rank from one day to the next.

Reason: ''
User avatar
Purplegoo
Legend
Legend
Posts: 2259
Joined: Mon Jan 14, 2008 1:13 pm
Location: Cambridge

Re: Glicko ranking bugs

Post by Purplegoo »

Aha. Understood, good clarification!

Reason: ''
User avatar
besters
Ex-Mega Star, now just a Super Star
Ex-Mega Star, now just a Super Star
Posts: 1559
Joined: Thu Jun 16, 2005 7:37 pm
Location: Wandering in East Anglia

Re: Glicko ranking bugs

Post by besters »

Thanks Phil, I guess my issue is that I can see the movement in the ELO rankings, while we just have the numbers for the Glicko ranking with no detail available, so can't see where the difference is created.

A further issue for me is that having played all races, I have a target to get them all to certain rankings, difficult in ELO where you are constantly being overtaken, impossible in Glicko when you add in decay.

Reason: ''
User avatar
Purplegoo
Legend
Legend
Posts: 2259
Joined: Mon Jan 14, 2008 1:13 pm
Location: Cambridge

Re: Glicko ranking bugs

Post by Purplegoo »

Sure. It’s absolutely fair to say that there are pros and cons in any ranking system, especially when you add in meta goals. I like the idea that the membership has more now and as such can choose what they like / what they want to shoot for, but I appreciate that it’s possible to be frustrated because it’s impossible to play enough BB to satisfy your meta goals in every system.

Reason: ''
kyrre
Experienced
Experienced
Posts: 156
Joined: Sun Aug 28, 2016 7:44 am

Re: Glicko ranking bugs

Post by kyrre »

Glicko ranks have been changed to include every game played. So no monthly cut-off with daily updates like elo.

Reason: ''
Melifaxis
Legend
Legend
Posts: 5833
Joined: Tue Feb 25, 2003 9:26 pm
Location: MA, USA
Contact:

Re: Glicko ranking bugs

Post by Melifaxis »

Ranking column seems to have a problem, many people ranked 1,769 throughout the column of data regardless of their value in the rating column.

Reason: ''

NAF Rankings
Commissioner: HBBL & GSBBL (7's)
Tournament Organizer: The Beantown Brouhaha & the Draughthouse Massacre & The Tricorn Cup
NBA Heretic & Proud Beer-Drinker of the NFL
Post Reply