Top Ten Pitch
Ranked, argued, explained

ICC

Team ratings versus league tables, and why they disagree

A standings table and a rating system are answering different questions, and the fact that they routinely produce different orders is a feature of both designs.

Team ratings versus league tables, and why they disagree
Team ratings versus league tables, and why they disagree · Photo via Pexels
Editorial note. Analysis and general information only — see our terms before acting on anything here.

Two instruments with different jobs

A standings table records what happened by awarding points for outcomes, and it is designed to be indisputable rather than insightful. A rating system attempts to estimate underlying strength, which requires interpretation and therefore assumptions that a standings table deliberately avoids. The first must be simple enough that every participant can verify it, because it determines titles and qualification directly.

The second can be as sophisticated as its designers like, because nothing depends on it except understanding. Expecting the two to agree misunderstands why they are built so differently. Each is authoritative within its own remit, and neither has any standing to correct the other about a question it was never built to answer.

Schedule imbalance as the main divergence

In a balanced competition where everybody plays everybody equally, the two orders converge closely and disagreement is mostly about margins. In an unbalanced competition, a side can accumulate points against a favourable fixture list while a rating system discounts exactly those results. International schedules are strongly unbalanced, which is why ratings and tournament tables diverge more in that setting than in domestic leagues.

The divergence is informative, since it identifies which sides have benefited from their calendar rather than from their play. That information is unavailable from the standings alone, which is the argument for maintaining both. It also explains why a side can be widely regarded as the strongest in a competition while finishing behind a rival it never actually played.

Margin and the information standings discard

Most standings award the same points for a narrow win as for a heavy one, which discards a substantial amount of usable information. A rating that uses margin therefore separates sides that the table treats as identical, and the separation is usually predictive of later results. The discarding is intentional, because counting margin in a standings table would create incentives to run up scores in settled matches.

Bonus point systems attempt a middle path by awarding extra credit for defined achievements rather than for raw margin. Those systems change behaviour noticeably, which demonstrates how directly a scoring rule shapes the sport it governs.

Timing and what each order describes

A standings table describes an entire completed period and cannot be updated to reflect that a side has changed since the early rounds. A rating with decay describes the recent portion of that period more heavily, so it can indicate an improving side sitting mid-table. Both descriptions are accurate about their own subject, and confusion arises when one is used to criticise the other.

For deciding a champion, the completed record is the right instrument, because it is the record the competition was contested over. For anticipating the next stage, the rating is more useful, because recent evidence is more relevant to what comes next.

Using disagreement productively

The gap between a side position in the table and its position in a rating is a compact summary of luck, schedule and timing. A side rated well above its table position has usually lost close matches or faced a harder fixture list than its rivals. A side rated well below has usually benefited from favourable margins or from meeting weakened opposition at convenient moments.

Neither observation determines what happens next, and both narrow the range of explanations worth considering. Publishing both orders together, with the gap shown explicitly, is more informative than defending either as the true one. The gap is also the quantity most likely to shrink over a longer period, since schedule advantages and narrow margins rarely persist across many seasons.

The short version
  • Standings count outcomes, ratings estimate strength
  • Schedule imbalance separates the two orders
  • Each is correct for its own purpose
ICCstandingsrating systemsinterpretation
Vikram Singh
Contributing writer, Top Ten Pitch

Vikram Singh writes on icc for Top Ten Pitch, focusing on what the evidence supports rather than what makes the better headline.

Also by Vikram Singh

Read next

More icc →

ICC

Decay functions: how a rating forgets last season

Every rating has to decide how quickly old evidence stops mattering, and that single setting does more to shape the published order than the rest of the formula combined.

David Smith··3 min read