Top Ten Pitch
Ranked, argued, explained

Player Rankings

The replacement-level idea, and what it quietly assumes

Measuring a competitor against a freely available alternative is one of the most useful ideas in sports analysis, and its usefulness rests on an assumption that is often false.

The replacement-level idea, and what it quietly assumes
The replacement-level idea, and what it quietly assumes · Photo via Pexels
Editorial note. Analysis and general information only — see our terms before acting on anything here.

The question the idea answers

Asking how good somebody is has no natural zero point, which makes it difficult to express quality as a quantity rather than as a comparison. Replacement-level reasoning supplies that zero by asking what would happen if the competitor were removed and the easiest available alternative used instead. The difference between the two is then a measure of value, expressed in whatever currency the sport uses to describe contribution to results.

This reframing is powerful because it converts an abstract judgement about quality into a concrete question about a decision somebody might actually face. It also explains why a competitor can be genuinely excellent and still add little, if the alternative behind them is nearly as good.

Choosing the baseline

The whole measure depends on what counts as the freely available alternative, and that definition is a choice rather than something observed directly. Set the baseline too low and everybody appears valuable, which flattens the distinctions the measure was introduced to make visible. Set it too high and only the very best show any value at all, which understates the contribution of a large useful population.

Different published systems place the baseline differently, which is one reason their value figures disagree even when built from identical performance data. Because the baseline is an assumption, any ranking built on it should state where the line was drawn and why.

Where the availability assumption fails

The idea assumes an alternative is genuinely available at negligible cost, which holds reasonably well for ordinary squad positions and badly at the top. When a role requires a rare combination of attributes, there may be no realistic replacement, and the calculated value understates the disruption of losing them. Roster rules, registration limits and squad size constrain availability further, so the theoretical alternative may not be usable in practice.

In those situations the measure is answering a hypothetical that the decision maker cannot actually choose, which weakens its practical relevance. The measure remains useful as a common scale, provided nobody treats it as a direct statement about what would happen after a departure.

Chained replacement and knock-on effects

Removing a competitor rarely results in a direct substitution, because a side usually reshuffles and the vacancy appears somewhere else entirely. The real loss is the sum of small degradations across several positions rather than one clean swap at the point of departure. Modelling that chain requires knowing how a coach would respond, which is unobservable and varies between coaches facing identical circumstances.

Simplified models ignore the chain, which makes them tractable and causes them to misestimate value in squads with unusual shapes. The error is largest exactly where squads are most specialised, which is again the setting where the answer matters most.

Using the concept without overclaiming

Replacement reasoning is best understood as a common denominator that lets different roles and different totals be discussed on one scale. It is not a prediction of what would happen in a specific absence, and treating it as one attributes a precision it never claimed. Reporting it alongside the baseline definition allows a reader to recompute under a different assumption if they disagree with the choice.

Where the baseline choice changes the order of the leading candidates, that fact deserves a sentence rather than being hidden inside a method note. The concept survives criticism well precisely because its assumptions are explicit, which is more than most alternative measures can claim.

The short version
  • Value is measured against the realistic alternative
  • The baseline is chosen rather than observed
  • Availability assumptions break down at the top of a squad
Player Rankingsvaluationmetricsassumptions
Aarav Sharma
Contributing writer, Top Ten Pitch

Aarav Sharma writes on player rankings for Top Ten Pitch, focusing on what the evidence supports rather than what makes the better headline.

Also by Aarav Sharma

Player Rankings

Era adjustment: what it fixes and what it cannot

Comparing competitors from different periods requires translating between conditions that changed in several directions at once, and no adjustment can recover what was never measured.

Michael Johnson··3 min read