Calibration

Whether a percentage from this model can be taken at face value — and whether a bigger claimed edge is a bigger real one.
Outcomes graded
15000
Bets measured
353

When the model says ~40%, what happens?

7% predicted, 14% observed, 196 calls16% predicted, 21% observed, 1109 calls26% predicted, 27% observed, 6443 calls34% predicted, 34% observed, 3269 calls45% predicted, 43% observed, 2513 calls55% predicted, 52% observed, 917 calls64% predicted, 61% observed, 380 calls74% predicted, 71% observed, 119 calls84% predicted, 68% observed, 47 calls93% predicted, 100% observed, 7 callspredictedobserved

Each dot is one band: predicted across, observed up, sized by how many calls it holds. The dashed diagonal is a perfectly calibrated model — a dot above it means the outcome happened more often than the model said, below it less often. Distance from the line is only as meaningful as the dot is large.

Model saidNPredictedActually happenedGapReads as
0–10%1966.8%14.3%+7.5ptwhen the model says about 7%, it happens 14.3% of the time
10–20%110916%20.6%+4.6ptwhen the model says about 16%, it happens 20.6% of the time
20–30%644326.3%26.7%+0.4ptwhen the model says about 26%, it happens 26.7% of the time
30–40%326934%33.6%-0.4ptwhen the model says about 34%, it happens 33.6% of the time
40–50%251344.7%43.4%-1.3ptwhen the model says about 45%, it happens 43.4% of the time
50–60%91754.5%52.1%-2.4ptwhen the model says about 55%, it happens 52.1% of the time
60–70%38064.4%61.1%-3.3ptwhen the model says about 64%, it happens 61.1% of the time
70–80%11974.4%70.6%-3.8ptwhen the model says about 74%, it happens 70.6% of the time
80–90%4784%68.1%-15.9ptwhen the model says about 84%, it happens 68.1% of the time
90–100%792.5%100%+7.5ptonly 7 samples in this band — too few to read

Each finished fixture contributes three samples — home, draw and away — so a slate of 100 matches is 300 outcomes. Measured over every fixture the model priced and that has since finished — not only the ones we bet. A band with fewer than 30 samples is shown but marked unreadable: it is here because removing it would be the cherry-pick, not because it means anything yet.

CLV by model probability

posted bets only

Are we better at finding a price on favourites or on outsiders? The band is the model's own probability for the side we backed. “With a close” is the denominator for the two CLV columns — a bet whose closing line was never captured has no CLV, and counting it against the band would render a missing measurement as a worse result.

Model saidBetsAvg CLVBeat closeWith a closeWin rateW–L
under 20%2too few+0.7%50%2100%2–0
20–30%23too few+1.03%69.6%2360.9%14–9
30–40%21too few-0.6%61.9%2176.2%16–5
40–50%54+0.84%63%5461.1%33–21
50–60%52+0.06%50%5255.8%29–23
60–70%63-0.59%46%6371.4%45–18
70%+29too few+0.48%51.7%2969%20–9

A band marked too few holds fewer than 30 settled bets. It is shown because removing it would be the cherry-pick, not because its numbers mean anything yet.

109 bets excluded: bets outside 1X2, or on a fixture with no stored model probability — neither has a model probability to band, and inventing one would be a fabricated number.

CLV by expected value

posted bets only

Does a bigger claimed edge actually beat the close by more? If it does not, the EV number is not measuring what it says it measures — which is worth publishing whether or not it flatters us.

Claimed edgeBetsAvg CLVBeat closeWith a closeWin rateW–L
negative282+0.64%56%28263.5%179–103
0–3%46-0.56%43.5%4660.9%28–18
3–6%0——0——
6–10%0——0——
10%+0——0——

25 bets excluded: bets posted before EV was recorded on the ledger.

Why two different universes: calibration is measured on every fixture because bets are SELECTED — a tip exists where the model and the market disagreed, so measuring calibration on bets alone would measure the selection rather than the model. They are not shown on one axis because a well-calibrated model can still lose money, and a profitable run can come from a badly-calibrated one. Presenting either as evidence for the other would be the easiest lie on this page to tell.