What Brier Score Measures
The Brier Score is a proper scoring rule for probabilistic forecasts. Instead of asking
only whether a prediction was right or wrong, it measures the size of the probability
error. A confident forecast receives a small penalty when it is correct and a much larger
penalty when it is wrong.
The interpretation is simple: lower is better. A score of 0 means the
forecast probabilities matched the observed outcomes perfectly.
Brier Score Formula
For a single binary event, the Brier Score is the squared difference between the predicted
probability and the observed outcome:
Binary formula
Brier Score = (predicted probability − actual outcome)²
The actual outcome is 1 if the event happens and 0 if it does not.
Football 1X2 markets have three mutually exclusive outcomes: Home, Draw, and Away. In the
OddsAccuracy framework, the three-outcome score is the mean squared probability error across
those outcomes:
OddsAccuracy 1X2 formula
Brier Score = [(pH − oH)² + (pD − oD)² + (pA − oA)²] / 3
The probabilities are margin-normalized before scoring, and the observed outcome vector
contains one 1 and two 0s.
Brier Score Example
Suppose a binary forecast assigns an 80% probability to a home win.
If the home team wins
(0.80 − 1)² = 0.04
The forecast receives a small error because the high-probability event happened.
If the home team does not win
(0.80 − 0)² = 0.64
The forecast receives a much larger error because it was confident and wrong.
Over a large sample, these errors are aggregated into an accuracy measure. That makes the
Brier Score more informative than counting only correct and incorrect picks.
What Is a Good Brier Score?
There is no universal number that is “good” in every forecasting problem. A Brier Score must
be interpreted using the same market structure, dataset, and calculation convention.
In the OddsAccuracy three-outcome Home/Draw/Away framework, a uniform forecast of
33.33% / 33.33% / 33.33% produces a reference score of approximately 0.2222.
A perfect forecast has a score of 0.0000. Under the same scoring convention,
values below 0.2222 indicate lower probability error than that uniform reference.
A “good” Brier Score is therefore not an isolated number. It is a score that is meaningfully
lower than an appropriate benchmark or competing forecast under identical conditions.
Some publications use a summed multiclass convention instead of averaging the squared errors.
That changes the numerical scale, so scores from different conventions should not be compared
directly.
How to Interpret a Brier Score
Brier Score interpretation should focus on both direction and context. Lower scores mean the
probability forecasts were closer to the observed outcomes, but the numerical value only becomes
meaningful when it is compared consistently.
- 0.0000: perfect probability accuracy.
- Lower values: smaller forecast error and better probability accuracy.
- Higher values: larger probability error and weaker forecasting performance.
- 0.2222 in OddsAccuracy 1X2 scoring: the uniform-random Home/Draw/Away reference.
The safest comparisons use the same competition, time window, market phase, probability
normalization, and scoring convention.
Why Win Rate Alone Is Misleading
A football forecast is a probability statement, not just a pick. Saying a team has a 70% chance
of winning is different from saying the team is certain to win. One upset does not invalidate a
well-calibrated forecast, and one correct result does not prove the probability estimate was good.
Brier Score preserves that information because it evaluates the probability assigned to each
outcome rather than reducing the forecast to binary hindsight.
How Brier Score Is Used for Football Odds
Decimal bookmaker odds can be converted into implied probabilities. Because bookmaker odds include
a profit margin, those raw implied probabilities typically sum to more than 100%. OddsAccuracy
removes that margin by normalizing the Home, Draw, and Away probabilities before calculating the
three-outcome Brier Score.
This allows bookmakers to be evaluated as probability forecasters rather than judged only by
individual winning or losing selections.
- Probability magnitude is preserved.
- Overconfident errors are penalized more heavily.
- Large match samples can be compared consistently.
- Opening and closing probability accuracy can remain separate measures.
For the full calculation process, see the OddsAccuracy methodology.
Brier Score and the OA Score
The OA Score is OddsAccuracy's standardized use of the three-outcome Brier Score
on margin-normalized bookmaker probabilities. It is not a replacement for the Brier Score; the
underlying scoring principle remains the Brier framework.
OddsAccuracy adds value by applying that score consistently across operators, leagues, time windows,
and market phases so probability accuracy can be compared under a defined methodology.
In OddsAccuracy, lower OA Score means better probabilistic accuracy, 0.0000 is
perfect, and 0.2222 is the uniform 1X2 reference.
Bottom Line
The Brier Score answers a more useful question than “Was the prediction correct?” It asks how close
the forecast probabilities were to reality. For football odds, that makes it a practical way to
compare probability quality across bookmakers, models, and large match samples.
Read the broader football odds analysis
Frequently Asked Questions
What is a Brier Score?
A Brier Score measures probability forecast accuracy by comparing predicted probabilities with
actual outcomes. Lower values indicate smaller forecast error, and 0 represents a perfect forecast.
What is a good Brier Score?
There is no universal good value because the benchmark depends on the forecast structure and
scoring convention. In the OddsAccuracy three-outcome 1X2 framework, 0.2222 is the uniform-random
reference and lower scores are better.
How do you interpret a Brier Score?
Compare it with scores calculated on the same basis. Lower values mean the forecast probabilities
were closer to the observed outcomes. The benchmark, market, and calculation convention should be
held constant when comparing forecasts.
Is a lower Brier Score better?
Yes. Lower means less squared probability error. A score of 0 is perfect.
How is Brier Score used in football predictions?
Home, Draw, and Away probabilities can be scored against the actual match result. For bookmaker
odds, OddsAccuracy first converts the odds to implied probabilities and normalizes them to remove
the bookmaker margin.