How good are these forecasts?

Every forecast scored on seasons the model never saw while its settings were chosen.

Held-back seasons

ForecastForecastsLog lossFavourite won
The model15721.04647%
Base rate15721.07046%
Recent form15721.06146%
Betting market15721.02149%

Against the betting markets

Each market's price before the start, scored on the same finished games as the model. A negative figure means the market was more accurate.

MarketSincePricedModel log lossMarket log lossModel vs market
Bookmakers (Pinnacle, DraftKings, bet365)21 Feb 20265101.0481.018−3.0%
Polymarket9 Aug 20256371.0371.009−2.8%
Kalshi28 May 20258041.0451.016−2.9%

Home advantage is large in MLS: long journeys, time zones, altitude and artificial pitches all fall on the visiting side.

Summer heat counts as rough weather here, as well as wind and rain.

The Supporters' Shield is the 'Finish first' column.

Designated-player signings, international call-ups and midweek rotation are not in the model.

Questions and answers

How accurate are PodiumOracle's MLS predictions?

On 1,572 games from held-back seasons (2024 to 2026), which the model never saw while it was tuned, the side it favoured won 47% of the time. Its log loss was 1.046, against 1.070 for the base rate and 1.061 for recent form, and 1.021 for the closing betting odds. Against the betting markets on the same finished games, its log loss was 1.048 against the bookmakers' 1.018 over 510 games, 1.037 against Polymarket's 1.009 over 637 games and 1.045 against Kalshi's 1.016 over 804 games (lower is better).