Divot Lab Research · Study 04

The Model Moves the Market

120,065 graded outcomes 283 tournaments 2019–2025 3 sportsbooks 2 model variants
What we found

Bet the outcomes a public golf model likes and the price you took will, on average, have shortened by the time the market closes. That happens in every market we tested, at every confidence threshold, and it gets stronger the more confident the model is — 24 out of 24 measurements, none of them marginal.

Whether it makes money is a different question, and the answer is that nobody can tell yet — including us. About a quarter of the strategies we tested return a profit on paper, one of them +33%. Not one has a confidence interval that clears zero. The intervals that do exclude zero are all losses. At this sample size the honest statement is not that the model loses; it is that its edge and the hold it must clear are close enough in size that seven seasons cannot separate them.

Why this study exists

Our own model page carries an open question we have never been able to answer: would following the model have made money? Accuracy and profit are different things. A model can rank every player correctly and still lose, because the price already contains most of what it knows and the book keeps the difference.

We have now archived seven seasons of sportsbook prices — opening and closing, per player, per market, per book, already graded against what happened. That makes the question answerable rather than arguable.

The sample

289,355 priced outcomes across 283 tournaments, 2019–2025, from DraftKings, FanDuel and Pinnacle, in four markets: outright win, top 5, top 10 and top 20. Joined to 74,565 archived model predictions — the numbers as they stood before each event, not recomputed afterwards.

01 The model predicts where the line goes

Closing-line value is the standard test of whether a bettor has an edge. If you consistently take prices that shorten before the market closes, you are seeing something ahead of the people setting them. It is a cleaner measurement than profit because it does not have to wait for variance to average out.

We took every outcome where the model’s probability implied a positive expected value at the best opening price available, and measured what happened to that price.

MarketBetsPrice moved Relativet
Outright win2,813+0.16 pp+19%26.8
Top 52,415+0.75 pp+20%39.4
Top 101,703+1.55 pp+21%40.7
Top 201,479+2.58 pp+18%39.3
Positive means the price shortened after we would have bet it. ' Relative is the move as a share of the price taken. t-statistics above 3 are conventionally decisive; these run from 26 to 41.

Every market. Every threshold we tested. And it is monotone in confidence: raise the bar for what counts as a bet and the closing-line value goes up rather than down. On top-10 outcomes it climbs from +21% at any positive edge to +84% at the strictest cut. A model that was picking at random would show no such gradient.

02 Whether it makes money is unproven, in both directions

Here is the same set of bets, settled. One unit on each, priced at the open, across 138 tournaments the calibration was never fitted on.

MarketBetsROI 95% confidence interval
Outright win2,813−21.9%−55% to +19%
Top 52,415−17.4%−38% to +7%
Top 101,703−29.0%−42% to −14%
Top 201,479−12.8%−24% to −2%
Intervals from 4,000 bootstrap resamples drawn by tournament, not by bet — wagers inside one event share a winner and a cut line, so treating them as independent would shrink these intervals to a fiction. Rows in orange exclude zero.

Some individual cells look excellent. Applying the calibration correction and betting only outcomes with a 20% modelled edge returned +46.6% on top-5 markets. That number is worthless: it rests on 145 bets at an average price of 77, where a single winner swings the result by more than fifty units, and its confidence interval runs from −100% to +342%.

The result in one line

Across 48 strategy variants — four markets, three confidence thresholds, raw and calibrated, on both model variants the archive stores — not one has a confidence interval entirely above zero, and the handful that exclude zero are losses. Eleven return a profit on paper. None of the eleven can be told apart from luck.

The stronger variant, shown rather than described

DataGolf archives two model variants. The one that folds in course history does noticeably better, and reporting only the weaker of the two would be its own kind of overclaim.

Market and thresholdBetsROI95% confidence interval
Win, edge above 20%890+24.7%−54% to +138%
Top 5, corrected, edge above 10%305+33.5%−78% to +203%
Top 20, corrected, any edge364+8.1%−22% to +40%
Top 10, any edge1,742−37.2%−50% to −24%
The first three rows are the best results anywhere in this study. Every one of their intervals contains zero by a wide margin. The fourth is the clearest loss, and is here because a table of only the good rows is the thing this study is about.

Read the intervals rather than the point estimates. A strategy returning +33% whose plausible range runs from −78% to +203% has told you almost nothing, and 305 bets is nowhere near enough to narrow it. That is the honest position: the quantity we can measure precisely here is the line movement, not the profit.

03 The hold is the whole story

These findings are not in tension. The model sees something real — that is what the closing-line value proves. What is unresolved is whether it sees enough of it to pay the toll.

MarketPinnacleDraftKingsFanDuel
Outright win22.8%43.9%43.4%
Top 515.8%30.9%34.0%
Top 1025.2%30.4%27.9%
Top 2020.8%26.2%20.9%
The book’s margin at the open, normalised by the number of paying places — a top-20 market has twenty winners, so a fair book’s probabilities sum to twenty, not one.

Set the two numbers side by side. The model’s prices shorten by around 20% of what was taken. The hold on those same markets runs from 16% to 44%. The edge is real and it is about the size of the fee — which is exactly the situation in which you reliably move the line and cannot tell, across seven seasons, whether you are ahead of it.

This also explains the one book that behaves differently. Pinnacle charges a third of what the recreational books charge on outright winners, which is the same finding our third study reached from the opposite direction.

04 Fixing the probabilities does not fix the profit

The model’s raw probabilities are miscalibrated in a consistent direction, and that is correctable. Fitting a two-parameter correction on 2019–2022 and applying it to seasons the fit had never seen cuts calibration error sharply.

MarketError, rawCorrectedImprovement
Outright win0.07%0.05%34%
Top 50.69%0.15%79%
Top 101.31%0.19%86%
Top 201.92%0.43%77%
Expected calibration error on held-out seasons. The model reads 8.09% on top-10 outcomes that happen 6.86% of the time; corrected, that gap nearly closes.

The correction improves closing-line value too — in all four markets, at every threshold. It makes the model demonstrably better at the thing it is for.

It does not settle the profit question. Corrected returns bounce between +46% and −42% depending on which cell you look at, with intervals wide enough to contain both. Better probabilities help; they do not narrow the interval enough to resolve it.

What we are not claiming

The one thing we will claim is the negative: we have looked, with seven seasons and 120,065 graded outcomes, and we cannot find a strategy off these models whose profit is distinguishable from luck — in either direction. Several look profitable. None survives an honest confidence interval. Anyone selling you an edge off the same public inputs owes you this table, and so do we.

Method