Paper: arXiv 2306.01740
Authors: Lawrence Clegg, John Cartlidge
Abstract
We present a replication and correction of a recent article (Ramirez, P., Reade, J.J., Singleton, C., Betting on a buzz: Mispricing and inefficiency in online sportsbooks, International Journal of Forecasting, 39:3, 2023, pp. 1413-1423, doi: 10.1016/j.ijforecast.2022.07.011). RRS measure profile page views on Wikipedia to generate a “buzz factor” metric for tennis players and show that it can be used to form a profitable gambling strategy by predicting bookmaker mispricing. Here, we use the same dataset as RRS to reproduce their results exactly, thus confirming the robustness of their mispricing claim. However, we discover that the published betting results are significantly affected by a single bet (the “Hercog” bet), which returns substantial outlier profits based on erroneously long odds. When this data quality issue is resolved, the majority of reported profits disappear and only one strategy, which bets on “competitive” matches, remains significantly profitable in the original out-of-sample period. While one profitable strategy offers weaker support than the original study, it still provides an indication that market inefficiencies may exist, as originally claimed by RRS. As an extension, we continue backtesting after 2020 on a cleaned dataset. Results show that (a) the “competitive” strategy generates no further profits, potentially suggesting markets have become more efficient, and (b) model coefficients estimated over this more recent period are no longer reliable predictors of bookmaker mispricing. We present this work as a case study demonstrating the importance of replication studies in sports forecasting, and the necessity to clean data. We open-source release comprehensive datasets and code.
Complexity vs Empirical Score
- Math Complexity: 5.0/10
- Empirical Rigor: 6.0/10 (capped from 9.0: transaction costs not modelled; see penalty flags)
- Quadrant: Holy Grail — high math complexity, high empirical rigor (effective empirical rigor capped from 9.0)
Why this score: The paper relies on standard regression analysis (OLS) and does not introduce advanced mathematical theory, but demonstrates high empirical rigor by replicating results, discovering data anomalies, extending backtests with new data, and releasing open-source code and datasets.
Research Flowchart
flowchart TD
A["Research Goal: Replicate &<br>correct RRS study"] --> B{"Dataset & Code"}
B --> C["Exact Replication<br>Confirm Mispricing"]
C --> D{"Check Betting Results"}
D --发现数据异常 --> E["Identify 'Hercog' Bet<br>Outlier Profits"]
E --> F["Data Cleaning & Correction"]
D --无异常 --> C
F --> G["Revised Outcomes:<br>Profits Vanish"]
G --> H{"Strategy Check"}
H --"Competitive" matches<br>still profitable --> I["Key Finding:<br>Market Inefficiency Exists"]
H --All profits disappear --> J["Key Finding:<br>No Significant Inefficiency"]
I --> K["Extension: Post-2020 Analysis"]
J --> K
K --> L["Results:<br>1. Profits disappear<br>2. Predictors become unreliable"]
L --> M["Conclusion:<br>Importance of replication<br>& data cleaning"]
Evidence Card
What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card
Proposes
The paper replicates and corrects a prior study, providing a cleaned and extended dataset and re‑evaluating betting strategies.
Source sentence
We present a replication and correction of a recent article (Ramirez, P., Reade, J.J., Singleton, C., Betting on a buzz: Mispricing and inefficiency in online sportsbooks, International Journal of Forecasting, 39:3, 2023, pp. 1413-1423, doi: 10.1016/j.ijforecast.2022.07.011).
Assumes
No explicit assumptions found in the text.
Data
- tennis-data.co.uk WTA dataset alternative public
Source sentence
The dataset contains WTA data sourced from tennis-data.co.uk for the period July 2015 to February 2020, inclusive; which includes information on every tennis match
Costs
Not modeled
Finds 3
- After correcting the Hercog error, the competitive Bet365 strategy remains profitable but at a lower rate of 12.44% (down from 29.38%). performance
Source sentence
ve, albeit at a much lower rate of 12.44% (previously, reported as 29.38%).
- Using the cleaned and extended dataset, no further profits are generated after February 2020, suggesting markets have become more efficient. performance
Source sentence
we see that no further profits are generated after Feb. 2020.
- In the extended period (Feb 2020 – Aug 2023) the WikiBuzz and RankDist coefficients are no longer significant (p‑values 0.837 and 0.471). statistical
Source sentence
new estimated coefficients for WikiBuzz and RankDist are no longer significant over this period, with respective p-values of 0.837 and 0.471.
Checked by others
No other paper in the archive has been found to support or contradict these findings (compared with 17 related papers). Coverage is partial, so this is neither replication nor refutation.
Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.