Paper: arXiv 2306.01740

Authors: Lawrence Clegg, John Cartlidge

Abstract

We present a replication and correction of a recent article (Ramirez, P., Reade, J.J., Singleton, C., Betting on a buzz: Mispricing and inefficiency in online sportsbooks, International Journal of Forecasting, 39:3, 2023, pp. 1413-1423, doi: 10.1016/j.ijforecast.2022.07.011). RRS measure profile page views on Wikipedia to generate a “buzz factor” metric for tennis players and show that it can be used to form a profitable gambling strategy by predicting bookmaker mispricing. Here, we use the same dataset as RRS to reproduce their results exactly, thus confirming the robustness of their mispricing claim. However, we discover that the published betting results are significantly affected by a single bet (the “Hercog” bet), which returns substantial outlier profits based on erroneously long odds. When this data quality issue is resolved, the majority of reported profits disappear and only one strategy, which bets on “competitive” matches, remains significantly profitable in the original out-of-sample period. While one profitable strategy offers weaker support than the original study, it still provides an indication that market inefficiencies may exist, as originally claimed by RRS. As an extension, we continue backtesting after 2020 on a cleaned dataset. Results show that (a) the “competitive” strategy generates no further profits, potentially suggesting markets have become more efficient, and (b) model coefficients estimated over this more recent period are no longer reliable predictors of bookmaker mispricing. We present this work as a case study demonstrating the importance of replication studies in sports forecasting, and the necessity to clean data. We open-source release comprehensive datasets and code.

Complexity vs Empirical Score

  • Math Complexity: 5.0/10
  • Empirical Rigor: 6.0/10 (capped from 9.0: transaction costs not modelled; see penalty flags)
  • Quadrant: Holy Grail — high math complexity, high empirical rigor (effective empirical rigor capped from 9.0)

Why this score: The paper relies on standard regression analysis (OLS) and does not introduce advanced mathematical theory, but demonstrates high empirical rigor by replicating results, discovering data anomalies, extending backtests with new data, and releasing open-source code and datasets.

Research Flowchart

  flowchart TD
  A["Research Goal: Replicate &<br>correct RRS study"] --> B{"Dataset & Code"}
  B --> C["Exact Replication<br>Confirm Mispricing"]
  C --> D{"Check Betting Results"}
  D --发现数据异常 --> E["Identify 'Hercog' Bet<br>Outlier Profits"]
  E --> F["Data Cleaning & Correction"]
  D --无异常 --> C
  F --> G["Revised Outcomes:<br>Profits Vanish"]
  G --> H{"Strategy Check"}
  H --"Competitive" matches<br>still profitable --> I["Key Finding:<br>Market Inefficiency Exists"]
  H --All profits disappear --> J["Key Finding:<br>No Significant Inefficiency"]
  I --> K["Extension: Post-2020 Analysis"]
  J --> K
  K --> L["Results:<br>1. Profits disappear<br>2. Predictors become unreliable"]
  L --> M["Conclusion:<br>Importance of replication<br>& data cleaning"]

Evidence Card

What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card

Proposes

The paper replicates and corrects a prior study, providing a cleaned and extended dataset and re‑evaluating betting strategies.

Source sentence
We present a replication and correction of a recent article (Ramirez, P., Reade, J.J., Singleton, C., Betting on a buzz: Mispricing and inefficiency in online sportsbooks, International Journal of Forecasting, 39:3, 2023, pp. 1413-1423, doi: 10.1016/j.ijforecast.2022.07.011).

Assumes

No explicit assumptions found in the text.

Data

  • tennis-data.co.uk WTA dataset · tennis-data.co.uk alternative public
    July 2015 to August 2023 · WTA matches and players
    Source sentence
    The dataset contains WTA data sourced from tennis-data.co.uk for the period July 2015 to February 2020, inclusive; which includes information on every tennis match

Costs

Not modeled A trading or execution result is reported without costs.

Finds 3

  • After correcting the Hercog error, the competitive Bet365 strategy remains profitable but at a lower rate of 12.44% (down from 29.38%). performance
    Source sentence
    ve, albeit at a much lower rate of 12.44% (previously, reported as 29.38%).
  • Using the cleaned and extended dataset, no further profits are generated after February 2020, suggesting markets have become more efficient. performance
    Source sentence
    we see that no further profits are generated after Feb. 2020.
  • In the extended period (Feb 2020 – Aug 2023) the WikiBuzz and RankDist coefficients are no longer significant (p‑values 0.837 and 0.471). statistical
    Source sentence
    new estimated coefficients for WikiBuzz and RankDist are no longer significant over this period, with respective p-values of 0.837 and 0.471.

Checked by others

No other paper in the archive has been found to support or contradict these findings (compared with 17 related papers). Coverage is partial, so this is neither replication nor refutation.

Code

https://github.com/Faxulous/notFeelingTheBuzz — the authors' own repository

Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.