P-Hacking

Is There a Replication Crisis inFinance? ArXiv ID: ssrn-3774514 “View on arXiv” Authors: Unknown Abstract Several papers argue that financial economics faces a replication crisis because the majority of studies cannot be replicated or are the result of multiple test Keywords: replication crisis, multiple testing, publication bias, p-hacking, Financial Economics Complexity vs Empirical Score Math Complexity: 8.0/10 Empirical Rigor: 9.0/10 Quadrant: Holy Grail Why: The paper employs a complex Bayesian statistical model for joint factor estimation, involving advanced priors and shrinkage methods, indicating high mathematical density. It also demonstrates high empirical rigor through extensive global backtesting on a new large dataset (93 countries) and provides open-source data access, making it highly data and implementation-heavy. flowchart TD A["Research Goal Replicability in Finance?"] --> B["Methodology Replicate 200+ Studies"] A --> C["Data Input Prominent Finance Journals"] B --> D["Computational Process Statistical Test & Meta-Analysis"] C --> D D --> E["Key Findings High Failure Rate Significant Publication Bias"]

Is There A Replication Crisis In Finance? ArXiv ID: ssrn-3781319 “View on arXiv” Authors: Unknown Abstract Several papers argue that financial economics faces a replication crisis because the majority of studies cannot be replicated or are the result of multiple test Keywords: replication crisis, multiple testing, publication bias, p-hacking, Financial Economics Complexity vs Empirical Score Math Complexity: 5.0/10 Empirical Rigor: 8.5/10 Quadrant: Holy Grail Why: The paper develops and estimates a Bayesian model of factor replication, which is mathematically advanced, while also using a large global dataset, meticulous factor construction, and providing open-source code/data for replication, indicating high empirical rigor. flowchart TD A["Research Goal: Assess Replication Rate in Finance"] --> B["Data: SSRN & American Finance Association Publications"] B --> C["Method: Direct Replication Attempts of 28 Studies"] C --> D["Analysis: Test for Publication Bias & p-hacking"] D --> E{"Findings"} E --> F["High Replication Success Rate"] E --> G["No Evidence of Systemic Crisis"] E --> H["Methodological Rigor Improving"]