{"paper_id":"2310.12428","title":"Enhanced Local Explainability and Trust Scores with Random Forest Proximities","authors":["Joshua Rosaler","Dhruv Desai","Bhaskarjit Sarmah","Dimitrios Vamvourellis","Deran Onay","Dhagash Mehta","Stefano Pasquali"],"paper_date":"2023-10-19","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2310.12428v3","page_url":"https://thequant.space/flowcharts/enhanced-local-explainability-and-trust-scores-with-random-f/","scores":{"empirical_rigor":7,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes a proximity‑based explainability method for random forests that generates trust scores and complements SHAP by using GAP proximities to assess out‑of‑sample performance.","quote":"We initiate a novel approach to explain the predictions and out of sample performance of random forest (RF) regression and classification models by exploiting the fact that any RF can be mathematically formulated as an adaptive weighted K nearest-neighbors model.","summary":"We initiate a novel approach to explain the predictions and out of sample performance of random forest (RF) regression and classification models by exploiting the fact that any RF can be mathematically formulated as an adaptive weighted K nearest-neighbors model. Specifically, we employ a recent…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Random forest predictions can be exactly expressed as a weighted sum of training targets using RF proximities.","type":"model","stated":"explicit","quote":"any RF prediction can be rewritten exactly as a weighted sum of the training targets, where the weights are RF proximities between the corresponding pairs of data points."},{"assumption":"The training data is a random sub‑sample of 10,000 trades to enable faster computation of the proximity matrix.","type":"data","stated":"explicit","quote":"To enable faster computation of the proximity matrix, the model was trained on a random sub‑sample of 10,000 trades."},{"assumption":"Hyperparameter tuning uses 5‑fold walk‑forward expanding‑window time series cross‑validation.","type":"statistical","stated":"explicit","quote":"Hyperparameter tuning was performed using 5-fold walk-forward, expanding-window time series cross validation with randomized grid search over sklearn’s RF regressor max_depth, max_features, min_samples_leaf, and n_estimators parameters."},{"assumption":"Out‑of‑sample performance is evaluated on three months following the nine‑month training period.","type":"data","stated":"explicit","quote":"The model is trained on 9 months of public trade data for US investment grade (IG) and high yield (HY) corporate bonds, from Aug. 1 2022 to April 30 2023, and tested on the following three months."}]},"datasets":{"status":"available","items":[{"name":"FINRA TRACE dataset","provider":"FINRA","kind":"market-prices","access":"public","period":"Aug. 1 2022 to April 30 2023","universe":"US investment grade and high yield corporate bonds","quote":"The trade data on which the model was trained was taken from the publicly available FINRA TRACE dataset, while the quotes were drawn from internal fixed income quote data."},{"name":"Internal fixed income quote data","provider":null,"kind":"market-prices","access":"proprietary","period":null,"universe":null,"quote":"while the quotes were drawn from internal fixed income quote data."},{"name":"Internal bond fundamentals data","provider":null,"kind":"fundamentals","access":"proprietary","period":null,"universe":null,"quote":"Bond characteristics such as sector, industry, ticker, duration, option-adjusted spread, rating, and maturity were also drawn from internal data sources."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"intraday-bars"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R1","candidates":{"front_matter":"n/a","evidence_card":"unclear","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"The RF model improves RMSE by 9.07% over the coarse initial estimate, with test RMSE .356 versus .392 for the baseline.","kind":"predictive-accuracy","quote":"Out of sample, the price estimate generated by the RF model showed a 9.07% improvement in RMSE over the preliminary coarse estimate"},{"finding":"On average only about 1/15 of the training set contributes significantly to each RF prediction.","kind":"statistical","quote":"On average, only 1/15 of the the total training set contributes to the RF model’s prediction."},{"finding":"Approximately 500 nearest neighbors (out of 7,500 trades) are sufficient to recover the original RF prediction to close precision.","kind":"statistical","quote":"In Figure 1, we see that on average, only about 500 nearest neighbors out of the full training set of 7500 trades are needed to recover the original RF model prediction to close precision."},{"finding":"Higher proximity‑weighted training MAE correlates with larger out‑of‑sample prediction errors, providing a trust score.","kind":"performance","quote":"The monotonic relationship indicates that higher proximity-weighted training error can help to explain why the model prediction was more likely to be off."},{"finding":"The proximity‑based explanations complement SHAP by identifying cases where the model is likely to be off due to target variability or data sparsity.","kind":"theoretical","quote":"Proximities identify cases where the model is more likely to be off, either because the target variable shows greater variability and uncertainty in the region around the test point, or because the data is relatively sparse."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":30,"citations":{"cited_by_in_corpus":1,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":1},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:20:34Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}