{"paper_id":"2408.06679","title":"Case-based Explainability for Random Forest: Prototypes, Critics, Counter-factuals and Semi-factuals","authors":["Gregory Yampolsky","Dhruv Desai","Mingshu Li","Stefano Pasquali","Dhagash Mehta"],"paper_date":"2024-08-13","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2408.06679v1","page_url":"https://thequant.space/flowcharts/case-based-explainability-for-random-forest-prototypes-cri/","scores":{"empirical_rigor":6,"math_complexity":7.5,"quadrant":"Holy Grail"},"proposes":{"status":"available","statement":"The paper proposes integrating Random Forest proximities into the Explainable Case-Based Reasoning (XCBR) framework to identify prototypes, critics, semi-factuals, and counter-factuals for explaining RF predictions.","quote":"In the pursuit of refining the capabilities of XCBR for the predictions of RF model, we propose integrating RF proximities into the XCBR framework.","summary":"The explainability of black-box machine learning algorithms, commonly known as Explainable Artificial Intelligence (XAI), has become crucial for financial and other regulated industrial applications due to regulatory requirements and the need for transparency in business practices. Among the…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The extracted Random Forest distance metric is geometry- and accuracy-preserving.","type":"model","stated":"explicit","quote":"By utilizing a recently proposed technique to extract the distance metric learned by Random Forests (RFs), which is both geometry- and accuracy-preserving"},{"assumption":"The datasets used (toy and funds) are representative for evaluating XCBR methods.","type":"data","stated":"implied","quote":"In order to make sure the results are not biased towards one specific type of data, we compiled results from a variety of datasets."}]},"datasets":{"status":"available","items":[{"name":"Diabetes","provider":"public","kind":"other","access":"public","period":null,"universe":null,"quote":"Diabetes: A small tabular dataset of 393 rows and two classes."},{"name":"Blood alcohol","provider":"public","kind":"other","access":"public","period":null,"universe":null,"quote":"Blood alcohol: Larger tabular dataset of 2002 rows. A mixture of numeric and categorical columns."},{"name":"German credit","provider":"public","kind":"other","access":"public","period":null,"universe":null,"quote":"German credit: A dataset with many rows that are a combination of numeric and categorical."},{"name":"MNIST 4&9","provider":"public","kind":"other","access":"public","period":null,"universe":null,"quote":"MNIST 4&9: MNIST dataset from sklearn filtered only for labels 4 and 9."},{"name":"Funds Data","provider":"Morningstar","kind":"fundamentals","access":"commercial","period":"march 2024 snapshot","universe":"4002 funds","quote":"We sourced our data for funds from Morningstar Data warehouse data feed"}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"GAP proximity delivers high-quality results in identifying and distinguishing prototypes and critics across datasets, with prototypes showing lower diversity and critics higher diversity.","kind":"statistical","quote":"These findings lead to the conclusion that GAP proximity delivers high-quality results in identifying and distinguishing prototypes and critics across different various, demonstrating its effectiveness and accuracy."},{"finding":"Semi-factuals generally exhibit higher distance values compared to counter-factuals, confirming expected behavior.","kind":"statistical","quote":"Semi-factuals generally exhibit higher distance values compared to counter-factuals. This aligns with the expectation that semi-factuals are further from the query point"},{"finding":"In the MNIST visualization, the optimal number of prototypes is 2 with an f1 score of 0.997, indicating strong representation of the classes.","kind":"performance","quote":"The f1 score is high, 0.997, indicating that the prototypes effectively represent the data"},{"finding":"Evaluation metrics for funds data show prototypes have lower outlier score (4944 vs 373 for critics) and lower diversity (0.667 vs 4.537 for critics).","kind":"statistical","quote":"... outlier score, diversity, and out-of-distribution (OOD) distance. Specifically, prototypes, which exhibit lower values in these metrics"},{"finding":"The proposed method successfully identifies prototypes, critics, semi- and counter-factuals, demonstrating the utility of GAP proximity for explaining RF predictions.","kind":"theoretical","quote":"various types of explanantia including prototypes, critics, semi- and counter-factuals, which play critical roles in explaining RF outcomes."}],"reported_performance":null,"out_of_sample":{"method":"cross-validation","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":17,"citations":{"cited_by_in_corpus":2,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":2},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:04:20Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}