{"paper_id":"2408.10340","title":"Can an unsupervised clustering algorithm reproduce a categorization system?","authors":["Nathalia Castellanos","Dhruv Desai","Sebastian Frank","Stefano Pasquali","Dhagash Mehta"],"paper_date":"2024-08-19","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2408.10340v1","page_url":"https://thequant.space/flowcharts/can-an-unsupervised-clustering-algorithm-reproduce-a-categor/","scores":{"empirical_rigor":4,"math_complexity":7,"quadrant":"Lab Rats"},"proposes":{"status":"available","statement":"The paper proposes that with appropriate features and a learned distance metric (e.g., supervised Random Forest‑based), an unsupervised clustering algorithm can reproduce ground‑truth classes as distinct clusters.","quote":"we then show that if appropriate features are available in the dataset, and a proper distance metric is known (e.g., using a supervised Random Forest-based distance metric learning method), then an unsupervised clustering can indeed reproduce the ground truth classes as distinct clusters.","summary":"Peer analysis is a critical component of investment management, often relying on expert-provided categorization systems. These systems’ consistency is questioned when they do not align with cohorts from unsupervised clustering algorithms optimized for various metrics. We investigate whether…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The available variables are predictive enough for the ground‑truth labels.","type":"data","stated":"implied","quote":"if the available variables are predictive enough for the ground truth labels and the distance metric is learned using the ground truth labels"},{"assumption":"A proper distance metric can be learned from the ground‑truth labels.","type":"model","stated":"implied","quote":"the distance metric is learned using the ground truth labels with supervised distance metric learning methods such as the Mahalanobis distance metric learning"},{"assumption":"Standard K‑means clustering can be used as the base clustering algorithm.","type":"model","stated":"explicit","quote":"We first use Euclidean distance‑based clustering as our baseline, and then apply supervised distance metric learning with Mahalanobis distance"},{"assumption":"One‑hot encoding and zero imputation for missing categorical values are appropriate preprocessing steps.","type":"data","stated":"explicit","quote":"We one‑hot encoded all the categorical columns before employing any of the algorithms. There were no missing values in the toy datasets. For the fund’s data,"}]},"datasets":{"status":"available","items":[{"name":"Funds (Morningstar)","provider":"Morningstar","kind":"fundamentals","access":"commercial","period":"March 2024 snapshot","universe":null,"quote":"imbalanced distribution, with 14 numerical and 2 categorical variables, for the March 2024 snapshot."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Standard Euclidean K‑means rarely reproduces the number of ground‑truth classes; internal metrics like Inertia and Davies‑Bouldin perform poorly.","kind":"statistical","quote":"Inertia metric and Davies‑Bouldin index showed poor performance rarely reproducing the number of ground truth classes."},{"finding":"Using Mahalanobis distance improves internal metrics; Silhouette Score achieves exact match 53% of the time and discrepancy ≤2 in ~64% of datasets.","kind":"statistical","quote":"Silhouette Score achieved an exact match 53% of the time and a discrepancy of 2 or less in around 64% of the datasets"},{"finding":"RF‑PHATE transformed K‑means further improves matches; external metrics Fowlkes‑Mallows and Rand achieve exact matches around 75% of the time.","kind":"statistical","quote":"the Fowlkes‑Mallows Score and Rand Score both achieved an exact match around 75% of the time"},{"finding":"On the Morningstar fund dataset, advanced distance metrics achieve perfect match for six out of eight external evaluation metrics and are within one class for the remaining two.","kind":"performance","quote":"obtaining the perfect match with the ground truth class count for six out of the eight external evaluation metrics, with the remaining two metrics being only one‑off from the ground truth class count"}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":18,"citations":{"cited_by_in_corpus":2,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":2},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:03:54Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}