{"paper_id":"2403.00707","title":"Dimensionality reduction techniques to support insider trading detection","authors":["Adele Ravagnani","Fabrizio Lillo","Paola Deriu","Piero Mazzarisi","Francesca Medda","Antonio Russo"],"paper_date":"2024-03-01","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2403.00707v2","page_url":"https://thequant.space/flowcharts/dimensionality-reduction-techniques-to-support-insider-tradi/","scores":{"empirical_rigor":6,"math_complexity":4,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes an unsupervised machine learning method for contextual anomaly detection using reconstruction-based PCA and autoencoders to support insider trading surveillance.","quote":"We propose an unsupervised machine learning method for contextual anomaly detection, which allows to support market surveillance aimed at identifying potential insider trading activities.","summary":"Identification of market abuse is an extremely complicated activity that requires the analysis of large and complex datasets. We propose an unsupervised machine learning method for contextual anomaly detection, which allows to support market surveillance aimed at identifying potential insider…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Investors’ positions are assumed to be zero at the initial time t0.","type":"data","stated":"explicit","quote":"In the definition of Equation 1, we assume that investors’ positions are null on t0."},{"assumption":"Investors with constant positions (no net trade) are discarded from the analysis.","type":"data","stated":"explicit","quote":"investors with constant positions i.e. investors who do not trade or are strict daily investors (i.e. the number of shares purchased and sold on each day are equal), are discarded."},{"assumption":"Normal observations have low reconstruction error, while anomalies have large reconstruction error.","type":"model","stated":"explicit","quote":"we expect that normal observations have low ϵi, while anomalies have large ϵi;"},{"assumption":"Anomalous investors are substantially less numerous than normal investors.","type":"statistical","stated":"explicit","quote":"assuming they are substantially less numerous than investors with normal behavior."},{"assumption":"The only input to the method is the trading position of each investor on the asset with a price sensitive event.","type":"data","stated":"explicit","quote":"The only input of this method is the trading position of each investor active on the asset for which we have a price sensitive event (PSE)."},{"assumption":"Positions are computed in number of shares rather than monetary value.","type":"data","stated":"explicit","quote":"We also observe that positions are computed using the number of shares and not Euro."}]},"datasets":{"status":"available","items":[{"name":"Investor resolved data of Italian stocks around takeover bids","provider":null,"kind":"other","access":"unknown","period":null,"universe":null,"quote":"as a case study, we apply our method to investor resolved data of Italian stocks around takeover bids."},{"name":"Asset position dataset (shares per investor per day)","provider":null,"kind":"other","access":"unknown","period":null,"universe":null,"quote":"For each investor we extract from the database the asset position (in shares) at the end of each day."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"daily"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Among the first 500 ranked anomalous investors, 451 are also identified by the previous k‑means clustering method, showing high compatibility.","kind":"performance","quote":"Of the first 500 ranked anomalous investors, 451 are also identified by the method based on k-means."},{"finding":"The new dimensionality‑reduction approach can detect anomalous investors independently of the chosen starting point for position computation.","kind":"performance","quote":"Another positive aspect of the new method based on a dimensionality reduction approach is its ability to detect given investors as anomalous, independently of the starting point chosen for the computation of her position"},{"finding":"The method based on PCA does not depend on knowledge of investors’ initial positions, unlike other insider detection methods.","kind":"theoretical","quote":"Finally, it is worth noticing that, compared to other insider detection methods, the one based on PCA does not depend on the knowledge of the initial position of the investors."},{"finding":"Autoencoders can capture investor types not detected by PCA, complementing the detection capability.","kind":"performance","quote":"The ability of autoencoders to capture this type of investors which are not detected by PCA, was already shown in the study related to IMA."}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":20,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:14:03Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}