{"paper_id":"2504.12319","title":"Specialized text classification: an approach to classifying Open Banking transactions","authors":["Duc Tuyen TA","Wajdi Ben Saad","Ji Young Oh"],"paper_date":"2025-04-10","paper_type":"methodological","paper_url":"https://arxiv.org/pdf/2504.12319v1","page_url":"https://thequant.space/flowcharts/specialized-text-classification-an-approach-to-classifying/","scores":{"empirical_rigor":6,"math_complexity":3.5,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes a language‑based Open Banking transaction classification system tailored to French banking text.","quote":"In this paper, we introduce a language-based Open Banking transaction classification system with a focus on the french market and french language text.","summary":"With the introduction of the PSD2 regulation in the EU which established the Open Banking framework, a new window of opportunities has opened for banks and fintechs to explore and enrich Bank transaction descriptions with the aim of building a better understanding of customer behavior, while using…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"The transaction descriptions are in French and can be processed with French‑specific language techniques.","type":"data","stated":"implied","quote":"focus on the french market and french language text"},{"assumption":"A multi‑class classifier can replace pairwise binary classifiers and scale to many categories.","type":"model","stated":"implied","quote":"using a multi-class classifier is a more practical alternative"},{"assumption":"Weighted precision, recall and F1 are appropriate evaluation metrics for the heavily imbalanced dataset.","type":"statistical","stated":"implied","quote":"we employed precision, recall, and F1 metrics using a weighted-average approach"},{"assumption":"TF‑IDF vectorisation and cosine similarity are sufficient to detect similar transaction descriptions at scale.","type":"model","stated":"implied","quote":"transforming the transaction descriptions into vector form using Term Frequency-Inverse Document Frequency (TF-IDF) as terms to identify similar strings"},{"assumption":"The training and test sets (94,356 and 109,509 transactions) are representative of French Open Banking data.","type":"data","stated":"implied","quote":"The data consists of a training set with 94, 356 transactions and a test set with 109, 509 transactions, both from customer accounts of major French banks"}]},"datasets":{"status":"available","items":[{"name":"Open Banking transaction dataset (French customers)","provider":null,"kind":"text-news","access":"proprietary","period":"December 2021 to January 2023","universe":"major French banks customers","quote":"The data consists of a training set with 94, 356 transactions and a test set with 109, 509 transactions, both from customer accounts of major French banks, written mostly in French, from December 2021 to January 2023."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Linear SVM achieves weighted precision, recall and F1 of 90% with 50% of the training data and 94% with 80% of the training data using only transaction descriptions.","kind":"performance","quote":"we observe with only transaction description, the system with Linear SVM model can get the (weighted) precision, recall, and F1 of 90% with only 50% of the training set and 94% with 80% of the training set."},{"finding":"Random Forest with Word2Vec embeddings reaches weighted precision, recall and F1 of 95% on the test set.","kind":"performance","quote":"the training model with Random Forest can get the (weighted) precision, recall, and F1 of 95% in the tests set."},{"finding":"Category‑specific performance is high overall, with the worst results for categories having few training examples (e.g., ADVANCE SALARY F1 83%).","kind":"performance","quote":"The worst performance corresponds to the categories with fewer entries in the training set. In the case of ”GROCERIES”, the classification highly relied on the merchant name which explains the relatively low performance."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":30,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:41:05Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}