{"paper_id":"2308.00065","title":"FinPT: Financial Risk Prediction with Profile Tuning on Pretrained Foundation Models","authors":["Yuwei Yin","Yazheng Yang","Jian Yang","Qi Liu"],"paper_date":"2023-07-22","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2308.00065v1","page_url":"https://thequant.space/flowcharts/finpt-financial-risk-prediction-with-profile-tuning-on-pret/","scores":{"empirical_rigor":8,"math_complexity":2.5,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes FinPT, a novel profile tuning method for financial risk prediction, and FinBench, a benchmark dataset collection.","quote":"To tackle these issues, we propose FinPT and FinBench: the former is a novel approach for financial risk prediction that conduct Profile Tuning on large pretrained foundation models, and the latter is a set of high-quality datasets on financial risks such as default, fraud, and churn.","summary":"Financial risk prediction plays a crucial role in the financial sector. Machine learning methods have been widely applied for automatically detecting potential risks and thus saving the cost of labor. However, the development in this field is lagging behind in recent years by the following two…","strategy":null},"assumptions":{"status":"none_found","items":[]},"datasets":{"status":"available","items":[{"name":"cd1 dataset","provider":"Kaggle","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"cd1 dataset 4 comprises data on thousands of clients from a financial institution, including their random identification numbers, banking default status, loan types, gender, age, education, income, credit scores, and other related information.","known_id":"kaggle"},{"name":"cd2 dataset","provider":"Kaggle","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"cd2 dataset 5 consists of credit card client information from April 2005 to September 2005 in Taiwan, encompassing default payments, demographic factors, credit data, history of payment, and bill statements.","known_id":"kaggle"},{"name":"ld1 dataset (The Home Equity dataset, HMEQ)","provider":"Kaggle","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"ld1 dataset 6 (The Home Equity dataset, HMEQ) comprises detailed records for home equity loans, including a binary target variable that indicates whether an applicant defaulted or was seriously delinquent.","known_id":"kaggle"},{"name":"ld2 dataset","provider":"Kaggle","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"ld2 dataset 7 contains tens thousands of different types of loan records with features like age, annual income, employment length (in years), home ownership, loan intent, loan amount, interest rate, historical default, and credit history length, etc.","known_id":"kaggle"},{"name":"ld3 dataset","provider":"Kaggle","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"ld3 dataset 8 consists of more than 200K records on vehicle loan, providing information regarding the loan, loanee, and loan history.","known_id":"kaggle"},{"name":"cf1 dataset","provider":"Kaggle","kind":"benchmark","access":"public","period":null,"universe":null,"quote":"cf1 dataset 9 summarizes the usage patterns exhibited by numerous credit card users over a period of six months.","known_id":"kaggle"}],"known":[{"id":"kaggle","name":"Kaggle","provider":"Kaggle","kind":"other","access":"public","quote":"Specifically, we collect hundreds of financial datasets from the Kaggle platform and then screen out ten high-quality datasets on three common financial risks, including default, fraud, and churn.","mentions":2,"used_in":2}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"unclear"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"FinPT outperforms tree-based methods and previous neural models on average F1-score across FinBench datasets, especially when fully fine-tuning large foundation models like GPT-2, T5, and Flan‑T5.","kind":"predictive-accuracy","quote":"On average, FinPT outperforms tree-based methods and previous neural models by a large margin, especially when we apply FinPT to fully fine-tune large foundation models such as GPT-2, T5, and Flan‑T5."},{"finding":"Flan‑T5 is the best backbone for FinPT, achieving the highest F1-scores on eight datasets, demonstrating the benefit of instruction tuning and scaling.","kind":"performance","quote":"When fine-tuning all the parameters on foundation models, Flan‑T5 is the best backbone model for our FinPT approach. It performs the best among all models in eight datasets, showing the extraordinary capacity to predict financial risks."},{"finding":"GPT‑2 consistently outperforms BERT models by a large margin in FinPT, indicating decoder‑only Transformers can be better classifiers for this task.","kind":"performance","quote":"Also, we find GPT‑2 consistently outperforms BERT models by a large margin, demonstrating that the decoder-only Transformer model using last-token hidden-states prediction can be a better classifier than the encoder-only model using last-layer hidden-states…"}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":19,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":true,"code_url":"https://github.com/YuweiYin/FinPT","note":null},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:24:22Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}