{"paper_id":"2411.09937","title":"Refined and Segmented Price Sentiment Indices from Survey Comments","authors":["Masahiro Suzuki","Hiroki Sakaji"],"paper_date":"2024-11-15","paper_type":"survey-review","paper_url":"https://arxiv.org/pdf/2411.09937v2","page_url":"https://thequant.space/flowcharts/refined-and-segmented-price-sentiment-indices-from-survey-co/","scores":{"empirical_rigor":7,"math_complexity":2.5,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes a framework that uses multiple large language models to extract price‑related comments and build segmented price sentiment indices for consumers and corporations, goods and services.","quote":"We propose a framework that integrates multiple LLMs and develops more segmented PSIs from comments classified from the perspectives of consumer and business, goods and services","summary":"We aim to enhance a price sentiment index and to more precisely understand price trends from the perspective of not only consumers but also businesses. We extract comments related to prices from the Economy Watchers Survey conducted by the Cabinet Office of Japan and classify price trends using a…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Comments from the Economy Watchers Survey after 2000 are sufficient for price‑direction analysis, so data from 2001 onward are used.","type":"data","stated":"explicit","quote":"Since the number of respondents in the survey’s starting year (2000) is significantly lower compared to subsequent years, we use data from 2001 onwards. Out of the total 280,825 entries, 67,060 entries are extracted as being related to prices."},{"assumption":"Integrating outputs of multiple LLMs can improve classification performance compared with a single model.","type":"model","stated":"implied","quote":"A slightly better performance is achieved compared to using only a single model by integrating the outputs of multiple models."}]},"datasets":{"status":"available","items":[{"name":"Economy Watchers Survey comments","provider":"Cabinet Office of Japan","kind":"macro","access":"public","period":"2001 onward","universe":null,"quote":"Since the number of respondents in the survey’s starting year (2000) is significantly lower compared to subsequent years, we use data from 2001 onwards. Out of the total 280,825 entries, 67,060 entries are extracted as being related to prices."}],"known":[],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"weekly-monthly"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"Specific PSI shows a correlation with CPI (Services) about 0.04 higher than the General PSI.","kind":"performance","quote":"the correlation between Specific PSI and CPI (Services) is approximately 0.04 higher than that with the General PSI."},{"finding":"General PSI Granger‑causes Core CPI (F=42.616, p=0.0000) while the reverse is not significant.","kind":"statistical","quote":"General PSI Core Core CPI 42.616*** 0.0000"},{"finding":"Segmented PSIs have the highest correlation with three consumer‑related price indices compared to previous studies.","kind":"performance","quote":"showed the highest correlation with the three consumer-related price indices compared to the previous studies"}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":22,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T17:53:47Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}