{"paper_id":"2409.17933","title":"ChatGPT and Corporate Policies","authors":["Manish Jha","Jialin Qian","Michael Weber","Baozhong Yang"],"paper_date":"2024-09-26","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2409.17933v2","page_url":"https://thequant.space/flowcharts/chatgpt-and-corporate-policies/","scores":{"empirical_rigor":8.5,"math_complexity":4.5,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes a firm‑level ChatGPT investment score extracted from earnings call transcripts to measure managers' expected changes in capital expenditures.","quote":"We create a firm-level ChatGPT investment score, based on conference calls, that measures managers' anticipated changes in capital expenditures.","summary":"We create a firm-level ChatGPT investment score, based on conference calls, that measures managers’ anticipated changes in capital expenditures. We validate the score with interpretable textual content and its strong correlation with CFO survey responses. The investment score predicts future…","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Tobin’s q is decomposed into an expected component, a private manager signal, and a random error.","type":"model","stated":"explicit","quote":"We assume that the Tobin’s q consists of several components: qt+1 = qe t + qm t +ϵt+1, where qe t is the expected value of Tobin’s q, qm t is a private signal from the manager, and ϵt+1 is a random component not known to investors or the manager."},{"assumption":"The manager publicly discloses her private signal at the beginning of period t+1 before investment decisions.","type":"model","stated":"explicit","quote":"In the model, the manager publicly discloses her signal qm t at the beginning of period t +1, before investment and dividend decisions are made, which allows the market to update its expectation of qt+1 from qe t to qe t + qm t ."}]},"datasets":{"status":"available","items":[{"name":"Earnings call transcripts","provider":"Seeking Alpha","kind":"text-news","access":"public","period":"2006-2020","universe":"U.S. public firms","quote":"The primary text dataset we use encompasses earnings call transcripts from 2006 to 2020, sourced from the Seeking Alpha website."},{"name":"Duke CFO survey","provider":"Graham and Harvey (2001)","kind":"other","access":"public","period":null,"universe":null,"quote":"We obtain the quarterly Duke CFO survey firm-level data which has been initiated and analyzed in Graham and Harvey (2001)."},{"name":"Compustat","provider":"S&P Global","kind":"fundamentals","access":"commercial","period":null,"universe":null,"quote":"We utilize Compustat and CRSP to obtain corporate accounting variables and stock returns.","known_id":"compustat"},{"name":"CRSP","provider":"Center for Research in Security Prices","kind":"market-prices","access":"commercial","period":null,"universe":null,"quote":"We utilize Compustat and CRSP to obtain corporate accounting variables and stock returns.","known_id":"crsp"}],"known":[{"id":"compustat","name":"Compustat","provider":"S&P Global","kind":"fundamentals","access":"commercial","quote":"Second, we obtain the quarterly Duke CFO survey firm-level data which has been initiated and analyzed in Graham and Harvey (2001).7 Third, we utilize Compustat and CRSP to obtain corporate accounting variables and stock returns.","mentions":4,"used_in":2},{"id":"crsp","name":"CRSP","provider":"Center for Research in Security Prices","kind":"market-prices","access":"commercial","quote":"Second, we obtain the quarterly Duke CFO survey firm-level data which has been initiated and analyzed in Graham and Harvey (2001).7 Third, we utilize Compustat and CRSP to obtain corporate accounting variables and stock returns.","mentions":4,"used_in":2}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"weekly-monthly"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"unclear","findings":[{"finding":"The ChatGPT investment score predicts future capital expenditure for up to nine quarters, even after controlling for Tobin’s q and other determinants.","kind":"predictive-accuracy","quote":"The investment score predicts future capital expenditure for up to nine quarters, controlling for Tobin's $q$ and other determinants, implying the investment score provides incremental information about firms' future investment opportunities."},{"finding":"A one‑standard‑deviation increase in the investment score is associated with a −1.83% raw return and similar negative abnormal returns over the next quarter.","kind":"negative","quote":"A one-standard-deviation increase in the investment score corresponds to −1.83%,−1.49%, and −1.42% in raw returns, FF5-adjusted returns, and q5-adjusted returns in the quarter subsequent to the earnings call, respectively."},{"finding":"The negative association between the investment score and future abnormal returns persists for up to nine quarters, with average quarterly impacts of about −1.5% (q5‑adjusted) and −1.1% (FF5‑adjusted).","kind":"negative","quote":"On average, a one-standard-deviation increase in the investment score leads to a change of −1.54% in annualized q5-adjusted returns for each quarter n = 2 to 10, and −1.10% in annualized FF5-adjusted return for each quarter n = 2 to 6, respectively."},{"finding":"The investment score is positively associated with cumulative abnormal returns in the short‑term windows [0,1], [0,3] and [0,5], yielding about a 0.6% increase per standard‑deviation.","kind":"performance","quote":"Economically, a one-standard-deviation increase in the investment score leads to an increase of around 0.6% cumulative abnormal return."},{"finding":"ChatGPT can also be applied to extract expectations about other corporate policies such as dividends and hiring.","kind":"other","quote":"The methodology we develop, however, can be equally applied to extract firms’ expectations about other corporate policies. We consider two important discretionary policies: dividend payment and hiring."}],"reported_performance":null,"out_of_sample":{"method":"holdout","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[],"compared_with":18,"citations":{"cited_by_in_corpus":8,"by_independent_authors":7,"how_cited":{"used_as_baseline":0,"uses_method_or_data":1,"extends":0,"discusses_findings":1,"mentions":4,"unclassified":2},"independent_papers":[{"paper":{"paper_id":"2512.23847","title":"A Test of Lookahead Bias in LLM Forecasts","paper_date":"2025-12-29","authors":["Zhenyu Gao","Wenxi Jiang","Yutong Yan"],"empirical_rigor":7,"page_url":"https://thequant.space/flowcharts/a-test-of-lookahead-bias-in-llm-forecasts/"},"how":"discusses_findings","quote":"Our second application follows [CITED] and uses earnings-call transcripts to predict capital expenditures two quarters ahead. The pattern is qualitatively the same. The baseline LLM signal predicts future capex..."},{"paper":{"paper_id":"2508.21285","title":"A Financial Brain Scan of the LLM","paper_date":"2025-08-29","authors":["Hui Chen","Antoine Didisheim","Mohammad","Pourmohammadi","Luciano Somoza","Hanqing Tian"],"empirical_rigor":6,"page_url":"https://thequant.space/flowcharts/a-financial-brain-scan-of-the-llm/"},"how":"uses_method_or_data","quote":null}],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:01:30Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}