{"paper_id":"2312.00202","title":"Investigate The ESG Score Methodology","authors":["Zhi Chen"],"paper_date":"2023-11-30","paper_type":"methodological","paper_url":"https://arxiv.org/pdf/2312.00202v2","page_url":"https://thequant.space/flowcharts/investigate-the-esg-score-methodology/","scores":{"empirical_rigor":2,"math_complexity":1,"quadrant":"Philosophers"},"proposes":{"status":"available","statement":"The paper proposes to assess and compare the predictive capabilities of raw ESG variables versus the aggregated ESG scores.","quote":"We aim to assess and compare the predictive capabilities of these raw variables versus the aggregated ESG scores.","summary":"Whether the Refinitiv provide a reliable and trusted methodology in the process of aggregating 10 category scores to overall score?","strategy":null},"assumptions":{"status":"available","items":[{"assumption":"Refinitiv uses the same category weights across years.","type":"model","stated":"implied","quote":"It indicates that the Refinitiv assigned the same weights from year to year."},{"assumption":"Linear regression of overall ESG score on the ten category scores is appropriate.","type":"statistical","stated":"explicit","quote":"Regress overall score on 10 category scores."},{"assumption":"The sample includes only companies in the S&P 500 and Russell 2000 with data from 2002 to 2020.","type":"data","stated":"explicit","quote":"We refined the data to the companies that are included in the Standard & Poor’s 500 and Rusell 2000 with data ranging from 2002-2020."}]},"datasets":{"status":"available","items":[{"name":"Refinitiv ESG dataset","provider":"Refinitiv","kind":"fundamentals","access":"commercial","period":"2002-2020","universe":"S&P 500 and Russell 2000 constituents","quote":"For each company in energy sector, we collect different levels of data: ESG overall score, pillar score, category score, raw data point with data ranging from 2002-2020.","known_id":"refinitiv"}],"known":[{"id":"refinitiv","name":"Refinitiv / LSEG (Datastream, Eikon, Tick History)","provider":"LSEG","kind":"market-prices","access":"commercial","quote":"Among of these companies, we use The Refinitiv Business Classification (TRBC) (i.e., an industry classification system that is owned and operated by Refinitiv.) to break down correlated companies and organizations.","mentions":19,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"weekly-monthly"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"unclear","findings":[{"finding":"Adjusted R-squared values of the regressions are very close to 1, indicating that Refinitiv’s weights are effectively constant over time.","kind":"statistical","quote":"We found that adjusted R-squared of all regression models are very close or equal to 1."},{"finding":"Refinitiv assigns different raw variable weights depending on the company’s sector, e.g., CO2 emissions weigh less for technology firms than for energy firms.","kind":"predictive-accuracy","quote":"Refinitiv weighs certain raw variables as more important depending on a company’s sector/industry."},{"finding":"Some raw variables are collected but remain inactive and are not included in the final ESG score calculation.","kind":"other","quote":"There are also various raw variables that are still collected but remain inactive which means they are not included in the final calculations that eventually accumulate to the total ESG score."}],"reported_performance":null,"out_of_sample":{"method":"none","headline_out_of_sample":null}},"independent_evidence":{"status":"none_found","supports":[],"contradicts":[],"qualifies":[],"compared_with":13,"citations":{"cited_by_in_corpus":0,"by_independent_authors":0,"how_cited":{"used_as_baseline":0,"uses_method_or_data":0,"extends":0,"discusses_findings":0,"mentions":0,"unclassified":0},"independent_papers":[],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:18:20Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}