{"paper_id":"2408.04948","title":"HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extraction","authors":["Bhaskarjit Sarmah","Benika Hall","Rohan Rao","Sunil Patel","Stefano Pasquali","Dhagash Mehta"],"paper_date":"2024-08-09","paper_type":"empirical","paper_url":"https://arxiv.org/pdf/2408.04948v1","page_url":"https://thequant.space/flowcharts/hybridrag-integrating-knowledge-graphs-and-vector-retrieval/","scores":{"empirical_rigor":7.5,"math_complexity":2,"quadrant":"Street Traders"},"proposes":{"status":"available","statement":"The paper proposes HybridRAG, a combination of Knowledge Graph‑based RAG (GraphRAG) and Vector‑based RAG (VectorRAG) to improve information extraction from financial documents.","quote":"We introduce a novel approach based on a combination, called HybridRAG, of the Knowledge Graphs (KGs) based RAG techniques (called GraphRAG) and VectorRAG techniques to enhance question-answer (Q&A) systems for information extraction from financial documents","summary":"Extraction and interpretation of intricate information from unstructured text data arising in financial applications, such as earnings call transcripts, present substantial challenges to large language models (LLMs) even using the current best practices to use Retrieval Augmented Generation (RAG)…","strategy":null},"assumptions":{"status":"none_found","items":[]},"datasets":{"status":"available","items":[{"name":"Earnings call transcripts of Nifty 50 constituents","provider":"company websites (NIFTY 50 universe)","kind":"text-news","access":"proprietary","period":"quarter ending June 2023 (Q1 FY2024)","universe":"Nifty 50 companies","quote":"... Our dataset encompasses 50 transcripts for this quarter, spanning over 50 companies within Nifty 50 universe"}],"known":[{"id":"the-graph","name":"The Graph (subgraphs)","provider":"The Graph","kind":"crypto-onchain","access":"public","quote":"A subgraph, which consists of these relevant nodes and edges, is extracted from the full KG to provide context.","mentions":2,"used_in":1}],"sample":{"start":null,"end":null,"market":null,"asset_class":null,"frequency":null},"data_resolution":"weekly-monthly"},"transaction_costs":{"status":"not_applicable","modeled":"n/a","headline_net_of_costs":null,"detail":null,"quote":null,"source":"front_matter","rule":"R3","candidates":{"front_matter":"n/a","evidence_card":"n/a","evidence_card_quoted":false},"meaning":"the paper reports no trading or execution result"},"results":{"status":"available","evaluation_type":"forecast-accuracy","findings":[{"finding":"HybridRAG achieves the highest answer relevancy score of 0.96, outperforming VectorRAG (0.91) and GraphRAG (0.89).","kind":"performance","quote":"Answer relevancy scores varied across the methods, with HybridRAG outperforming the others at 0.96, followed by VectorRAG at 0.91, and GraphRAG at 0.89."},{"finding":"HybridRAG and GraphRAG both obtain a faithfulness score of 0.96, slightly higher than VectorRAG's 0.94.","kind":"performance","quote":"In terms of Faithfulness, GraphRAG and HybridRAG demonstrated superior performance, both achieving a score of 0.96, while VectorRAG trailed slightly with a score of 0.94."},{"finding":"HybridRAG attains perfect context recall (1.0) while maintaining high faithfulness, though its context precision is lower (0.79) compared to GraphRAG (0.96).","kind":"performance","quote":"However, in context recall, both VectorRAG and HybridRAG achieved perfect scores of 1, while GraphRAG lagged behind at 0.85."}],"reported_performance":null,"out_of_sample":{"method":"unclear","headline_out_of_sample":null}},"independent_evidence":{"status":"available","supports":[],"contradicts":[],"qualifies":[],"compared_with":11,"citations":{"cited_by_in_corpus":3,"by_independent_authors":3,"how_cited":{"used_as_baseline":0,"uses_method_or_data":1,"extends":0,"discusses_findings":0,"mentions":1,"unclassified":1},"independent_papers":[{"paper":{"paper_id":"2503.05185","title":"Towards Temporal-Aware Multi-Modal Retrieval Augmented Generation in Finance","paper_date":"2025-03-07","authors":["Fengbin Zhu","Junfeng Li","Liangming Pan","Wenjie Wang","Fuli Feng","Chao Wang"],"empirical_rigor":8.5,"page_url":"https://thequant.space/flowcharts/towards-temporal-aware-multi-modal-retrieval-augmented-gener/"},"how":"uses_method_or_data","quote":null}],"scope":"Citations between papers in this corpus only; citations from outside it are not counted."}},"implementation":{"status":"available","public":false,"code_url":null,"note":"No repository presented by the authors as their own was found in the paper. Absence here is not proof that no code exists."},"replication":{"status":"none_found","card":null,"note":"No replication of this paper has been run by thequant.space yet."},"extraction":{"text_source":"fulltext","model":"openai/gpt-oss-120b","version":1,"extracted_at":"2026-11-14T18:04:26Z"},"provenance":{"claims":"Everything here is what the authors state in the paper. Nothing was re-run or reproduced by the platform.","quotes":"Assumptions, datasets, cost detail and findings were extracted by a language model. Every quote is verbatim paper text. Where an item has `support`, \"full\" means every figure in it appears in the quoted sentences and \"partial\" means a figure is stated elsewhere in the paper; items with a figure found nowhere in the paper were discarded.","datasets_known":"datasets.known lists well-known vendors and public datasets by a stable id, found by a dictionary over the full text where the sentence says the data is used; it is independent of the model and covers only names in the dictionary.","flags":"transaction_costs.modeled, results.evaluation_type and results.out_of_sample.method are platform classifications (structured-decision models); see https://thequant.space/score-guide/#penalty-flags","comparisons":"supports / contradicts / qualifies are a language model's reading of two papers' quoted findings, restricted to closely related papers that share no author. They are pointers to read, not verified replications, and coverage is partial.","implementation":"code_url is a repository the paper itself presents as its own (rule-scored, ambiguous cases judged by a model), checked for liveness when it was recorded."},"docs":"https://thequant.space/agents/"}