Paper: arXiv 2404.01338
Authors: Silvia García-Méndez, Francisco de Arriba-Pérez, Ana Barros-Vila, Francisco J. González-Castaño, Enrique Costa-Montenegro
Abstract
Financial news items are unstructured sources of information that can be mined to extract knowledge for market screening applications. Manual extraction of relevant information from the continuous stream of finance-related news is cumbersome and beyond the skills of many investors, who, at most, can follow a few sources and authors. Accordingly, we focus on the analysis of financial news to identify relevant text and, within that text, forecasts and predictions. We propose a novel Natural Language Processing (NLP) system to assist investors in the detection of relevant financial events in unstructured textual sources by considering both relevance and temporality at the discursive level. Firstly, we segment the text to group together closely related text. Secondly, we apply co-reference resolution to discover internal dependencies within segments. Finally, we perform relevant topic modelling with Latent Dirichlet Allocation (LDA) to separate relevant from less relevant text and then analyse the relevant text using a Machine Learning-oriented temporal approach to identify predictions and speculative statements. We created an experimental data set composed of 2,158 financial news items that were manually labelled by NLP researchers to evaluate our solution. The ROUGE-L values for the identification of relevant text and predictions/forecasts were 0.662 and 0.982, respectively. To our knowledge, this is the first work to jointly consider relevance and temporality at the discursive level. It contributes to the transfer of human associative discourse capabilities to expert systems through the combination of multi-paragraph topic segmentation and co-reference resolution to separate author expression patterns, topic modelling with LDA to detect relevant text, and discursive temporality analysis to identify forecasts and predictions within this text.
Complexity vs Empirical Score
- Math Complexity: 3.5/10
- Empirical Rigor: 7.0/10
- Quadrant: Street Traders — empirical and applied, lower math complexity
Why this score: The paper focuses on implementing an NLP pipeline with established models like LDA and machine learning, resulting in moderate empirical rigor due to the detailed experimental setup and evaluation metrics (ROUGE-L, dataset size). Math complexity is low, as it relies on standard probabilistic topic modeling and classification techniques without novel mathematical derivations.
Research Flowchart
flowchart TD
A["Research Goal<br>Automatic detection of relevant info,<br>predictions, and forecasts in financial news"] --> B["Data Input<br>2,158 financial news items<br>(manually labeled)"]
B --> C{"Methodology Pipeline"}
C --> D["Step 1: Topic Segmentation<br>Group closely related text"]
D --> E["Step 2: Co-reference Resolution<br>Discover internal text dependencies"]
E --> F["Step 3: LDA Topic Modelling<br>Detect relevant vs. less relevant text"]
F --> G["Step 4: Temporal Analysis<br>Identify predictions & forecasts<br>within relevant text"]
G --> H["Key Outcomes<br>ROUGE-L Score: 0.662 (Relevance)<br>ROUGE-L Score: 0.982 (Predictions)<br>First work to jointly consider relevance & temporality"]
Evidence Card
What the authors claim, on what data, and who has checked it. Read from the paper's own text by a language model: every quote is verbatim, nothing was re-run. How to read this card
Proposes
The paper proposes a novel NLP system that segments financial news, applies co‑reference resolution, uses LDA topic modelling to detect relevant text, and performs discursive temporality analysis to identify forecasts and predictions.
Source sentence
We propose a novel Natural Language Processing (NLP) system to assist investors in the detection of relevant financial events in unstructured textual sources by considering both relevance and temporality at the discursive level.
Assumes 1
- There is a direct causal relationship between financial news and asset prices. market
Source sentence
Assuming there is a direct causal relationship between financial news and asset prices [17]
Data
- Experimental data set of financial news items text-news unknown
Source sentence
Our experimental data set was composed of 2,158 news pieces (average length of 27.98 sentences and 537.24 words). As previously mentioned, the pieces were automatically extracted with a script from popular and prestigious financial websites between 1st October 2018 and 1st October 2020.
Yahoo Finance
Costs
Not applicable
Finds 3
- The system achieved ROUGE‑L scores of 0.662 for relevant‑text detection and 0.982 for prediction/forecast detection. performance
Source sentence
The rouge-l values for the identification of relevant text and predictions/forecasts were 0.662 and 0.982, respectively.
- The proposed NLP system outperformed a rule‑based baseline system for extracting relevance and temporality from financial news. performance
Source sentence
Our solution outperformed a rule‑based baseline system.
- Inter‑annotator agreement showed mean Alpha‑reliability of 0.552 and accuracy of 0.861, indicating acceptable annotation quality. statistical
Source sentence
The mean values were 0.552 and 0.861, respectively. Previous works have considered an Alpha‑reliability value above 0.41 to be acceptable.
Checked by others
No other paper in the archive has been found to support or contradict these findings (compared with 13 related papers). Coverage is partial, so this is neither replication nor refutation.
1 paper in the archive
Code
No repository by the authors found in the paper.
Extracted 2026-11-14 · same card as JSON · A language model chose these items: check the source sentence before relying on one.
Cited References (71)
- Pre-trained language models to extract information from radiological reports (2021)
- Seeing the wood for the trees: How machine learning can help firms in identifying relevant electronic word-of-mouth in social media (2019) — link
- Text analytics approach to extract course improvement suggestions from students’ feedback (2018) — link
- Web opinion mining (2008) — link
- Deep Learning for Stock Market Prediction Using Event Embedding and Technical Indicators (2018) — link
- Event detection in finance using hierarchical clustering algorithms on news and tweets (2021) — link
- Economic Event Detection in Company-Specific News Text (2018) — link
- Improving text summarization using neuro-fuzzy approach (2017) — link
and 63 more
- Information Extraction. A survey (2005)
- An overview of graph-based keyword extraction methods and approaches (2015)
- LDA Meets Word2Vec (2018) — link
- A multi-layer and multi-ensemble stock trader using deep learning and deep reinforcement learning (2021) — link
- Incomplete multi-view subspace clustering with adaptive instance-sample mapping and deep feature fusion (2021) — link
- An optimal deep learning-based LSTM for stock price prediction using twitter sentiment analysis (2022) — link
- MKPM: Multi keyword-pair matching for natural language sentences (2022) — link
- A new efficient decision making algorithm based on interval-valued fuzzy soft set (2020) — link
- Detection of temporality at discourse level on financial news by combining Natural Language Processing and Machine Learning (2022) — link
- A new graphic kernel method of stock price trend prediction based on financial news semantic and structural similarity (2019) — link
- Investment strategies applied to the Brazilian stock market: A methodology based on Sentiment Analysis with deep learning (2021) — link
- Partially collapsed Gibbs sampling for latent Dirichlet allocation (2019) — link
- PAN-LDA: A latent Dirichlet allocation based novel feature extraction model for COVID-19 data using machine learning (2021) — link
- An overview of online fake news: Characterization, detection, and discussion (2020) — link
- Enhancing Aspect-Based Sentiment Analysis of Arabic Hotels’ reviews using morphological, syntactic and semantic features (2019) — link
- Karcı summarization: A simple and effective approach for automatic text summarization using Karcı entropy (2020) — link
- Extractive Multi-Document Arabic Text Summarization Using Evolutionary Multi-Objective Optimization With K-Medoid Clustering (2020) — link
- Extractive multi-document text summarization using a multi-objective artificial bee colony optimization approach (2018) — link
- Improving Coreference Resolution by Learning Entity-Level Distributed Representations (2016) — link
- Extractive summarization of clinical trial descriptions (2019) — link
- Toward assessing clinical trial publications for reporting transparency (2021) — link
- Online Hate Ratings Vary by Extremes (2019) — link
- Development and accuracy of an artificial intelligence algorithm for acne grading from smartphone photographs (2019) — link
- Assessing the efficacy of a manual‐based intervention for improving the detection of facial pain expression (2019) — link
- Content Analysis: An Introduction to its Methodology (2018) — link
- Latent Dirichlet allocation (LDA) and topic modeling: models, applications, a survey (2019) — link
- Improvement of Text Segmentation TextTiling Algorithm (2020) — link
- Detection of Financial Opportunities in Micro-Blogging Data With a Stacked Classification System (2020) — link
- Identifying Banking Transaction Descriptions via Support Vector Machine Short-Text Classification Based on a Specialized Labelled Corpus (2020) — link
- A systematic review of fundamental and technical analysis of stock market predictions (2020) — link
- NATSUM: Narrative abstractive summarization through cross-document timeline generation (2019) — link
- A Generative Model for category text generation (2018) — link
- Combined deep learning classifiers for stock market prediction: integrating stock price and news sentiments (2021) — link
- Stock market prediction using machine learning classifiers and social media, news (2022) — link
- A review of unsupervised feature selection methods (2020) — link
- COVID-19 Future Forecasting Using Supervised Machine Learning Models (2020) — link
- Whose story is it anyway? Automatic extraction of accounts from news articles (2019) — link
- On temporality in discourse annotation: Theoretical and practical considerations (2017) — link
- SRL-ESA-TextSum: A text summarization approach based on semantic role labeling and explicit semantic analysis (2019) — link
- Natural language based financial forecasting: a survey (2018) — link
- The evolution of argumentation mining: From models to social media and emerging tools (2019) — link
- Asymmetric dependence between stock market returns and news during COVID-19 financial turmoil (2020) — link
- AUSS: An Arabic query-based update-summarization system (2020) — link
- Abstractive summarization: An overview of the state of the art (2019) — link
- Linguistic summarization of fuzzy social and economic networks: an application on the international trade network (2020) — link
- Statistical Features for Extractive Automatic Text Summarization (2020) — link
- Template Based Medical Reports Summarization (2018) — link
- Framing overtourism: a critical news media analysis (2020) — link
- Hyping health effects: a news analysis of the ‘new smoking’ and the role of sitting (2019) — link
- Fake News Analysis Modeling Using Quote Retweet (2019) — link
- NEWS Analysis Towards Youth Financial Competency Management (2018) — link
- Financial news predicts stock market volatility better than close price (2018) — link
- Estimating the impact of domain-specific news sentiment on financial assets (2018) — link
- Deep Learning Based Part-of-Speech Tagging for Malayalam Twitter Data (Special Issue: Deep Learning Techniques for Natural Language Processing) (2019) — link
- Unmasking text plagiarism using syntactic-semantic based natural language processing techniques: Comparisons, analysis and challenges (2018) — link
- Applying Natural Language Processing and Hierarchical Machine Learning Approaches to Text Difficulty Classification (2020) — link
- Augmenting Qualitative Text Analysis with Natural Language Processing: Methodological Study (2018) — link
- Construction site accident analysis using text mining and natural language processing techniques (2019) — link
- Speech Technology Progress Based on New Machine Learning Paradigm (2019) — link
- A new architecture of Internet of Things and big data ecosystem for secured smart healthcare monitoring and alerting system (2018) — link
- An Intelligent Anomaly Detection Scheme for Micro-Services Architectures With Temporal and Spatial Data Analysis (2020) — link
- Textual Analysis in Accounting and Finance: A Survey (2016) — link
- Predicting sentence-level polarity labels of financial news using abnormal stock returns (2020) — link
0 of 71 cited works are in the corpus; resolved via arXiv source bundles, Semantic Scholar and OpenAlex. Corpus-wide: 2596 linked papers.