Refined and Segmented Price Sentiment Indices from Survey Comments

ArXiv ID: 2411.09937 “View on arXiv”

Authors: Unknown

Abstract

We aim to enhance a price sentiment index and to more precisely understand price trends from the perspective of not only consumers but also businesses. We extract comments related to prices from the Economy Watchers Survey conducted by the Cabinet Office of Japan and classify price trends using a large language model (LLM). We classify whether the survey sample reflects the perspective of consumers or businesses, and whether the comments pertain to goods or services by utilizing information on the fields of comments and the industries of respondents included in the Economy Watchers Survey. From these classified price-related comments, we construct price sentiment indices not only for a general purpose but also for more specific objectives by combining perspectives on consumers and prices, as well as goods and services. It becomes possible to achieve a more accurate classification of price directions by employing a LLM for classification. Furthermore, integrating the outputs of multiple LLMs suggests the potential for the better performance of the classification. The use of more accurately classified comments allows for the construction of an index with a higher correlation to existing indices than previous studies. We demonstrate that the correlation of the price index for consumers, which has a larger sample size, is further enhanced by selecting comments for aggregation based on the industry of the survey respondents.

Keywords: Large Language Models (LLM), Sentiment Index, Natural Language Processing (NLP), Text Classification, Time Series Analysis, Macro/General

Complexity vs Empirical Score

• Math Complexity: 2.5/10
• Empirical Rigor: 7.0/10
• Quadrant: Street Traders
• Why: The paper employs practical, data-driven NLP techniques (LLMs) and focuses on building indices with high empirical validation (correlation metrics against established CPI/PPI), but lacks advanced mathematical derivations or statistical modeling.

  flowchart TD
    A["Research Goal: Enhance price sentiment indices<br>using Economy Watchers Survey comments"] --> B
    
    subgraph B ["Data & Preprocessing"]
        direction LR
        B1["Survey Comments<br>with Industry Metadata"] --> B2["Extract Price-Related Comments"]
    end

    B --> C{"LLM Classification"}
    C --> D["Classify Perspective:<br>Consumer vs. Business"]
    D --> E["Classify Sector:<br>Goods vs. Services"]

    subgraph F ["Sentiment Aggregation"]
        direction LR
        F1["Construct Indices:<br>General, Consumer, Business"] --> F2["Industry-Selection<br>for Consumer Samples"]
    end

    E --> F

    F --> G["Key Findings & Outcomes"]
    G --> H["Higher correlation to<br>existing price indices"]
    G --> I["Potential performance gain<br>via multiple LLM integration"]