Reading News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns
ORIGINAL / Reading the News Without Hindsight: NoLBERT Topics and the Cross-Section of Stock Returns
The study addresses hindsight bias in financial news language models, which often train on text overlapping the test period, and proposes NoLBERT—pretrained only on 1976-1995 text—to construct news topics. It compares topic extractors on 1.26 million articles from 2012 to 2024 for predicting U.S. stock returns, systematically testing the feasibility and stability of hindsight-free topic extraction and highlighting the role of the attention-shock measurement window.
01 ABSTRACT
The study uses NoLBERT, an encoder pretrained only on 1976-1995 text and contrastively fine-tuned into a sentence encoder, to generate news topics and build attention shocks and stock exposures for forecasting returns of the 1,000 largest U.S. stocks. Models are fitted on 2013-2019, validated on 2020-2021, and tested on 2022-2024; the best validation model loses money at every rebalancing frequency, and extending the attention-shock reference window from 5 to 63 trading days raises test rank IC for all readers. NoLBERT produces the most stable topics and forecasts about as well as LDA; an equal-weight combination of all readers and models earns a monthly net Sharpe ratio of 1.12, significant against zero before search adjustment but not against a price-only benchmark.
02 KEY FINDINGS
- The model with the best validation score loses money out-of-sample (2022-2024) at every rebalancing frequency, suggesting validation-based selection may not generalize.
- Changing the attention-shock reference window from 5 trading days to the past 63 trading days raises test rank IC for all topic extractors (LDA, MiniLM, FinBERT, NoLBERT).
- NoLBERT yields the most stable topics and forecasts about as well as LDA; the equal-weight combination of all models and readers has a monthly net Sharpe of 1.12 but is not significant relative to a price-only benchmark.
AI GENERATED SUMMARY / DISCOVERED BY ARXIV CS.CL · ARXIV CS.LG · ARXIV Q-FIN