LabelFusion-TS: Fusing Large Language Models, Transformer Encoders, and Financial Time Series for Monetary-Policy Stance Classification

arXiv cs.CL Papers

Summary

This paper introduces LabelFusion-TS, which fuses a fine-tuned RoBERTa encoder, a prompted LLM, and time-series transformers over market data to classify Federal Reserve communication as hawkish, dovish, or neutral. The fused system achieves 70.2% weighted F1, outperforming a zero-shot LLM and showing early evidence that market time series help financial text classification.

arXiv:2608.11753v1 Announce Type: new Abstract: Financial text is produced and interpreted within a market environment, yet financial text classifiers almost always receive text alone. We study whether financial time series are useful as an additional input on the task of classifying sentences from Federal Reserve communication as hawkish, dovish, or neutral. Our system, \lfts{}, extends the \lf{} architecture with this modality: a small voting network combines three independently trained components, a fine-tuned RoBERTa encoder, a prompted large language model (LLM), and a fused ensemble of time-series transformers over the market series of the months preceding publication. Because only about a thousand annotated sentences are available for training, the RoBERTa encoder is first pre-trained on sentences annotated automatically by the LLM and only then fine-tuned on the human labels. Trained on Federal Open Market Committee (FOMC) communication up to 2015 and evaluated on 2015--2022, the fused system achieves 70.2\% weighted F1 -- against 64.1\% for the zero-shot LLM -- and overtakes it with as few as 240 human-labelled sentences. We take this as initial evidence for market time series as an input modality in financial text classification.
Original Article
View Cached Full Text

Cached at: 08/13/26, 03:28 PM

# Fusing Large Language Models, Transformer Encoders,and Financial Time Series for Monetary-Policy Stance Classification
Source: [https://arxiv.org/html/2608.11753](https://arxiv.org/html/2608.11753)
Fabian Lukassen Christoph WeisserAffiliation:Centre for Statistics, Georg\-August\-Universität Göttingen, GermanyAffiliation:Hochschule Bielefeld \(HSBI\) \- University of Applied Sciences and Arts, Bielefeld, Germanymichael\.schlee@uni\-goettingen\.de,fabian\.lukassen@uni\-goettingen\.de,christoph\.weisser@hsbi\.de

###### Abstract

Financial text is produced and interpreted within a market environment, yet financial text classifiers almost always receive text alone\. We study whether financial time series are useful as an additional input on the task of classifying sentences from Federal Reserve communication as hawkish, dovish, or neutral\. Our system, LabelFusion\-TS, extends the LabelFusion architecture with this modality: a small voting network combines three independently trained components, a fine\-tuned RoBERTa encoder, a prompted large language model \(LLM\), and a fused ensemble of time\-series transformers over the market series of the months preceding publication\. Because only about a thousand annotated sentences are available for training, the RoBERTa encoder is first pre\-trained on sentences annotated automatically by the LLM and only then fine\-tuned on the human labels\. Trained on Federal Open Market Committee \(FOMC\) communication up to 2015 and evaluated on 2015–2022, the fused system achieves 70\.2% weighted F1 – against 64\.1% for the zero\-shot LLM – and overtakes it with as few as 240 human\-labelled sentences\. We take this as initial evidence for market time series as an input modality in financial text classification\.

## 1Introduction

Financial language is produced and interpreted within a quantitative environment\. A reader who assesses a central\-bank statement, an earnings release, or a news report does so with the recent behaviour of interest rates, inflation, and asset prices in view, and identical wording can support different readings depending on that background\. Market data are also unusually convenient as a model input: they are public, machine\-readable, available at daily or finer resolution over several decades, and aligned in time with any dated document\. Classification models in financial natural language processing, nevertheless, operate almost exclusively on text\. Where the two data types are combined, the direction of use is typically the reverse of the one studied here, with textual features added to numerical models to improve forecasts of prices or volatility\([9](https://arxiv.org/html/2608.11753#bib.bib10);[3](https://arxiv.org/html/2608.11753#bib.bib11)\); market series as input to text classifiers remain little explored\.

![Refer to caption](https://arxiv.org/html/2608.11753v1/fig_motivation.png)Figure 1:The same sentence under two market regimes\. Whether*“the Committee will act as appropriate”*announces further tightening or continued easing is not decided by the words but by the environment they are spoken into; the market series preceding the document carry exactly this information\.A step towards using both sources is the LabelFusion architecture of[7](https://arxiv.org/html/2608.11753#bib.bib1), which fuses a prompted large language model with a fine\-tuned transformer encoder for financial news classification\. The architecture was designed to accommodate additional input sources, and the paper closes by proposing price time series as the next modality\. The present work carries out this proposal\.

We evaluate it on monetary\-policy stance classification\([8](https://arxiv.org/html/2608.11753#bib.bib2)\), where sentences from Federal Reserve communication are labelled hawkish, dovish, or neutral\. The task suits a first test of the modality: central\-bank language is deliberately hedged, so that a sentence such as*“the Committee will act as appropriate”*is read differently in a tightening than in an easing cycle \(Figure[1](https://arxiv.org/html/2608.11753#S1.F1)\), and every sentence originates from a dated public document, so the market data of the months before it can be attached without further assumptions\. Our fused system exceeds a zero\-shot large language model when trained on past communication and tested on future statements\.

Our contributions are:

1. 1\.LabelFusion\-TS, a recipe for extending intermediate fusion in financial text classification with further input modalities, instantiated here for financial time series\.
2. 2\.Initial empirical evidence that financial time series can provide context for the classification of financial text across varying data availability regimes\.

## 2Related Work

### LabelFusion\.

Given a textxx, LabelFusion\([7](https://arxiv.org/html/2608.11753#bib.bib1)\)obtains label scoresz=fLLM​\(x\)z=f\_\{\\mathrm\{LLM\}\}\(x\)from a prompted LLM and a contextual embeddingh=fRB​\(x\)h=f\_\{\\mathrm\{RB\}\}\(x\)from a fine\-tuned RoBERTa encoder and fuses them with a small MLP,y^=fMLP​\(\[h;z\]\)\\hat\{y\}=f\_\{\\mathrm\{MLP\}\}\(\[\\,h;z\\,\]\)\. Since views are combined as representations rather than as raw features or as separate decisions, this is a hybrid fusion in the taxonomy of[1](https://arxiv.org/html/2608.11753#bib.bib8)\. On Reuters\-21578, the fusion beats the standalone LLM and RoBERTa classifiers in the full\-data regime, while the prompted LLM dominates in the low\-data regime\. We keep this design unchanged and add one expert\.

### Monetary\-policy stance classification\.

[8](https://arxiv.org/html/2608.11753#bib.bib2)built the benchmark we use: sentences from FOMC meeting minutes, press\-conference transcripts, and speeches \(1996–2022\), labelled hawkish, dovish, or neutral by trained annotators, with baselines up to fine\-tuned RoBERTa\-large and zero\-shot ChatGPT\. To our knowledge, no published work uses market data as an*input*to stance classification; the connection between central\-bank communication and markets is otherwise well documented\([10](https://arxiv.org/html/2608.11753#bib.bib5);[2](https://arxiv.org/html/2608.11753#bib.bib6)\)\.

### Time series, text, and distillation\.

Purpose\-built series encoders such as PatchTST\([6](https://arxiv.org/html/2608.11753#bib.bib4)\)treat a time series as a sequence of patches, which suits short fixed windows; the multimodal literature predominantly uses text to help forecast series, whereas we use series to help classify text\. Our silver\-label stage follows knowledge distillation\([4](https://arxiv.org/html/2608.11753#bib.bib7)\)in its self\-training form\(xie2020self\): the LLM acts as a free annotator of in\-domain unlabelled text, producing silver pseudo\-labels for the student; unlike Xie et al\., where injected noise lets the student surpass the teacher, in our setting a subsequent gold fine\-tuning stage plays this role\."

## 3Data and Task

### Benchmark\.

The benchmark of[8](https://arxiv.org/html/2608.11753#bib.bib2)covers three forms of Federal Reserve communication published between 1996 and 2022: the minutes of FOMC meetings, the transcripts of post\-meeting press conferences, and speeches by members of the Board\. Trained annotators assigned every sentence the policy direction it signals, hawkish for a tightening of monetary policy, dovish for an easing, and neutral otherwise\. The combined release contains 2,379 annotated sentences, of which 2,312 remain after duplicates and the few sentences with conflicting annotations are removed\. Neutral is the largest class \(48%\), followed by dovish \(27%\) and hawkish \(25%\)\. The task is a single\-label three\-class classification of one sentence at a time; Appendix[A](https://arxiv.org/html/2608.11753#A1)shows examples\.

### Metric\.

Following the benchmark, we report weighted F1, the class\-wise F1 scores averaged with weights proportional to how often each class occurs in the test set, and

F1w=∑cncN⋅2​Pc​RcPc\+Rc,\\mathrm\{F1\_\{w\}\}\\;=\\;\\sum\_\{c\}\\frac\{n\_\{c\}\}\{N\}\\cdot\\frac\{2P\_\{c\}R\_\{c\}\}\{P\_\{c\}\+R\_\{c\}\},\(1\)wherePcP\_\{c\}andRcR\_\{c\}are the precision and recall of classcc,ncn\_\{c\}is the number of test sentences carrying that class andNNthe size of the test set\. The measure therefore rewards precision and recall on every class, but the frequent neutral class dominates the average, unlike the macro average, which weights all three classes equally\.

### Sentence dates\.

The published sentences state only the year of the document they come from, while both parts of our setup require the exact day of publication: the evaluation splits the data chronologically, and the system pairs every sentence with market data from the period preceding its publication \(§[4](https://arxiv.org/html/2608.11753#S4)\)\. The documents themselves are published with their dates in the benchmark’s repository, which allows the missing date to be recovered by locating the document from which a sentence originates: first by exact match against the sentence lists of the individual documents and for the remaining cases by searching for the normalised sentence in the raw document text\. Sentences found in documents of more than one date, mostly formulaic passages that recur across meetings, and sentences found in no document are excluded\. The procedure dates 1,692 sentences, or 73% of the benchmark, with a class distribution close to that of the full release; Appendix[B](https://arxiv.org/html/2608.11753#A2)gives the details\.

### Evaluation protocol\.

We split the dated sentences by time: the 1,274 sentences up to September 2015 are used for training, with the most recent 15% held out for model selection, and the 418 sentences from 2015–2022 form the test set\. September 2015 serves as the cut\-off throughout the paper\. The chronological split mirrors deployment, where a model trained on past communication reads future statements, and prevents the leak a random split would allow: sentences from the same period appearing on both sides and revealing the prevailing conditions\. A further 96 benchmark sentences occur only in documents published in 2014 or earlier; their exact day is unknown, but they precede the cut\-off with certainty, and we use them as additional training sentences for the sentence encoder \(§[4](https://arxiv.org/html/2608.11753#S4)\), the one component that operates on text alone and needs no date\.

### Market context\.

For each sentence, we build a window of six daily series over the 126 business days ending the day*before*its document date: the federal funds rate, the 2\-year Treasury yield, the yield\-curve slope, the log equity index, CPI year\-over\-year inflation, and the unemployment rate, each expressed as its change since the window start\. All series are public \(FRED\)\. The window ends before the document date, and the macro releases enter with a 45\-day publication lag, so it contains only what markets actually knew at the time\.

### Automatically annotated sentences\.

Expert annotation covers only a fraction of the available text: the training\-period documents contain roughly ten times as many sentences as the benchmark annotates\. We label 13,017 of them with a prompted LLM, using the prompt of[8](https://arxiv.org/html/2608.11753#bib.bib2)\(Appendix[D](https://arxiv.org/html/2608.11753#A4)\) – the same model that is also one of the three classifiers our system combines \(§[4](https://arxiv.org/html/2608.11753#S4)\)\. These*silver labels*are used for a single purpose: pre\-training the sentence encoder \(§[4](https://arxiv.org/html/2608.11753#S4)\)\. The selection excludes benchmark sentences, duplicates, and any sentence with word overlap above0\.850\.85with a test sentence, so no test material enters pre\-training\.

## 4LabelFusion\-TS

![Refer to caption](https://arxiv.org/html/2608.11753v1/gfx/model_architecture.png)Figure 2:LabelFusion\-TS\. Three experts are trained independently and frozen: a RoBERTa encoder \(pre\-trained on LLM\-annotated silver sentences, fine\-tuned on gold\), a prompted LLM voting zero\-shot, and a small time\-series transformer reading the market window of the sentence’s document\. A voting MLP combines the three views, exactly as in LabelFusion with one additional input\.LabelFusion\-TS keeps the recipe of LabelFusion: Three specialised models, called experts in the following, are trained on the task individually, then frozen, and a small voting network is trained separately on their output \(Figure[2](https://arxiv.org/html/2608.11753#S4.F2)\)\. Afterwards, we compare LabelFusion\-TS with a baseline model, the so\-called market expert, which is a standard Transformer encoder\([11](https://arxiv.org/html/2608.11753#bib.bib9)\)trained from scratch\.

### Text expert\.

RoBERTa\-large\([5](https://arxiv.org/html/2608.11753#bib.bib3)\)is trained in two stages\. First, a silver stage: two epochs on the 13k LLM\-annotated training\-era sentences, which teaches the encoder the task’s shape from plentiful but imperfect labels\. Then a gold stage: standard fine\-tuning on the human\-labelled training sentences plus the 96 recovered undated ones\. Its CLS embeddingh∈ℝ1024h\\in\\mathbb\{R\}^\{1024\}represents the sentence, as in LabelFusion\.

### LLM expert\.

An instruction\-tuned open LLM,gemma4:31bat temperature 0, classifies each sentence zero\-shot with the classification prompt that[8](https://arxiv.org/html/2608.11753#bib.bib2)used for ChatGPT, reproduced in Appendix[D](https://arxiv.org/html/2608.11753#A4); its vote is encoded asz∈\{0,1\}3z\\in\\\{0,1\\\}^\{3\}\. The same model with the same prompt produces the silver labels of §[3](https://arxiv.org/html/2608.11753#S3)\.

### Fusion\.

With all experts frozen, a voting MLP with one hidden layer combines the three views of a sentence,

y^=fMLP​\(\[h;z;m\]\)∈\[0,1\]3,\\hat\{y\}\\;=\\;f\_\{\\mathrm\{MLP\}\}\\big\(\\big\[\\,h;\\;z;\\;m\\,\\big\]\\big\)\\;\\in\\;\[0,1\]^\{3\},\(2\)which is LabelFusion’s fusion with one added input; removingmmrecovers LabelFusion exactly\. Training involves random initialisation at three places, in the text expert, the market expert, and the voting network\. To make the results independent of any particular draw, every component is trained with three different random seeds and all3×3×3=273\\times 3\\times 3=27combinations are evaluated\. We report their mean and, in addition, a*probability ensemble*that averages, per sentence, the class distributions predicted by the 27 systems and can be deployed as a single classifier\.

## 5Results

Table[1](https://arxiv.org/html/2608.11753#S5.T1)reports the time\-split evaluation\. The market expert alone reaches 37\.3%\. The text expert reaches 66\.1% and already exceeds the zero\-shot LLM \(64\.1%\) whose silver labels it was pre\-trained on\. The full fusion reaches 67\.4% on average, with all 27 seed combinations above the LLM, and the probability ensemble of the 27 systems reaches 70\.2%, ahead of every individual component\.

wF1 \(%\)market expert alone37\.3LLM zero\-shot64\.1RoBERTa\-large, silver→\\rightarrowgold66\.1LabelFusion\-TS \(ours\), mean of 27 runs67\.4LabelFusion\-TS \(ours\), probability ensemble70\.2

Table 1:Stance classification on the time\-split test set \(418 sentences from 2015–2022; models trained on sentences up to 2015\)\. Weighted F1 in percent, following the benchmark’s metric; means are over all seed combinations of the trained components\.Table[2](https://arxiv.org/html/2608.11753#S6.T2)reports the amount of human labelling required by the system\. LabelFusion\-TS overtakes zero\-shot LLM at roughly 20% of the training pool \(≈\\approx240 sentences\) and remains above it for 100%, while the LLM row remains constant by construction\.[7](https://arxiv.org/html/2608.11753#bib.bib1)report a crossover only after the majority of a substantially larger training set\."

## 6Discussion

### Why market context can help\.

The market–label connection is visible before any model is trained: grouping training\-year sentences by the federal\-funds\-rate move over the preceding 126 business days, 66% are hawkish when the rate rose by at least 10 basis points, versus only 38% when it fell as much\. Hedging often leaves the words alone underdetermined;*“act as appropriate”*\(Table[3](https://arxiv.org/html/2608.11753#A1.T3)\) appears in a dovish 2019 sentence and a neutral 2000 one\. A text\-only model under a chronological split cannot observe the test period’s environment, while the market window supplies it at test time by construction\. This also explains why the market expert is weak alone \(37\.3%\): all sentences of a document share one window, so it contributes to the environment rather than an independent judgement, useful only in combination with the text views\. The same logic should extend to other tasks whose label semantics shift with the economic environment, such as sentiment or risk classification across volatility regimes\.

gold labelsLabelFusion\-TSRoBERTaMarketLLM5%\(59\)63\.461\.936\.164\.110% \(119\)62\.863\.935\.664\.120% \(236\)66\.366\.338\.464\.140% \(471\)68\.165\.437\.664\.160% \(710\)67\.865\.141\.064\.180% \(945\)69\.767\.438\.764\.1100% \(1181\)70\.266\.137\.364\.1

Table 2:Label\-budget sweep: weighted F1 \(%\) as a function of the number of gold\-labelled training sentences\. Silver labels and the market expert’s rate\-cycle pre\-training are label\-free and constant across rows\. LabelFusion\-TS is the probability ensemble; RoBERTa and the market expert are means over their three seeds; the zero\-shot LLM uses no training data and is constant\.

## 7Conclusion & Limitations

Financial text classifiers routinely ignore an input every human analyst consults: the market context\. Adding it as an additional expert to an existing fusion architecture, trained with silver labels from the fusion’s own LLM and evaluated on a train\-on\-the\-past, test\-on\-the\-future protocol, beats a modern zero\-shot LLM with as few as∼240\{\\sim\}240human labels, and a simple seed\-grid ensemble adds another three points\. Components weak alone can be strong together, and the market time series is a cheap, public, time\-aligned signal that there is little reason to keep leaving out\. The study is limited to one task and benchmark, a seven\-year test span dominated by two unusual regimes, a recovered date subset \(73% of sentences\), and silver labels drawn from the same LLM used as the zero\-shot baseline — a different teacher could shift the picture\.

## References

- Baltrušaitiset al\.\(2017\)T\. Baltrušaitis, C\. Ahuja, and L\. MorencyMultimodal machine learning: a survey and taxonomy\.Note:ArXiv:1705\.09406Cited by:[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px1.p1.1)\.
- Barber and Odean \(2008\)B\. M\. Barber and T\. OdeanAll that glitters: the effect of attention and news on the buying behavior of individual and institutional investors\.The Review of Financial Studies21\(2\),pp\. 785–818\.External Links:[Document](https://dx.doi.org/10.1093/rfs/hhm079)Cited by:[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px2.p1.1)\.
- Caoet al\.\(2024\)Y\. Cao, Z\. Chen, Q\. Pei, N\. J\. Lee, K\. P\. Subbalakshmi, and P\. M\. NdiayeECC analyzer: extract trading signal from earnings conference calls using large language model for stock volatility prediction\.External Links:2404\.18470,[Link](https://arxiv.org/abs/2404.18470)Cited by:[§1](https://arxiv.org/html/2608.11753#S1.p1.1)\.
- Hintonet al\.\(2015\)G\. Hinton, O\. Vinyals, and J\. DeanDistilling the knowledge in a neural network\.Note:ArXiv:1503\.02531Cited by:[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px3.p1.1)\.
- Liuet al\.\(2019\)Y\. Liu, M\. Ott, N\. Goyal, J\. Du, M\. Joshi, D\. Chen, O\. Levy, M\. Lewis, L\. Zettlemoyer, and V\. StoyanovRoBERTa: a robustly optimized BERT pretraining approach\.Note:arXiv:1907\.11692External Links:[Link](https://arxiv.org/abs/1907.11692)Cited by:[§4](https://arxiv.org/html/2608.11753#S4.SS0.SSS0.Px1.p1.1)\.
- Nieet al\.\(2023\)Y\. Nie, N\. H\. Nguyen, P\. Sinthong, and J\. KalagnanamA time series is worth 64 words: long\-term forecasting with transformers\.InThe Eleventh International Conference on Learning Representations,External Links:[Link](https://arxiv.org/abs/2211.14730)Cited by:[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px3.p1.1)\.
- Schleeet al\.\(2026\)M\. Schlee, C\. Weisser, T\. Kivimäki, M\. Mashiku, and B\. SäfkenLabelFusion: fusing large language models with transformer encoders for robust financial news classification\.InProceedings of the 7th Financial Narrative Processing Workshop \(FNP 2026\),Palma de Mallorca, Spain\.External Links:[Document](https://dx.doi.org/10.48550/arXiv.2512.10793),[Link](https://arxiv.org/abs/2512.10793)Cited by:[§1](https://arxiv.org/html/2608.11753#S1.p2.1),[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px1.p1.1),[§5](https://arxiv.org/html/2608.11753#S5.p2.1)\.
- Shahet al\.\(2023\)A\. Shah, S\. Paturi, and S\. ChavaTrillion dollar words: a new financial dataset, task & market analysis\.InProceedings of the 61st Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),External Links:[Document](https://dx.doi.org/10.18653/v1/2023.acl-long.368)Cited by:[Appendix D](https://arxiv.org/html/2608.11753#A4.p1.1),[§1](https://arxiv.org/html/2608.11753#S1.p3.1),[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px2.p1.1),[§3](https://arxiv.org/html/2608.11753#S3.SS0.SSS0.Px1.p1.1),[§3](https://arxiv.org/html/2608.11753#S3.SS0.SSS0.Px6.p1.1),[§4](https://arxiv.org/html/2608.11753#S4.SS0.SSS0.Px2.p1.1)\.
- Sunet al\.\(2026\)Y\. Sun, P\. Gao, Y\. Yan, and X\. YangStock price prediction with attention\-based framework by integrating LLM\-generated features\.InNeural Information Processing \(ICONIP 2025\),T\. Taniguchi, C\. S\. A\. Leung, T\. Kozuno, J\. Yoshimoto, M\. Mahmud, M\. Doborjeh, and K\. Doya \(Eds\.\),Lecture Notes in Computer Science, Vol\.16313,pp\. 562–576\.External Links:[Document](https://dx.doi.org/10.1007/978-981-95-4445-5%5F38),[Link](https://doi.org/10.1007/978-981-95-4445-5_38)Cited by:[§1](https://arxiv.org/html/2608.11753#S1.p1.1)\.
- Tetlock \(2007\)P\. C\. TetlockGiving content to investor sentiment: the role of media in the stock market\.The Journal of Finance62\(3\),pp\. 1139–1168\.External Links:[Document](https://dx.doi.org/10.1111/j.1540-6261.2007.01232.x)Cited by:[§2](https://arxiv.org/html/2608.11753#S2.SS0.SSS0.Px2.p1.1)\.
- Vaswaniet al\.\(2017\)A\. Vaswani, N\. Shazeer, N\. Parmar, J\. Uszkoreit, L\. Jones, A\. N\. Gomez, Ł\. Kaiser, and I\. PolosukhinAttention is all you need\.InAdvances in Neural Information Processing Systems 30,Cited by:[§4](https://arxiv.org/html/2608.11753#S4.p1.1)\.

## Appendix ABenchmark Examples

LabelDateSentencehawkish2005\-05\-03A discernable upcreep was apparent in survey measures of short\- and, to a limited extent, long\-term inflation expectations over recent months\.hawkish2017\-12\-13Many indicated that they expected cyclical pressures associated with a tightening labor market to show through to higher inflation over the medium term\.dovish2011\-08\-09Some participants noted that additional asset purchases could be used to provide more accommodation by lowering longer\-term interest rates\.dovish2019\-06\-19In light of increased uncertainties and muted inflation pressures, we now emphasize that the Committee will closely monitor the implications of incoming information for the economic outlook and will act as appropriate to sustain the expansion with a strong labor market and inflation near its 2 percent objective\.neutral2000\-02\-02As long as the Federal Reserve is required to set and report ranges for money and debt growth, it should update them as appropriate\.neutral2004\-12\-02A commonly used analogy takes the U\.S\. economy to be an automobile, the FOMC to be the driver, and monetary policy actions to be taps on the accelerator or brake\.Table 3:Annotated sentences of the benchmark, with the document date recovered by the procedure of Appendix[B](https://arxiv.org/html/2608.11753#A2)\. The last two rows illustrate the difficulty of the task: both are labelled neutral although they discuss policy instruments, while the phrase*“act as appropriate”*appears in a dovish sentence of 2019 and in a neutral one of 2000\.
## Appendix BDating Procedure

The benchmark releases sentences with labels and a year, but not the document date needed to attach market data\. All source documents are public and are included in the benchmark’s repository as date\-named files\. We match each sentence to its document by exact text match against the per\-document sentence files and, where that fails, by containment matching of the normalised sentence against the raw document text; normalisation lowercases and strips all non\-alphanumeric characters, so that differences in punctuation, quotation marks, and sentence splitting do not prevent a match\. Sentences matching documents on more than one date and sentences matching no document are excluded\.

Three cases illustrate the procedure\. The sentence*“After precipitous drops in March and April, employment rose strongly in May and June as many people returned to work from temporary layoffs\.”*occurs in the sentence file of exactly one document and receives its date, the press conference of 29 July 2020; 1,203 sentences are dated by such exact matches\. The sentence*“Actual or realized saving depends on the equilibrium values of the real interest rate and other economic variables\.”*appears in no sentence file but is found, after normalisation, in the raw text of a single document, a speech of 10 March 2005; containment matching dates 489 further sentences this way\. The sentence*“Consistent with its statutory mandate, the Committee seeks to foster maximum employment and price stability\.”*is the Committee’s standing mandate formula and occurs in 76 documents; no unique date can be assigned, and it is excluded\. This yields 1,692 uniquely dated sentences of 2,312 unique sentences \(73%\), spanning January 1996 to September 2022, with label proportions close to the full benchmark \(neutral 47%, dovish 28%, hawkish 25%\)\. By source, 893 come from meeting minutes, 489 from speeches, and 310 from press conferences\. The year column of the release disagrees with the date of the matched document for the large majority of sentences and is not used\. Undated sentences whose matching documents are all dated 2014 or earlier \(96 sentences, excluding those with word overlap above0\.850\.85with a test sentence\) are added to the text expert’s training data\.

## Appendix CMarket Window Details

All series come from FRED, the public database of the Federal Reserve Bank of St\. Louis, retrieved as CSV files through its unauthenticated download interface \(fred\.stlouisfed\.org/graph/fredgraph\.csv?id=*series*\); the released code performs the retrieval\. Table[4](https://arxiv.org/html/2608.11753#A3.T4)lists the six channels and their construction\.

ChannelFRED seriesConstructionpolicy rateDFFlevel2\-year yieldDGS2levelyield\-curve slopeDGS10,DGS2differenceequity marketNASDAQCOMlogarithm of the indexinflationCPIAUCSL12\-month change, 45\-day lagunemploymentUNRATElevel, 45\-day lag

Table 4:The six market channels\. Daily series are used as released; monthly series \(inflation, unemployment\) are stepped forward to daily frequency and shifted by 45 days to respect their publication delay\.A window spans the 126 business days ending the day before the sentence’s document date\. Within the window, every channel is expressed as its change since the first day of the window, and each channel is standardised with mean and standard deviation computed on the training split only\.

## Appendix DLLM Prompt

The LLM expert uses, verbatim, the prompt published by[8](https://arxiv.org/html/2608.11753#bib.bib2)for their ChatGPT baseline;\[sentence\]is replaced by the sentence to classify\.

Discardallthepreviousinstructions\.Behavelikeyouareanexpertsentenceclassifier\.ClassifythefollowingsentencefromFOMCinto’HAWKISH’,’DOVISH’,or’NEUTRAL’class\.Label’HAWKISH’ifitiscorrespondingtotighteningofthemonetarypolicy,’DOVISH’ifitiscorrespondingtoeasingofthemonetarypolicy,or’NEUTRAL’ifthestanceisneutral\.Providethelabelinthefirstlineandprovideashortexplanationinthesecondline\.Thesentence:\[sentence\]

The first line of the reply is parsed as the label\. The same model and prompt produce the silver labels for the 13,017 automatically annotated sentences of §[3](https://arxiv.org/html/2608.11753#S3)\(99\.98% of replies parse\)\.

## Appendix ETraining Details

Table[5](https://arxiv.org/html/2608.11753#A5.T5)lists the training configuration of the three experts and the voting network; Table[6](https://arxiv.org/html/2608.11753#A5.T6)accounts for the market expert’s parameters\.

*Text expert*encoderroberta\-large, max\. 128 tokensoptimiserAdamW, learning rate10−510^\{\-5\}batchingsize 16, gradient accumulation 2lossclass\-weighted cross\-entropysilver stage2 epochs on the 13,017 silver sentencesgold stage≤6\\leq 6epochs, epoch selection on validationprecisionmixed \(fp16\)*Market expert*input126×6126\\times 6window, 18 patches of 7 daysencoder4 layers, width 64, 8 heads, FF 128regularisationdropout 0\.2pre\-trainingwindows every 2nd business day 1962–2015,rate change in 30 days \(±10\\pm 10bp, 3 classes\)task trainingAdam,3×10−43\\times 10^\{\-4\},≤40\\leq 40epochs, validation sel\.*Voting network*architectureMLP, one hidden layer of 64inputsconcatenated frozen expert outputs

Table 5:Training configuration\.patch projection \(42×6442\\times 64\+ biases\)2,752position embeddings \(18×6418\\times 64\)1,152encoder layers \(4×33,4724\\times 33\{,\}472\)133,888per layer: attention16,640per layer: feed\-forward16,576per layer: layer norms256output layer norm128classification head195total138,115

Table 6:Parameter count of the market expert\.Every trained component uses seeds\{1,2,3\}\\\{1,2,3\\\}, giving the 27 systems of §[4](https://arxiv.org/html/2608.11753#S4)\. Label budgets subsample the gold pool stratified by class; silver data and rate\-cycle pre\-training stay constant across budgets\. The full pipeline, all seeds and all budgets, runs in under two hours on a single T4 GPU; an end\-to\-end notebook reproducing every number, together with the input bundle and its construction script, will be released \(anonymised for review\)\.

Similar Articles

Long Live Fine-Tuning: Task-Specific Transformers Outperform Zero-Shot LLMs for Misinformation Response Classification on Reddit

arXiv cs.CL

Researchers from University of Technology Sydney compare fine-tuned transformers (DistilBERT, RoBERTa) against zero-shot LLMs (Llama variants, Claude, Gemini) for classifying misinformation responses on Reddit, finding that fine-tuned RoBERTa achieves 0.62 macro-F1 versus 0.50 for the best zero-shot model. The study shows that task-specific fine-tuning outperforms larger generalist models, particularly for detecting belief propagation, and that safety-alignment artifacts in frontier models can degrade performance.