Probabilistic Textual Time Series Depression Detection

arXiv cs.CL Papers

Summary

This paper proposes PTTSD, a probabilistic framework for depression severity detection from clinical interview transcripts that models uncertainty and provides temporal interpretability, achieving competitive performance on benchmark datasets.

arXiv:2511.04476v2 Announce Type: replace Abstract: Accurate and interpretable predictions of depression severity are essential for clinical decision support, yet existing models often lack uncertainty estimates and temporal interpretability. We propose PTTSD, a Probabilistic framework for Depression Detection from clinical interview utterance sequences that predicts PHQ-8 scores while modeling calibrated uncertainty. PTTSD includes sequence-to-sequence and sequence-to-one variants, both combining LSTMs, self-attention, and residual connections with Gaussian or Student's-t output heads trained via negative log-likelihood. The sequence-to-sequence variant enables temporal analysis of how predictive confidence evolves over an interview, despite the target being a single session-level score. Evaluated on E-DAIC and DAIC-WOZ, PTTSD achieves competitive performance among text-only systems (e.g., MAE = 3.85 on E-DAIC, 3.55 on DAIC) and produces well-calibrated prediction intervals. Ablations confirm the value of attention and probabilistic modeling, while a three-part calibration analysis and qualitative case studies highlight the clinical relevance of uncertainty-aware prediction.
Original Article
View Cached Full Text

Cached at: 07/13/26, 08:00 AM

# Probabilistic Textual Time Series Depression Detection
Source: [https://arxiv.org/html/2511.04476](https://arxiv.org/html/2511.04476)
Fabian Schmidt1,Seyedehmoniba Ravan2,Vladimir Vlassov1

1Department of Computer Science, KTH Royal Institute of Technology, Sweden 2Department of Information Technology, Uppsala University, Sweden Correspondence:[fschm@kth\.se](https://arxiv.org/html/2511.04476v2/mailto:[email protected])

###### Abstract

Accurate and interpretable predictions of depression severity are essential for clinical decision support, yet existing models often lack uncertainty estimates and temporal interpretability\. We propose PTTSD, a*Probabilistic*framework for*Depression Detection*from clinical interview utterance sequences that predicts PHQ\-8 scores while modeling calibrated uncertainty\. PTTSD includes sequence\-to\-sequence and sequence\-to\-one variants, both combining LSTMs, self\-attention, and residual connections with Gaussian or Student’s\-ttoutput heads trained via negative log\-likelihood\. The sequence\-to\-sequence variant enables temporal analysis of how predictive confidence evolves over an interview, despite the target being a single session\-level score\. Evaluated on E\-DAIC and DAIC\-WOZ, PTTSD achieves competitive performance among text\-only systems \(e\.g\., MAE = 3\.85 on E\-DAIC, 3\.55 on DAIC\) and produces well\-calibrated prediction intervals\. Ablations confirm the value of attention and probabilistic modeling, while a three\-part calibration analysis and qualitative case studies highlight the clinical relevance of uncertainty\-aware prediction\.

Probabilistic Textual Time Series Depression Detection

Fabian Schmidt1, Seyedehmoniba Ravan2, Vladimir Vlassov11Department of Computer Science, KTH Royal Institute of Technology, Sweden2Department of Information Technology, Uppsala University, SwedenCorrespondence:[fschm@kth\.se](https://arxiv.org/html/2511.04476v2/mailto:[email protected])

## 1Introduction

Depression remains one of the leading causes of global disability, affecting over 300 million individuals worldwideWHO \([2017](https://arxiv.org/html/2511.04476#bib.bib32),[2022](https://arxiv.org/html/2511.04476#bib.bib33)\)\. Scalable, automated tools for assessing depressive symptom severity offer valuable support in digital therapy and remote care, where access to clinicians is limited\. Among these tools, text\-based systems that process clinical interviews have shown strong potential for predicting standardized scores such as the PHQ\-8Kroenke et al\. \([2009](https://arxiv.org/html/2511.04476#bib.bib13)\)\.

Recent methods typically model interview transcripts as sequences of utterances and employ architectures such as LSTMs, Transformers, or large language models \(LLMs\)Mandal et al\. \([2025](https://arxiv.org/html/2511.04476#bib.bib16)\); Fang et al\. \([2023a](https://arxiv.org/html/2511.04476#bib.bib6)\); Nykoniuk et al\. \([2025](https://arxiv.org/html/2511.04476#bib.bib20)\); Sadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)\. However, most existing approaches produce scalar severity estimates without quantifying uncertainty, which is an important limitation in high\-stakes clinical contexts where a prediction of “PHQ\-8 = 12” is far more actionable when accompanied by a measure of confidence\.

We argue that the sequential nature of clinical interviews creates a natural opportunity to address this gap\. Each utterance provides a context\-dependent observation, and the cumulative sequence progressively constrains the space of plausible severity estimates\. While the prediction target, i\.e\., the PHQ\-8 score, is a single\-session\-level value rather than a time\-varying quantity, the*input*is inherently sequential, and modeling it as such offers two key advantages that point\-estimate systems forgo\. First, it allows probabilistic models to capture*aleatoric uncertainty*, that is, the uncertainty arising from sparse, contradictory, or ambiguous language, and to express how that uncertainty resolves as context accumulates\. Second, it enables interpretable temporal analyses: identifying which utterances drive prediction shifts, and how model confidence stabilizes \(or fails to stabilize\) over the course of an interview\.

We introducePTTSD, a*Probabilistic Textual Time Series Depression Detection*model that makes temporally grounded, calibrated predictions over PHQ\-8 scores from utterance\-level sequences\. PTTSD addresses two key gaps in the field\. First, it replaces point predictions with calibrated distributional outputs \(Gaussian or Student’s\-ttheads trained via negative log\-likelihood\), enabling clinicians to assess both predicted severity and the model’s confidence in that prediction\. Second, through its sequence\-to\-sequence \(seq\-to\-seq\) variant, it exposes how the model’s predictive belief evolves across an interview, providing temporal interpretability that is absent from prior systems\. Clinicians can therefore identify when the model becomes confident, which utterances drive prediction shifts, and where ambiguity persists\.

We evaluate PTTSD on the DAIC and E\-DAIC benchmarks using original and re\-transcribed interviews and demonstrate competitive performance on standard metrics \(e\.g\., MAE = 3\.55, RMSE = 4\.77 on DAIC; MAE = 3\.85, RMSE = 4\.52 on E\-DAIC\), matching or exceeding recent text\-only baselines on held\-out test sets without relying on prompt engineering or handcrafted features\. Importantly, PTTSD additionally provides calibrated uncertainty estimates and interpretable temporal dynamics—capabilities absent from prior systems\. Ablation and sensitivity analyses further validate the contributions of probabilistic loss design, attention mechanisms, and calibration metrics\.

In summary, our main contributions are:

- •We propose PTTSD, a fully probabilistic sequence model that jointly predicts PHQ\-8 scores along with calibrated uncertainty from utterance\-level textual time series, and provide thorough calibration, temporal, and sensitivity analyses to assess uncertainty quality and clinical relevance\.
- •We introduce a seq\-to\-one and a seq\-to\-seq formulation\. The latter exposes how the model’s predictive belief, both point estimate and uncertainty, evolves over the course of an interview for temporal interpretability analyses such as identifying critical utterances and tracking when model confidence stabilizes\.
- •We empirically demonstrate competitive results on E\-DAIC and DAIC test sets among text\-only models, while offering calibrated interpretable uncertainty estimates that go beyond the point predictions of prior work\.

## 2Related Work

Textual time series modeling has been central to recent efforts in automatic depression detection, especially within clinical interviews and therapy sessions\. Prior work has predominantly relied on point estimate neural methods such as LSTMs and attention\-based transformers to model temporal dependencies in textual dataMandal et al\. \([2025](https://arxiv.org/html/2511.04476#bib.bib16)\); Fang et al\. \([2023a](https://arxiv.org/html/2511.04476#bib.bib6)\); Nykoniuk et al\. \([2025](https://arxiv.org/html/2511.04476#bib.bib20)\)\. Such models capture sequential patterns but lack mechanisms to quantify temporal uncertainty\. While LLMs extract richer textual featuresSadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\); Chen et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib3)\), most systems remain heuristic or point estimates that focus on structural or multimodal fusion rather than probabilistic reasoning\. In contrast, our fully probabilistic, end\-to\-end model captures uncertainty directly from raw utterances without handcrafted prompts\.

Notably,Qureshi et al\. \([2019b](https://arxiv.org/html/2511.04476#bib.bib24)\)use multitask learning with attention mechanisms for joint regression and classification, but do not incorporate uncertainty modeling\. Similarly, prompt\-based methods such as those ofZhang and Guo \([2024](https://arxiv.org/html/2511.04476#bib.bib36)\)transform depression detection into a few\-shot classification task via language model prompting, but still yield single\-point predictions\. Graph\-based architecturesBurdisso et al\. \([2023](https://arxiv.org/html/2511.04476#bib.bib2)\); Chen et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib3)\)model discourse\-level context across utterances and questions, offering enhanced interpretability and structural awareness, though they too typically omit calibrated uncertainty\.

A rare exception isDia et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib5)\), who propose a stochastic transformer for post\-traumatic stress disorder detection, introducing probabilistic components such as stochastic activations to model uncertainty across modalities\. However, their work focuses on visual signals and does not address textual time series or PHQ\-8 regression\. More recently,Zhang et al\. \([2025](https://arxiv.org/html/2511.04476#bib.bib37)\)apply a multi\-instance learning \(MIL\) framework to estimate depression severity from long transcripts and assign confidence scores to depressive cues at the sentence level\. This approach does provide instance\-level interpretability, but the underlying model is not explicitly probabilistic in the Bayesian sense\.

Several recent works have explored fair or calibrated uncertainty estimation\.Li and Zhou \([2025](https://arxiv.org/html/2511.04476#bib.bib14)\)propose Fair Uncertainty Quantification \(FUQ\) for PHQ regression with conformal prediction intervals across demographic groups\. While effective for fairness, FUQ operates at the distributional output level and does not model temporal evolution within interviews\. Other systems, such asMao et al\. \([2023](https://arxiv.org/html/2511.04476#bib.bib17)\)andGuo et al\. \([2022](https://arxiv.org/html/2511.04476#bib.bib10)\), employ BiLSTMs or Transformers with textual features, sometimes augmented by topic signals, but focus solely on point estimate loss objectives\.

## 3Probabilistic Textual Time\-Series Depression Detection

![Refer to caption](https://arxiv.org/html/2511.04476v2/x1.png)Figure 1:Overview of PTTSD\. Utterances are embedded, encoded with a BiLSTM and multi\-head self\-attention with residual connections, and mapped to a predictive distribution over PHQ\-8\.### 3\.1Problem Formulation

We model PHQ\-8 estimation as probabilistic regression over utterance sequences\. Given a transcript withTTutterances\{u1,…,uT\}\\\{u\_\{1\},\\dots,u\_\{T\}\\\}and utterance embeddingse1:Te\_\{1:T\}, the model maps the sequence to a distribution over the session\-level scorey∈ℝy\\in\\mathbb\{R\}:

p​\(y∣e1:T;θ\)\.p\\\!\\left\(y\\mid e\_\{1:T\};\\theta\\right\)\.
We study two PTTSD model variants:

- •*seq\-to\-one*: predicts a single distribution from the full utterance sequence\.
- •*seq\-to\-seq*: produces a per\-utterance distributionp​\(y∣e1:t;θ\)p\(y\\mid e\_\{1:t\};\\theta\)for each prefixe1:te\_\{1:t\}, trained against the same session\-level labelyy\.

We note that the PHQ\-8 target is a single score per session, not a time\-varying quantity\. The seq\-to\-seq variant therefore does not model a changing target\. Rather, it exposes how the model’s*predictive belief*, i\.e\., its point estimateμ^t\\hat\{\\mu\}\_\{t\}and its uncertaintyσ^t\\hat\{\\sigma\}\_\{t\}, evolves as conversational context accumulates\. This serves two purposes: \(i\) it enables temporal interpretability analyses, such as identifying utterances that trigger large shifts in predicted severity or uncertainty, and \(ii\) it acts as a form of regularization, encouraging the model to form reasonable estimates from partial context rather than relying solely on global sequence features\.

Concretely, the trajectories of\(μ^t,σ^t\)\(\\hat\{\\mu\}\_\{t\},\\hat\{\\sigma\}\_\{t\}\)across an interview support three types of analysis: \(i\) how uncertainty decreases as context accumulates and signals that the model has “seen enough”; \(ii\) error and uncertainty alignment to measure whether high predicted uncertainty genuinely corresponds to high error \(in terms of correlations and interval coverage\); and \(iii\) identification of critical utterances where the predicted mean shifts sharply or attention mass concentrates, which may correspond to clinically salient moments in the interview\.

### 3\.2Data

We utilize the Distress Analysis Interview Corpus \(DAIC\)Gratch et al\. \([2014](https://arxiv.org/html/2511.04476#bib.bib9)\)and extended DAIC \(E\-DAIC\)DAIC‑WOZ Project \([2019](https://arxiv.org/html/2511.04476#bib.bib4)\)datasets, which contain anonymized semi\-structured interview transcripts and associated Patient Health Questionnaire\-8 \(PHQ\-8\)Kroenke et al\. \([2009](https://arxiv.org/html/2511.04476#bib.bib13)\)depression scores\. Each participant’s data consists of a sequence of utterances extracted from transcript files, along with a PHQ\-8 score indicating depression severity\. The PHQ\-8 is a standardized self\-report instrument with scores ranging from 0 to 24 that assesses depressive symptom severity\. The DAIC‑WOZ corpus includes 189 clinical interview sessionss\. Its extended counterpart, E‑DAIC, includes 275 sessions\. Both remain among the few publicly available conversation‑based clinical corpora annotated with PHQ‑8 depression scores, collected under stringent ethical and privacy safeguards typical of mental health research\. More details on the PHQ\-8 and DAIC in Appendix[A](https://arxiv.org/html/2511.04476#A1)and Appendix[B](https://arxiv.org/html/2511.04476#A2), respectively\.

### 3\.3Utterance Embeddings

We represent each utterance using pretrained sentence encoders\. Our primary model uses theall\-MiniLM\-L6\-v2Sentence Transformer111[https://huggingface\.co/sentence\-transformers/all\-MiniLM\-L6\-v2](https://huggingface.co/sentence-transformers/all-MiniLM-L6-v2)Reimers and Gurevych \([2019](https://arxiv.org/html/2511.04476#bib.bib26)\), a compact model with only 22 million parameters that achieves competitive performance across a wide range of tasks on the Hugging Face MTEB Embedding LeaderboardMuennighoff et al\. \([2023](https://arxiv.org/html/2511.04476#bib.bib18)\)\. We also evaluate an alternative variant of our model usingMentalBERTJi et al\. \([2022](https://arxiv.org/html/2511.04476#bib.bib11)\), a domain\-adapted BERT model pretrained on mental health\-related corpora222[https://huggingface\.co/mental/mental\-bert\-base\-uncased](https://huggingface.co/mental/mental-bert-base-uncased)\. Tokenization, pooling, and other encoder specifics are in Appx\.[D](https://arxiv.org/html/2511.04476#A4)\.

### 3\.4Backbone: BiLSTM \+ Self\-Attention

We employ a multi\-layer unidirectional LSTM that encodes𝐗\\mathbf\{X\}into hidden states𝐇∈ℝT×H\\mathbf\{H\}\\in\\mathbb\{R\}^\{T\\times H\}\. We then apply multi\-head self\-attention with a residual connection:

𝐀=Attention​\(𝐇\)\+𝐇,\\mathbf\{A\}\\;=\\;\\textsc\{Attention\}\(\\mathbf\{H\}\)\\;\+\\;\\mathbf\{H\},allowing each utterance embedding to condition on the full conversational context\. In*seq\-to\-one*, we aggregate𝐀\\mathbf\{A\}over time by average pooling\. We retain the per\-utterance representations𝐚t\\mathbf\{a\}\_\{t\}in*seq\-to\-seq*\.

### 3\.5Uncertainty\-Aware Output Heads

Separate MLP heads predict the parameters of the predictive distribution to model the PHQ\-8 score \(μ^\\hat\{\\mu\}\) and uncertainty \(σ^\\hat\{\\sigma\}\)\.

p​\(y∣⋅\)∈\{𝒩​\(μ^,σ^2\),Student\-​t​\(μ^,σ^,ν\)\}\.p\(y\\mid\\cdot\)\\in\\left\\\{\\mathcal\{N\}\\\!\\big\(\\hat\{\\mu\},\\hat\{\\sigma\}^\{2\}\\big\),\\;\\text\{Student\-\}t\\\!\\big\(\\hat\{\\mu\},\\hat\{\\sigma\},\\nu\\big\)\\right\\\}\.For*seq\-to\-one*, the heads take the pooled vector as input and for*seq\-to\-seq*, the heads take each𝐚t\\mathbf\{a\}\_\{t\}to predict the parameters at each timestep\.

### 3\.6Training Objective

We minimize the NLL of the ground\-truth PHQ\-8 under the predicted distribution\. For*seq\-to\-one*:

ℒ=−log⁡p​\(y∣e1:T;θ\)\.\\mathcal\{L\}\\;=\\;\-\\log p\\\!\\left\(y\\mid e\_\{1:T\};\\theta\\right\)\.For*seq\-to\-seq*, we average the per\-utterance NLL across the sequence\. Gaussian vs\. Student’s\-ttobjectives and optional weighting terms are provided in Appx\.[E](https://arxiv.org/html/2511.04476#A5)\. Optimization settings and other training hyperparameters are in Appx\.[D](https://arxiv.org/html/2511.04476#A4)\.

## 4Experiments

### 4\.1Experimental Setup

#### Data Splits\.

We follow the official training, validation, and test splits provided with each dataset\. For E\-DAIC, the data is partitioned into 163 training, 56 validation, and 56 test participants\. For DAIC\-WOZ, the official splits include 107 training, 35 validation, and 56 test participants\. E\-DAIC audio is re\-transcribed using WhisperX to improve transcription quality and alignment over the original transcripts to allow for better uncertainty quantification, which is the main focus of our study\. To ensure fair comparison with prior work that used the original transcripts, we additionally report results on the unaltered E\-DAIC transcripts in Appendix[F](https://arxiv.org/html/2511.04476#A6)\.

#### Evaluation Metrics\.

We evaluate models on both the validation and held\-out test sets using mean squared error \(MSE\) and root mean squared error \(RMSE\)\. MSE and RMSE quantify average prediction error, with RMSE placing greater emphasis on larger errors due to its squaring operation\. RMSE is particularly useful for identifying models that minimize not only average error but also the variance in error magnitude\. When modeling predictive uncertainty, we additionally report negative log\-likelihood \(NLL\)\.

#### Reproducibility\.

All preprocessing steps, model configurations, and training scripts are made publicly available on GitHub\.333[https://github\.com/smidtfab/PTTSD](https://github.com/smidtfab/PTTSD)To account for variability due to random initialization, we report average performance over three runs with different seeds\.

### 4\.2Main Results

DevTestMethodMAERMSEMAERMSEWilliamson et al\. \([2016](https://arxiv.org/html/2511.04476#bib.bib34)\)3\.344\.46––Gong and Poellabauer \([2017](https://arxiv.org/html/2511.04476#bib.bib8)\)2\.773\.543\.964\.99Yang et al\. \([2017](https://arxiv.org/html/2511.04476#bib.bib35)\)3\.524\.52––Stepanov et al\. \([2018](https://arxiv.org/html/2511.04476#bib.bib31)\)––4\.885\.83Oureshi et al\. \([2021](https://arxiv.org/html/2511.04476#bib.bib21)\)3\.78–––Niu et al\. \([2021](https://arxiv.org/html/2511.04476#bib.bib19)\)3\.734\.80––Fang et al\. \([2023b](https://arxiv.org/html/2511.04476#bib.bib7)\)––3\.614\.76Rohanian et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib27)\)––4\.986\.05Al Hanai et al\. \([2018](https://arxiv.org/html/2511.04476#bib.bib1)\)5\.186\.38––Qureshi et al\. \([2019a](https://arxiv.org/html/2511.04476#bib.bib23)\)3\.744\.80––PTTSD seq\-to\-one \(MentalBERT\)4\.39±\\pm0\.105\.47±\\pm0\.433\.65±\\pm0\.244\.69±\\pm0\.24PTTSD seq\-to\-seq \(MentalBERT\)4\.67±\\pm0\.045\.82±\\pm0\.343\.92±\\pm0\.544\.79±\\pm0\.54PTTSD seq\-to\-one \(MiniLM\)3\.82±\\pm0\.094\.84±\\pm0\.283\.55±\\pm0\.154\.77±\\pm0\.53PTTSD seq\-to\-seq \(MiniLM\)4\.59±\\pm0\.075\.22±\\pm0\.303\.88±\\pm0\.415\.10±\\pm0\.92

\(a\)DAIC\-WOZ
DevTestMethodMAERMSEMAERMSERay et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib25)\)–4\.374\.024\.73Makiuchi et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib15)\)LSTM–4\.97–6\.88Makiuchi et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib15)\)LSTM\+CNN–4\.22––Sadeghi et al\. \([2023](https://arxiv.org/html/2511.04476#bib.bib28)\)3\.655\.274\.265\.37Sadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)Pr3\+Whisper3\.174\.514\.225\.07Sadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)Pr3\+Whisper\+AQ2\.854\.023\.864\.66PTTSD seq\-to\-one \(MentalBERT\)†3\.56±\\pm0\.014\.45±\\pm0\.074\.18±\\pm0\.055\.23±\\pm0\.13PTTSD seq\-to\-seq \(MentalBERT\)†3\.55±\\pm0\.144\.58±\\pm0\.204\.20±\\pm0\.035\.39±\\pm0\.08PTTSD seq\-to\-one \(MiniLM\)†3\.60±\\pm0\.134\.76±\\pm0\.144\.58±\\pm0\.505\.87±\\pm0\.92PTTSD seq\-to\-seq \(MiniLM\)†3\.47±\\pm0\.024\.57±\\pm0\.043\.85±\\pm0\.044\.52±\\pm0\.38

†PTTSD results obtained on WhisperX re\-transcriptions of the original E\-DAIC audio, similar toSadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)’s approach rather than transcripts from the dataset\. See Appendix[F](https://arxiv.org/html/2511.04476#A6)for results on the original transcripts\.

\(b\)E\-DAIC

Table 1:Comparison of text\-only PHQ\-8 regression models, split by dataset\. Bold = best\.Table[1](https://arxiv.org/html/2511.04476#S4.T1)presents PHQ\-8 regression performance on both E\-DAIC and DAIC\. We compare our PTTSD models across multiple configurations \(seq\-to\-seq vs\. seq\-to\-one and MentalBERT vs\. all\-MiniLM\-L6\-v2\) against relevant text\-based approaches\.

#### E\-DAIC\.

Among the text\-only systems evaluated, PTTSD \(seq\-to\-seq with all\-MiniLM\-L6\-v2\) achieves the lowest test MAE \(3\.85\) and RMSE \(4\.52\) in our comparison\. Other PTTSD variants, including MentalBERT\-based and seq\-to\-one configurations, also perform competitively, showing robustness across architecture choices\. We note that direct numerical comparison with prior work is complicated by two factors: \(i\) our use of WhisperX re\-transcriptions may yield different input quality than the original transcripts used by prior systems, and \(ii\) several baselines report only development or only test metrics, making comprehensive comparison difficult\. Earlier works such asRay et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib25)\)andMakiuchi et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib15)\)attain dev RMSEs of 4\.22–4\.97, but their test performance is either weaker or unreported\. More recent prompt\-based models bySadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)use Whisper transcripts and audio\-based quality filtering\. Their best variant \(Pr3\+Whisper\+AudioQual\) reports strong dev MAE \(2\.85\) and RMSE \(4\.02\) with the additional audio quality gating\. Their text\-only variant \(Pr3\+Whisper\) achieves 4\.22 MAE and 5\.07 RMSE on the test set, which PTTSD improves upon on both metrics\. However, given the differences in the transcripts, these comparisons should be interpreted with caution\. To directly address comparability, we also evaluate PTTSD on the original \(unaltered\) E\-DAIC transcripts\. Using seq\-to\-seq with Gaussian NLL, MiniLM achieves a test MAE of 4\.63 and RMSE of 5\.56, while MentalBERT achieves 4\.60 MAE and 5\.58 RMSE \(Appendix[F](https://arxiv.org/html/2511.04476#A6), Table[5](https://arxiv.org/html/2511.04476#A6.T5)\)\. While these numbers are expectedly weaker than those obtained on re\-transcribed data, they confirm that PTTSD remains competitive and that the core contributions, the calibrated uncertainty and interpretable temporal trajectories, hold regardless of transcript source and are arguably more valuable for clinical deployment than marginal improvements in MAE or RMSE\.

#### DAIC\.

On the original DAIC dataset, PTTSD again performs competitively, especially in the all\-MiniLM\-L6\-v2 seq\-to\-one variant, which achieves the lowest test MAE \(3\.55\) and matches the best test RMSE \(4\.77\) ofFang et al\. \([2023a](https://arxiv.org/html/2511.04476#bib.bib6)\)\. Interestingly,Gong and Poellabauer \([2017](https://arxiv.org/html/2511.04476#bib.bib8)\)reports strong dev performance \(MAE 2\.77, RMSE 3\.54\), while test results \(MAE 3\.96, RMSE 4\.99\) show a notable drop, which may reflect differences in evaluation protocols or generalization challenges\.

#### Seq\-to\-seq vs\. seq\-to\-one\.

The seq\-to\-seq variant \(MiniLM\) outperforms seq\-to\-one on E\-DAIC, whereas the pattern reverses on DAIC\. We do not interpret this as evidence that one formulation is strictly superior\. Rather, the two variants serve complementary roles\. Seq\-to\-one optimizes for aggregate prediction quality from the full sequence, while seq\-to\-seq provides temporal interpretability at a modest and dataset\-dependent cost to accuracy\. The seq\-to\-one variant uses masked average pooling, whereas seq\-to\-seq retains per\-timestep representations\. Exploring alternative pooling strategies \(e\.g\., attention\-weighted aggregation\) is a viable direction for future work\.

### 4\.3Ablation Studies

#### Effect of Loss Function\.

LossDevTestMAERMSEMAERMSEGaussian NLL3\.44404\.52933\.86035\.0219Student\-ttNLL3\.66374\.93283\.92945\.1488MAE3\.64274\.80914\.18855\.4407MSE3\.63984\.98453\.66944\.8760Table 2:Loss function comparison on dev/test sets \(E\-DAIC, single run\)\.Table[2](https://arxiv.org/html/2511.04476#S4.T2)compares the impact of different loss functions on validation and test performance\. Gaussian NLL yields the best overall balance with low MAE and RMSE across both splits, particularly on test MAE \(3\.86\)\. Student’s\-ttNLL performs comparably but with slightly worse calibration and higher RMSE, likely due to the added complexity of estimating the degrees of freedom\. MAE and MSE losses exhibit inconsistent behavior\. While MSE achieves the lowest test MAE \(3\.67\), it performs worse on the dev set and yields the highest test RMSE among all probabilistic losses\. The MAE loss underperforms across all metrics, suggesting it is less effective at learning stable sequence\-level representations in this setting\. In summary, Gaussian NLL offers the most reliable and generalizable performance when modeling uncertainty in PHQ\-8 prediction from textual time series\.

#### Effect of the Model Architecture\.

We conduct an ablation study to assess the contribution of individual architectural components in our probabilistic LSTM seq\-to\-seq model\. Each ablation variant disables a specific component \(attention, residual connections, or the variance prediction head\) while all other settings are held constant\. The models are trained for 50 epochs with early stopping \(patience of 15 epochs\)\. The final evaluation is performed on the test set using MAE, RMSE, and NLL, averaged over three random seeds\. Full experimental details are included in Appendix[C](https://arxiv.org/html/2511.04476#A3)\.

VariantMAEΔ\\DeltaMAE \(%\)RMSEΔ\\DeltaRMSE \(%\)NLLFull Model3\.85–4\.99–1\.05\- w/o Attention5\.91\+53\.297\.40\+48\.281\.56\- w/o Residual5\.34\+38\.526\.66\+33\.421\.43\- w/o Variance Head3\.99\+3\.575\.24\+5\.04–

Table 3:Ablation of architectural components averaged over three seeds\. Absolute scores and percentage change relative to the full model\. NLL is not applicable \(–\) for the variant without a variance head, as it produces only point estimates\.Table[3](https://arxiv.org/html/2511.04476#S4.T3)illustrates the effects of disabling each component\. Self\-attention produces the largest degradation when removed, with MAE increasing by 53\.3% and RMSE by 48\.3%\. This is expected given that interviews span up to 355 utterances \(median: 164\)\. Such a range over which recurrent hidden states alone can be insufficient to maintain coherent long\-range context\. Omitting residual connections also causes substantial performance drops \(MAE \+38\.5%, RMSE \+33\.4%\)\. Hence, skip connections are essential for stable gradient flow and effective feature reuse across layers\. Ablating the variance prediction head degrades performance across all metrics, including raw point\-estimate accuracy \(MAE \+3\.6%, RMSE \+5\.0%\), and results in the expected loss of calibrated uncertainty estimates\. We conjecture that probabilistic training acts as a form of regularisation and that by explicitly modeling aleatoric uncertainty, the model avoids over\-committing to noisy targets and achieves better generalization, which aligns withKendall and Gal \([2017](https://arxiv.org/html/2511.04476#bib.bib12)\)andSeitzer et al\. \([2022](https://arxiv.org/html/2511.04476#bib.bib30)\)\.

### 4\.4Hyperparameter Sensitivity

α\\alphaβ\\betaγ\\gammaNLL \(Dev\)NLL \(Test\)Description1111\.36741\.2439standard NLL1211\.47181\.4519uncertainty\-averse1121\.33631\.3766error\-focused110\.51\.45551\.4459calibration\-first

Table 4:Sensitivity analysis of Gaussian NLL loss weighting parametersα\\alpha,β\\beta, andγ\\gammaon the E\-DAIC seq\-to\-seq model \(single run\)\.Table[4](https://arxiv.org/html/2511.04476#S4.T4)reports the effect of the NLL weighting parametersβ\\beta\(log\-variance term\) andγ\\gamma\(normalised squared error term\)\. Theα\\alphaweights only the constantlog⁡\(2​π\)\\log\(2\\pi\)and therefore do not affect gradients\. The standard configuration \(β=γ=1\\beta=\\gamma=1\) achieves the lowest test NLL \(1\.2439\), which indicates a balanced trade\-off between data fit and uncertainty calibration\. A doubledβ\\beta\(“uncertainty\-averse”\) raises NLL on both splits, which suggests that excessive penalisation of predicted variance compresses the model’s uncertainty range\. A doubledγ\\gamma\(“error\-focused”\) yields a marginal Dev improvement but increases the test NLL to 1\.3766, consistent with overfitting\. A halvedγ\\gamma\(“calibration\-first”\) produces similarly elevated NLL, potentially because the weakened error term provides insufficient supervision for accurate mean predictions\. Hence, aggressive reweighting may destabilize the balance between sharpness and calibration, and the default Gaussian NLL remains the most reliable configuration\.

Beyond aggregate NLL, loss weighting also shapes how the model distributes uncertainty across severity levels \(Figure[2](https://arxiv.org/html/2511.04476#S4.F2)\)\. In the standard setting withα=β=γ=1\\alpha=\\beta=\\gamma=1, the predictedσ\\sigmavalues span a moderate range \(μσ=4\.0\\mu\_\{\\sigma\}=4\.0,x~=3\.8\\tilde\{x\}=3\.8,σσ=1\.9\\sigma\_\{\\sigma\}=1\.9\) and the five severity categories stay within\[0,10\]\[0,10\]\. Both theβ=2\\beta=2andγ=0\.5\\gamma=0\.5configurations compress predictions into a narrow band \(σσ=0\.6\\sigma\_\{\\sigma\}=0\.6and0\.80\.8, respectively\), which collapses severity\-level distinctions and limits clinical utility\. In contrast,γ=2\\gamma=2produces a wide distribution \(μσ=9\.5\\mu\_\{\\sigma\}=9\.5,σσ=6\.2\\sigma\_\{\\sigma\}=6\.2\) with better separation between severity groups, yet the inflated absolute values reflect miscalibration consistent with its elevated test NLL\.

![Refer to caption](https://arxiv.org/html/2511.04476v2/x2.png)Figure 2:Predicted uncertainty \(σ\\sigma\) by PHQ\-8 severity category under four loss configurations: standard NLL \(top\-left\), increased log\-variance penaltyβ=2\\beta=2\(top\-right\), error\-penalisedγ=2\\gamma=2\(bottom\-left\), and calibration\-focusedγ=0\.5\\gamma=0\.5\(bottom\-right\)\. Summary statistics \(μ\\mu,x~\\tilde\{x\},σ\\sigma\) refer to the distribution of predicted uncertainty across all test participants\.
### 4\.5Uncertainty Calibration and Interpretability

Accurate uncertainty quantification is critical in clinical NLP, where predictions may inform sensitive decisions\. We first evaluate PTTSD calibration using the Expected Calibration Error \(ECE\), empirical coverage, and visual diagnostics in Figure[3](https://arxiv.org/html/2511.04476#S4.F3)\. We then explore how predicted uncertainty evolves over time and correlates with error to offer insights into model interpretability and potential clinical utility\.

#### Calibration Metrics\.

Figure[3](https://arxiv.org/html/2511.04476#S4.F3)compares models trained with Gaussian NLL and MSE losses\. Each subplot presents \(i\) a binned calibration curve comparing predicted standard deviation and MAE; \(ii\) a scatter plot of predicted uncertainty vs\. observed error, and \(iii\) a coverage plot showing the percentage of ground truth values falling within model\-predicted confidence intervals\. Perfect calibration aligns with the diagonal in all plots\.

The Gaussian NLL model achieves a low ECE of 0\.0220 and near\-ideal 68% coverage \(66\.2%\), indicating well\-calibrated uncertainty\. It adapts confidence intervals to input ambiguity, producing sharp yet reliable estimates\. In contrast, the MSE\-based model is underconfident, with wide intervals \(84\.0% coverage\) and worse calibration \(ECE = 0\.0675\)\. Thus, probabilistic modeling provides more trustworthy uncertainty estimates than single\-point regression\.

![Refer to caption](https://arxiv.org/html/2511.04476v2/x3.png)\(a\)Probabilistic Gaussian NLL \(α=β=γ=1\\alpha=\\beta=\\gamma=1\)
![Refer to caption](https://arxiv.org/html/2511.04476v2/x4.png)\(b\)Point Estimate MSE

Figure 3:Calibration analysis of PTTSD seq\-to\-seq on DAIC test set \(Gaussian NLL vs\. MSE\)
#### Interpretable Temporal Behavior\.

To understand how uncertainty evolves over a session, Figure[4](https://arxiv.org/html/2511.04476#S4.F4)plots the average predicted uncertainty and absolute error across utterance positions\. Initially, both metrics are high due to limited context\. As the dialogue progresses, uncertainty decreases and stabilizes around timestep 250\. After timestep 300, the error begins to increase again, likely due to data sparsity, since only a few sessions exceed this length in the training set\.

![Refer to caption](https://arxiv.org/html/2511.04476v2/x5.png)Figure 4:Temporal dynamics of uncertainty and error across utterance positions \(Gaussian NLL\)\.
#### Error–Uncertainty Correlation\.

In addition to aggregate calibration, we report the correlation between error and uncertainty, since a useful uncertainty signal should covary with actual prediction error so that harder inputs receive wider intervals\. As shown in Figure[5](https://arxiv.org/html/2511.04476#S4.F5), PTTSD exhibits a strong correlation between predicted standard deviation and absolute error \(r=0\.88r=0\.88,ρ=0\.64\\rho=0\.64,p<0\.001p<0\.001\), which indicates that the model can meaningfully distinguish between confident and uncertain predictions\.

![Refer to caption](https://arxiv.org/html/2511.04476v2/x6.png)Figure 5:Correlation between predicted uncertainty and absolute error\.
#### Case Studies\.

Figure[6](https://arxiv.org/html/2511.04476#S4.F6)illustrates sequence\-level predictions for four representative participants that each capture a distinct uncertainty pattern\. Participant 634 represents the ideal case,*Accurate & Confident*: the prediction trajectory remains roughly constant and closely tracks the ground truth with narrow±1​σ\\pm 1\\sigmabands and a normalised error of0\.120\.12\. Participant 716 shows*Calibrated Uncertainty*during a more difficult narrative\. The model initially struggles with high error until utterance 70, likely because the participant reports a lack of memorable positive experiences and a complicated relationship with their girlfriend\. As the model processes more information, it converges to the ground truth, though it maintains wide confidence intervals \(ratio of0\.410\.41\), potentially due to the participant’s cryptic and short responses\.

Participant 640 exposes an*Overconfident Error*, the model’s worst\-case failure mode\. Despite a true score of1717, the model predicts low severity, with tight bands, resulting in a ratio of7\.687\.68\(outside2​σ2\\sigma\)\. Here, the transcript language may mask symptom severity\. Finally, Participant 710 is*Ambiguous but Correct*\. The model picks up on mentions of sleep deprivation and a PTSD diagnosis from six years ago\. The predicted PHQ\-8 score reaches a peak ofy^=8\.63\\hat\{y\}=8\.63at utterance 125\. The peak is accompanied by increased uncertainty, likely due to a lack of signals in the preceding dialogue\. Interestingly, the predicted score later decreases toward the ground truth \(\|y−y^\|=0\.32\|y\-\\hat\{y\}\|=0\.32, marked by ✩ at utterance 140\) as the participant reports feeling more in control and mentions attending a concert\. While the model hedges with broad intervals \(σ=4\.53\\sigma=4\.53\), it successfully captures the shifting sentiment\.

Participants 716 and 640 represent extreme cases\. In aggregate, however, the model’s typical behavior is closer to the participants 6134 and 710 with accurate predictions and with uncertainty that reflects input ambiguity, which aligns with the quantitative evaluation presented before\. Overall, the case studies visually demonstrate the practical value of uncertainty quantification\. PTTSD identifies both predictions clinicians can trust and those that warrant caution\.

![Refer to caption](https://arxiv.org/html/2511.04476v2/x7.png)Figure 6:Case studies illustrating four uncertainty regimes\. Each row shows one participant with \(a\) sequence\-level PHQ\-8 predictions and±1​σ\\pm 1\\sigmaintervals, \(b\) the critical context window, and \(c\) a calibration summary comparing\|y−y^\|\|y\-\\hat\{y\}\|,σ\\sigma, and their ratio\. Rows from top to bottom:*Accurate & Confident*\(Participant 634\),*Calibrated Uncertainty*\(Participant 716\),*Overconfident Error*\(Participant 640\), and*Ambiguous but Correct*\(Participant 710\)\.

## 5Conclusion

We introduced PTTSD, a probabilistic framework for predicting PHQ\-8 depression severity from utterance\-level clinical interviews\. PTTSD outputs calibrated Gaussian or Student\-ttdistributions rather than point estimates, such that clinicians receive both a predicted severity and a model\-confidence signal alongside it\.

A key design feature is the seq\-to\-seq variant, which reveals how the model’s belief evolves over an interview, even though the target is a single session\-level score\. This provides temporal interpretability as we can identify when the model becomes confident, which utterances drive prediction shifts, and where ambiguity persists\. Our calibration analyses confirm that predicted uncertainty is well\-aligned with actual error \(r=0\.88r=0\.88, ECE = 0\.022\), and case studies illustrate how these properties manifest at the individual participant level\.

Our experiments on DAIC and E\-DAIC show competitive performance among text\-only systems\. While accuracy degrades on the original E\-DAIC transcripts relative to WhisperX re\-transcriptions, the calibration and uncertainty properties — our main contribution — hold across transcript sources\. Future work includes multimodal extensions to complement text with prosodic and visual signals, and clinical validation to evaluate whether uncertainty estimates inform practitioner decisions\.

## Limitations

While PTTSD offers promising results in predictive accuracy and uncertainty modeling, several limitations remain\. First, the framework relies solely on textual data\. Although effective, it does not leverage multimodal cues such as vocal prosody or facial expressions, which are known to be informative for assessing mental health\. Second, the E\-DAIC dataset contains fewer than 300 participants, and further reduction due to filtering and partitioning limits the statistical power and generalizability of our findings to broader clinical settings\. Third, the interviews in E\-DAIC are conducted with a virtual interviewer \("Ellie"\) operated in a Wizard\-of\-Oz setup rather than a real clinician, which may affect the ecological validity of the speech data and limit applicability to authentic client–clinician interactions\. In terms of modeling, we encode utterances independently using pretrained language models without context\-aware finetuning, potentially overlooking local coherence or discourse\-level cues\. Furthermore, while PTTSD provides distributional predictions, we do not assess its clinical utility or decision\-support value\. Human\-centered evaluations with therapists or end users are needed to determine the interpretability and trustworthiness of predicted uncertainty\. Finally, although we evaluate calibration quantitatively, we do not study how uncertainty scores might be perceived or utilized by clinicians in real\-world settings\.

## References

- Al Hanai et al\. \(2018\)Tuka Al Hanai, Mohammad M Ghassemi, and James R Glass\. 2018\.Detecting depression with audio/text sequence modeling of interviews\.In*Interspeech*, pages 1716–1720\.
- Burdisso et al\. \(2023\)Sergio Burdisso, Esaú Villatoro\-Tello, Srikanth Madikeri, and Petr Motlicek\. 2023\.[Node\-weighted graph convolutional network for depression detection in transcribed clinical interviews](https://doi.org/10.21437/Interspeech.2023-1923)\.In*INTERSPEECH 2023*, pages 3617–3621\.
- Chen et al\. \(2024\)Zhuang Chen, Jiawen Deng, Jinfeng Zhou, Jincenzi Wu, Tieyun Qian, and Minlie Huang\. 2024\.[Depression detection in clinical interviews with LLM\-empowered structural element graph](https://doi.org/10.18653/v1/2024.naacl-long.452)\.In*Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\)*, pages 8181–8194, Mexico City, Mexico\. Association for Computational Linguistics\.
- DAIC‑WOZ Project \(2019\)DAIC‑WOZ Project\. 2019\.[Extended distress analysis interview corpus–wizard of oz \(e‑daic\)](https://dcapswoz.ict.usc.edu/extended-daic-database-download/)\.Extended DAIC Database, downloadable via the DAIC‑WOZ project website at dcapswoz\.ict\.usc\.edu\.AVEC 2019 subset: 275 sessions \(163 train, 56 dev, 56 test\); includes audio, transcripts, visual and acoustic features; Accessed: 2025\-01\-30\.
- Dia et al\. \(2024\)Mamadou Dia, Ghazaleh Khodabandelou, and Alice Othmani\. 2024\.Paying attention to uncertainty: A stochastic multimodal transformers for post\-traumatic stress disorder detection using video\.*Computer Methods and Programs in Biomedicine*, 257:108439\.
- Fang et al\. \(2023a\)Ming Fang, Siyu Peng, Yujia Liang, Chih\-Cheng Hung, and Shuhua Liu\. 2023a\.A multimodal fusion model with multi\-level attention mechanism for depression detection\.*Biomedical Signal Processing and Control*, 82:104561\.
- Fang et al\. \(2023b\)Ming Fang, Siyu Peng, Yujia Liang, Chih\-Cheng Hung, and Shuhua Liu\. 2023b\.A multimodal fusion model with multi\-level attention mechanism for depression detection\.*Biomedical Signal Processing and Control*, 82:104561\.
- Gong and Poellabauer \(2017\)Yuan Gong and Christian Poellabauer\. 2017\.[Topic modeling based multi\-modal depression detection](https://doi.org/10.1145/3133944.3133945)\.In*Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge*, AVEC ’17, page 69–76, New York, NY, USA\. Association for Computing Machinery\.
- Gratch et al\. \(2014\)Jonathan Gratch, Ron Artstein, Gale Lucas, Giota Stratou, Stefan Scherer, Angela Nazarian, Rachel Wood, Jill Boberg, David DeVault, Stacy Marsella, David Traum, Skip Rizzo, and Louis\-Philippe Morency\. 2014\.[The distress analysis interview corpus of human and computer interviews](https://aclanthology.org/L14-1421/)\.In*Proceedings of the Ninth International Conference on Language Resources and Evaluation \(LREC‘14\)*, pages 3123–3128, Reykjavik, Iceland\. European Language Resources Association \(ELRA\)\.
- Guo et al\. \(2022\)Yanrong Guo, Chenyang Zhu, Shijie Hao, and Richang Hong\. 2022\.A topic\-attentive transformer\-based model for multimodal depression detection\.*arXiv preprint arXiv:2206\.13256*\.
- Ji et al\. \(2022\)Shaoxiong Ji, Tianlin Zhang, Luna Ansari, Jie Fu, Prayag Tiwari, and Erik Cambria\. 2022\.[MentalBERT: Publicly available pretrained language models for mental healthcare](https://aclanthology.org/2022.lrec-1.778/)\.In*Proceedings of the Thirteenth Language Resources and Evaluation Conference*, pages 7184–7190, Marseille, France\. European Language Resources Association\.
- Kendall and Gal \(2017\)Alex Kendall and Yarin Gal\. 2017\.[What uncertainties do we need in bayesian deep learning for computer vision?](https://proceedings.neurips.cc/paper_files/paper/2017/file/2650d6089a6d640c5e85b2b88265dc2b-Paper.pdf)In*Advances in Neural Information Processing Systems*, volume 30\. Curran Associates, Inc\.
- Kroenke et al\. \(2009\)Kurt Kroenke, Tara W Strine, Robert L Spitzer, Janet BW Williams, Joyce T Berry, and Ali H Mokdad\. 2009\.The phq\-8 as a measure of current depression in the general population\.*Journal of affective disorders*, 114\(1\-3\):163–173\.
- Li and Zhou \(2025\)Yonghong Li and Xiuzhuang Zhou\. 2025\.Fair uncertainty quantification for depression prediction\.*arXiv preprint arXiv:2505\.04931*\.
- Makiuchi et al\. \(2019\)Mariana Rodrigues Makiuchi, Tifani Warnita, Kuniaki Uto, and Koichi Shinoda\. 2019\.[Multimodal fusion of bert\-cnn and gated cnn representations for depression detection](https://doi.org/10.1145/3347320.3357694)\.In*Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop*, AVEC ’19, page 55–63, New York, NY, USA\. Association for Computing Machinery\.
- Mandal et al\. \(2025\)Aishik Mandal, Dana Atzil\-Slonim, Thamar Solorio, and Iryna Gurevych\. 2025\.[Enhancing depression detection via question\-wise modality fusion](https://aclanthology.org/2025.clpsych-1.4/)\.In*Proceedings of the 10th Workshop on Computational Linguistics and Clinical Psychology \(CLPsych 2025\)*, pages 44–61, Albuquerque, New Mexico\. Association for Computational Linguistics\.
- Mao et al\. \(2023\)Kaining Mao, Wei Zhang, Deborah Baofeng Wang, Ang Li, Rongqi Jiao, Yanhui Zhu, Bin Wu, Tiansheng Zheng, Lei Qian, Wei Lyu, Minjie Ye, and Jie Chen\. 2023\.[Prediction of depression severity based on the prosodic and semantic features with bidirectional lstm and time distributed cnn](https://doi.org/10.1109/TAFFC.2022.3154332)\.*IEEE Transactions on Affective Computing*, 14\(3\):2251–2265\.
- Muennighoff et al\. \(2023\)Niklas Muennighoff, Nouamane Tazi, Loic Magne, and Nils Reimers\. 2023\.[MTEB: Massive text embedding benchmark](https://doi.org/10.18653/v1/2023.eacl-main.148)\.In*Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics*, pages 2014–2037, Dubrovnik, Croatia\. Association for Computational Linguistics\.
- Niu et al\. \(2021\)Meng Niu, Kai Chen, Qingcai Chen, and Lufeng Yang\. 2021\.[Hcag: A hierarchical context\-aware graph attention model for depression detection](https://doi.org/10.1109/ICASSP39728.2021.9413486)\.In*ICASSP 2021 \- 2021 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\)*, pages 4235–4239\.
- Nykoniuk et al\. \(2025\)Mariia Nykoniuk, Oleh Basystiuk, Nataliya Shakhovska, and Nataliia Melnykova\. 2025\.Multimodal data fusion for depression detection approach\.*Computation*, 13\(1\):9\.
- Oureshi et al\. \(2021\)Syed Arbaaz Oureshi, Gaël Dias, Sriparna Saha, and Mohammed Hasanuzzaman\. 2021\.[Gender\-aware estimation of depression severity level in a multimodal setting](https://doi.org/10.1109/IJCNN52387.2021.9534330)\.In*2021 International Joint Conference on Neural Networks \(IJCNN\)*, pages 1–8\.
- Paszke et al\. \(2019\)Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, and 2 others\. 2019\.[Pytorch: An imperative style, high\-performance deep learning library](https://papers.nips.cc/paper_files/paper/2019/hash/bdbca288fee7f92f2bfa9f7012727740-Abstract.html)\.In*Advances in Neural Information Processing Systems*, volume 32\.
- Qureshi et al\. \(2019a\)Syed Arbaaz Qureshi, Mohammed Hasanuzzaman, Sriparna Saha, and Gaël Dias\. 2019a\.The verbal and non verbal signals of depression–combining acoustics, text and visuals for estimating depression level\.*arXiv preprint arXiv:1904\.07656*\.
- Qureshi et al\. \(2019b\)Syed Arbaaz Qureshi, Sriparna Saha, Mohammed Hasanuzzaman, and Gaël Dias\. 2019b\.Multitask representation learning for multimodal estimation of depression level\.*IEEE Intelligent Systems*, 34\(5\):45–52\.
- Ray et al\. \(2019\)Anupama Ray, Siddharth Kumar, Rutvik Reddy, Prerana Mukherjee, and Ritu Garg\. 2019\.[Multi\-level attention network using text, audio and video for depression prediction](https://doi.org/10.1145/3347320.3357697)\.In*Proceedings of the 9th International on Audio/Visual Emotion Challenge and Workshop*, AVEC ’19, page 81–88, New York, NY, USA\. Association for Computing Machinery\.
- Reimers and Gurevych \(2019\)Nils Reimers and Iryna Gurevych\. 2019\.[Sentence\-BERT: Sentence embeddings using Siamese BERT\-networks](https://doi.org/10.18653/v1/D19-1410)\.In*Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing \(EMNLP\-IJCNLP\)*, pages 3982–3992, Hong Kong, China\. Association for Computational Linguistics\.
- Rohanian et al\. \(2019\)Morteza Rohanian, Julian Hough, and Matthew Purver\. 2019\.[Detecting depression with word\-level multimodal fusion](https://doi.org/10.21437/Interspeech.2019-2283)\.In*INTERSPEECH 2019*, pages 1443–1447\.
- Sadeghi et al\. \(2023\)Misha Sadeghi, Bernhard Egger, Reza Agahi, Robert Richer, Klara Capito, Lydia Helene Rupp, Lena Schindler\-Gmelch, Matthias Berking, and Bjoern M\. Eskofier\. 2023\.[Exploring the capabilities of a language model\-only approach for depression detection in text data](https://doi.org/10.1109/BHI58575.2023.10313367)\.In*2023 IEEE EMBS International Conference on Biomedical and Health Informatics \(BHI\)*, pages 1–5\.
- Sadeghi et al\. \(2024\)Misha Sadeghi, Robert Richer, Bernhard Egger, Lena Schindler\-Gmelch, Lydia Helene Rupp, Farnaz Rahimi, Matthias Berking, and Bjoern M Eskofier\. 2024\.Harnessing multimodal approaches for depression detection using large language models and facial expressions\.*npj Mental Health Research*, 3\(1\):66\.
- Seitzer et al\. \(2022\)Maximilian Seitzer, Arash Tavakoli, Dimitrije Antic, and Georg Martius\. 2022\.[On the pitfalls of heteroscedastic uncertainty estimation with probabilistic neural networks](https://openreview.net/forum?id=aPOpXlnV1T)\.In*International Conference on Learning Representations*\.
- Stepanov et al\. \(2018\)Evgeny A\. Stepanov, Stéphane Lathuilière, Shammur Absar Chowdhury, Arindam Ghosh, Radu\-Laurenţiu Vieriu, Nicu Sebe, and Giuseppe Riccardi\. 2018\.[Depression severity estimation from multiple modalities](https://doi.org/10.1109/HealthCom.2018.8531119)\.In*2018 IEEE 20th International Conference on e\-Health Networking, Applications and Services \(Healthcom\)*, pages 1–6\.
- WHO \(2017\)WHO\. 2017\.[Depression and other common mental disorders: Global health estimates](https://www.who.int/publications/i/item/depression-global-health-estimates)\.Technical report, World Health Organization, Geneva\.WHO/MSD/MER/2017\.2\.
- WHO \(2022\)WHO\. 2022\.[World mental health report: Transforming mental health for all](https://www.who.int/publications/i/item/9789240049338)\.Accessed: 2025\-05\-18\.
- Williamson et al\. \(2016\)James R\. Williamson, Elizabeth Godoy, Miriam Cha, Adrianne Schwarzentruber, Pooya Khorrami, Youngjune Gwon, Hsiang\-Tsung Kung, Charlie Dagli, and Thomas F\. Quatieri\. 2016\.[Detecting depression using vocal, facial and semantic communication cues](https://doi.org/10.1145/2988257.2988263)\.In*Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge*, AVEC ’16, page 11–18, New York, NY, USA\. Association for Computing Machinery\.
- Yang et al\. \(2017\)Le Yang, Dongmei Jiang, Xiaohan Xia, Ercheng Pei, Meshia Cédric Oveneke, and Hichem Sahli\. 2017\.[Multimodal measurement of depression using deep learning models](https://doi.org/10.1145/3133944.3133948)\.In*Proceedings of the 7th Annual Workshop on Audio/Visual Emotion Challenge*, AVEC ’17, page 53–59, New York, NY, USA\. Association for Computing Machinery\.
- Zhang and Guo \(2024\)Jun Zhang and Yanrong Guo\. 2024\.[Multilevel depression status detection based on fine\-grained prompt learning](https://doi.org/10.1016/j.patrec.2024.01.005)\.*Pattern Recogn\. Lett\.*, 178\(C\):167–173\.
- Zhang et al\. \(2025\)Xu Zhang, Chenlong Li, Weisi Chen, Jiaxin Zheng, and Feihong Li\. 2025\.Optimizing depression detection in clinical doctor\-patient interviews using a multi\-instance learning framework\.*Scientific Reports*, 15\(1\):6637\.

## Appendix APHQ\-8 Depression Assessment

The Patient Health Questionnaire\-8 \(PHQ\-8\)Kroenke et al\. \([2009](https://arxiv.org/html/2511.04476#bib.bib13)\)is a widely used self\-report scale designed to measure the presence and severity of depressive symptoms\. It is derived from the PHQ\-9 but omits the ninth item concerning suicidal thoughts, making it more suitable for large\-scale screening and automated processing\.

Each of the eight items corresponds to a DSM\-IV criterion for depression and asks respondents to rate how often they have experienced a specific symptom over the past two weeks\. Responses are scored on a 4\-point Likert scale:

- •0 – Not at all
- •1 – Several days
- •2 – More than half the days
- •3 – Nearly every day

The total PHQ\-8 score ranges from 0 to 24 and is interpreted as follows:

- •0–4: None
- •5–9: Mild depression
- •10–14: Moderate depression
- •15–19: Moderately severe depression
- •20–24: Severe depression

The PHQ\-8 has been validated in both clinical and general populations and is considered a reliable proxy for identifying depressive symptom severity in mental health research\.

## Appendix BDistress Analysis Interview Corpus \(DAIC and E\-DAIC\)

TheDistress Analysis Interview Corpus\(DAIC\-WOZ\)Gratch et al\. \([2014](https://arxiv.org/html/2511.04476#bib.bib9)\)and its extended version,E\-DAICDAIC‑WOZ Project \([2019](https://arxiv.org/html/2511.04476#bib.bib4)\), are widely used datasets for research in automated depression detection\. Both datasets contain semi\-structured clinical interviews conducted by a virtual interviewer named Ellie, operated via a "Wizard\-of\-Oz" setup, to elicit verbal and non\-verbal indicators of psychological distress\.

### B\.1E\-DAIC vs\. DAIC\-WOZ

The E\-DAIC corpus is a re\-transcribed and quality\-controlled extension of DAIC\-WOZ\. It corrects known transcription errors and inconsistencies, and provides standardized splits for training, development, and testing\. While DAIC\-WOZ has been extensively used in prior work, E\-DAIC offers improved data quality and is recommended for text\-based modeling tasks\.

### B\.2Dataset Composition

E\-DAIC consists of 275 participant interviews, partitioned as follows:

- •Training set: 163 participants
- •Development set: 56 participants
- •Test set: 56 participants

Each session includes:

- •Audio recordings: Interview audio in WAV format\.
- •Transcripts: Time\-stamped dialogue with speaker labels\.
- •Visual features: Extracted using OpenFace, including facial landmarks, action units, and head pose\.
- •Acoustic features: Extracted via COVAREP and FORMANT analysis\.
- •PHQ\-8 scores: Self\-reported ratings of depression severity\.

### B\.3Data Organization

The dataset is organized into session\-specific folders identified by participant IDs \(e\.g\.,300\_P\), each containing:

- •TRANSCRIPT\.csv: Annotated dialogue transcript\.
- •AUDIO\.wav: Raw audio file\.
- •COVAREP\.csv,FORMANT\.csv: Acoustic features\.
- •CLNF\_features\.txt,CLNF\_AUs\.csv,CLNF\_pose\.txt,CLNF\_gaze\.txt: Visual features extracted using OpenFace\.

Additional metadata includes:

- •train\_split\.csv,dev\_split\.csv,test\_split\.csv: Partition definitions\.
- •PHQ8\_scores\.csv: Item\-level and total PHQ\-8 responses\.

### B\.4PHQ\-8 Score Distribution

PHQ\-8 scores in both DAIC and E\-DAIC range from 0 to 24, capturing varying levels of depressive symptom severity\. The distribution is right\-skewed, with a concentration of low\-to\-moderate severity cases, which presents challenges for model calibration and minority class performance\.

### B\.5Usage Considerations

Researchers working with DAIC or E\-DAIC should consider the following:

- •Data Quality: E\-DAIC addresses known issues in DAIC\-WOZ, including transcript errors and missing data, and is recommended for textual modeling\.
- •Ethical Use: Given the sensitive nature of the interviews, ethical guidelines and approvals must be followed\.
- •Licensing: Access requires agreement to the dataset’s End User License Agreement \(EULA\)\.

Our use of both datasets complies with their intended research purpose\. The corpora were released to support research on automated detection of psychological distress and related mental health conditions\. In this work, we focus exclusively on the prediction of PHQ\-8 depression severity from textual transcripts, a primary task for which the dataset was designed\. The datasets are anonymized at source, with personally identifiable information removed prior to distribution\. We further restrict our usage to non\-commercial, academic settings, operate solely on de\-identified utterance sequences, and report only aggregate results\. No individual\-level data or metadata are released\. All use complies with the dataset’s End User License Agreement \(EULA\) and contributes to its intended goal of advancing computational methods for mental health assessment\.

For detailed information on data preprocessing and feature extraction methodologies, refer to the official documentation provided with the dataset\.

## Appendix CAblation Study Experimental Setup

For each ablation, we use the same data splits, batch size, optimizer, learning rate schedule, and early stopping criteria as the main experiments\. The following configurations are evaluated:

- •Full Model: All components enabled \(attention, residual, variance\)\.
- •No Attention: Attention layer removed\.
- •No Residual: Residual connection removed\.
- •No Variance: Variance prediction head disabled; model trained with MSE loss\.

Each model is trained for the same number of epochs with fixed random seeds for reproducibility\. After training, we evaluate on the held\-out test set and report MAE, RMSE, and NLL \(where available\)\. All code, configurations, and results are available for reproducibility\.

## Appendix DImplementation Details

### D\.1Implementation\.

All models are implemented in PyTorchPaszke et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib22)\)\. Padding, batching, and masking ensure that variable\-length sequences do not affect loss or metric computations\.

### D\.2Hardware\.

Training is performed on a single NVIDIA A100\-SXM4\-80GB GPU with 80GB of GDDR6 VRAM, using CUDA version 12\.2\.

### D\.3Runtime\.

Training PTTSD for 50 epochs on a single NVIDIA A100–80 GB takes ~2h 23min in wall\-clock time \(≈\\approx172 s per epoch\)\. The model has a total 2,703,403 trainable parameters\.

### D\.4Terminology\.

Throughout, we avoid “valid/invalid utterances\.” We instead say*padded positions are masked*and we compute losses/metrics over*non\-padded*positions only\.

### D\.5Batching, Padding, and Masking

We batch at the*participant/session*level\. Variable\-length sequences are right\-padded to the maximum length in the batch\. A Boolean mask𝐦∈\{0,1\}T\\mathbf\{m\}\\\!\\in\\\!\\\{0,1\\\}^\{T\}\(per sequence\) is propagated so that: \(i\) attention, \(ii\) pooling, \(iii\) loss, and \(iv\) metric computations exclude padded positions\. This mask is applied within the attention mechanism and used to zero\-out contributions from padded indices\.

### D\.6Pooling Mechanics \(seq\-to\-one\)

For the seq\-to\-one variant, we apply*average pooling over time*on the attended sequence𝐀∈ℝT×H\\mathbf\{A\}\\\!\\in\\\!\\mathbb\{R\}^\{T\\times H\}:

𝐚¯=1∑tmt​∑t=1Tmt​𝐚t,\\bar\{\\mathbf\{a\}\}\\;=\\;\\frac\{1\}\{\\sum\_\{t\}m\_\{t\}\}\\sum\_\{t=1\}^\{T\}m\_\{t\}\\,\\mathbf\{a\}\_\{t\},wheremt∈\{0,1\}m\_\{t\}\\\!\\in\\\!\\\{0,1\\\}masks out padding\. \(In the main text, we simply refer to this as*average pooling*; masking only excludes padding and does not introduce a new modeling component\.\)

### D\.7Tokenization and Utterance Embeddings

We evaluate two encoders: \(i\)all\-MiniLM\-L6\-v2\(Sentence\-Transformers\) with mean pooling over tokens; and \(ii\)MentalBERTwith the final\[CLS\]vector as utterance embedding\. We follow each model’s default casing, tokenization, and truncation rules\. The stacked utterance matrix is𝐗∈ℝT×D\\mathbf\{X\}\\\!\\in\\\!\\mathbb\{R\}^\{T\\times D\}\(orB×T×DB\\times T\\times Din batched form\)\.

### D\.8Optimization, Schedules, and Targets

We use Adam with cosine\-annealed learning rate, training for 50 epochs with early stopping on development MAE \(patience 15\)\. Initial learning rate2×10−42\\times 10^\{\-4\}decays smoothly to10−410^\{\-4\}\. We apply a log\-transform to targets during training for stability and invert it at evaluation\.

## Appendix EPredictive Distributions and NLL Details

### E\.1Loss Aggregation: seq\-to\-one vs\. seq\-to\-seq

Forseq\-to\-one, the loss is the negative log\-likelihood \(NLL\) of the session\-level prediction:

ℒseq\-to\-one=−log⁡p​\(y∣e1:T;θ\)\.\\mathcal\{L\}\_\{\\text\{seq\-to\-one\}\}\\;=\\;\-\\log p\\\!\\left\(y\\mid e\_\{1:T\};\\theta\\right\)\.Forseq\-to\-seq, we average the per\-step NLL across non\-padded time steps:

ℒseq\-to\-seq=−1∑tmt​∑t=1Tmt​log⁡p​\(y∣e≤t;θ\)\.\\mathcal\{L\}\_\{\\text\{seq\-to\-seq\}\}\\;=\\;\-\\frac\{1\}\{\\sum\_\{t\}m\_\{t\}\}\\sum\_\{t=1\}^\{T\}m\_\{t\}\\,\\log p\\\!\\left\(y\\mid e\_\{\\leq t\};\\theta\\right\)\.

### E\.2Gaussian Negative Log\-Likelihood

With predicted meanμ^t\\hat\{\\mu\}\_\{t\}and standard deviationσ^t\\hat\{\\sigma\}\_\{t\},

ℒGauss=1M∑t=1Tmt\[αlog\(2π\)\+βlogσ^t2\+γ\(y−μ^t\)2/σ^t2\]\.\\mathcal\{L\}\_\{\\text\{Gauss\}\}=\\frac\{1\}\{M\}\\sum\_\{t=1\}^\{T\}m\_\{t\}\\Bigl\[\\alpha\\log\(2\\pi\)\+\\beta\\log\\hat\{\\sigma\}\_\{t\}^\{2\}\\\\ \+\\gamma\\,\(y\-\\hat\{\\mu\}\_\{t\}\)^\{2\}/\\hat\{\\sigma\}\_\{t\}^\{2\}\\Bigr\]\.Unless stated otherwise,α=β=γ=1\\alpha\\\!=\\\!\\beta\\\!=\\\!\\gamma\\\!=\\\!1\.

### E\.3Student’s\-ttDensity

With\(μ^t,σ^t,νt\)\(\\hat\{\\mu\}\_\{t\},\\hat\{\\sigma\}\_\{t\},\\nu\_\{t\}\),

p​\(y\)=Γ​\(ν\+12\)Γ​\(ν2\)​ν​π​σ^​\[1\+1ν​\(y−μ^σ^\)2\]−ν\+12\.p\(y\)=\\frac\{\\Gamma\\\!\\left\(\\frac\{\\nu\+1\}\{2\}\\right\)\}\{\\Gamma\\\!\\left\(\\frac\{\\nu\}\{2\}\\right\)\\sqrt\{\\nu\\pi\}\\,\\hat\{\\sigma\}\}\\left\[1\+\\frac\{1\}\{\\nu\}\\left\(\\frac\{y\-\\hat\{\\mu\}\}\{\\hat\{\\sigma\}\}\\right\)^\{2\}\\right\]^\{\-\\frac\{\\nu\+1\}\{2\}\}\.We observed that Gaussian heads were the most stable and best calibrated in our setting; Student’s\-ttis included for completeness\.

### E\.4Auxiliary Objectives

We report MAE/MSE baselines for reference:

ℒMSE=1∑tmt​∑t=1Tmt​\(y−μ^t\)2,\\mathcal\{L\}\_\{\\text\{MSE\}\}=\\frac\{1\}\{\\sum\_\{t\}m\_\{t\}\}\\sum\_\{t=1\}^\{T\}m\_\{t\}\\,\(y\-\\hat\{\\mu\}\_\{t\}\)^\{2\},ℒMAE=1∑tmt​∑t=1Tmt​\|y−μ^t\|\.\\mathcal\{L\}\_\{\\text\{MAE\}\}=\\frac\{1\}\{\\sum\_\{t\}m\_\{t\}\}\\sum\_\{t=1\}^\{T\}m\_\{t\}\\,\|y\-\\hat\{\\mu\}\_\{t\}\|\.

## Appendix FResults on Original E\-DAIC Transcripts

To ensure fair comparison with prior work that used the original E\-DAIC transcripts rather than WhisperX re\-transcriptions, we evaluate PTTSD under the same seq\-to\-seq Gaussian NLL configuration on the unaltered transcripts\. Table[5](https://arxiv.org/html/2511.04476#A6.T5)reports mean and standard deviation over multiple runs\.

Table 5:Results on E\-DAIC with original transcripts \(seq\-to\-seq, Gaussian NLL\)\. Mean and standard deviation over multiple runs\.ModelVal NLLVal MAEVal RMSETest NLLTest MAETest RMSEMiniLMMean1\.334\.105\.061\.314\.635\.56Std0\.040\.040\.090\.070\.100\.09MentalBERTMean1\.343\.494\.521\.324\.605\.58Std0\.220\.070\.200\.220\.090\.09

Performance on original transcripts is expectedly weaker than on re\-transcribed data \(e\.g\., MiniLM test MAE increases from 3\.85 to 4\.63\), confirming that transcript quality meaningfully affects downstream regression accuracy\. Nonetheless, PTTSD remains competitive with prior text\-only systems on the original transcripts, and the calibration and uncertainty modeling capabilities—which constitute the paper’s primary contributions—are preserved regardless of transcript source\.

## Appendix GStatistical Significance Tests

We report two sets of significance tests to support the comparisons in Table[1](https://arxiv.org/html/2511.04476#S4.T1)\.

#### Setup\.

PTTSD results are reported as mean±\\pmstandard deviation overn=3n=3independent runs with different random seeds\. Baseline values are single reported point estimates \(no variance available\)\. Against baselines, we apply aone\-samplett\-testtreating the baseline as a known constant \(df=n−1=2\\text\{df\}=n\-1=2, one\-tailed,H1​: PTTSD<baselineH\_\{1\}\\text\{: PTTSD\}<\\text\{baseline\}, i\.e\. lower error is better\)\. Between PTTSD variants, we applyWelch’stt\-test\(two\-tailed, Welch–Satterthwaite degrees of freedom\)\. Allpp\-values are reported as\-is without multiplicity correction\. Given the small number of runs \(n=3n=3\), results should be interpreted conservatively\.

#### Significance codes\.

p<0\.001p<0\.001:∗∗∗;p<0\.01p<0\.01:∗∗;p<0\.05p<0\.05:∗;p<0\.10p<0\.10:†;p≥0\.10p\\geq 0\.10: ns\.

Table 6:One\-samplett\-tests: best PTTSD variant vs\. baselines\.H1H\_\{1\}: PTTSD mean<<baseline \(lower MAE / RMSE is better\)\. df = 2 throughout\.DatasetBaselineMetricBaselinettppBest PTTSD on DAIC: seq\-to\-one \(MiniLM\), MAE=3\.55±0\.15=\\,3\.55\\pm 0\.15DAICFang et al\. \([2023b](https://arxiv.org/html/2511.04476#bib.bib7)\)MAE3\.61−0\.693\-0\.6930\.280DAICGong and Poellabauer \([2017](https://arxiv.org/html/2511.04476#bib.bib8)\)MAE3\.96−4\.734\-4\.7340\.021∗DAICRohanian et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib27)\)MAE4\.98−16\.512\-16\.5120\.002∗∗DAICStepanov et al\. \([2018](https://arxiv.org/html/2511.04476#bib.bib31)\)MAE4\.88−15\.358\-15\.3580\.002∗∗Best PTTSD on DAIC: seq\-to\-one \(MentalBERT\), RMSE=4\.69±0\.24=\\,4\.69\\pm 0\.24DAICFang et al\. \([2023b](https://arxiv.org/html/2511.04476#bib.bib7)\)RMSE4\.76−0\.505\-0\.5050\.332DAICGong and Poellabauer \([2017](https://arxiv.org/html/2511.04476#bib.bib8)\)RMSE4\.99−2\.165\-2\.1650\.081†DAICRohanian et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib27)\)RMSE6\.05−9\.815\-9\.8150\.005∗∗DAICStepanov et al\. \([2018](https://arxiv.org/html/2511.04476#bib.bib31)\)RMSE5\.83−8\.227\-8\.2270\.007∗∗Best PTTSD on E\-DAIC: seq\-to\-seq \(MiniLM\), MAE=3\.85±0\.04=\\,3\.85\\pm 0\.04E\-DAICSadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)Pr3\+WMAE4\.22−16\.021\-16\.0210\.002∗∗E\-DAICSadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)Pr3\+W\+AQ‡MAE3\.86−0\.433\-0\.4330\.354E\-DAICSadeghi et al\. \([2023](https://arxiv.org/html/2511.04476#bib.bib28)\)MAE4\.26−17\.754\-17\.7540\.002∗∗E\-DAICRay et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib25)\)MAE4\.02−7\.361\-7\.3610\.009∗∗Best PTTSD on E\-DAIC: seq\-to\-seq \(MiniLM\), RMSE=4\.52±0\.38=\\,4\.52\\pm 0\.38E\-DAICSadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)Pr3\+WRMSE5\.07−2\.507\-2\.5070\.065†E\-DAICSadeghi et al\. \([2024](https://arxiv.org/html/2511.04476#bib.bib29)\)Pr3\+W\+AQ‡RMSE4\.66−0\.638\-0\.6380\.294E\-DAICSadeghi et al\. \([2023](https://arxiv.org/html/2511.04476#bib.bib28)\)RMSE5\.37−3\.874\-3\.8740\.030∗E\-DAICRay et al\. \([2019](https://arxiv.org/html/2511.04476#bib.bib25)\)RMSE4\.73−0\.957\-0\.9570\.220
‡Pr3\+Whisper\+AudioQual is not text\-only \(uses audio quality gating\); comparisons with this variant should be interpreted with particular caution\. Pr3\+W = Pr3\+Whisper\.

Table 7:Welch’stt\-tests between all pairs of PTTSD variants on the test set \(two\-tailed;n=3n=3per variant\)\.DatasetVariant A vs\. Variant BMetricx¯A\\bar\{x\}\_\{A\}x¯B\\bar\{x\}\_\{B\}ttppDAICDAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MentalBERT\)MAE3\.653\.92−0\.791\-0\.7910\.491 nsDAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)MAE3\.653\.55\+0\.612\+0\.6120\.580 nsDAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)MAE3\.653\.88−0\.839\-0\.8390\.459 nsDAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)MAE3\.923\.55\+1\.143\+1\.1430\.358 nsDAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)MAE3\.923\.88\+0\.102\+0\.1020\.924 nsDAICseq\-to\-one \(MiniLM\) vs\. seq\-to\-seq \(MiniLM\)MAE3\.553\.88−1\.309\-1\.3090\.297 nsDAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MentalBERT\)RMSE4\.694\.79−0\.293\-0\.2930\.790 nsDAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)RMSE4\.694\.77−0\.238\-0\.2380\.828 nsDAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)RMSE4\.695\.10−0\.747\-0\.7470\.525 nsDAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)RMSE4\.794\.77\+0\.046\+0\.0460\.966 nsDAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)RMSE4\.795\.10−0\.503\-0\.5030\.647 nsDAICseq\-to\-one \(MiniLM\) vs\. seq\-to\-seq \(MiniLM\)RMSE4\.775\.10−0\.538\-0\.5380\.626 nsE\-DAICE\-DAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MentalBERT\)MAE4\.184\.20−0\.594\-0\.5940\.591 nsE\-DAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)MAE4\.184\.58−1\.379\-1\.3790\.300 nsE\-DAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)MAE4\.183\.85\+8\.927\+8\.9270\.001∗∗E\-DAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)MAE4\.204\.58−1\.314\-1\.3140\.319 nsE\-DAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)MAE4\.203\.85\+12\.124\+12\.124<<0\.001∗∗∗E\-DAICseq\-to\-one \(MiniLM\) vs\. seq\-to\-seq \(MiniLM\)MAE4\.583\.85\+2\.521\+2\.5210\.126 nsE\-DAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MentalBERT\)RMSE5\.235\.39−1\.816\-1\.8160\.158 nsE\-DAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)RMSE5\.235\.87−1\.193\-1\.1930\.351 nsE\-DAICseq\-to\-one \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)RMSE5\.234\.52\+3\.062\+3\.0620\.071†E\-DAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-one \(MiniLM\)RMSE5\.395\.87−0\.900\-0\.9000\.462 nsE\-DAICseq\-to\-seq \(MentalBERT\) vs\. seq\-to\-seq \(MiniLM\)RMSE5\.394\.52\+3\.880\+3\.8800\.053†E\-DAICseq\-to\-one \(MiniLM\) vs\. seq\-to\-seq \(MiniLM\)RMSE5\.874\.52\+2\.349\+2\.3490\.111 ns
#### Interpretation\.

On DAIC, no PTTSD variant is statistically distinguishable from any other \(all pairwise comparisons ns\), consistent with the high standard deviations atn=3n=3\. Against baselines, PTTSD seq\-to\-one \(MiniLM\) significantly outperforms weaker prior systems in MAE \(p<0\.05p<0\.05vs\.Gong and Poellabauer[2017](https://arxiv.org/html/2511.04476#bib.bib8);p<0\.01p<0\.01vs\.Rohanian et al\.[2019](https://arxiv.org/html/2511.04476#bib.bib27); Stepanov et al\.[2018](https://arxiv.org/html/2511.04476#bib.bib31)\), but the gap withFang et al\. \([2023b](https://arxiv.org/html/2511.04476#bib.bib7)\)does not reach significance \(p=0\.28p=0\.28\), reflecting their close numerical proximity \(3\.55 vs\. 3\.61\)\.

On E\-DAIC, PTTSD seq\-to\-seq \(MiniLM\) significantly outperforms all comparable text\-only baselines in MAE \(Sadeghi et al\.[2024](https://arxiv.org/html/2511.04476#bib.bib29)Pr3\+Whisper,p=0\.002p=0\.002;Sadeghi et al\.[2023](https://arxiv.org/html/2511.04476#bib.bib28),p=0\.002p=0\.002;Ray et al\.[2019](https://arxiv.org/html/2511.04476#bib.bib25),p=0\.009p=0\.009\)\. The non\-significant gap with Pr3\+Whisper\+AudioQual \(p=0\.35p=0\.35\) is expected, as that system uses audio quality gating and is not directly comparable\. In the pairwise PTTSD comparisons, seq\-to\-seq \(MiniLM\) is significantly better than both MentalBERT variants in MAE \(p=0\.001p=0\.001andp<0\.001p<0\.001\), while no other pairwise contrast reaches significance\.

## Appendix HUse Of AI Assistants

We used ChatGPT \(GPT\-4o/GPT\-5\) and Claude \(Sonnet 4\.5\) to polish selected passages throughout the manuscript and to assist with literature discovery; all cited references were read and verified by the authors\. We used GitHub Copilot for code completion during implementation\.

Similar Articles

Interpretable Depression Detection from Social Media Text Using LLM-Derived Embeddings

arXiv cs.CL

This paper investigates the use of large language models (LLMs) and supervised classifiers for depression detection from social media text, proposing a prompt-based embedding method that enhances interpretability. Experiments on multiple datasets show that zero-shot LLMs perform well for binary classification but struggle with fine-grained severity, while supervised models on LLM summary embeddings achieve more consistent performance across multi-class and ordinal tasks.