On-Device Language Models for Privacy-Preserving Stress Prediction: A Multimodal Evaluation on Mobile Health
Summary
This paper evaluates on-device language models for privacy-preserving stress prediction using multimodal data on mobile devices, finding that lightweight models achieve low latency and predictable resource usage while highlighting practical constraints for mobile mental health applications.
View Cached Full Text
Cached at: 09/14/26, 08:29 AM
# On-Device Language Models for Privacy-Preserving Stress Prediction: A Multimodal Evaluation on Mobile Health
Source: [https://arxiv.org/html/2609.11961](https://arxiv.org/html/2609.11961)
###### Abstract
Stress is a pervasive determinant of mental health and a key target for mobile health interventions\. On\-device language models \(ODLMs\) offer privacy\-preserving inference without cloud dependency, yet their feasibility for health prediction under mobile resource constraints remains underexplored\. We evaluate ODLMs for multi\-modal stress prediction using zero\-shot prompting, measuring predictive accuracy alongside latency and throughput\. Our results show that objective sensor features marginally outperform subjective self\-reports on average, and that lightweight sub\-2B models achieve low latency with predictable resource usage\. Our findings highlight both the promise and the practical constraints of ODLMs for mobile mental health\.
## IIntroduction
Stress is a routinely occurring condition in everyday life that negatively influences cognitive performance, emotional regulation, and long\-term physical and mental health\[[4](https://arxiv.org/html/2609.11961#bib.bib46),[12](https://arxiv.org/html/2609.11961#bib.bib42),[14](https://arxiv.org/html/2609.11961#bib.bib49)\]\. Prolonged and chronic stress is associated with adverse health and mental health outcomes, motivating the development of mobile health \(mHealth\) systems capable of detecting and predicting stress in real\-world settings\[[13](https://arxiv.org/html/2609.11961#bib.bib40),[14](https://arxiv.org/html/2609.11961#bib.bib49)\]\. Advances in wearable sensing and smartphone\-based data collection have enabled continuous capture of multimodal physiological and behavioral signals, including: heart rate variability, activity levels, sleep patterns, and self\-reported affect\[[16](https://arxiv.org/html/2609.11961#bib.bib11),[20](https://arxiv.org/html/2609.11961#bib.bib25)\]\. These sensing capabilities have supported machine learning \(ML\) approaches for stress prediction from time\-series data in ubiquitous computing environments\[[18](https://arxiv.org/html/2609.11961#bib.bib2)\]\.
Most traditional stress detection systems rely on task\-specific supervised models trained directly on structured numerical features\[[7](https://arxiv.org/html/2609.11961#bib.bib50)\]\. While effective, these models are typically limited to predefined prediction objectives and require retraining for new tasks or data configurations\. In parallel, large language models \(LLMs\) have demonstrated flexible reasoning abilities across a range of structured and semi\-structured inputs\[[17](https://arxiv.org/html/2609.11961#bib.bib32),[6](https://arxiv.org/html/2609.11961#bib.bib45)\]\. Recent work suggests that language models can interpret serialized time\-series data using zero\-shot prompting, raising the possibility of more generalizable inference pipelines that reduce task\-specific engineering\[[10](https://arxiv.org/html/2609.11961#bib.bib9)\]\.
However, deploying LLM\-based inference in mHealth contexts presents significant challenges\. Cloud\-based models introduce privacy risks when handling sensitive physiological and behavioral data, and network latency can hinder real\-time feedback\. Recent advances in scaling down LLMs through quantization\[[2](https://arxiv.org/html/2609.11961#bib.bib26)\], pruning\[[11](https://arxiv.org/html/2609.11961#bib.bib27)\], and knowledge distillation\[[8](https://arxiv.org/html/2609.11961#bib.bib28)\]have enabled small language models to operate directly on edge devices\. On\-device language models \(ODLMs\) provide stronger privacy guarantees and reduced latency, but their capacity for reasoning over multimodal health time\-series data under resource constraints remains insufficiently understood\.
In this work, we investigate the feasibility of using ODLMs for stress prediction from combined objective \(sensor\-derived\) and subjective \(self\-reported\) time\-series data\. Rather than relying on fine\-tuning, we evaluate structured zero\-shot prompting approaches that vary health data modality and temporal context serialization\. We systematically measure predictive accuracy alongside device\-level metrics, including inference latency and throughput, to characterize the trade\-offs between model capability and edge\-device constraints\.
Our contributions are:\(1\) An empirical evaluation of ODLMs for multimodal stress event prediction using structured zero\-shot prompting and \(2\) a systematic analysis of modality composition and temporal serialization strategies for time\-series reasoning under edge constraints\. By examining predictive capability, resource efficiency, and deployment feasibility, this work advances understanding of how ODLMs can support real\-time, privacy\-sensitive stress monitoring in ubiquitous computing systems\.
## IIRelated Works
Recent work has explored the use of LLMs for structured health event prediction tasks\. Kim et al\.\[[10](https://arxiv.org/html/2609.11961#bib.bib9)\]evaluated the ability of popular LLMs to infer subjective health outcomes from objective and self\-reported data across multiple datasets\. Their study compared prompting strategies including zero\-shot, few\-shot, chain\-of\-thought, self\-consistency, and fine\-tuning, demonstrating that explicitly defining task context substantially improves predictive accuracy\. Wang et al\.\[[18](https://arxiv.org/html/2609.11961#bib.bib2)\]extended this line of inquiry to ODLMs, evaluating zero\-shot prompting within the HealthLLM framework using the PMData dataset\[[16](https://arxiv.org/html/2609.11961#bib.bib11)\]\. They reported that smaller models such as TinyLlama\-1\.1B offered comparable inference accuracy to larger cloud\-based models while offering advantages in latency and privacy\.
Parallel efforts have explored LLMs for mental health assessment and counseling applications\. Wei et al\.\[[19](https://arxiv.org/html/2609.11961#bib.bib39)\]introduced MoPHES, a mobile framework that fine\-tunes compact LLMs for multi\-turn mental health support, demonstrating that domain adaptation can enable competitive on\-device performance\. Liu et al\.\[[12](https://arxiv.org/html/2609.11961#bib.bib42)\]proposed ChatCounselor, trained on professionally curated counseling dialogues, showing that high\-quality domain data substantially improves response quality\. Zheng et al\.\[[21](https://arxiv.org/html/2609.11961#bib.bib43)\]addressed data scalability by synthesizing large\-scale emotional support dialogues to improve empathy and contextual grounding\. While these systems demonstrate the promise of LLM\-based mental health tools, they largely rely on fine\-tuning and curated conversational corpora rather than structured multimodal physiological inputs\. Furthermore, many approaches prioritize dialogue generation quality over deployment trade\-offs such as latency and memory footprint\.
## IIIMethodology
TABLE I:An example of constructed zero\-shot promptsContextPromptSystem PromptYou are a personalized healthcare agent trained to predict a stress score, which ranges from 1 to 5 based on physiological data and user information\.User ContextGiven the user’s profile as age: \{48\}\-year\-old, sex: \{male\} and height: \{195\} cmTemporal ContextThe recent data from the past 2\-weeks \{14 days\} show:Health Data \(NLS\)Objective DataSubjective DataSteps: \{1476\.0, 4809\.0, …, NaN\}Burned calories: \{169\.0, 419\.0, …, NaN\}Resting heart rate: \{53\.24, …, 51\.40\}Sleep minutes: \{110\.0, 524\.0, …, 481\.0\}Mood\(Out of 5\): \{3\.0, 4\.0, …, NaN\}Sleep Quality\(Out of 5\): \{1\.0, …, NaN\}Fatigue\(Out of 5\): \{1\.0, 5\.0, …, NaN\}Label ConditioningScore 3 is normal; 1–2 are below normal; 4–5 are above normal\.Answer promptThe response should be a single discrete integer value\. Use the following format to produce output: “The predicted stress level is \[Your response here\]”To evaluate selected state\-of\-the\-art ODLMs, we integrated LLMs into a research\-based platform, “Assuage” with support for offline storage and data synchronization\[[3](https://arxiv.org/html/2609.11961#bib.bib38)\]\. Experiments were conducted on both iOS and iPadOS devices, all running version 18\.5 of their respective operating systems\.
### III\-AModel Selection
Our experimental design combines methods from prior work\. Like\[[15](https://arxiv.org/html/2609.11961#bib.bib3)\], we make use of MLXExamples to facilitate deployment, download, and interfacing with ODLMs available on HuggingFace\. Model sizes are classified as small \(\[1, 3\) billion\), medium \(\[3, 7\) billion\), and large \(\[7,∞\\infty\) billion\)\[[15](https://arxiv.org/html/2609.11961#bib.bib3)\]\. Our selected ODLMs are as follows\.Qwen3\-0\.6BandQwen3\-1\.7Bare quantized variants of the Qwen3 family from Alibaba, with approximately 0\.6B and 1\.7B parameters and on\-device storage footprints of*0\.33*GB and*0\.94*GB, respectively\.Granite\-3\.3\-2bis a 2\-billion parameter instruction\-tuned model from IBM, occupying*1\.33*GB on device\.
### III\-BPrompting Strategies
Our evaluation follows established prompt engineering practices, including zero\-shot prompting, temporal context prompting, user context, label conditioning, and structured answer formatting\[[5](https://arxiv.org/html/2609.11961#bib.bib15),[9](https://arxiv.org/html/2609.11961#bib.bib19),[1](https://arxiv.org/html/2609.11961#bib.bib33),[10](https://arxiv.org/html/2609.11961#bib.bib9),[17](https://arxiv.org/html/2609.11961#bib.bib32)\]\.Temporal Context Prompting: To present time\-series data to the language model, we adopt temporal context prompting\. Prior work categorizes temporal context representations into three classes: Natural Language String \(NLS\)\[[5](https://arxiv.org/html/2609.11961#bib.bib15)\], Statistical Summary \(SS\)\[[9](https://arxiv.org/html/2609.11961#bib.bib19)\], and Modality\-specific Encoding\[[1](https://arxiv.org/html/2609.11961#bib.bib33)\]\. In this study, we employ the first two representations\.
NLS representation presents time\-series data as ordered string sequences, using NaN for missing entries\. SS representation encodes time\-series data using aggregate statistics \(mean, standard deviation, minimum, and maximum\)111Sleep in Hours: avg = 6\.03, std = 2\.53, min = 0\.97, max = 9\.83\.\.
To ensure fair comparison across models, prompt templates were standardized and not optimized per model\. All ODLMs received identical system instructions, temporal context formatting, and answer constraints\. We intentionally avoided model\-specific prompt tuning to isolate the effects of model architecture, scale, and quantization on stress prediction performance\. While prompt optimization may improve individual model accuracy, our goal was to evaluate robustness under a consistent prompting framework\.
### III\-CDataset
PMData is a five\-month life\-logging dataset comprising subjective and objective time\-series health data from 16 participants\[[16](https://arxiv.org/html/2609.11961#bib.bib11)\]\. Objective data were collected via a Fitbit Versa 2 and include multi\-rate measurements such as steps, calories, heart rate, and sleep\. Subjective data were self\-reported through the PMSys mobile app and Google Forms, capturing metrics including sleep quality, fatigue, mood, and readiness\.
## IVExperiment
Figure 1:Experiment workflowFigure[1](https://arxiv.org/html/2609.11961#S4.F1)illustrates the high\-level workflow of our experimental pipeline\. Prior work evaluating language models for stress prediction on the PMData dataset commonly adopts the original prompt proposed by\[[10](https://arxiv.org/html/2609.11961#bib.bib9)\], which combines objective measures with the subjective Mood score\. In contrast, we decompose this prompt and extend it by incorporating additional metrics available in the dataset, allowing us to isolate the contribution of objective and subjective signals to stress prediction\.
Table[I](https://arxiv.org/html/2609.11961#S3.T1)presents a sample of our prompt design, illustrating the three prompt variants developed in this study\. The first consists of objective features only and mirrors the default prompt used in prior work, excluding the subjective Mood score\. The second consists exclusively of subjective features\. Each subjective metric is contextualized relative to its upper bound, and the semantic meaning of the scale is explicitly defined by specifying which values correspond to low, normal, and high levels\. The third prompt combines both objective and subjective features\.
We evaluate these models with prompts that capture four time intervals: 1 day \(1D\), 1 week \(1W\), 2 weeks \(2W\) and 1 month \(1M\), using both NLS and SS prompting strategies\. Each experimental instance is defined by a reference date and its associated retrospective temporal window\. The prompt conditions the language model on data collected during this window, including subjective and objective signals recorded on the reference date, and tasks the model with nowcasting the patient’s stress level for that date\. For our baseline comparison, we evaluated several traditional ML models, including Decision Trees, Random Forests \(RF\), Support Vector Machines \(SVM\), Gradient Boosting, k\-Nearest Neighbors \(kNN\), Naive Bayes, and Logistic Regression, using a 70:30 train\-test split\.
TABLE II:MAE comparison using Traditional ML BaselinesModel1D1W2W1M1D1W2W1M1D1W2W1MObjective↓\\downarrowSubjective↓\\downarrowObjective \+ Subjective↓\\downarrowDecision Trees0\.96±\\pm0\.170\.96±\\pm0\.200\.82±\\pm0\.270\.91±\\pm0\.180\.69±\\pm0\.150\.65±\\pm0\.200\.71±\\pm0\.230\.77±\\pm0\.190\.68±\\pm0\.130\.69±\\pm0\.250\.72±\\pm0\.190\.70±\\pm0\.10RF0\.69±\\pm0\.170\.58±\\pm0\.240\.55±\\pm0\.220\.52±\\pm0\.200\.58±\\pm0\.170\.53±\\pm0\.200\.52±\\pm0\.190\.52±\\pm0\.190\.52±\\pm0\.210\.53±\\pm0\.190\.52±\\pm0\.210\.50±\\pm0\.20SVM0\.56±\\pm0\.130\.61±\\pm0\.120\.59±\\pm0\.110\.54±\\pm0\.160\.52±\\pm0\.180\.52±\\pm0\.200\.57±\\pm0\.080\.54±\\pm0\.120\.52±\\pm0\.190\.50±\\pm0\.190\.53±\\pm0\.150\.53±\\pm0\.15Gradient Boosting0\.91±\\pm0\.200\.77±\\pm0\.200\.70±\\pm0\.190\.71±\\pm0\.210\.63±\\pm0\.150\.62±\\pm0\.230\.59±\\pm0\.220\.57±\\pm0\.210\.55±\\pm0\.180\.56±\\pm0\.230\.53±\\pm0\.240\.54±\\pm0\.22kNN0\.90±\\pm0\.260\.82±\\pm0\.220\.83±\\pm0\.180\.92±\\pm0\.230\.61±\\pm0\.180\.69±\\pm0\.070\.73±\\pm0\.090\.74±\\pm0\.110\.66±\\pm0\.240\.73±\\pm0\.090\.72±\\pm0\.120\.77±\\pm0\.11Naïve Bayes0\.71±\\pm0\.100\.95±\\pm0\.140\.95±\\pm0\.131\.04±\\pm0\.110\.83±\\pm0\.170\.72±\\pm0\.260\.72±\\pm0\.310\.70±\\pm0\.340\.73±\\pm0\.100\.73±\\pm0\.200\.78±\\pm0\.170\.93±\\pm0\.11Logistic Regression1\.35±\\pm0\.621\.34±\\pm0\.631\.42±\\pm0\.561\.61±\\pm0\.461\.23±\\pm0\.591\.02±\\pm0\.330\.91±\\pm0\.230\.91±\\pm0\.141\.19±\\pm0\.550\.89±\\pm0\.250\.97±\\pm0\.261\.04±\\pm0\.16
TABLE III:Model Performance \- Natural Language StringModel1D1W2W1M1D1W2W1M1D1W2W1MObjective↓\\downarrowSubjective↓\\downarrowObjective \+ Subjective↓\\downarrowQwen3\-0\.6B0\.57 ± 0\.360\.56 ± 0\.310\.60 ± 0\.310\.57 ± 0\.320\.53 ± 0\.340\.57 ± 0\.350\.54 ± 0\.330\.51 ± 0\.350\.55 ± 0\.350\.55 ± 0\.320\.56 ± 0\.340\.55 ± 0\.35Qwen3\-1\.7B0\.58 ± 0\.380\.58 ± 0\.290\.63 ± 0\.370\.61 ± 0\.400\.59 ± 0\.370\.59 ± 0\.330\.61 ± 0\.370\.59 ± 0\.400\.59 ± 0\.410\.59 ± 0\.380\.58 ± 0\.380\.58 ± 0\.43Granite\-3\.3\-2b0\.62 ± 0\.300\.73 ± 0\.210\.70 ± 0\.230\.70 ± 0\.220\.85 ± 0\.200\.80 ± 0\.150\.86 ± 0\.190\.73 ± 0\.220\.84 ± 0\.110\.72 ± 0\.160\.74 ± 0\.170\.64 ± 0\.24
TABLE IV:Model Performance \- Statistical SummaryModel1D1W2W1M1D1W2W1M1D1W2W1MObjective↓\\downarrowSubjective↓\\downarrowObjective \+ Subjective↓\\downarrowQwen3\-0\.6B0\.55 ± 0\.340\.56 ± 0\.270\.58 ± 0\.280\.51 ± 0\.280\.52 ± 0\.340\.52 ± 0\.290\.51 ± 0\.290\.48 ± 0\.280\.54 ± 0\.340\.53 ± 0\.300\.53 ± 0\.290\.49 ± 0\.29Qwen3\-1\.7B0\.43 ± 0\.240\.52 ± 0\.300\.55 ± 0\.280\.51 ± 0\.270\.52 ± 0\.340\.54 ± 0\.300\.53 ± 0\.300\.49 ± 0\.290\.54 ± 0\.320\.52 ± 0\.290\.51 ± 0\.290\.48 ± 0\.29Granite\-3\.3\-2b0\.54 ± 0\.320\.59 ± 0\.270\.57 ± 0\.250\.52 ± 0\.280\.72 ± 0\.310\.66 ± 0\.260\.67 ± 0\.220\.58 ± 0\.220\.63 ± 0\.280\.62 ± 0\.250\.59 ± 0\.240\.57 ± 0\.26
TABLE V:Average Prompt Token CountPrompting Strategy1D1W2W1M1D1W2W1M1D1W2W1MObjectiveSubjectiveObjective \+ SubjectiveNatural Language String209\.08351\.75525\.64908\.56192\.70241\.51301\.26416\.03247\.30429\.80655\.981161\.47Statistical Summary343\.09349\.43356\.97349\.62271\.36280\.70288\.66280\.87447\.93460\.93468\.72461\.37
\(a\)Throughput
\(b\)Latency
Figure 2:Device Performance Metrics
## VResults
Model performance was evaluated using Mean Absolute Error \(MAE\) between participants’ reported stress values and the language models’ predictions, where lower MAE values indicate better agreement with the ground truth\.
### V\-ATraditional Machine Learning Baselines
Table[II](https://arxiv.org/html/2609.11961#S4.T2)reports the MAE of conventional supervised models across objective\-only, subjective\-only, and combined feature configurations for the four time intervals\. Overall, RF and SVM consistently achieve the strongest performance across the evaluated settings\. For objective features, SVM attains the lowest MAE at the interval 1D \(0\.56\), while RF performs best at 1W \(0\.58\), 2W \(0\.55\), and 1M \(0\.52\)\. For subjective features, SVM achieves the lowest MAE at 1D \(0\.52\) and 1W \(0\.52\), whereas RF performs best at 2W \(0\.52\) and 1M \(0\.52\)\. For the combined objective and subjective feature set, SVM achieves the lowest MAE at 1D \(0\.52\) and 1W \(0\.50\), while RF obtains the best results at 2W \(0\.52\) and 1M \(0\.50\)\. Across all time intervals, the combined feature configuration generally yields the lowest errors, indicating that integrating objective and subjective signals provides complementary information that improves predictive performance\.
### V\-BModel Accuracy: Natural Language String
Table[III](https://arxiv.org/html/2609.11961#S4.T3)summarizes model performance under the NLS prompting strategy\. Although longer temporal windows produce substantially longer prompts, particularly for the 1M interval \(Table[V](https://arxiv.org/html/2609.11961#S4.T5)\), performance remains relatively stable across time intervals\. Qwen3\-0\.6B consistently achieves the lowest MAE across nearly all modality and interval combinations, with errors ranging from 0\.51 to 0\.60\. Qwen3\-1\.7B performs similarly but with slightly higher error, while Granite\-3\.3\-2b exhibits the weakest performance, particularly for subjective inputs where MAE reaches 0\.86 at 2W\. Objective inputs generally provide the most reliable predictions, while subjective inputs are more variable across models\. The combined modality offers modest improvements in some longer\-horizon settings, especially for Granite\. Overall, Qwen3\-0\.6B is the strongest and most consistent model under NLS prompting, indicating that model selection has a greater impact on performance than time interval length\.
### V\-CModel Accuracy: Statistical Summary
Table[IV](https://arxiv.org/html/2609.11961#S4.T4)presents model performance under the SS prompting strategy\. Across all temporal windows, the Qwen3 models consistently outperform Granite\-3\.3\-2B, particularly when objective features are used\. The lowest MAE overall is achieved by Qwen3\-1\.7B using objective features at the 1D interval \(0\.43±\\pm0\.24\)\. Subjective features generally produce comparable performance for the Qwen models, with Qwen3\-0\.6B achieving the best subjective results across all temporal windows \(0\.48–0\.52 MAE\)\. Objective \+ subjective fusion performs similarly to the strongest single\-modality results and yields the lowest errors at the 1M interval for both Qwen models \(0\.48–0\.49 MAE\), suggesting that statistical summaries enable effective multimodal integration over longer time intervals\. In contrast, Granite\-3\.3\-2B exhibits consistently higher error, particularly for subjective inputs, indicating reduced ability to leverage self\-reported features under the SS representation\. Overall, the results demonstrate that compact Qwen models are more effective than Granite\-3\.3\-2B at utilizing statistical summaries for stress estimation\.
### V\-DOn\-device Performance Evaluation
We evaluate on\-device performance using two core system metrics: end\-to\-end latency and generation throughput \(Figure[2](https://arxiv.org/html/2609.11961#S4.F2)\)\. Together, these results characterize the practical performance envelope of lightweight LLMs under realistic mobile workloads\.
#### V\-D1Latency
Latency exhibits clear differences across models and temporal intervals\. Qwen3\-0\.6B consistently achieves sub\-second latency \(0\.37–0\.47 s\) with minimal variation\. Qwen3\-1\.7B remains below 1\.2 s for 1D–2W intervals but increases to 2\.43 s at 1M\.\. Granite\-3\.3\-2B exhibits the highest latency, peaking at 3\.18 s \(1W\) and 3\.00 s \(2W\)\. Overall, Qwen3\-0\.6B shows the most stable latency profile, while larger models are more sensitive to temporal interval length\.
#### V\-D2Throughput
Throughput generally decreases with model size\. Qwen3\-0\.6B sustains the highest generation rates \(78\.0–82\.9 tokens/s\), followed by Qwen3\-1\.7B \(51\.1–56\.9 tokens/s\) and Granite\-3\.3\-2B \(32\.0–36\.3 tokens/s\)\. Across all models, throughput varies only modestly across temporal intervals, indicating consistent generation performance over time\.
## VIDiscussion
Our results yield several insights with implications for mobile health system design, temporal modeling of mental states, and the practical deployment of LLMs under mobile resource constraints\.
### VI\-ATraditional ML vs\. Zero\-Shot ODLMs
The performance gap between traditional supervised models and zero\-shot ODLMs is relatively small\. While the best supervised baselines \(SVM and RF\) achieve the lowest MAE values of 0\.50 across several configurations, the best\-performing ODLM, Qwen3\-0\.6B\-4bit, achieves a comparable mean MAE of 0\.51 \(SS\)\. This comparison should be interpreted in light of the different learning paradigms\. Traditional ML models are trained directly on labeled patient data and may require retraining when deployed to new populations or settings\. In contrast, ODLMs operate entirely in a zero\-shot manner, requiring no patient\-specific training and remaining readily deployable across novel users and contexts\. This flexibility is particularly valuable in mobile health applications, where labeled data are often limited, costly to obtain, and subject to privacy constraints\.
### VI\-BNatural Language String vs\. Statistical Summary
SS consistently outperforms NLS, achieving lower MAE across all modalities and forecast horizons\. Unlike NLS, which requires models to process increasingly long serialized time\-series sequences, SS provides a compact and fixed\-format representation of feature distributions\. Consequently, NLS exhibits greater variability across horizons, whereas SS maintains stable and often improved performance, particularly at longer horizons\. These findings suggest that reducing prompt complexity is more beneficial than preserving raw sequential detail for long\-range forecasting\.
### VI\-CImpact of Multimodal Fusion
Multimodal fusion yields limited and inconsistent improvements across models and time intervals\. In the NLS setting \(Table[III](https://arxiv.org/html/2609.11961#S4.T3)\), combined inputs generally perform similarly to the best single modality, with the most notable improvement observed for Granite\-3\.3\-2b at the 1M horizon\. A similar pattern is seen for the SS representation \(Table[IV](https://arxiv.org/html/2609.11961#S4.T4)\), where fusion occasionally improves performance but rarely outperforms the strongest unimodal input\. Overall, the results suggest that multimodal fusion offers modest, model\-dependent benefits, indicating that the current fusion strategy may not fully exploit complementary information from both modalities\.
### VI\-DLimitations
Several limitations of this work should be acknowledged\. First, all evaluations are conducted using zero\-shot prompting without fine\-tuning; domain\-adapted models may substantially reduce the accuracy gap observed relative to supervised baselines\. Second, experiments are conducted on a single dataset and results may not generalize across populations, devices, or stress measurement scales\. Third, device\-level evaluations span multiple iPhone generations and per\-device performance breakdowns were not reported, which may obscure hardware\-specific variation\. Finally, energy consumption was not systematically measured, representing an important gap for battery\-constrained deployments that warrants dedicated evaluation in future work\.
## VIIConclusion
This work demonstrates the feasibility of zero\-shot stress prediction using compact, quantized ODLMs on mobile devices\. Despite requiring no patient\-specific training, the smallest evaluated model, Qwen3\-0\.6B\-4bit, achieves competitive accuracy alongside sub\-second latency and a minimal memory footprint; underscoring generalizability and efficiency as key advantages over traditional supervised approaches in privacy\-sensitive mobile health settings\.
## References
- \[1\]A\. Belyaeva, J\. Cosentino, F\. Hormozdiari, K\. Eswaran, S\. Shetty, G\. Corrado, A\. Carroll, C\. Y\. McLean, and N\. A\. Furlotte\(2023\)Multimodal llms for health grounded in individual\-specific data\.InWorkshop on Machine Learning for Multimodal Healthcare Data,pp\. 86–102\.Cited by:[§III\-B](https://arxiv.org/html/2609.11961#S3.SS2.p1.1)\.
- \[2\]Y\. Bondarenko, M\. Nagel, and T\. Blankevoort\(2021\)Understanding and overcoming the challenges of efficient transformer quantization\.arXiv preprint arXiv:2109\.12948\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p3.1)\.
- \[3\]A\. Donawa, C\. Powell, R\. Wang, M\. Chih, R\. Patel, R\. Zinner, E\. Aronoff\-Spencer, C\. E\. Baker,et al\.\(2024\)Designing survey\-based mobile interfaces for rural patients with cancer using apple’s researchkit and carekit: usability study\.JMIR Formative Research8\(1\),pp\. e57801\.Cited by:[§III](https://arxiv.org/html/2609.11961#S3.p1.1)\.
- \[4\]P\. Dongre\(2024\)Physiology\-driven empathic large language models \(emllms\) for mental health support\.InExtended Abstracts of the CHI Conference on Human Factors in Computing Systems,pp\. 1–5\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1)\.
- \[5\]N\. Gruver, M\. Finzi, S\. Qiu, and A\. G\. Wilson\(2023\)Large language models are zero\-shot time series forecasters\.Advances in Neural Information Processing Systems36,pp\. 19622–19635\.Cited by:[§III\-B](https://arxiv.org/html/2609.11961#S3.SS2.p1.1)\.
- \[6\]Y\. Haque, R\. S\. Zawad, C\. S\. A\. Rony, H\. Al Banna, T\. Ghosh, M\. S\. Kaiser, and M\. Mahmud\(2024\)State\-of\-the\-art of stress prediction from heart rate variability using artificial intelligence\.Cognitive Computation16\(2\),pp\. 455–481\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p2.1)\.
- \[7\]Y\. Hua, S\. Siddals, Z\. Ma, I\. Galatzer\-Levy, W\. Xia, C\. Hau, H\. Na, M\. Flathers, J\. Linardon, C\. Ayubcha,et al\.\(2025\)Charting the evolution of artificial intelligence mental health chatbots from rule\-based systems to large language models: a systematic review\.World Psychiatry24\(3\),pp\. 383–394\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p2.1)\.
- \[8\]T\. Ji, S\. Jain, M\. Ferdman, P\. Milder, H\. A\. Schwartz, and N\. Balasubramanian\(2021\)On the distribution, sparsity, and inference\-time quantization of attention values in transformers\.arXiv preprint arXiv:2106\.01335\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p3.1)\.
- \[9\]M\. Jin, S\. Wang, L\. Ma, Z\. Chu, J\. Y\. Zhang, X\. Shi, P\. Chen, Y\. Liang, Y\. Li, S\. Pan,et al\.\(2023\)Time\-llm: time series forecasting by reprogramming large language models\.arXiv preprint arXiv:2310\.01728\.Cited by:[§III\-B](https://arxiv.org/html/2609.11961#S3.SS2.p1.1)\.
- \[10\]Y\. Kim, X\. Xu, D\. McDuff, C\. Breazeal, and H\. W\. Park\(2024\)Health\-llm: large language models for health prediction via wearable sensor data\.arXiv preprint arXiv:2401\.06866\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p2.1),[§II](https://arxiv.org/html/2609.11961#S2.p1.1),[§III\-B](https://arxiv.org/html/2609.11961#S3.SS2.p1.1),[§IV](https://arxiv.org/html/2609.11961#S4.p1.1)\.
- \[11\]B\. Li, Z\. Kong, T\. Zhang, J\. Li, Z\. Li, H\. Liu, and C\. Ding\(2020\)Efficient transformer\-based large scale language representations using hardware\-friendly block structured pruning\.arXiv preprint arXiv:2009\.08065\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p3.1)\.
- \[12\]J\. M\. Liu, D\. Li, H\. Cao, T\. Ren, Z\. Liao, and J\. Wu\(2023\)Chatcounselor: a large language models for mental health support\.arXiv preprint arXiv:2309\.15461\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1),[§II](https://arxiv.org/html/2609.11961#S2.p2.1)\.
- \[13\]Z\. Ma, Y\. Mei, and Z\. Su\(2024\)Understanding the benefits and challenges of using large language model\-based conversational agents for mental well\-being support\.InAMIA Annual Symposium Proceedings,Vol\.2023,pp\. 1105\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1)\.
- \[14\]B\. S\. McEwen and H\. Akil\(2020\-01\)Revisiting the Stress Concept: Implications for Affective Disorders\.The Journal of Neuroscience40\(1\),pp\. 12–21\(en\)\.External Links:ISSN 0270\-6474, 1529\-2401,[Link](https://www.jneurosci.org/lookup/doi/10.1523/JNEUROSCI.0733-19.2019),[Document](https://dx.doi.org/10.1523/JNEUROSCI.0733-19.2019)Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1)\.
- \[15\]L\. Nissen, P\. Zagar, V\. Ravi, A\. Zahedivash, L\. M\. Reimer, S\. Jonas, O\. Aalami, and P\. Schmiedmayer\(2025\)Medicine on the edge: comparative performance analysis of on\-device llms for clinical reasoning\.arXiv preprint arXiv:2502\.08954\.Cited by:[§III\-A](https://arxiv.org/html/2609.11961#S3.SS1.p1.1)\.
- \[16\]V\. Thambawita, S\. A\. Hicks, H\. Borgli, H\. K\. Stensland, D\. Jha, M\. K\. Svensen, S\. Pettersen, D\. Johansen, H\. D\. Johansen, S\. D\. Pettersen,et al\.\(2020\)Pmdata: a sports logging dataset\.InProceedings of the 11th ACM Multimedia Systems Conference,pp\. 231–236\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1),[§II](https://arxiv.org/html/2609.11961#S2.p1.1),[§III\-C](https://arxiv.org/html/2609.11961#S3.SS3.p1.1)\.
- \[17\]B\. Thapa, M\. Rivas, H\. Griffith, and H\. Rathore\(2025\)StressLLM: large language models for stress prediction via wearable sensor data\.In2025 IEEE International Conference on Consumer Electronics \(ICCE\),pp\. 1–6\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p2.1),[§III\-B](https://arxiv.org/html/2609.11961#S3.SS2.p1.1)\.
- \[18\]X\. Wang, T\. Dang, V\. Kostakos, and H\. Jia\(2024\)Efficient and personalized mobile health event prediction via small language models\.InProceedings of the 30th Annual International Conference on Mobile Computing and Networking,pp\. 2353–2358\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1),[§II](https://arxiv.org/html/2609.11961#S2.p1.1)\.
- \[19\]X\. Wei, P\. Zhou, and Z\. Wang\(2025\)MoPHES: leveraging on\-device llms as agent for mobile psychological health evaluation and support\.arXiv preprint arXiv:2510\.16085\.Cited by:[§II](https://arxiv.org/html/2609.11961#S2.p2.1)\.
- \[20\]X\. Xu, H\. Zhang, Y\. Sefidgar, Y\. Ren, X\. Liu, W\. Seo, J\. Brown, K\. Kuehn, M\. Merrill, P\. Nurius,et al\.\(2022\)GLOBEM dataset: multi\-year datasets for longitudinal human behavior modeling generalization\.Advances in neural information processing systems35,pp\. 24655–24692\.Cited by:[§I](https://arxiv.org/html/2609.11961#S1.p1.1)\.
- \[21\]Z\. Zheng, L\. Liao, Y\. Deng, and L\. Nie\(2023\)Building emotional support chatbots in the era of llms\.arXiv preprint arXiv:2308\.11584\.Cited by:[§II](https://arxiv.org/html/2609.11961#S2.p2.1)\.Similar Articles
Stress-testing medical large language models reveals latent safety pathology beyond benchmark accuracy
This paper introduces AI-MASLD, a stress-audit framework for medical LLMs that reveals how benchmark accuracy can hide serious safety failures, and demonstrates that open-weight models can match or exceed proprietary ones on safety dimensions.
Can Language Models Identify Side Effects of Breast Cancer Radiation Treatments?
This paper presents a deployment-oriented stress-testing framework to evaluate how well large language models identify side effects of breast cancer radiation treatments. The study highlights limitations in LLM reliability, such as sensitivity to minor documentation changes and under-recall of rare side effects, suggesting that grounding outputs in clinician-curated lists improves robustness.
Energy- and Memory-Efficient PEFT Methods for Personalized On-Device SLMs on Consumer GPUs
The paper compares five parameter-efficient fine-tuning methods on four small language models for on-device personalization, finding LoRA+ best for energy efficiency and QLoRA best for memory-limited deployment.
Micro Language Models Enable Instant Responses
Researchers introduce 8M-30M parameter micro language models that instantly generate the first few words on-device before cloud models complete responses, enabling responsive AI on ultra-constrained devices like smartwatches.
Large Language Models as Unified Multimodal Learners for Clinical Prediction
The paper proposes converting multimodal patient data (text, labs, vitals) into a single natural language sequence and fine-tuning LLMs for clinical prediction, achieving comparable or better performance than specialized fusion architectures across three tasks.