Large-Language-Models-as-a-Judge in Theory-Agnostic Adaptive Metric-Alignment for Prototypical Networks in Personality Recognition

arXiv cs.CL Papers

Summary

Introduces JAM, a theory-agnostic framework for personality recognition that uses LLMs as judges to improve metric alignment in prototypical networks, achieving better cross-framework generalization.

arXiv:2607.08374v1 Announce Type: new Abstract: Personality recognition has traditionally been constrained by theory-dependent formulations, where models are trained to fit predefined psychological taxonomies rather than uncovering shared underlying behavioral structure. This limits generalization, as personality itself is better understood as theory-invariant, while existing annotations reflect only partial and sometimes inconsistent views of the same latent traits. In this work, we introduce JAM ((J)udge for (A)daptive (M)etric-Alignment), a theory-agnostic framework that shifts learning from adapting to predefined personality theories toward discovering unified latent pseudo-facets that capture shared psychological structure. Rather than constraining the model to any personality taxonomy during training or inference, the framework learns generalizable psychological representations and can infer an individual's latent psychological profile directly from the textual samples, without requiring theory-specific labels. JAM achieves this through an Attention-Pooled Graph Prototypical Network that learns structured representations via clustering in embedding space, together with a Cross-Theory Harmonization (CTH) approach that integrates (i) Human-Guided Linkage and (ii) Machine-Induced Consensus to unify heterogeneous datasets without relying on predefined labels. To further improve robustness and data quality, we incorporate an LLM-as-a-Judge mechanism operating in two configurations, (i) LLM-before-the-loop and (ii) LLM-in-the-loop which identifies ambiguous samples to guide adaptive metric learning. Experiments show that JAM improves cross-framework generalization and performance, establishing a strong step toward theory-agnostic personality inference and supporting low-resource personality theories. The related code repository, model weights, and artifacts are available at https://research.jingjietan.com/JAM
Original Article
View Cached Full Text

Cached at: 07/10/26, 06:14 AM

# Large-Language-Models-as-a-Judge in Theory-Agnostic Adaptive Metric-Alignment for Prototypical Networks in Personality Recognition
Source: [https://arxiv.org/html/2607.08374](https://arxiv.org/html/2607.08374)
Jing Jie Tan1, Ban\-Hoe Kwan1, Danny Wee\-Kiat Ng1, Yan\-Chai Hum1, Shih\-Yu Lo 2, Po\-An Chen 3, Noriyuki Kawarazaki4, Kosuke Takano4, Anissa Mokraoui5 Email: tanjingjie@1utar\.my, \{kwanbh, ngwk, humyc\}@utar\.edu\.my,\{shihyulo, poanchen\}@nycu\.edu\.tw,\{kawara@rm, takano@ic\}\.kanagawa\-it\.ac\.jp, anissa\.mokraoui@univ\-paris13\.fr

###### Abstract

Personality recognition has traditionally been constrained by theory\-dependent formulations, where models are trained to fit predefined psychological taxonomies rather than uncovering shared underlying behavioral structure\. This limits generalization, as personality itself is better understood as theory\-invariant, emerging from stable psychological patterns that should manifest consistently across different frameworks, while existing annotations reflect only partial and sometimes inconsistent views of the same latent traits\. In this work, we introduceJAM\(\(J\)udge for \(A\)daptive \(M\)etric\-Alignment\), a theory\-agnostic framework that shifts learning from adapting to predefined personality theories toward discovering unified latent “pseudo\-facets” that capture shared psychological structure\. Rather than constraining the model to any personality taxonomy during training or inference, the framework learns generalizable psychological representations and can infer an individual’s latent psychological profile directly from the textual samples, without requiring theory\-specific labels\. JAM achieves this through an Attention\-Pooled Graph Prototypical Network that learns structured representations via clustering in embedding space, together with a Cross\-Theory Harmonization \(CTH\) approach that integrates \(i\) Human\-Guided Linkage and \(ii\) Machine\-Induced Consensus to unify heterogeneous datasets without relying on predefined labels\. To further improve robustness and data quality, we incorporate an LLM\-as\-a\-Judge mechanism operating in two configurations, \(i\) LLM\-before\-the\-loop and \(ii\) LLM\-in\-the\-loop which identifies ambiguous, mislabeled, and boundary samples to guide adaptive metric learning\. Experiments on Essays and Kaggle personality datasets show that JAM improves cross\-framework generalization and performance, establishing a strong step toward theory\-agnostic personality inference and supporting low\-resource personality theories\. The related code repository, model weights, and artifacts are available at[https://research\.jingjietan\.com/JAM](https://research.jingjietan.com/JAM)\.

## IIntroduction

Personality recognition has become increasingly important, especially in recommendation systems\[[11](https://arxiv.org/html/2607.08374#bib.bib2)\]\. By understanding user personalities, these systems can provide personalized suggestions, enhancing user satisfaction and trust\. Understanding user personality is crucial for delivering a superior user experience, making this an important area of study\[[2](https://arxiv.org/html/2607.08374#bib.bib10)\]\. By tailoring interactions and recommendations to individual personality traits, AI systems and robots can achieve higher levels of personalization, leading to increased user satisfaction and trust\[[24](https://arxiv.org/html/2607.08374#bib.bib5)\]\. Furthermore, incorporating personality traits into recommendation algorithms can help address issues such as the cold start and data sparsity problems, resulting in more accurate and user\-centric recommendations\[[31](https://arxiv.org/html/2607.08374#bib.bib3),[12](https://arxiv.org/html/2607.08374#bib.bib4)\]\. Additionally, this approach can contribute to explainable AI by providing clearer explanations for the recommendations made\.

Despite these advancements, current personality\-recognition models remain constrained by several fundamental limitations\. Most approaches are built around specific psychological theories, such as the Big\-5 or MBTI, limiting their ability to generalize across datasets and cultural contexts\. This dependence is further exacerbated by the scarcity of large\-scale annotated data\. The widely usedmyPersonality dataset\[[41](https://arxiv.org/html/2607.08374#bib.bib64)\], which originally contained data from millions of users, wasdiscontinueddue to privacy concerns, leaving only relatively small public datasets\. Moreover, existing methods treat personality recognition as a static classification task, without leveraging psychological insights, limiting their generalizability\.

These limitations motivate atheory\-agnostic frameworkthat eliminates dependence on predefined personality taxonomies during both training and inference\. Instead of learning theory\-specific representations, the model discovers latentpseudo\-facetsthat capture underlying psychological structure across heterogeneous data sources\. At inference time, the model directly infers an individual’s latent psychological profile from behavioral or textual samples without requiring theory\-specific labels or adherence to a particular personality framework\. This design enables the integration of heterogeneous datasets while improving generalization across existing personality theories\.

### I\-AContributions

In this study, we make the following key contributions:

1. 1\.We incorporate a psychology\-based methodology for integrating datasets constructed under different personality theories and generalize the model through human\-guided linkage, supporting low\-resource personality theory\.
2. 2\.We enhance the prototypical network by incorporating machine\-induced consensus for pseudo\-facet construction, improving cross\-theory harmonization and mitigating class imbalance, leading to improved performance\.
3. 3\.We investigate the LLM\-as\-a\-Judge mechanism, assessing its comparative effectiveness when applied during the pre\-learning stage \(LLM\-before\-the\-loop\) versus within the learning process \(LLM\-in\-the\-loop\) for filtering ambiguous or noisy personality\-related text samples\.

## IILiterature Review

### II\-APersonality Theory

Recent studies have demonstrated that humans express their personality through language use, providing a rich source of data for personality recognition\[[34](https://arxiv.org/html/2607.08374#bib.bib20),[9](https://arxiv.org/html/2607.08374#bib.bib21),[23](https://arxiv.org/html/2607.08374#bib.bib22),[1](https://arxiv.org/html/2607.08374#bib.bib24)\]\. The rise of social media platforms has provided a rich source of data to understand how particular individuals often leave behind a personality footprint through their online activities\[[34](https://arxiv.org/html/2607.08374#bib.bib20)\]\. This creates a significant opportunity to extract personality information from such indirect background data, which is particularly beneficial for initializing personality\-aware functionalities in new robots or applications\. There are two primary types of assessments to measure, quantify, and classify personality traits\[[40](https://arxiv.org/html/2607.08374#bib.bib28),[37](https://arxiv.org/html/2607.08374#bib.bib29)\]:

- •Self\-report tests: These tests require test\-takers to understand the provided statements and evaluate how well they describe themselves\. The results can be quantitatively standardized, ensuring high reliability and validity\[[51](https://arxiv.org/html/2607.08374#bib.bib27)\]\.
- •Projective tests: These tests involve asking test\-takers to provide their interpretations of scenes, scenarios, or objects\[[28](https://arxiv.org/html/2607.08374#bib.bib30)\]\. This type of test considers various aspects, such as tone, message, or body language, making it more capable of addressing potential issues like misinterpretation of questions or dishonesty from the test\-taker\[[47](https://arxiv.org/html/2607.08374#bib.bib26)\]\.

Various personality theories have been proposed to model personality using distinct sets of dimensions\[[36](https://arxiv.org/html/2607.08374#bib.bib18),[8](https://arxiv.org/html/2607.08374#bib.bib19)\]\. For instance, the Myers–Briggs Type Indicator \(MBTI\), sometimes described in relation to 4 dichotomies, categorizes personality across paired preferences\[[29](https://arxiv.org/html/2607.08374#bib.bib11),[13](https://arxiv.org/html/2607.08374#bib.bib14)\]\. The Big\-5 framework \(OCEAN\) defines five broad traits: Openness to Experience, Conscientiousness, Extraversion, Agreeableness, and Neuroticism\[[14](https://arxiv.org/html/2607.08374#bib.bib12),[26](https://arxiv.org/html/2607.08374#bib.bib17)\]\. The HEXACO model extends this structure by adding Honesty–Humility to Emotionality, Extraversion, Agreeableness, Conscientiousness, and Openness\[[3](https://arxiv.org/html/2607.08374#bib.bib15),[52](https://arxiv.org/html/2607.08374#bib.bib16)\]\. Table[I](https://arxiv.org/html/2607.08374#S2.T1)summarizes the correspondence among these three major frameworks, offering a general comparison of their dimensions\. Basically, facets are commonly regarded as the lower\-level constructs or descriptions that collectively define a broader personality dimension or trait\. They provide a more granular representation of personality by capturing specific behavioral and psychological tendencies within each dimension\. The terminology can be summarized as in Fig\.[1](https://arxiv.org/html/2607.08374#S2.F1)\.

TABLE I:Mapping the dimensions of three prominent personality frameworks: Big\-5, MBTI, and HEXACO\.SymbolBig\-5MBTIHEXACOGeneral DescriptionOOpenness to Experience \(O\)Sensors \(S\)\-Intuitive \(N\)Openness \(O\)Creativity, curiosity, noveltyCConscientiousness \(C\)Perceivers \(P\)\-Judgers \(J\)Conscientiousness \(C\)Organise, responsibility, disciplineEExtraversion \(E\)Introverts \(I\)\-Extroverts \(E\)Extraversion \(X\)Sociability, energy, assertivenessAAgreeableness \(A\)Thinkers \(T\)\-Feelers \(F\)Agreeableness \(A\)Empathy, kindness, cooperativenessNNeuroticism \(N\)\-Emotionality \(E\)Sensitivity, anxiety, hostilityH\-\-Honesty\-Humility \(H\)Sincerity, fairness, modesty
Note: The correlations presented are intended as reference points, aligning these theories to the widely recognized Big\-5 framework\. This alignment supports evaluating model performance across diverse personality theories, fostering comparative analysis and deeper insights into their unique characteristics\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x1.png)Figure 1:Overview of the relationship, terminology, and theoretical structure of personality assessment models, illustrating how theories define dimensions, traits, facets, and personality types\.These mappings should be interpreted cautiously: they reflect partial conceptual overlap rather than equivalence\. For example, Big\-5 Openness includes facets such as curiosity and preference for novelty, whereas MBTI’s Sensing–Intuition dimension distinguishes concrete, detail\-oriented perception from abstract, future\-oriented thinking\. Similarly, related constructs are distributed differently across frameworks; emotional reactivity in Big\-5 Neuroticism only loosely corresponds to the MBTI Thinking–Feeling dimension, which primarily reflects decision\-making style rather than affective stability\.

This highlights alimitation:personality models are human\-constructed abstractionsrather than directly observable ground truth categories\. Consequently, their use in machine learning can introducesystematic noise and inconsistency, especially at the facet level where definitions differ across studies\. In practice, available datasets seldom provide sufficiently fine\-grained and consistently annotated signals to support reliable bottom\-up learning of stable psychological components, not only due to annotation cost but also because personality is inherently composite and context\-dependent\. To our knowledge, no prior work has directly addressed this mismatch between psychologically defined trait hierarchies and their operationalization in data\-driven settings, or proposed effective strategies to mitigate the resulting label ambiguity\.

### II\-BRelated Algorithms

Personality recognition has evolved alongside advances in natural language processing and representation learning\[[42](https://arxiv.org/html/2607.08374#bib.bib60)\]\. Early research primarily focused on developing task\-specific models for predicting personality labels defined by a particular framework, such as the Big\-5 or MBTI\. As language models became increasingly capable of capturing semantic and contextual information, researchers began adopting pretrained Transformer architectures as general\-purpose representations for personality\-related tasks\. More recently, large language models have enabled prompting\-based inference, reducing reliance on framework\-specific training procedures and expanding the possibility of transferring personality knowledge across different theoretical formulations\.

To contextualize these developments, this section first reviews the language\-model foundations underlying modern personality recognition, including \(i\) sentence transformer language models \(encoder\-only models\) and \(ii\) autoregressive transformer large language models \(decoder\-only models\)\. It then surveys \(iii\) prior personality recognition methods built upon these representations, followed by \(iv\) recent generative approaches that increasingly support flexible personality inference\. Together, these developments provide the foundation for investigating personality recognition beyond a single predefined personality theory\.

#### II\-B1Sentence Transformer Language Model \(Encoder\-only Model\)

These models are trained on large corpora of text data, enabling them to capture complex linguistic patterns and relationships\[[50](https://arxiv.org/html/2607.08374#bib.bib35),[39](https://arxiv.org/html/2607.08374#bib.bib36),[30](https://arxiv.org/html/2607.08374#bib.bib37),[6](https://arxiv.org/html/2607.08374#bib.bib38),[16](https://arxiv.org/html/2607.08374#bib.bib39)\]\. The produced embeddings represent the semantic meaning of the input text, facilitating downstream tasks such as text classification, clustering, and similarity analysis\.MiniLM\[[50](https://arxiv.org/html/2607.08374#bib.bib35)\]compresses large Transformer models through deep self\-attention distillation, where a small student model mimics the self\-attention of the teacher’s last layer\. It retains over 99% accuracy on SQuAD 2\.0 and GLUE benchmarks while reducing Transformer parameters and computation by 50%\. Moreover,MPNet\[[39](https://arxiv.org/html/2607.08374#bib.bib36)\]integrates permuted language modeling \(PLM\) and auxiliary position information, improving dependency modeling and reducing position discrepancy\. It surpasses BERT, XLNet, and RoBERTa across GLUE and SQuAD\. Furthermore,Sentence\-T5\[[30](https://arxiv.org/html/2607.08374#bib.bib37)\]explores sentence embeddings from T5 models, introducing an encoder\-only approach that outperforms Sentence\-BERT and SimCSE in STS tasks\. Scaling T5 to billions of parameters further enhances performance, setting new state\-of\-the\-art results for sentence embeddings\. Given the efficiency and strong semantic representation capabilities of these models, we select a relatively lightweight yet effective encoder\-only model tailored for the personality domain, ensuring optimal performance while balancing computational efficiency\.

#### II\-B2Autoregressive Transformer Large Language Model \(Decoder\-only Model\)

Generative Pretrained Transformer 3 \(GPT\-3\) was the first to demonstrate effectiveness in Natural Language Understanding \(NLU\) through its few\-shot learning capability, facilitated by techniques such as Chain\-of\-Thought \(CoT\) prompting\. This family of decoder\-only models enhances reasoning, coherence, and adaptability in tasks such as emotion detection, sentiment analysis, and personality recognition\[[46](https://arxiv.org/html/2607.08374#bib.bib47),[38](https://arxiv.org/html/2607.08374#bib.bib48),[25](https://arxiv.org/html/2607.08374#bib.bib49)\]\. The open\-source LLaMA model introduced a family of models with varying parameter sizes, achieving competitive performance while maintaining efficiency in training and inference\[[49](https://arxiv.org/html/2607.08374#bib.bib46)\]\. Following this, Mistral AI released the Mistral 7B model, which, despite its relatively smaller size, demonstrated remarkable capabilities in code generation, mathematics, and reasoning tasks, benefiting from an extended context window of 128k tokens\[[20](https://arxiv.org/html/2607.08374#bib.bib45)\]\. Qwen models have been proposed as strong open\-weight alternatives, exhibiting robust performance across reasoning, multilingual understanding tasks\[[4](https://arxiv.org/html/2607.08374#bib.bib13)\]\. OpenAI’s GPT\-4 further pushed the boundaries by introducing multimodal capabilities, allowing the model to process both text and images, thereby enhancing its applicability across diverse domains\[[32](https://arxiv.org/html/2607.08374#bib.bib42)\]\.

Later, reasoning models further extended their capabilities in scientific and mathematical contributions\. OpenAI’s o1 model introduced a novel approach by generating extended chains of thought before arriving at a final answer, thereby improving the model’s reasoning depth and accuracy\[[57](https://arxiv.org/html/2607.08374#bib.bib41)\]\. DeepSeek’s R1 model emerged as a notable open\-source contribution, achieving performance comparable to OpenAI’s o1 model across mathematics, coding, and reasoning tasks\[[10](https://arxiv.org/html/2607.08374#bib.bib44)\]with a relatively low computational complexity\. The R1 model employs a unique training methodology that emphasizes reinforcement learning to enhance its reasoning capabilities\. These developments underscore a growing trend toward integrating advanced reasoning processes within large language models, aiming to improve their problem\-solving abilities and decision\-making processes\.

#### II\-B3Prior Works for Personality Recognition

Prior research has consistently highlighted the importance of large, high\-quality datasets for training machine learning models that generalize effectively\[[43](https://arxiv.org/html/2607.08374#bib.bib62),[45](https://arxiv.org/html/2607.08374#bib.bib43)\]\. However, in privacy\-sensitive domains, the development and utilization of such datasets are often constrained by regulatory and ethical considerations\. In contrast, other research areas are better positioned to achieve scale by aggregating or integrating existing public datasets\. A frequently cited example is themyPersonality Project\[[41](https://arxiv.org/html/2607.08374#bib.bib64)\], once a prominent open dataset for computational personality research, which was discontinued in 2018 due to increasing challenges related to regulatory compliance, controlled data access, and governance obligations\. In personality recognition, we are limited by personality theory; hence, few researchers are tackling algorithmic improvements, including architecture, feature exploration, graph neural networks, loss reweighted contributions, etc\.

Building on the importance of data and representation, prior work has explored a range of modeling approaches for personality classification from text\. Early advances include BiLSTM\-based models\[[22](https://arxiv.org/html/2607.08374#bib.bib57)\], which leverage bidirectional context to outperform traditional machine learning methods such as SVM, RF, and DT, highlighting the role of sequential modeling and hyperparameter tuning\. To further enhance representation learning,\[[15](https://arxiv.org/html/2607.08374#bib.bib54)\]proposes Personality2vec, which integrates semantic, linguistic, and structural information from social networks through biased random walks and skip\-gram modeling, demonstrating robustness particularly in data\-scarce settings\. After that,\[[45](https://arxiv.org/html/2607.08374#bib.bib43)\]further explored the dataset splitting and proposed a stratification feature, as well as focal loss for reweighting the contribution in the neural network, and analyzed the evaluation metrices\.

Subsequent studies have focused on enriching deep contextual representations with complementary linguistic and structural information\. For example, a hybrid Transformer–BLSTM framework\[[21](https://arxiv.org/html/2607.08374#bib.bib53)\]integrates psycholinguistic features with attention mechanisms to improve both predictive performance and interpretability\. Graph\-based methods have also emerged as an effective direction\. KGrAt\-Net\[[35](https://arxiv.org/html/2607.08374#bib.bib51)\]leverages knowledge graph attention over DBpedia entities to model richer semantic relationships, while TranSentGAT\[[5](https://arxiv.org/html/2607.08374#bib.bib52)\]combines BERT with sentiment knowledge and graph attention to enhance contextual representations and improve personality prediction\.

Nonetheless, these advances in modeling and feature integrationdo not resolve the core bottleneck of limited and fragmented data\. Performance in personality recognition remains constrained by dataset scale, diversity, and ecological validity under strict privacy and governance requirements\. From this perspective, expanding datasets in a cost\-efficient and flexible manner is essential to overcoming current theoretical and empirical limits\. However, collecting such data is often difficult, particularly for low\-resource settings, due to time, cost, and regulatory constraints, while cross\-institutional approaches such as federated learning remain limited in practice \(to the best of our knowledge\), partly because of heterogeneous theoretical frameworks and incompatible data assumptions\. These challenges motivate a shift toward moretheory\-agnosticapproaches\.

#### II\-B4Generative Approaches to Personality Recognition

Recent work on generative AI for personality inference has explored both data\-centric and architecture\-centric improvements\. Early studies focus on data augmentation and heterogeneous graph\-based models for dialogue understanding\. For instance, Wu et al\.\[[53](https://arxiv.org/html/2607.08374#bib.bib56)\]introduce personality trait interpolation to generate synthetic training data and propose HC\-GNN to capture both inter\- and intra\-speaker dependencies, improving conversational personality recognition\. Similarly, Semi\-PerGCN\[[58](https://arxiv.org/html/2607.08374#bib.bib63)\]adopts a semi\-supervised framework with multi\-view graph augmentation and heterogeneous graph construction, addressing limited labeled data and enhancing robustness in low\-resource settings\. Collectively, these approaches reflect a transition from sequential modeling toward graph\-based and hybrid architectures, with increasing emphasis on representation richness and data efficiency\.

More recent studies have investigated large language models as direct inference engines for personality recognition\. ChatGPT has been shown to exhibit strong zero\-shot capability and partial interpretability in personality prediction tasks\[[19](https://arxiv.org/html/2607.08374#bib.bib61)\]\. Related work integrates emotional knowledge with structured prompting strategies for trait inference\[[25](https://arxiv.org/html/2607.08374#bib.bib49)\], while PICEPR\[[44](https://arxiv.org/html/2607.08374#bib.bib59)\]not only proposes embedding\-based knowledge elicitation, but it also demonstrates that modular prompting can improve classification performance\.

Compared with traditional approaches that require task\-specific feature engineering or model training, these methods leverage in\-context learning, enabling models to infer personality labels directly from instructions, label descriptions, or a small number of exemplars\. Consequently, prompting\-based approaches move toward a more theory\-agnostic paradigm, as the same pretrained model can be adapted to different personality frameworks by modifying the prompt and label definitions rather than redesigning or retraining the prediction architecture\. While the provided labels may still originate from a specific theory, the underlying inference mechanism is not inherently bound to a specific personality theory\. Through in\-context learning, the same model can perform personality inference in few\-shot settings using a small number of labeled examples or in zero\-shot settings using only trait descriptions and task instructions, without requiring model retraining\.

However, these approaches also introduce important limitations\. First, decoder\-only large language models rely oninference\-time reasoning, which is computationally expensive and often impractical for large\-scale deployment\. Second, they do not produceexplicit intermediate representationsof psychological states, limiting their usefulness for downstream modeling of structured cognitive or behavioral processes\. More critically, since these models are trained on internet\-scale corpora, there is a non\-trivial risk of implicit exposure to similar evaluation data, weakening the assumption of strict zero\-shot generalization and introducingpotential dataset leakageconcerns\. These issues suggest that encoder\-based models remain necessary for stable and controllable representation learning in personality recognition systems\.

## IIIMethodologies

Fig\.[2](https://arxiv.org/html/2607.08374#S3.F2)illustrates the proposed JAM architecture, which targets tailoring generalization across datasets annotated under different psychological theories, thus achieving a theory\-agnostic model\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x2.png)Figure 2:Overview of the proposed JAM architecture for theory\-agnostic personality recognition\. The framework integrates a language embedding backbone with an attention\-pooled graph prototypical network to learn representations that capture latent pseudo\-facets through clustering in the embedding space\. A Cross\-Theory Harmonization module is introduced to bridge heterogeneous psychological annotations and consists of Human\-Guided Linkage and Machine\-Induced Consensus for constructing consistent pseudo\-facet structures\. Under this harmonization process, Essays and Kaggle datasets are organized into support–query pairs for prototypical learning\. Two training pipelines are explored: \(A\) LLM\-before\-the\-loop, where an LLM filters and refines data prior to training, and \(B\) LLM\-in\-the\-loop, where the LLM dynamically assesses sample quality during training to identify ambiguous, mislabeled, or boundary cases\. The resulting embeddings are attention\-pooled and passed through a projection layer\. The model is optimized using a meta\-learning objective with contrastive loss, followed by a classification head trained with cross\-entropy, enabling the formation of machine\-induced pseudo\-facets\.### III\-ADatasets

We utilized Tan’s train\-validation\-test split algorithm for the standard Essays and Kaggle datasets\[[45](https://arxiv.org/html/2607.08374#bib.bib43)\]\. This stratified algorithm ensures an even distribution of personality traits across all dimensions within each split, promoting fairness in comparison and validating the effectiveness of our model\. Table[II](https://arxiv.org/html/2607.08374#S3.T2)summarizes the datasets used in this study\. Note that, due to the nature of the JAM’s prototypical learning, the training sets are resampled into support and query sets for each episode in training; while evaluating, the existing validation set will serve as the support set, and the existing test set will be the query set\.

TABLE II:Datasets and their descriptions with the number of samples in train, validation, and test splitsDatasetTheorySplitting DistributionDescriptionEssays \(Public\)\[[33](https://arxiv.org/html/2607.08374#bib.bib31)\]Big\-51578, 395, 494
\(Train, Validation, Test\)This dataset was collected in a controlled environment where volunteers were instructed to write down whatever came to mind over a 20\-minute period\. It includes both self\-reported ratings \(via questionnaire\) and projective ratings \(by 18 observers\)\.Kaggle \(Public\)\[[18](https://arxiv.org/html/2607.08374#bib.bib32)\]MBTI5552, 1388, 1735
\(Train, Validation, Test\)This dataset comprises data crawled, labeled, and filtered from PersonalityCafe, an online community forum where users share self\-reported personality test results\.As in Eq\.[1](https://arxiv.org/html/2607.08374#S3.E1), we treated the dataset,𝒟standard\\mathcal\{D\}\_\{\\text\{standard\}\}, as a multi\-label \(or multi\-task\) classification problem instead of a multi\-class classification problem, where:nnis the total number of samples in the dataset,xxrepresents the sample text, andyyrepresents the labels \(the number of labels depends on the dimensions of the personality theory,d=\{d1,d2,…,d\|d\|\}d=\\\{d\_\{1\},d\_\{2\},\\dots,d\_\{\|d\|\}\\\}\) associated withxx\. This is because personality theory treats each dimension as independent from the others\[[56](https://arxiv.org/html/2607.08374#bib.bib33),[48](https://arxiv.org/html/2607.08374#bib.bib34)\]\. However, certain research argues that there are interdependencies or correlations between personality dimensions, suggesting that traits might not be entirely independent but could interact in complex ways\[[36](https://arxiv.org/html/2607.08374#bib.bib18),[48](https://arxiv.org/html/2607.08374#bib.bib34)\]\. Nevertheless, we adopt a multilabel classification approach to ensure that the model outputs a probability distribution over the dimensions\. This approach avoids framing the task as a binary classification problem, instead allowing the intermediate layers of the neural network to automatically capture potential correlations between the labels via gradient backpropagation\. In addition to the labelsyy, we include a vector of sample\-specific confidencezz, where eachziz\_\{i\}adjusts the influence of the corresponding labelyiy\_\{i\}during training\.

𝒟standard=\{\(x,y,z\)n\|x=sample texty=\(y0,y1,…,y\|d\|−1\),z=\(z0,z1,…,z\|d\|−1\),yi∈\{0,1\},zi∈ℝ​∀i\}\\mathcal\{D\}\_\{\\text\{standard\}\}=\\left\\\{\(x,y,z\)^\{n\}\\;\\left\|\\;\\begin\{aligned\} &x=\\text\{sample text\}\\\\ &y=\(y\_\{0\},y\_\{1\},\\dots,y\_\{\|d\|\-1\}\),\\\\ &z=\(z\_\{0\},z\_\{1\},\\dots,z\_\{\|d\|\-1\}\),\\\\ &y\_\{i\}\\in\\\{0,1\\\},\\;z\_\{i\}\\in\\mathbb\{R\}\\;\\;\\forall i\\end\{aligned\}\\right\.\\right\\\}\(1\)

### III\-BProposed Algorithms

As illustrated in Fig\.[2](https://arxiv.org/html/2607.08374#S3.F2), the JAM framework comprises three major components designed to achieve the overall objectives\. We design anAttention\-Pooled Graph Prototypical Networkto learn representations that capture underlying pseudo\-facets through clustering in the embedding space\. JAM incorporates aCross\-Theory Harmonizationmodule, which includesHuman\-Guided LinkageandMachine\-Induced Consensus, enabling the model to derive pseudo\-facets from learned representations rather than relying solely on predefined human annotations, as discussed in Section[II\-A](https://arxiv.org/html/2607.08374#S2.SS1)\. We further investigate anLLM\-as\-a\-Judgemechanism operating under two configurations:LLM\-before\-the\-loopandLLM\-in\-the\-loop\. These configurations differ in the stage and manner in which the LLM influences training\. The mechanism is incorporated to assess training sample quality and identify hard examples, including ambiguous, mislabeled, or boundary\-adjacent instances, thereby guiding more focused learning\.

#### III\-B1Attention\-Pooled Graph Prototypical Network

We adopt the Longformer model as the language embedding backbone due to its ability to efficiently process long textual sequences, which is particularly important for personality recognition tasks involving extensive user\-generated content\. Longformer employs a combination of local and global attention mechanisms, enabling scalable encoding of long documents while maintaining computational efficiency\[[7](https://arxiv.org/html/2607.08374#bib.bib58)\]\. Given an input textxx, we first tokenize it and feed it into the Longformer encoder to obtain contextualized hidden representations\. The encoder produces layer\-wise hidden states across all transformer layers\. From these, we derive a set ofLLpooled representations, where each node corresponds to a layer\-wise pooled representation of the input inℝv\\mathbb\{R\}^\{v\}obtained via pooling over token embeddings within that layer\. The resulting node feature matrix is defined in Eq\.[2](https://arxiv.org/html/2607.08374#S3.E2)\.

𝐇=Longformer​\(x\),𝐇∈ℝL×v\\mathbf\{H\}=\\text\{Longformer\}\(x\),\\quad\\mathbf\{H\}\\in\\mathbb\{R\}^\{L\\times v\}\(2\)
Later, the output𝐇\\mathbf\{H\}is used as input to the graph neural network, which refines the representations by modeling interactions among embedding vectors derived from the language encoder\. We construct a normalized adjacency matrix𝐀~\\mathbf\{\\tilde\{A\}\}from an adjacency matrix𝐀\\mathbf\{A\}that defines the relationships between nodes\. In this work, we adopt a fully connected weighted graph, where each node is connected to all other nodes, to enable unrestricted and symmetric information exchange across all representation nodes\. The number of nodes in the graph neural network corresponds to the number of layers \(LL\) in the selected encoder, and the adjacency matrix remains shared across all layers\. The node aggregation process is illustrated in Eq\.[3](https://arxiv.org/html/2607.08374#S3.E3)\.

𝐀~\\displaystyle\\mathbf\{\\tilde\{A\}\}=𝐃−1/2​𝐀𝐃−1/2,𝐃i​i=∑j𝐀i​j,\\displaystyle=\\mathbf\{D\}^\{\-1/2\}\\mathbf\{A\}\\mathbf\{D\}^\{\-1/2\},\\mathbf\{D\}\_\{ii\}=\\sum\_\{j\}\\mathbf\{A\}\_\{ij\},\(3\)𝐀i​j\\displaystyle\\mathbf\{A\}\_\{ij\}=1,∀i≠j,𝐀i​i=0,𝐀~∈ℝL×L\.\\displaystyle=1,\\;\\forall i\\neq j,\\mathbf\{A\}\_\{ii\}=0,\\mathbf\{\\tilde\{A\}\}\\in\\mathbb\{R\}^\{L\\times L\}\.
This design treats all layer\-wise representations as mutually interacting components without imposing predefined hierarchical or locality constraints, thereby allowing the model to learn how information should be integrated across different abstraction levels in a data\-driven manner\. While this choice provides a simple and uniform mechanism for cross\-layer fusion, it does not explicitly encode heterogeneous or sparse inter\-layer dependencies\.Investigating adaptive or learned graph structures that could more finely capture layer\-specific relationships is therefore left as a promising direction for future work\.

Through matrix multiplication with the normalized adjacency matrix𝐀~\\mathbf\{\\tilde\{A\}\}, information is aggregated from neighboring nodes to update node embeddings\. This propagation is performed iteratively across GNN layers, where𝐇\(k\)\\mathbf\{H\}^\{\(k\)\}denotes the node representations at thekk\-th layer\. Eq\.[4](https://arxiv.org/html/2607.08374#S3.E4)illustrates the node update process\. Here,σ​\(⋅\)\\sigma\(\\cdot\)denotes the LeakyReLU activation function with negative slope coefficientα=0\.01\\alpha=0\.01, and𝐖\(k\)\\mathbf\{W\}^\{\(k\)\}is the trainable weight matrix at thekk\-th layer\.

𝐇\(k\)\\displaystyle\\mathbf\{H\}^\{\(k\)\}=σ​\(𝐀~​𝐇\(k−1\)​𝐖\(k\)\),\\displaystyle=\\sigma\\left\(\\mathbf\{\\tilde\{A\}\}\\mathbf\{H\}^\{\(k\-1\)\}\\mathbf\{W\}^\{\(k\)\}\\right\),\(4\)σ\(x\)=max\(αx,\\displaystyle\\sigma\(x\)=\\max\(\\alpha x,x\),𝐖\(k\)∈ℝv×v,𝐇\(k\)∈ℝL×v\.\\displaystyle x\),\\mathbf\{W\}^\{\(k\)\}\\in\\mathbb\{R\}^\{v\\times v\},\\mathbf\{H\}^\{\(k\)\}\\in\\mathbb\{R\}^\{L\\times v\}\.
Lastly, we apply attention\-based pooling to obtain the final graph representation, denoted as𝐡graph\\mathbf\{h\}\_\{\\text\{graph\}\}, as shown in Eq\.[5](https://arxiv.org/html/2607.08374#S3.E5)\. The attention mechanism computes a scalar importance score for each node based on its interaction with a trainable query vectorqq\. These scores are normalized via a softmax function to obtain attention weightsαi\\alpha\_\{i\}, which determine the contribution of each node to the final representation\. This operation is fully differentiable, allowing gradients to propagate not only to the query vectorqq, but also to each dimension of the node embeddings𝐇i\(k\)\\mathbf\{H\}\_\{i\}^\{\(k\)\}\. This enables the model to jointly learn which nodes are important and how the inferred embeddings should be adjusted to optimize personality trait prediction\.

𝐡graph=∑i=1Lαi​𝐇i\(k\),αi=exp⁡\(𝐇i\(k\)​q\)∑j=1Lexp⁡\(𝐇j\(k\)​q\),q∈ℝv\\displaystyle\\mathbf\{h\}\_\{\\text\{graph\}\}=\\sum\_\{i=1\}^\{L\}\\alpha\_\{i\}\\mathbf\{H\}\_\{i\}^\{\(k\)\},\\alpha\_\{i\}=\\frac\{\\exp\\left\(\\mathbf\{H\}\_\{i\}^\{\(k\)\}q\\right\)\}\{\\sum\_\{j=1\}^\{L\}\\exp\\left\(\\mathbf\{H\}\_\{j\}^\{\(k\)\}q\\right\)\},q\\in\\mathbb\{R\}^\{v\}\(5\)

#### III\-B2Cross\-Theory Harmonization \(CTH\)

In order to achieve theory\-agnostic modeling, we aim to ensure that the model captures the core personality features embedded within the text\. Given the presence of personality theories across different datasets, this setting provides an opportunity for the model to learn not only surface\-level patterns but also to structure the representation space in a more disentangled manner\. Fig\.[3](https://arxiv.org/html/2607.08374#S3.F3)illustrates the overall idea behind this motivation\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x3.png)\(a\)Regular CE
![Refer to caption](https://arxiv.org/html/2607.08374v1/x4.png)\(b\)Weighted CE
![Refer to caption](https://arxiv.org/html/2607.08374v1/x5.png)\(c\)Prototypical Finetuning \(PF\)
![Refer to caption](https://arxiv.org/html/2607.08374v1/x6.png)\(d\)PF \+ HGL
![Refer to caption](https://arxiv.org/html/2607.08374v1/x7.png)\(e\)PF \+ MIC
![Refer to caption](https://arxiv.org/html/2607.08374v1/x8.png)\(f\)PF \+ HGL \+ MIC \(Full CTH\)

Figure 3:The conceptual schematic visualization comparing the effects of the baseline \(prior\) algorithm, the proposed CTH algorithm, and its ablation variants\. Each particle represents a pseudo\-facet that belongs to the respective cluster of the personality theory: red and blue correspond to the respective personality theories used during inference\. The numbers inside each particle represent shared features that can potentially be learned and aligned\. Identical numbers \(e\.g\., 1, 2, 3, …\) indicate the same feature across theories, while the numerical values themselves are only used as indices and do not carry intrinsic meaning\. Alphabetic labels denote features unique to each personality theory; letters \(a, b, c, …\) are also meaningless sequential identifiers\. Purple particles indicate shared features that have been successfully learned and aligned, while grey particles represent incorrectly aligned features\. The values are presented by \\tiny\{$\\cdot\|\\cdot$\}⃝, where the left side corresponds to the Big\-5 representation and the right side corresponds to the MBTI representation\.Under a standard cross\-entropy \(CE\) formulation, different personality theories are treated as independent labels\. As a result, the model tends to prioritize dominant and easily separable signals during optimization, while underutilizing or completely ignoring subtler but potentially shared representational facets across theories\. Although weighted CE \(eg\., focal loss\) can rebalance gradient contributions and improve sensitivity to harder samples, these approaches primarily amplify already\-learned discriminative cues rather than fundamentally restructuring the representation space\. Consequently, the underlying bias toward dominant features remains largely unchanged\.

To address this limitation, we adoptprototypical fine\-tuning \(PF\)\. The class prototypes are computed from the support set𝒟\(S\)\\mathcal\{D\}^\{\(S\)\}, where each prototypesis\_\{i\}is defined as the \(weighted\) centroid of embeddings belonging to a given class\. As shown in Eq\.[6](https://arxiv.org/html/2607.08374#S3.E6), each prototype is obtained as a weighted mean of support embeddings, where sample weights are denoted byzz\(set toz=1z=1in our current setting\)\. The encoderfϕ​\(x\)f\_\{\\phi\}\(x\)maps each inputxxinto an embedding space parameterized byϕ\\phi, and classification is performed by comparing query embeddings against class prototypes in this space\. In particular, the model minimizes the distance between a query embedding and the prototype of its ground\-truth class while maximizing its distance to all other prototypes\. A softmax over negative Euclidean distances is then used to define the probability of assigning a queryqqto classdid\_\{i\}\. The training objective is formulated as a weighted negative log\-likelihood over the query set𝒟\(Q\)\\mathcal\{D\}^\{\(Q\)\}, where each query is also associated with a sample\-specific weight\.

ℒPF=−w\(Q\)\\displaystyle\\mathcal\{L\}\_\{\\text\{PF\}\}=\-w^\{\(Q\)\}⋅log⁡exp⁡\(−‖fϕ​\(q\)−si‖2\)∑jexp⁡\(−‖fϕ​\(q\)−sj‖2\),\\displaystyle\\cdot\\log\\frac\{\\exp\\left\(\-\\\|f\_\{\\phi\}\(q\)\-s\_\{i\}\\\|^\{2\}\\right\)\}\{\\sum\_\{j\}\\exp\\left\(\-\\\|f\_\{\\phi\}\(q\)\-s\_\{j\}\\\|^\{2\}\\right\)\},\\;\(6\)si\\displaystyle s\_\{i\}=∑\(x,w\)∈𝒟i\(S\)w⋅fϕ​\(x\)∑\(x,w\)∈𝒟i\(S\)w\\displaystyle=\\frac\{\\sum\_\{\(x,w\)\\in\\mathcal\{D\}^\{\(S\)\}\_\{i\}\}w\\cdot f\_\{\\phi\}\(x\)\}\{\\sum\_\{\(x,w\)\\in\\mathcal\{D\}^\{\(S\)\}\_\{i\}\}w\}
Through sampling combinations of instances and prototypes, PF naturally alleviates data imbalance and reduces representational bias\. This induces a structured clustering behavior in which distinct facets are progressively aligned with their corresponding theory\-specific prototypes, while latent shared structures begin to emerge\. However, at this stage, certain facets remain under\-trained or ambiguously represented, which may still lead to misclassification\. Overall, PF encourages the representation space to organize around theory\-aware prototypes, as illustrated in Fig\.[3\(c\)](https://arxiv.org/html/2607.08374#S3.F3.sf3)\.

We extend this withHuman\-Guided Linkage \(HGL\), where external human\-defined supervision is introduced to explicitly align shared facets across personality theories, encouraging the emergence of a more unified shared representation space\. As in Fig\.[3\(d\)](https://arxiv.org/html/2607.08374#S3.F3.sf4), while this strategy improves cross\-theory alignment, it may also introduce noise due to imperfect or overly rigid mappings that do not always reflect true semantic correspondence\. Nevertheless, these guided linkages are particularly valuable for handling edge cases: even when the provided alignments are partially inaccurate, they still gently steer the representations toward shared regions, facilitating the re\-discovery and re\-association of related facets\.

In parallel, we exploreMachine\-Induced Consensus \(MIC\)\. We employ a cross\-entropy objective \(Eq\.[7](https://arxiv.org/html/2607.08374#S3.E7)\) to guide cross\-dataset adaptation via a lightweight adaptation layer that projects embeddings into a shared space\. This layer is not treated as part of the core model architecture; instead, it serves as a training\-time mechanism to facilitate convergence toward representations that remain discriminative across different personality theories\.

ℒMIC\(D∈\{Essays,Kaggle\}\)​\(y,y^\)=−\[y​log⁡y^\+\(1−y\)​log⁡\(1−y^\)\]\\mathcal\{L\}\_\{\\text\{MIC\}\}^\{\(D\\in\\\{\\text\{Essays\},\\text\{Kaggle\}\\\}\)\}\(y,\\hat\{y\}\)=\-\\left\[\\begin\{aligned\} &y\\log\\hat\{y\}\\\\ &\+\(1\-y\)\\log\(1\-\\hat\{y\}\)\\end\{aligned\}\\right\]\(7\)
As illustrated in Fig\.[3\(e\)](https://arxiv.org/html/2607.08374#S3.F3.sf5), consensus is learned through joint optimization over paired tasks, enabling the model to infer shared structure from agreement signals rather than explicit manual supervision\. This process helps refine and further “clean” the shared space established by prototypical fine\-tuning \(PF\), while also revealing latent pseudo\-facets that are consistently aligned across theories\. However, MIC exhibits a conservative alignment tendency, prioritizing high\-confidence correspondences and potentially down\-weighting weaker but still informative relationships\. Consequently, it is most effective when applied after Human\-Guided Linkage \(HGL\), where it acts as a stabilizing mechanism that regularizes and consolidates the previously introduced human\-guided alignments\.

Lastly, we integrate PF, HGL, and MIC, termedCross\-Theory Harmonization \(CTH\)\. This hybrid design leverages the complementary strengths of each component: PF provides stable prototypical anchors for organizing the representation space, HGL introduces external guidance for soft alignment of potentially shared facets across theories, and MIC further refines these relations through data\-driven consensus\. Together, these mechanisms progressively reshape the representation space from one dominated by isolated theory\-specific signals into a coherent shared manifold, where both distinct and overlapping pseudo\-facets are more faithfully encoded, and previously under\-represented or unlearned features are systematically recovered and integrated\.

#### III\-B3LLM\-as\-a\-Judge \(LAJ\)

While CTH aims to align representations across personality theories, residual noise may still hinder effective learning and lead to incorrect connections, as shown in Fig\.[3\(c\)](https://arxiv.org/html/2607.08374#S3.F3.sf3), despite MIC efforts, which cannot fully address noise arising from mislabeled data\. Moreover, while LLM\-based augmentation has been shown to improve performance\[[44](https://arxiv.org/html/2607.08374#bib.bib59)\], it introduces potential risks of data leakage\. We therefore argue thatLLMs are better positioned as auxiliary evaluators rather than primary predictors\. In particular, encoder\-based architectures remain the backbone for representation learning and classification, while LLMs are employed as reasoning\-based judges for data quality assessment rather than direct personality inference\. They evaluate label consistency, contradictions, and noisy or implausible samples, improving dataset integrity and reducing leakage into core predictions\. This preserves the theoretical grounding of encoder\-based personality modeling while leveraging LLMs’ world knowledge and reasoning capabilities\.

In this work, we adopt LAJ to evaluate data correctness, specifically using \(i\) OpenAI’s ChatGPT model \(gpt,gpt\-4o\-2024\-08\-06\), \(ii\) Alibaba Qwen model \(qwen,Qwen3\.6\-35B\-A3B\), \(iii\) Meta Llama model \(llama,Llama\-3\.1\-8B\-Instruct\), and \(iv\) DeepSeek model \(ds,DeepSeek\-V4\-Flash\)\. We employ Chain\-of\-Thought \(CoT\) prompting to guide the LLMs in analyzing and determining whether a labeled sample isPossible,Impossible, orAmbiguouswith respect to its associated personality label, as in Fig\.[4](https://arxiv.org/html/2607.08374#S3.F4)\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x9.png)

Figure 4:The CoT System Prompt generates output in a structured JSON schema\. It performs an analysis of text samples and provides recommendations on whether to ‘maintain’, ‘mute,’ or ‘lower’ contributions for training\.We further conduct QLoRA fine\-tuning experiments on open\-source LLMs\. Training is performed exclusively on the training split using the reasoning\-data synthesis method proposed by\[[44](https://arxiv.org/html/2607.08374#bib.bib59)\], where ground\-truth labels are leveraged to generate reasoning traces that supervise the model’s decision\-making process\. However, the original dataset consists only of prototypical binary personality labels and lacks ambiguous cases that require reasoning over mixed or conflicting personality signals\. To address this limitation, we augment the training data by constructingambiguoussamples through the combination of two distinct personality profiles, randomly selecting sentences from each profile to form a single input\. This augmentation exposes the model to more realistic borderline cases and enables us to investigate whether LLM\-based judges exhibit systematic failures or introduce new prediction biases when personality evidence is ambiguous\. The augmentation is applied exclusively to the training data, while the test set remains untouched, ensuring that no data leakage occurs\.

As shown in Fig\.[2](https://arxiv.org/html/2607.08374#S3.F2), we study two pipelines\. In theLLM\-before\-the\-loop \(LBL\)approach \(Algorithm[1](https://arxiv.org/html/2607.08374#alg1)\), the LLM is employedprior to trainingto assess and refine training samples based on label plausibility\. In contrast, theLLM\-in\-the\-loop \(LIL\)strategy \(Algorithm[2](https://arxiv.org/html/2607.08374#alg2)\) integrates the LLMduring training, where it dynamically evaluates samples in real time based on their loss values\.

Algorithm 1LLM\-before\-the\-loop \(LBL\)0:

𝒟standard=\{\(x,y,z\)\}\\mathcal\{D\}\_\{\\text\{standard\}\}=\\\{\(x,y,z\)\\\}, where

zi=1z\_\{i\}=1by default, system\_prompt, JSON\_output\_schema

0:Updated

𝒟standard\\mathcal\{D\}\_\{\\text\{standard\}\}with modified

zz
1:for all

\(x,y,z\)\(x,y,z\)in

𝒟standard\\mathcal\{D\}\_\{\\text\{standard\}\}do

2:for

i=0i=0to

\|d\|−1\|d\|\-1do

3:Build

xxand

yiy\_\{i\}content and format as the"user"role, and Merge with system\_prompt

4:repeat

5:Send to LLM using JSON\_output\_schema

6:Attempt to parse LLM output

7:untilvalid JSON is returned

8:Extract LLM judgment and update the corresponding

zz\.

9:endfor

10:endfor

11:return

𝒟standard\\mathcal\{D\}\_\{\\text\{standard\}\}

Algorithm 2LLM\-in\-the\-loop \(LIL\)0:

𝒟standard=\{\(x,y,z\)\}\\mathcal\{D\}\_\{\\text\{standard\}\}=\\\{\(x,y,z\)\\\}, where

zi=1z\_\{i\}=1by default, model

fϕf\_\{\\phi\}, system prompt, JSON\_output\_schema, threshold

τ\\tau
0:Updated model parameters and possibly revised labels and weights

1:foreach training episodedo

2:Sample support and query sets

\(𝒟\(S\),𝒟\(Q\)\)\(\\mathcal\{D\}^\{\(S\)\},\\mathcal\{D\}^\{\(Q\)\}\)from

𝒟standard\\mathcal\{D\}\_\{\\text\{standard\}\},

3:Compute prototypes

\{sj\}\\\{s\_\{j\}\\\}from

𝒟\(S\)\\mathcal\{D\}^\{\(S\)\}
4:for all

\(x,y,w\(Q\)\)\(x,y,w^\{\(Q\)\}\)in

𝒟\(Q\)\\mathcal\{D\}^\{\(Q\)\}do

5:Compute query embedding

fϕ​\(q\)f\_\{\\phi\}\(q\)for

ℒJAM\(LIL\)\\mathcal\{L\}\_\{\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\}
6:if

ℒJAM\(LIL\)\>τ\\mathcal\{L\}\_\{\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\}\>\\tauthen

7:Build

xxand

yiy\_\{i\}content and format as the"user"role, and Merge with system\_prompt

8:repeat

9:Send message to LLM with JSON\_output\_schema

10:Receive and attempt to parse response

11:untilvalid JSON is returned

12:Extract LLM judgment and update the corresponding

zz\.

13:endif

14:endfor

15:Aggregate and minimize total

JAM\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}loss over query set

16:Update model parameters

ϕ\\phiusing gradient descent

17:endfor

Regardless of the pipeline, the outcomes, depending on the LLM’s judgment, updatezzin𝒟standard\\mathcal\{D\}\_\{\\text\{standard\}\}\. This updatedzzthereby influences each example’s contribution during prototype computation and training\. The resulting examples are later sampled to form𝒟prototypical\\mathcal\{D\}\_\{\\text\{prototypical\}\}in each episode and are organized into Support \(𝒟\(S\)\\mathcal\{D\}^\{\(S\)\}\) and Query \(𝒟\(Q\)\\mathcal\{D\}^\{\(Q\)\}\) sets for training\. We implemented anNN\-wayKK\-shot classification task\. In our setting,𝒟\(S\)=K∗N\\mathcal\{D\}^\{\(S\)\}=K\*Nand𝒟\(Q\)=q∗N\\mathcal\{D\}^\{\(Q\)\}=q\*N, whereN=\|d\|N=\|d\|andqqdepends on the GPU RAM capacity\. These were designed to facilitate representational learning, enabling the model to generalize to new personality theories\. Eq\.[8](https://arxiv.org/html/2607.08374#S3.E8)illustrates the structure of the dataset for prototypical model training, while Eq\.[9](https://arxiv.org/html/2607.08374#S3.E9)shows the weighting in this experiment \(modified later for sensitivity testing\)\. We also used the weighted mean of theNNembeddings as the support set for few\-shot learning\.

𝒟prototype\\displaystyle\\mathcal\{D\}\_\{\\text\{prototype\}\}\(8\)=\{𝒟\(S\)=⋃i=1N\{\(xi​j\(S\),yi​j\(S\),zi​j\(S\)\)\|j=1,…,K\},𝒟\(Q\)=⋃i=1N\{\(xi​j\(Q\),yi​j\(Q\),zi​j\(Q\)\)\|j=1,…,q\}\}\\displaystyle=\\left\\\{\\begin\{aligned\} &\\mathcal\{D\}^\{\(S\)\}=\\bigcup\_\{i=1\}^\{N\}\\left\\\{\\left\(x\_\{ij\}^\{\(S\)\},y\_\{ij\}^\{\(S\)\},z\_\{ij\}^\{\(S\)\}\\right\)\\;\\middle\|\\;j=1,\\dots,K\\right\\\},\\\\ &\\mathcal\{D\}^\{\(Q\)\}=\\bigcup\_\{i=1\}^\{N\}\\left\\\{\\left\(x\_\{ij\}^\{\(Q\)\},y\_\{ij\}^\{\(Q\)\},z\_\{ij\}^\{\(Q\)\}\\right\)\\;\\middle\|\\;j=1,\\dots,q\\right\\\}\\end\{aligned\}\\right\\\}
z=\{1\.0ifζ∈\{Possible\}, the LLM judgment isPossible\(valid\); maintain contributions\.0\.2ifζ∈\{Ambiguous\}, the LLM judgment isAmbiguous; lower the contribution\.0ifζ∈\{Impossible\}, the LLM judgment isImpossible\(invalid\); mute the contribution\.z=\\begin\{cases\}1\.0&\\parbox\[t\]\{281\.85034pt\}\{if $\\zeta\\in\\\{\\texttt\{Possible\}\\\}$, the LLM judgment is \{\{Possible\}\} \(valid\); maintain contributions\.\}\\\\\[6\.0pt\] 0\.2&\\parbox\[t\]\{281\.85034pt\}\{if $\\zeta\\in\\\{\\texttt\{Ambiguous\}\\\}$, the LLM judgment is \{\{Ambiguous\}\}; lower the contribution\.\}\\\\\[6\.0pt\] 0&\\parbox\[t\]\{281\.85034pt\}\{if $\\zeta\\in\\\{\\texttt\{Impossible\}\\\}$, the LLM judgment is \{\{Impossible\}\} \(invalid\); mute the contribution\.\}\\end\{cases\}\(9\)
Finally, we incorporate the LLM\-as\-a\-Judge mechanism to weight the contributions of each loss term\. We then summarize the overall formulation in Eq\.[10](https://arxiv.org/html/2607.08374#S3.E10), where the joint loss combines multiple components from different datasets and tasks\.

ℒJAM=ϕ​\(ℒPF\(Essays\)\+ℒPF\(Kaggle\)\)\+ψ​ℒHGL\(Essays⇔Kaggle\)\+ρ​ℒMIC\\mathcal\{L\}\_\{\\text\{JAM\}\}=\\phi\\Big\(\\mathcal\{L\}\_\{\\text\{PF\}\}^\{\(\\text\{Essays\}\)\}\+\\mathcal\{L\}\_\{\\text\{PF\}\}^\{\(\\text\{Kaggle\}\)\}\\Big\)\+\\psi\\,\\mathcal\{L\}\_\{\\text\{HGL\}\}^\{\(\\text\{Essays $\\Leftrightarrow$ Kaggle\}\)\}\+\\rho\\,\\mathcal\{L\}\_\{\\text\{MIC\}\}\(10\)

### III\-CExperiment Design

We train the model individually on the Essays\-only dataset and the Kaggle\-only dataset to establish the baseline reference for the ablation study\. Next, we train on the combined dataset to evaluate whether the JAM can generalize to new personality theories\. Subsequently, we study the JAM algorithm to determine whether it can improve dataset quality and model performance\. The experiments use a batch size of 32, a learning rate of1×10−51\\times 10^\{\-5\}, a maximum of 30,000 training episodes with early stopping, a random seed of 42, and 4 NVIDIA A100 GPUs\. Table[III](https://arxiv.org/html/2607.08374#S3.T3)presents the acronyms used and the corresponding experiment configurations\.

TABLE III:Overview of experimental configurations and notationsNotationDescriptionCE†\\text\{CE\}^\{\\dagger\}Regular cross\-entropy serves as a standard classification baseline\.PO†\\text\{PO\}^\{\\dagger\}Off\-the\-shelf model as the few\-shot prototypical baseline\. \(No training\)PF†\\text\{PF\}^\{\\dagger\}Fine\-tuning the model using regular meta\-learning for the few\-shot prototypical baseline\.\(ϕ=1\\phi=1;ψ=0\\psi=0;ρ=0\\rho=0;Eq\.[6](https://arxiv.org/html/2607.08374#S3.E6)\|z=1\\left\.\\text\{Eq\.~\\ref\{eq:PF\-loss\}\}\\right\|\_\{z=1\}\)HGL‡\\text\{HGL\}^\{\\ddagger\}PF with HGL\. \(ϕ=1\\phi=1;ψ=1\\psi=1;ρ=0\\rho=0;Eq\.[6](https://arxiv.org/html/2607.08374#S3.E6)\|z=1\\left\.\\text\{Eq\.~\\ref\{eq:PF\-loss\}\}\\right\|\_\{z=1\}\)MIC‡\\text\{MIC\}^\{\\ddagger\}PF with MIC\. \(ϕ=1\\phi=1;ψ=0\\psi=0;ρ=1\\rho=1;Eq\.[6](https://arxiv.org/html/2607.08374#S3.E6)\|z=1\\left\.\\text\{Eq\.~\\ref\{eq:PF\-loss\}\}\\right\|\_\{z=1\}\)CTH‡\\text\{CTH\}^\{\\ddagger\}PF with \(HGL \+ MIC\)\. \(ϕ=1\\phi=1;ψe\+1≤ψe,∀e≥1\\psi\_\{e\+1\}\\leq\\psi\_\{e\},\\forall e\\geq 1;ρ=1\\rho=1;Eq\.[6](https://arxiv.org/html/2607.08374#S3.E6)\|z=1\\left\.\\text\{Eq\.~\\ref\{eq:PF\-loss\}\}\\right\|\_\{z=1\}\)\.JAM<model\>\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{<model\>\}\}Proposed JAM approach with the LBL pipeline on CTH\.JAM<model\>\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\_\{\\textit\{<model\>\}\}Proposed JAM approach with the LIL pipeline on CTH\.\[Essays\]Training using only the Essays Dataset\.\[Kaggle\]Training using only the Kaggle Dataset\.\[Both\]Training using both Essays Dataset and Kaggle Dataset\.
Notes:

- †Baseline performance without any CTH modules\.
- ‡Ablation setting experiments for CTH modules of the JAM approach\.
- †‡Experiments conducted without any weighting \(no LAJ involved\)\.
- ¡model¿\{\}\_\{\\textit\{<model\>\}\}Indicates which LLM was used as judge in the JAM experiments\.
- \[·\]Indicates the training dataset, attached after the notation\.

### III\-DEvaluation

To evaluate the performance, we adopted the following metrics: Regular Accuracy \(RA\) \(Eq\.[11](https://arxiv.org/html/2607.08374#S3.E11)\) to determine the overall accuracy of the model, Balanced Accuracy \(BA\) \(Eq\.[12](https://arxiv.org/html/2607.08374#S3.E12)\) to assess performance on imbalanced datasets, and the F1 Score \(Eq\.[13](https://arxiv.org/html/2607.08374#S3.E13)\) to measure the model’s bias\. Here,T​PTP,F​PFP,T​NTN, andF​NFNrepresent true positives, false positives, true negatives, and false negatives, respectively\.

R​A=T​P\+T​NT​P\+T​N\+F​P\+F​N\.RA=\\frac\{TP\+TN\}\{TP\+TN\+FP\+FN\}\.\(11\)
B​A=12​\(T​PT​P\+F​N\+T​NT​N\+F​P\)\.BA=\\frac\{1\}\{2\}\\left\(\\frac\{TP\}\{TP\+FN\}\+\\frac\{TN\}\{TN\+FP\}\\right\)\.\(12\)
F​1=2⋅T​P2⋅T​P\+F​P\+F​N\.F1=\\frac\{2\\cdot TP\}\{2\\cdot TP\+FP\+FN\}\.\(13\)

## IVResults

TABLE IV:Performance comparison on the Essays dataset, including prior work, the baseline, ablation, and LAJ mechanisms\.ExperimentO \- OpennessC \- ConscientiousnessE \- ExtraversionA \- AgreeablenessN \- NeuroticismBAF1RABAF1RABAF1RABAF1RABAF1RAPsycholinguistic MLP\[[27](https://arxiv.org/html/2607.08374#bib.bib9)\]0\.64600\.59200\.60000\.58800\.6050BERT MLP\[[27](https://arxiv.org/html/2607.08374#bib.bib9)\]\-\-0\.6040\-0\.5730\-0\.5690\-0\.5700\-0\.5980CoT with Emotion\[[25](https://arxiv.org/html/2607.08374#bib.bib49)\]\-0\.60930\.6102\-0\.68640\.6800\-0\.63020\.6201\-0\.65010\.6498\-0\.56000\.5600Baseline Representative \[Essays\]0\.60300\.62780\.60320\.53460\.52870\.53440\.60360\.61170\.60320\.57600\.61900\.57490\.55360\.62580\.5573HGL \[Both\]0\.51440\.54820\.51620\.50030\.49070\.50000\.54240\.57940\.54450\.55750\.56800\.55670\.50610\.53960\.5061MIC \[Both\]0\.63880\.65640\.63970\.54260\.54070\.54250\.58430\.60190\.58500\.59280\.59760\.59110\.60320\.61570\.6032CTH \[Both\]0\.67340\.68740\.67410\.61180\.60000\.61130\.62780\.63200\.62750\.63890\.63410\.63560\.66400\.66930\.6640JAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]0\.71630\.72550\.71660\.64220\.63050\.64170\.64230\.64240\.64170\.65110\.64630\.64780\.68420\.69170\.6842JAMgpt\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]0\.67520\.69110\.67610\.60360\.59340\.60320\.61620\.61380\.61540\.61920\.61070\.61540\.67810\.67620\.6781TABLE V:Performance comparison on the Kaggle dataset, including prior work, the baseline, ablation, and LAJ mechanisms\.ExperimentO \- OpennessC \- ConscientiousnessE \- ExtraversionA \- AgreeablenessBAF1RABAF1RABAF1RABAF1RABERT MLP\[[27](https://arxiv.org/html/2607.08374#bib.bib9)\]\-\-0\.6840\-\-0\.6440\-\-0\.7830\-\-0\.7440TrigNet\[[55](https://arxiv.org/html/2607.08374#bib.bib8)\]\-0\.6717\-\-0\.6769\-\-0\.6954\-\-0\.7906\-TAE\[[17](https://arxiv.org/html/2607.08374#bib.bib7)\]\-0\.8117\-\-0\.7020\-\-0\.7090\-\-0\.6621\-DGCN\[[54](https://arxiv.org/html/2607.08374#bib.bib6)\]\-0\.6719\-\-0\.6816\-\-0\.6952\-\-0\.8053\-Baseline Representative \[Kaggle\]0\.81630\.93970\.89740\.78370\.73920\.79140\.81820\.72180\.87200\.84120\.85520\.8427HGL \[Both\]0\.59010\.67170\.54990\.64090\.58690\.63980\.62320\.43330\.62310\.75830\.76260\.7556MIC \[Both\]0\.76950\.90390\.84090\.69020\.63900\.68930\.68250\.50100\.70490\.80580\.81770\.8058CTH \[Both\]0\.81440\.92600\.87610\.76340\.71770\.76600\.77390\.64800\.83340\.84080\.85590\.8427JAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]0\.81330\.92870\.88010\.77210\.72800\.77350\.78720\.66590\.84030\.84980\.86480\.8519JAMgpt\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]0\.79410\.91940\.86510\.75380\.70720\.75560\.73560\.58180\.78790\.81710\.83720\.8202### IV\-ABaseline Acquisition

First, we establish a baseline for comparison by training the model separately on the Essays dataset, the Kaggle dataset, or both\. Fig\.[5](https://arxiv.org/html/2607.08374#S4.F5)illustrates the balanced accuracy of each approach under different dataset settings: Cross\-Entropy \(CE\), Off\-the\-shelf Prototypical \(PO\), and Fine\-tuned Prototypical \(PF\)\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x10.png)\(a\)Essays Dataset
![Refer to caption](https://arxiv.org/html/2607.08374v1/x11.png)\(b\)Kaggle Dataset

Figure 5:Visualization of balanced accuracy for regular classification using cross\-entropy \(CE\), prototypical few\-shot learning using off\-the\-shelf ready model \(PO\), and fine\-tuned prototypical few\-shot learning \(PF\) on the Essays and Kaggle datasets\. Each line in the legend corresponds to an individual experiment, with the dataset used for training indicated in the respective brackets, while the dotted lines with numbers represent the average value across dimensions of the respective experiment\.In the CE experiment, there is no doubt that when the model is trained and evaluated on the same personality theory dataset, it achieves relatively good performance\. However, when the model is trained on one dataset and evaluated on another, there is a significant drop in performance, indicating that the model struggles to generalize across different personality theories\. We also observe that a combination of datasets does not improve performance; rather, it degrades it\. This is likely because the model is confused by the conflicting signals from the two different personality theories\.

On the other hand, in the PO experiment, we observe that the Essays dataset shows very poor performance, while the Kaggle dataset is still able to capture relationships\. This can be attributed to the nature of how the datasets are collected\. The Essays dataset comes from a constrained environment, whereas the Kaggle dataset is sourced from social media, which is more informal and diverse\. This provides confidence that few\-shot learning can be effective in personality recognition tasks\. One interesting observation is that it naturally solves the class imbalance problem, as the algorithm focuses on learning the class prototypes rather than being biased towards the majority class\.

When the model is fine\-tuned using PF, we see a significant improvement in performance within the same dataset \(training and evaluation\)\. This is especially evident for the Kaggle dataset, giving confidence that the model can learn the underlying personality patterns in the data\. An interesting observation is that a model trained on the Kaggle dataset can generalize to the Essays dataset, but not vice versa, further demonstrating the quality of the Kaggle dataset\. Additionally, the results show that the model trained on the Kaggle dataset achieves similar results to the CE approach trained on the Essays dataset, further justifying that a prototypical network has potential in capturing personality features from text\.

### IV\-BPerformance

#### IV\-B1Cross\-Theory Harmonization \(CTH\) Performance

Table[IV](https://arxiv.org/html/2607.08374#S4.T4)and Table[V](https://arxiv.org/html/2607.08374#S4.T5)tabulate the performance of each CTH module under different dataset settings with its ablation study\. To provide a reference baseline, we include the row corresponding to the highest performance \(BA\) from the aforementioned experiments \(as shown in Fig\.[5](https://arxiv.org/html/2607.08374#S4.F5)\) as representative baseline\. We also include prior work; however, it is not fully comparable since they focus on training on a single dataset, whereas we train 1 model for 2 personalities theories\. Nevertheless, our performance remains competitive and significant in most cases, highlighting the advantage of our approach for generalization\.

By observing the results on the Essays dataset, we find that the model improves on average by more than 9% in balanced accuracy across all traits compared to the best\-performing baseline\. We further analyze the contribution of each component\. Across both datasets, when only HGL is included, performance actually degrades regardless of the dataset\. This supports the aforementioned hypothesis that human knowledge is limited; in the Essays dataset, due to its constrained data collection environment, such limitations may hinder the model and expose it to suboptimal supervision, obscuring the ultimate learning objective through self\-consensus\. Considering MIC alone, it only outperforms the baseline on the Essays dataset but not on Kaggle, further strengthening the observation that the combination of Essays data introduces additional noise\. Nevertheless, the combination of both components \(CTH\) is able to restore performance to a level comparable with the baseline on Kaggle and further improve results on the Essays dataset, suggesting that integrating HGL and MIC allows the model to better merge complementary knowledge sources, achieving theory\-agnostic modeling\.

#### IV\-B2LLM\-as\-a\-Judge \(LAJ\) Performance

Next, we study the impact of the LAJ mechanism\. Generally, theJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] approach consistently outperforms theJAMgpt\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] approach across all personality traits in both datasets\. This suggests that pre\-evaluating and refining the dataset before training is more effective than dynamically assessing samples during training\. TheJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] model converges within approximately 3000 episodes, whereasJAM\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\[Both\] requires around 7000 episodes to converge\. This difference arises because theJAMgpt\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] approach only gradually obtains a cleaner dataset over multiple iterative episodes, and not all samples are evaluated by the LLM due to the thresholding mechanism applied during training\. As a result, an initially noisy dataset may mislead the model toward suboptimal local minima, which helps explain why theJAMgpt\(LIL\)\\text\{JAM\}^\{\\text\{\(LIL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] approach is less effective thanJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]\. This trend is also reflected in the Essays dataset, where the performance ofJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] is comparable toCTH\[Both\]\.

Fig\.[6](https://arxiv.org/html/2607.08374#S4.F6)illustrates the distribution ofPossibleandImpossiblejudgments across personality traits for both datasets\. The Essays dataset contains a higher proportion ofPossiblejudgments \(85\.7%\) compared to the Kaggle dataset \(70\.8%\)\. Given that only a limited proportion of the dataset is estimated to be noisy \(approximately\>8%\>8\\%\), the observed 2% improvement is within a reasonable range\. This indicates that the filtering process effectively reduces the influence of noisy samples, while also suggesting that the achievable performance gain is naturally bounded by the proportion of removable noise in the dataset\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x12.png)\(a\)Essays Dataset
![Refer to caption](https://arxiv.org/html/2607.08374v1/x13.png)\(b\)Kaggle Dataset

Figure 6:Distribution ofLLMgpt\\text\{LLM\}\_\{\\text\{gpt\}\}judgments on personality trait implications across datasets\. The figure illustrates the proportion of LLM\-judged outcomes—Possible,Impossible, andAmbiguous—based on the binary labels for each of the personality traits\. Labels in the formd\_yrepresent traitdwith labely, wherey = 1denotes a positive class \(presence of the trait\) andy = 0denotes a negative class\. The divergence in distributions highlights the influence of annotation conditions and data origin on interpretability judgments made by language models\.Fig\.[7](https://arxiv.org/html/2607.08374#S4.F7)shows the performance of different LLMs under varying hyperparameter settings\. Overall,gptperforms the best\. On the Kaggle dataset, LLMs generally do not improve over the baseline, which is consistent with the CTH stage \(without LAJ\)\. In contrast, the Essays dataset shows a different trend: with the involvement of LAJ, performance generally improves over CTH alone\. This supports the generalisability claims for the low\-resource theory \(Essays dataset\) compared with the Kaggle dataset, showing that in most cases, model selection does not degrade performance\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x14.png)\(a\)Essays Dataset
![Refer to caption](https://arxiv.org/html/2607.08374v1/x15.png)\(b\)Kaggle Dataset

Figure 7:Visualization of different large language models \(gpt,qwen,llama,ds\) and their performance under respective hyperparameter settings onζ\\zetatozzvalues inJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\], including a reduced contribution of theambiguousandimpossibleflags by down\-weighting them at certain levels\. We further incorporate fine\-tuning for open\-source models using QLoRA, while forgptwe conduct an experiment in which 80% of the minor \(relatively underrepresented\) labels/classes are removed to address class imbalance, under the assumption that the LLM significantly underperforms on the task, in order to study the potential effects of such imbalance induction\.We observed that settingzζ∈\{Impossible\}=0z\_\{\\zeta\\in\\\{\\texttt\{Impossible\}\\\}\}=0\(muting theImpossiblesamples\) often leads to better performance in the Essays dataset, supporting the generalisation claim\. However, this effect is less consistent in the Kaggle dataset and depends more on the choice of LLM\. From the results of the Kaggle dataset,zζ∈\{Impossible\}=0z\_\{\\zeta\\in\\\{\\texttt\{Impossible\}\\\}\}=0generally has relatively low performance compared to other hyperparameters, suggesting that the model is not only incapable of filtering data but also introduces more noise by removing some important contributions\. In addition, we conduct an experiment in which 80% of the minor \(relatively underrepresented\) labels/classes are removed \(ingpt\) using the settingzζ∈\{Ambiguous\}=0\.2z\_\{\\zeta\\in\\\{\\texttt\{Ambiguous\}\\\}\}=0\.2andzζ∈\{Impossible\}=0z\_\{\\zeta\\in\\\{\\texttt\{Impossible\}\\\}\}=0, to simulate a worse model scenario\. The results show a significant drop across all dimensions, despite this being the best observed hyperparameter setting forgpt\. This again supports the claim that a worse LLM can negatively affect training, and shows thatzζ∈\{Impossible\}z\_\{\\zeta\\in\\\{\\texttt\{Impossible\}\\\}\}is sensitive\.

Across different models,zζ∈\{Ambiguous\}z\_\{\\zeta\\in\\\{\\texttt\{Ambiguous\}\\\}\}does not significantly affect performance \(evaluated under settingszζ∈\{Ambiguous\}=0\.2z\_\{\\zeta\\in\\\{\\texttt\{Ambiguous\}\\\}\}=0\.2andzζ∈\{Impossible\}=0\.8z\_\{\\zeta\\in\\\{\\texttt\{Impossible\}\\\}\}=0\.8, as well aszζ∈\{Impossible\}=0z\_\{\\zeta\\in\\\{\\texttt\{Impossible\}\\\}\}=0\)\. This suggests that it primarily acts as a tunable non\-sensitive hyperparameter rather than a structural factor\. On the other hand, in terms of their fine\-tuned model, the results show that although there is improvement in certain dimensions for some LLMs on the Kaggle dataset, the gains are not statistically significant\. In some cases, performance even drops on the Essays dataset, likely due to imbalance, as Kaggle is more dominant and relatively easier to learn\. These findings suggest that well\-trained LLMs are already sufficiently capable, and additional fine\-tuning is unnecessary and induces higher costs for the judging task\.

### IV\-CStatistical Findings

We conducted the McNemar test to support our findings, as illustrated in Fig\.[8](https://arxiv.org/html/2607.08374#S4.F8)\. The results indicate its potential utility in constrained environments, while the CTH method addresses the challenges of merging datasets, suggesting a pathway toward a theory\-agnostic model\. Furthermore, this demonstrates that our proposed approaches are able to reduce noise that appeared in the native collection of the dataset, where it statistically further improves through LAJ \(an average of 2% improvement in the Essays dataset\)\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x16.png)\(a\)Essays Dataset\(PF→\\rightarrowMIC\)\[Both\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x17.png)\(b\)Essays Dataset\(MIC→\\rightarrowCTH\)\[Both\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x18.png)\(c\)Essays Dataset\(CTH→JAMgpt\(LBL\)\\rightarrow\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\)\[Both\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x19.png)\(d\)Kaggle Dataset\(PF→\\rightarrowMIC\)\[Both\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x20.png)\(e\)Kaggle Dataset\(MIC→\\rightarrowCTH\)\[Both\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x21.png)\(f\)Kaggle Dataset\(CTH→JAMgpt\(LBL\)\\rightarrow\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\)\[Both\]

Figure 8:The Sankey diagram illustrates the transitions between 4 approaches: from the PF \[Both\] to the MIC\-involved method \(first MIC \[Both\], and then to CTH \[Both\] method, and to the proposed full approachJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]\)\. Note that the HGL\-only is excluded from this test since it functions as early generalization guidance\. It encapsulates noise and performs worse when functioning alone\. Each method’s outcomes are compared against the original ground truth \(G\)\. Statistical significance is determined using the McNemarpp\-value test\. Due to the fact that personality encompasses multiple dimensions, we flatten and concatenate these dimensions to facilitate clearer visualization\.To visualize the effectiveness of the proposed algorithm, we visualized the personality embeddings using t\-SNE in Fig\.[9](https://arxiv.org/html/2607.08374#S4.F9)\. Compared to the off\-the\-shelf PO approach, the embeddings produced byJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] are noticeably more structured and exhibit clearer separation between clusters corresponding to distinct personality trait combinations\. This improved separation indicates that the proposed method captures and preserves subtle personality cues from textual data more effectively\. In particular, the cluster centers in theJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] visualizations are more distinct and less overlapping, suggesting that the model can better differentiate between similar personality profiles\. This pattern is consistent across both datasets, with the effect being particularly pronounced in the Kaggle dataset, where clusters are clearer due to a larger number of samples and relatively higher classification accuracy, further highlighting the robustness and generalizability ofJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x22.png)\(a\)Essays DatasetPO \[Essays\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x23.png)\(b\)Essays DatasetJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x24.png)\(c\)Kaggle DatasetPO \[Kaggle\]
![Refer to caption](https://arxiv.org/html/2607.08374v1/x25.png)\(d\)Kaggle DatasetJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\]

Figure 9:The t\-SNE visualization of personality embeddings on both Essays and Kaggle datasets\. Subplots[9\(a\)](https://arxiv.org/html/2607.08374#S4.F9.sf1)and[9\(c\)](https://arxiv.org/html/2607.08374#S4.F9.sf3)show embeddings using the off\-the\-shelf model \(PO\), while subplots[9\(b\)](https://arxiv.org/html/2607.08374#S4.F9.sf2)and[9\(d\)](https://arxiv.org/html/2607.08374#S4.F9.sf4)show embeddings using the proposedJAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] approach\. Each color represents a distinct personality trait combination, with annotated labels indicating cluster centers\. Compared to the PO approach,JAMgpt\(LBL\)\\text\{JAM\}^\{\\text\{\(LBL\)\}\}\_\{\\textit\{gpt\}\}\[Both\] produces embeddings that are more structured and better separated, reflecting improved modeling of personality cues obtained from text\.
### IV\-DComputational Analysis

Fig\.[10](https://arxiv.org/html/2607.08374#S4.F10)compares the proposed JAM with previous approaches in terms of Floating Point Operations \(FLOPs\) and the corresponding computational cost\. This comparison applies to bothLLM\-before\-the\-loop \(LBL\)andLLM\-in\-the\-loop \(LIL\)settings\. Technically, the former achieves lower computational cost because the filtering mechanism depends only on the loss values; therefore, not all samples in the dataset require full inference\.

![Refer to caption](https://arxiv.org/html/2607.08374v1/x26.png)Figure 10:Visualization of Cost and FLOPs Comparison\. In this analysis, we assume that input and output tokens incur identical costs, adopting the estimated FLOPs per token and the corresponding pricing model used in\[[44](https://arxiv.org/html/2607.08374#bib.bib59)\]to enable direct comparison\. We assume a constant inference cost of 3\.2 GFLOPs per token and a pricing rate of $0\.25 per 10M tokens\. The visualization is based on three components: \(i\) single inference \(grey, with pink representing search time, e\.g\., retrieval\-augmented generation lookup or similarity measurement, quantified according to the respective approach used to achieve the reported performance\), \(ii\) training time \(purple, covering all experiments\), and \(iii\) pre\-inference \(yellow and orange\)\. Pre\-inference \(e\.g\., retrieval\-augmented generation indexing or prototype preparation\) is difficult to standardize because greater involvement can improve performance for certain methods\. To address this, we divide the pre\-inference stage into yellow and orange segments to represent an estimated ratio of involved classes or prototypes, where this is quantified according to the respective approach used to achieve the reported performance\. Note that this visualization excludes the training cost of the pretrained decoder\-only model, as it is common across all approaches and assumed to be comparable\.Overall, the proposed method achieves the lowest inference time compared to thePICEPR\(Embeddings\)\\text\{PICEPR\}^\{\(\\mathrm\{Embeddings\}\)\}method\[[44](https://arxiv.org/html/2607.08374#bib.bib59)\]\. Although a slight additional overhead is introduced due to prototype retrieval, this overhead is negligible because it only involves retrieving and averaging 4–5 embedding vectors\. Despite this, the method still achieves approximately8×8\\timeslower training FLOPs\. Furthermore, the proposed approach demonstrates the feasibility of incorporating LLMs to improve performance, while simultaneously reducing the risk of data leakage, which is difficult to achieve with purely decoder\-only model\-driven approaches such asPICEPR\(Contents\)\\text\{PICEPR\}^\{\(\\mathrm\{Contents\}\)\}\[[44](https://arxiv.org/html/2607.08374#bib.bib59)\]\. Overall, JAM maintains very low inference latency, which is particularly important for test\-time deployment and real\-world inference scenarios, while also reducing inference FLOPs, thereby lowering energy consumption and carbon footprint and improving the environmental sustainability especially on large\-scale deployment\.

### IV\-ELimitations and Future Works

Although JAM demonstrates consistent improvements across heterogeneous personality datasets, it is currently validated on only two personality theories \(MBTI and Big\-5\), and further evaluation on additional theories and culturally diverse datasets is needed to validate the robustness of the proposed Cross\-Theory Harmonization \(CTH\)\. In addition, as personality recognition relies on sensitive personal data, future work should prioritize privacy, informed consent, and fairness\. One promising direction is to integrate JAM with a federated learning framework, enabling collaboration across institutions or countries while keeping data local and aggregating only model updates, thereby improving generalizability without compromising data privacy\.

## VConclusion

In this work, we introduced Large\-Language\-Models\-as\-a\-Judge in Theory\-Agnostic Adaptive Metric\-Alignment for Prototypical Networks in Personality Recognition \(JAM\), a novelprototypical frameworkdesigned to enhance personality prediction and generalizability by leveragingCross\-Theory Harmonization\(Human\-Guided LinkageandMachine\-Induced Consensus\) andLLM\-as\-a\-Judgemechanisms, enabling the learning of latent pseudo\-facets that capture shared behavioral structure across heterogeneous personality theories under an embedding space\.

Through experiments on the Essays and Kaggle datasets, we demonstrated that JAM consistently outperforms existing baselines and prior work across multiple personality traits, with no class imbalance issues\. Specifically, JAM achieves an average BA improvement of 12% on the Essays dataset and 14% on the Kaggle dataset compared to the regular prototypical few\-shot learning approach\. When combining datasets, it becomes possible to leverage the dataset for generalization in low\-resource situations, where the performance of the Kaggle dataset is not affected\. Moreover, incorporating the LLM\-as\-a\-Judge mechanism further improves performance on the Essays dataset by an additional 2\.4%, by reweighting the contribution of each data row during model training\. These results indicate that JAM is particularly effective in constrained environments while maintaining robust performance across diverse datasets\.

## VIAcknowledgments

This research was funded by the Universiti Tunku Abdul Rahman Research Fund \(IPSR/RMC/UTARRF/2021\-C1/K03\)\. The authors also appreciate the support of Grid5000, France, for providing the computational resources used in this study\. The authors thank the Advanced Artificial Intelligence Research Center at the Kanagawa Institute of Technology, Japan, for supporting OpenAI’s model inferences\. The first author, Jing Jie Tan, also appreciates National Yang Ming Chiao Tung University for providing the Research Scholarship to establish a professional connection for guidance related to psychology\. Additionally, he appreciate the Embassy of France to Malaysia for the Doctoral Research Mobility Grant and the Japan Student Services Organization \(JASSO\) Scholarships, which facilitated the research collaboration between Universiti Tunku Abdul Rahman, Malaysia, Université Sorbonne Paris Nord, France, and Kanagawa Institute of Technology, Japan\.

## References

- \[1\]\(2024\-09\)Social media addiction, personality traits, and disorders: an overview of recent literature\.Current Opinion in Psychiatry38\(1\),pp\. 72–77\.External Links:ISSN 1473\-6578,[Link](http://dx.doi.org/10.1097/YCO.0000000000000969),[Document](https://dx.doi.org/10.1097/yco.0000000000000969)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p1.1)\.
- \[2\]T\. Ait Baha, M\. El Hajji, Y\. Es\-Saady, and H\. Fadili\(2023\-08\)The power of personalization: a systematic review of personality\-adaptive chatbots\.SN Computer Science4\(5\)\.External Links:ISSN 2661\-8907,[Link](http://dx.doi.org/10.1007/s42979-023-02092-6),[Document](https://dx.doi.org/10.1007/s42979-023-02092-6)Cited by:[§I](https://arxiv.org/html/2607.08374#S1.p1.1)\.
- \[3\]M\. C\. Ashton, K\. Lee, M\. Perugini, P\. Szarota, R\. E\. de Vries, L\. D\. Blas, K\. Boies, and B\. D\. Raad\(2004\)A six\-factor structure of personality\-descriptive adjectives: solutions from psycholexical studies in seven languages\.\.Journal of Personality and Social Psychology86,pp\. 356–366\.External Links:[Document](https://dx.doi.org/10.1037/0022-3514.86.2.356),ISSN 1939\-1315Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[4\]J\. Bai, S\. Bai, Y\. Chu, Z\. Cui, K\. Dang, X\. Deng, Y\. Fan, W\. Ge, Y\. Han, F\. Huang, B\. Hui, L\. Ji, M\. Li, J\. Lin, R\. Lin, D\. Liu, G\. Liu, C\. Lu, K\. Lu, J\. Ma, R\. Men, X\. Ren, X\. Ren, C\. Tan, S\. Tan, J\. Tu, P\. Wang, S\. Wang, W\. Wang, S\. Wu, B\. Xu, J\. Xu, A\. Yang, H\. Yang, J\. Yang, S\. Yang, Y\. Yao, B\. Yu, H\. Yuan, Z\. Yuan, J\. Zhang, X\. Zhang, Y\. Zhang, Z\. Zhang, C\. Zhou, J\. Zhou, X\. Zhou, and T\. Zhu\(2023\)Qwen technical report\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2309.16609),[Link](https://arxiv.org/abs/2309.16609)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1)\.
- \[5\]S\. S\. Bajestani, M\. M\. Khalilzadeh, M\. Azarnoosh, and H\. R\. Kobravi\(2024\)TranSentGAT: a sentiment\-based lexical psycholinguistic graph attention network for personality prediction\.IEEE Access12\(\),pp\. 59630–59642\.External Links:[Document](https://dx.doi.org/10.1109/ACCESS.2024.3390126)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p3.1)\.
- \[6\]D\. Bear and P\. Cook\(2023\-07\)Fine\-tuning sentence\-RoBERTa to construct word embeddings for low\-resource languages from bilingual dictionaries\.InProceedings of the Workshop on Natural Language Processing for Indigenous Languages of the Americas \(AmericasNLP\),M\. Mager, A\. Ebrahimi, A\. Oncevay, E\. Rice, S\. Rijhwani, A\. Palmer, and K\. Kann \(Eds\.\),Toronto, Canada,pp\. 47–57\.External Links:[Link](https://aclanthology.org/2023.americasnlp-1.7/),[Document](https://dx.doi.org/10.18653/v1/2023.americasnlp-1.7)Cited by:[§II\-B1](https://arxiv.org/html/2607.08374#S2.SS2.SSS1.p1.1)\.
- \[7\]I\. Beltagy, M\. E\. Peters, and A\. Cohan\(2020\)Longformer: the long\-document transformer\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2004.05150),[Link](https://arxiv.org/abs/2004.05150)Cited by:[§III\-B1](https://arxiv.org/html/2607.08374#S3.SS2.SSS1.p1.3)\.
- \[8\]D\. Cervone and L\. A\. Pervin\(2022\)Personality: theory and research\.John Wiley & Sons\.Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[9\]M\. Dalvi\-Esfahani, A\. Niknafs, Z\. Alaedini, H\. Barati Ahmadabadi, D\. J\. Kuss, and T\. Ramayah\(2021\-03\)Social media addiction and empathy: moderating impact of personality traits among high school students\.Telematics and Informatics57,pp\. 101516\.External Links:ISSN 0736\-5853,[Link](http://dx.doi.org/10.1016/j.tele.2020.101516),[Document](https://dx.doi.org/10.1016/j.tele.2020.101516)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p1.1)\.
- \[10\]DeepSeek\-AI, D\. Guo, D\. Yang, H\. Zhang, J\. Song, R\. Zhang, R\. Xu, Q\. Zhu, S\. Ma, P\. Wang, X\. Bi, X\. Zhang, X\. Yu, Y\. Wu, Z\. F\. Wu, Z\. Gou, Z\. Shao, Z\. Li, Z\. Gao, A\. Liu, B\. Xue, B\. Wang, B\. Wu, B\. Feng, C\. Lu, C\. Zhao, C\. Deng, C\. Zhang, C\. Ruan, D\. Dai, D\. Chen, D\. Ji, E\. Li, F\. Lin, F\. Dai, F\. Luo, G\. Hao, G\. Chen, G\. Li, H\. Zhang, H\. Bao, H\. Xu, H\. Wang, H\. Ding, H\. Xin, H\. Gao, H\. Qu, H\. Li, J\. Guo, J\. Li, J\. Wang, J\. Chen, J\. Yuan, J\. Qiu, J\. Li, J\. L\. Cai, J\. Ni, J\. Liang, J\. Chen, K\. Dong, K\. Hu, K\. Gao, K\. Guan, K\. Huang, K\. Yu, L\. Wang, L\. Zhang, L\. Zhao, L\. Wang, L\. Zhang, L\. Xu, L\. Xia, M\. Zhang, M\. Zhang, M\. Tang, M\. Li, M\. Wang, M\. Li, N\. Tian, P\. Huang, P\. Zhang, Q\. Wang, Q\. Chen, Q\. Du, R\. Ge, R\. Zhang, R\. Pan, R\. Wang, R\. J\. Chen, R\. L\. Jin, R\. Chen, S\. Lu, S\. Zhou, S\. Chen, S\. Ye, S\. Wang, S\. Yu, S\. Zhou, S\. Pan, S\. S\. Li, S\. Zhou, S\. Wu, S\. Ye, T\. Yun, T\. Pei, T\. Sun, T\. Wang, W\. Zeng, W\. Zhao, W\. Liu, W\. Liang, W\. Gao, W\. Yu, W\. Zhang, W\. L\. Xiao, W\. An, X\. Liu, X\. Wang, X\. Chen, X\. Nie, X\. Cheng, X\. Liu, X\. Xie, X\. Liu, X\. Yang, X\. Li, X\. Su, X\. Lin, X\. Q\. Li, X\. Jin, X\. Shen, X\. Chen, X\. Sun, X\. Wang, X\. Song, X\. Zhou, X\. Wang, X\. Shan, Y\. K\. Li, Y\. Q\. Wang, Y\. X\. Wei, Y\. Zhang, Y\. Xu, Y\. Li, Y\. Zhao, Y\. Sun, Y\. Wang, Y\. Yu, Y\. Zhang, Y\. Shi, Y\. Xiong, Y\. He, Y\. Piao, Y\. Wang, Y\. Tan, Y\. Ma, Y\. Liu, Y\. Guo, Y\. Ou, Y\. Wang, Y\. Gong, Y\. Zou, Y\. He, Y\. Xiong, Y\. Luo, Y\. You, Y\. Liu, Y\. Zhou, Y\. X\. Zhu, Y\. Xu, Y\. Huang, Y\. Li, Y\. Zheng, Y\. Zhu, Y\. Ma, Y\. Tang, Y\. Zha, Y\. Yan, Z\. Z\. Ren, Z\. Ren, Z\. Sha, Z\. Fu, Z\. Xu, Z\. Xie, Z\. Zhang, Z\. Hao, Z\. Ma, Z\. Yan, Z\. Wu, Z\. Gu, Z\. Zhu, Z\. Liu, Z\. Li, Z\. Xie, Z\. Song, Z\. Pan, Z\. Huang, Z\. Xu, Z\. Zhang, and Z\. Zhang\(2025\)DeepSeek\-r1: incentivizing reasoning capability in llms via reinforcement learning\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2501.12948),[Link](https://arxiv.org/abs/2501.12948)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p2.1)\.
- \[11\]S\. Dhelim, N\. Aung, M\. A\. Bouras, H\. Ning, and E\. Cambria\(2021\-09\)A survey on personality\-aware recommendation systems\.Artificial Intelligence Review55\(3\),pp\. 2409–2454\.External Links:ISSN 1573\-7462,[Link](http://dx.doi.org/10.1007/s10462-021-10063-7),[Document](https://dx.doi.org/10.1007/s10462-021-10063-7)Cited by:[§I](https://arxiv.org/html/2607.08374#S1.p1.1)\.
- \[12\]S\. Dhelim, L\. L\. Chen, N\. Aung, W\. Zhang, and H\. Ning\(2021\)Big\-five, mpti, eysenck or hexaco: the ideal personality model for personality\-aware recommendation systems\.External Links:2106\.03060,[Link](https://arxiv.org/abs/2106.03060)Cited by:[§I](https://arxiv.org/html/2607.08374#S1.p1.1)\.
- \[13\]A\. Furnham\(2017\)Myers\-briggs type indicator \(mbti\)\.Encyclopedia of Personality and Individual Differences,pp\. 1–4\.External Links:[Document](https://dx.doi.org/10.1007/978-3-319-28099-8%5F50-1)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[14\]L\. R\. Goldberg\(1993\)The structure of phenotypic personality traits\.\.American Psychologist48,pp\. 26–34\.External Links:[Document](https://dx.doi.org/10.1037/0003-066X.48.1.26),ISSN 1935\-990XCited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[15\]Z\. Guan, B\. Wu, B\. Wang, and H\. Liu\(2020\)Personality2vec: network representation learning for personality\.In2020 IEEE Fifth International Conference on Data Science in Cyberspace \(DSC\),Vol\.,pp\. 30–37\.External Links:[Document](https://dx.doi.org/10.1109/DSC50466.2020.00013)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p2.1)\.
- \[16\]J\. Han and L\. Yang\(2024\-12\)Sentence embedding generation framework based on kullback–leibler divergence optimization and roberta knowledge distillation\.Mathematics12\(24\),pp\. 3990\.External Links:ISSN 2227\-7390,[Link](http://dx.doi.org/10.3390/math12243990),[Document](https://dx.doi.org/10.3390/math12243990)Cited by:[§II\-B1](https://arxiv.org/html/2607.08374#S2.SS2.SSS1.p1.1)\.
- \[17\]L\. Hu, H\. He, D\. Wang, Z\. Zhao, Y\. Shao, and L\. Nie\(2024\-Mar\.\)LLM vs small model? large language model based text augmentation enhanced personality detection model\.Proceedings of the AAAI Conference on Artificial Intelligence38\(16\),pp\. 18234–18242\.External Links:[Link](https://ojs.aaai.org/index.php/AAAI/article/view/29782),[Document](https://dx.doi.org/10.1609/aaai.v38i16.29782)Cited by:[TABLE V](https://arxiv.org/html/2607.08374#S4.T5.2.7.1.1.1)\.
- \[18\]M\. J\.\(2017\)\(MBTI\) myers\-briggs personality type dataset\.External Links:[Link](https://www.kaggle.com/datasets/datasnaek/mbti-type)Cited by:[TABLE II](https://arxiv.org/html/2607.08374#S3.T2.3.3.1.1.1)\.
- \[19\]Y\. Ji, W\. Wu, H\. Zheng, Y\. Hu, X\. Chen, and L\. He\(2023\)Is chatgpt a good personality recognizer? a preliminary study\.External Links:2307\.03952,[Link](https://arxiv.org/abs/2307.03952)Cited by:[§II\-B4](https://arxiv.org/html/2607.08374#S2.SS2.SSS4.p2.1)\.
- \[20\]A\. Q\. Jiang, A\. Sablayrolles, A\. Mensch, C\. Bamford, D\. S\. Chaplot, D\. d\. l\. Casas, F\. Bressand, G\. Lengyel, G\. Lample, L\. Saulnier, L\. R\. Lavaud, M\. Lachaux, P\. Stock, T\. L\. Scao, T\. Lavril, T\. Wang, T\. Lacroix, and W\. E\. Sayed\(2023\)Mistral 7b\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2310.06825),[Link](https://arxiv.org/abs/2310.06825)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1)\.
- \[21\]E\. Kerz, Y\. Qiao, S\. Zanwar, and D\. Wiechmann\(2022\-05\)Pushing on personality detection from verbal behavior: a transformer meets text contours of psycholinguistic features\.InProceedings of the 12th Workshop on Computational Approaches to Subjectivity, Sentiment & Social Media Analysis,J\. Barnes, O\. De Clercq, V\. Barriere, S\. Tafreshi, S\. Alqahtani, J\. Sedoc, R\. Klinger, and A\. Balahur \(Eds\.\),Dublin, Ireland,pp\. 182–194\.External Links:[Link](https://aclanthology.org/2022.wassa-1.17/),[Document](https://dx.doi.org/10.18653/v1/2022.wassa-1.17)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p3.1)\.
- \[22\]A\. Khattak, N\. Jellani, M\. Z\. Asghar, and U\. Asghar\(2023\-09\)Personality classification from text using bidirectional long short\-term memory model\.Multimedia Tools and Applications83\(10\),pp\. 28849–28873\.External Links:ISSN 1573\-7721,[Link](http://dx.doi.org/10.1007/s11042-023-16661-7),[Document](https://dx.doi.org/10.1007/s11042-023-16661-7)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p2.1)\.
- \[23\]G\. Lampropoulos, T\. Anastasiadis, K\. Siakas, and E\. Siakas\(2022\)The impact of personality traits on social media use and engagement: an overview\.\.International Journal on Social and Education Sciences4\(1\),pp\. 34–51\.Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p1.1)\.
- \[24\]Z\. Li, S\. Yang, and S\. Wang\(2024\)Exploring personality\-driven personalization in xai: enhancing user trust in gameplay\.External Links:2408\.04778,[Link](https://arxiv.org/abs/2408.04778)Cited by:[§I](https://arxiv.org/html/2607.08374#S1.p1.1)\.
- \[25\]Z\. Li, D\. Zhu, Q\. Ma, W\. Xiong, and S\. Li\(2024\)EERPD: leveraging emotion and emotion regulation for improving personality detection\.External Links:2406\.16079,[Link](https://arxiv.org/abs/2406.16079)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1),[§II\-B4](https://arxiv.org/html/2607.08374#S2.SS2.SSS4.p2.1),[TABLE IV](https://arxiv.org/html/2607.08374#S4.T4.2.7.1.1.1)\.
- \[26\]X\. Luo, Y\. Ge, and W\. Qu\(2023\)The association between the big five personality traits and driving behaviors: a systematic review and meta\-analysis\.Accident Analysis and Prevention183,pp\. 106968\.External Links:ISSN 0001\-4575,[Document](https://dx.doi.org/https%3A//doi.org/10.1016/j.aap.2023.106968),[Link](https://www.sciencedirect.com/science/article/pii/S0001457523000155)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[27\]Y\. Mehta, S\. Fatehi, A\. Kazameini, C\. Stachl, E\. Cambria, and S\. Eetemadi\(2020\)Bottom\-up and top\-down: predicting personality with psycholinguistic and language model features\.In2020 IEEE International Conference on Data Mining \(ICDM\),Vol\.,pp\. 1184–1189\.External Links:[Document](https://dx.doi.org/10.1109/ICDM50108.2020.00146)Cited by:[TABLE IV](https://arxiv.org/html/2607.08374#S4.T4.2.5.1.1.1),[TABLE IV](https://arxiv.org/html/2607.08374#S4.T4.2.6.1.1.1),[TABLE V](https://arxiv.org/html/2607.08374#S4.T5.2.5.1.1.1)\.
- \[28\]I\. MUKHTASAR and M\. MAVLUDA\(2021\)The study of projective methods in psychology\.JournalNX7\(02\),pp\. 66–69\.Cited by:[2nd item](https://arxiv.org/html/2607.08374#S2.I1.i2.p1.1)\.
- \[29\]I\. B\. Myers\(1962\)The myers\-briggs type indicator: manual \(1962\)\.\.Consulting Psychologists Press\.External Links:[Document](https://dx.doi.org/10.1037/14404-000)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[30\]J\. Ni, G\. H\. Ábrego, N\. Constant, J\. Ma, K\. B\. Hall, D\. Cer, and Y\. Yang\(2021\)Sentence\-t5: scalable sentence encoders from pre\-trained text\-to\-text models\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2108.08877),[Link](https://arxiv.org/abs/2108.08877)Cited by:[§II\-B1](https://arxiv.org/html/2607.08374#S2.SS2.SSS1.p1.1)\.
- \[31\]S\. Omidvar and T\. Tran\(2023\-11\)Tackling cold\-start with deep personalized transfer of user preferences for cross\-domain recommendation\.International Journal of Data Science and Analytics\.External Links:ISSN 2364\-4168,[Link](http://dx.doi.org/10.1007/s41060-023-00467-9),[Document](https://dx.doi.org/10.1007/s41060-023-00467-9)Cited by:[§I](https://arxiv.org/html/2607.08374#S1.p1.1)\.
- \[32\]OpenAI, J\. Achiam, S\. Adler, S\. Agarwal, L\. Ahmad, I\. Akkaya, F\. L\. Aleman, D\. Almeida, J\. Altenschmidt, S\. Altman, S\. Anadkat, R\. Avila, I\. Babuschkin, S\. Balaji, V\. Balcom, P\. Baltescu, H\. Bao, M\. Bavarian, J\. Belgum, I\. Bello, J\. Berdine, G\. Bernadett\-Shapiro, C\. Berner, L\. Bogdonoff, O\. Boiko, M\. Boyd, A\. Brakman, G\. Brockman, T\. Brooks, M\. Brundage, K\. Button, T\. Cai, R\. Campbell, A\. Cann, B\. Carey, C\. Carlson, R\. Carmichael, B\. Chan, C\. Chang, F\. Chantzis, D\. Chen, S\. Chen, R\. Chen, J\. Chen, M\. Chen, B\. Chess, C\. Cho, C\. Chu, H\. W\. Chung, D\. Cummings, J\. Currier, Y\. Dai, C\. Decareaux, T\. Degry, N\. Deutsch, D\. Deville, A\. Dhar, D\. Dohan, S\. Dowling, S\. Dunning, A\. Ecoffet, A\. Eleti, T\. Eloundou, D\. Farhi, L\. Fedus, N\. Felix, S\. P\. Fishman, J\. Forte, I\. Fulford, L\. Gao, E\. Georges, C\. Gibson, V\. Goel, T\. Gogineni, G\. Goh, R\. Gontijo\-Lopes, J\. Gordon, M\. Grafstein, S\. Gray, R\. Greene, J\. Gross, S\. S\. Gu, Y\. Guo, C\. Hallacy, J\. Han, J\. Harris, Y\. He, M\. Heaton, J\. Heidecke, C\. Hesse, A\. Hickey, W\. Hickey, P\. Hoeschele, B\. Houghton, K\. Hsu, S\. Hu, X\. Hu, J\. Huizinga, S\. Jain, S\. Jain, J\. Jang, A\. Jiang, R\. Jiang, H\. Jin, D\. Jin, S\. Jomoto, B\. Jonn, H\. Jun, T\. Kaftan, K\. Kaiser, A\. Kamali, I\. Kanitscheider, N\. S\. Keskar, T\. Khan, L\. Kilpatrick, J\. W\. Kim, C\. Kim, Y\. Kim, J\. H\. Kirchner, J\. Kiros, M\. Knight, D\. Kokotajlo, K\. Kondraciuk, A\. Kondrich, A\. Konstantinidis, K\. Kosic, G\. Krueger, V\. Kuo, M\. Lampe, I\. Lan, T\. Lee, J\. Leike, J\. Leung, D\. Levy, C\. M\. Li, R\. Lim, M\. Lin, S\. Lin, M\. Litwin, T\. Lopez, R\. Lowe, P\. Lue, A\. Makanju, K\. Malfacini, S\. Manning, T\. Markov, Y\. Markovski, B\. Martin, K\. Mayer, A\. Mayne, B\. McGrew, S\. M\. McKinney, C\. McLeavey, P\. McMillan, J\. McNeil, D\. Medina, A\. Mehta, J\. Menick, L\. Metz, A\. Mishchenko, P\. Mishkin, V\. Monaco, E\. Morikawa, D\. Mossing, T\. Mu, M\. Murati, O\. Murk, D\. Mély, A\. Nair, R\. Nakano, R\. Nayak, A\. Neelakantan, R\. Ngo, H\. Noh, L\. Ouyang, C\. O’Keefe, J\. Pachocki, A\. Paino, J\. Palermo, A\. Pantuliano, G\. Parascandolo, J\. Parish, E\. Parparita, A\. Passos, M\. Pavlov, A\. Peng, A\. Perelman, F\. d\. A\. B\. Peres, M\. Petrov, H\. P\. d\. O\. Pinto, P\. Michael, M\. Pokrass, V\. H\. Pong, T\. Powell, A\. Power, B\. Power, E\. Proehl, R\. Puri, A\. Radford, J\. Rae, A\. Ramesh, C\. Raymond, F\. Real, K\. Rimbach, C\. Ross, B\. Rotsted, H\. Roussez, N\. Ryder, M\. Saltarelli, T\. Sanders, S\. Santurkar, G\. Sastry, H\. Schmidt, D\. Schnurr, J\. Schulman, D\. Selsam, K\. Sheppard, T\. Sherbakov, J\. Shieh, S\. Shoker, P\. Shyam, S\. Sidor, E\. Sigler, M\. Simens, J\. Sitkin, K\. Slama, I\. Sohl, B\. Sokolowsky, Y\. Song, N\. Staudacher, F\. P\. Such, N\. Summers, I\. Sutskever, J\. Tang, N\. Tezak, M\. B\. Thompson, P\. Tillet, A\. Tootoonchian, E\. Tseng, P\. Tuggle, N\. Turley, J\. Tworek, J\. F\. C\. Uribe, A\. Vallone, A\. Vijayvergiya, C\. Voss, C\. Wainwright, J\. J\. Wang, A\. Wang, B\. Wang, J\. Ward, J\. Wei, C\. Weinmann, A\. Welihinda, P\. Welinder, J\. Weng, L\. Weng, M\. Wiethoff, D\. Willner, C\. Winter, S\. Wolrich, H\. Wong, L\. Workman, S\. Wu, J\. Wu, M\. Wu, K\. Xiao, T\. Xu, S\. Yoo, K\. Yu, Q\. Yuan, W\. Zaremba, R\. Zellers, C\. Zhang, M\. Zhang, S\. Zhao, T\. Zheng, J\. Zhuang, W\. Zhuk, and B\. Zoph\(2023\)GPT\-4 technical report\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2303.08774),[Link](https://arxiv.org/abs/2303.08774)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1)\.
- \[33\]J\. W\. Pennebaker and L\. A\. King\(1999\)Linguistic styles: language use as an individual difference\.\.Journal of Personality and Social Psychology77,pp\. 1296–1312\.External Links:[Document](https://dx.doi.org/10.1037/0022-3514.77.6.1296),ISSN 1939\-1315Cited by:[TABLE II](https://arxiv.org/html/2607.08374#S3.T2.3.2.1.1.1)\.
- \[34\]L\. V\. Phan and J\. F\. Rauthmann\(2021\-06\)Personality computing: new frontiers in personality assessment\.Social and Personality Psychology Compass15\(7\)\.External Links:ISSN 1751\-9004,[Link](http://dx.doi.org/10.1111/spc3.12624),[Document](https://dx.doi.org/10.1111/spc3.12624)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p1.1)\.
- \[35\]M\. Ramezani, M\. Feizi\-Derakhshi, and M\. Balafar\(2022\-12\)Text\-based automatic personality prediction using kgrat\-net: a knowledge graph attention network classifier\.Scientific Reports12\(1\)\.External Links:ISSN 2045\-2322,[Link](http://dx.doi.org/10.1038/s41598-022-25955-z),[Document](https://dx.doi.org/10.1038/s41598-022-25955-z)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p3.1)\.
- \[36\]B\. W\. Roberts and H\. J\. Yoon\(2022\-01\)Personality psychology\.Annual Review of Psychology73\(1\),pp\. 489–516\.External Links:ISSN 1545\-2085,[Link](http://dx.doi.org/10.1146/annurev-psych-020821-114927),[Document](https://dx.doi.org/10.1146/annurev-psych-020821-114927)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1),[§III\-A](https://arxiv.org/html/2607.08374#S3.SS1.p2.10)\.
- \[37\]R\. W\. Robins, J\. L\. Tracy, and J\. W\. Sherman\(2023\)What kinds of methods do personality psychologists use?: a survey of journal editors and editorial board members\.Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p1.1)\.
- \[38\]M\. Shafikuzzaman, M\. R\. Islam, A\. C\. Rolli, S\. Akhter, and N\. Seliya\(2024\)An empirical evaluation of the zero\-shot, few\-shot, and traditional fine\-tuning based pretrained language models for sentiment analysis in software engineering\.IEEE Access12\(\),pp\. 109714–109734\.External Links:[Document](https://dx.doi.org/10.1109/ACCESS.2024.3439450)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1)\.
- \[39\]K\. Song, X\. Tan, T\. Qin, J\. Lu, and T\. Liu\(2020\)MPNet: masked and permuted pre\-training for language understanding\.InAdvances in Neural Information Processing Systems,H\. Larochelle, M\. Ranzato, R\. Hadsell, M\.F\. Balcan, and H\. Lin \(Eds\.\),Vol\.33,pp\. 16857–16867\.External Links:[Link](https://proceedings.neurips.cc/paper_files/paper/2020/file/c3a690be93aa602ee2dc0ccab5b7b67e-Paper.pdf)Cited by:[§II\-B1](https://arxiv.org/html/2607.08374#S2.SS2.SSS1.p1.1)\.
- \[40\]R\. M\. Spielman, K\. Dumper, W\. Jenkins, A\. Lacombe, M\. Lovett, and M\. Perlmutter\(2021\)Personality assessment\.Introduction to Psychology \(A critical approach\)\.Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p1.1)\.
- \[41\]D\. Stillwell and M\. Kosinski\(2015\)MyPersonality project website\.Cited by:[§I](https://arxiv.org/html/2607.08374#S1.p2.1),[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p1.1)\.
- \[42\]J\. J\. Tan, B\. Kwan, D\. W\. Ng, and Y\. C\. Hum\(2025\-06\)Psychology\-informed natural language understanding: integrating personality and emotion\-aware features for comprehensive sentiment analysis and depression detection\.Pertanika Journal of Science and Technology33\(S4\)\.External Links:ISSN 2231\-8526,[Link](http://dx.doi.org/10.47836/pjst.33.S4.04),[Document](https://dx.doi.org/10.47836/pjst.33.s4.04)Cited by:[§II\-B](https://arxiv.org/html/2607.08374#S2.SS2.p1.1)\.
- \[43\]J\. J\. Tan, B\. Kwan, D\. W\. Ng, Y\. Hum, N\. Kawarazaki, K\. Takano, and A\. Mokraoui\(2026\)Cross\-lingual attention distillation with personality\-informed generative augmentation for multilingual personality recognition\.IEEE Transactions on Cognitive and Developmental Systems,pp\. 1–16\.External Links:ISSN 2379\-8939,[Link](http://dx.doi.org/10.1109/TCDS.2026.3682672),[Document](https://dx.doi.org/10.1109/tcds.2026.3682672)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p1.1)\.
- \[44\]J\. J\. Tan, B\. Kwan, D\. W\. Ng, Y\. Hum, A\. Mokraoui, and S\. Lo\(2025\)Prompting\-in\-a\-series: psychology\-informed contents and embeddings for personality recognition with decoder\-only models\.IEEE Transactions on Computational Social Systems,pp\. 1–15\.External Links:ISSN 2373\-7476,[Link](http://dx.doi.org/10.1109/TCSS.2025.3593323),[Document](https://dx.doi.org/10.1109/tcss.2025.3593323)Cited by:[§II\-B4](https://arxiv.org/html/2607.08374#S2.SS2.SSS4.p2.1),[§III\-B3](https://arxiv.org/html/2607.08374#S3.SS2.SSS3.p1.1),[§III\-B3](https://arxiv.org/html/2607.08374#S3.SS2.SSS3.p3.1),[Figure 10](https://arxiv.org/html/2607.08374#S4.F10),[§IV\-D](https://arxiv.org/html/2607.08374#S4.SS4.p2.3)\.
- \[45\]J\. J\. Tan, B\. Kwan, D\. W\. Ng, and Y\. Hum\(2025\-11\)Adaptive focal loss with personality stratification for stably mitigating hard class imbalance in multi\-dimensional personality recognition\.Scientific Reports15\(1\)\.External Links:ISSN 2045\-2322,[Link](http://dx.doi.org/10.1038/s41598-025-22853-y),[Document](https://dx.doi.org/10.1038/s41598-025-22853-y)Cited by:[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p1.1),[§II\-B3](https://arxiv.org/html/2607.08374#S2.SS2.SSS3.p2.1),[§III\-A](https://arxiv.org/html/2607.08374#S3.SS1.p1.1)\.
- \[46\]S\. G\. Tesfagergish, J\. Kapočiūtė\-Dzikienė, and R\. Damaševičius\(2022\)Zero\-shot emotion detection for semi\-supervised sentiment analysis using sentence transformers and ensemble learning\.Applied Sciences12\(17\)\.External Links:[Link](https://www.mdpi.com/2076-3417/12/17/8662),ISSN 2076\-3417,[Document](https://dx.doi.org/10.3390/app12178662)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1)\.
- \[47\]R\. Tett and D\. Simonet\(2021\-05\)Applicant faking on personality tests: good or bad and why should we care?\.Personnel Assessment and Decisions7\(1\)\.External Links:ISSN 2377\-8822,[Link](http://dx.doi.org/10.25035/pad.2021.01.002),[Document](https://dx.doi.org/10.25035/pad.2021.01.002)Cited by:[2nd item](https://arxiv.org/html/2607.08374#S2.I1.i2.p1.1)\.
- \[48\]I\. Thielmann, M\. Moshagen, BenjaminE\. Hilbig, and I\. Zettler\(2021\-06\)On the comparability of basic personality models: meta\-analytic correspondence, scope, and orthogonality of the big five and hexaco dimensions\.European Journal of Personality36\(6\),pp\. 870–900\.External Links:ISSN 1099\-0984,[Link](http://dx.doi.org/10.1177/08902070211026793),[Document](https://dx.doi.org/10.1177/08902070211026793)Cited by:[§III\-A](https://arxiv.org/html/2607.08374#S3.SS1.p2.10)\.
- \[49\]H\. Touvron, T\. Lavril, G\. Izacard, X\. Martinet, M\. Lachaux, T\. Lacroix, B\. Rozière, N\. Goyal, E\. Hambro, F\. Azhar, A\. Rodriguez, A\. Joulin, E\. Grave, and G\. Lample\(2023\)LLaMA: open and efficient foundation language models\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2302.13971),[Link](https://arxiv.org/abs/2302.13971)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p1.1)\.
- \[50\]W\. Wang, F\. Wei, L\. Dong, H\. Bao, N\. Yang, and M\. Zhou\(2020\)MiniLM: deep self\-attention distillation for task\-agnostic compression of pre\-trained transformers\.InAdvances in Neural Information Processing Systems,H\. Larochelle, M\. Ranzato, R\. Hadsell, M\.F\. Balcan, and H\. Lin \(Eds\.\),Vol\.33,pp\. 5776–5788\.External Links:[Link](https://proceedings.neurips.cc/paper_files/paper/2020/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf)Cited by:[§II\-B1](https://arxiv.org/html/2607.08374#S2.SS2.SSS1.p1.1)\.
- \[51\]M\. H\. Waugh, C\. M\. McClain, E\. C\. Mariotti, A\. L\. Mulay, E\. N\. DeVore, K\. A\. Lenger, A\. N\. Russell, A\. R\. Florimbio, K\. C\. Lewis, J\. M\. Ridenour, and L\. G\. Beevers\(2020\-01\)Comparative content analysis of self\-report scales for level of personality functioning\.Journal of Personality Assessment103\(2\),pp\. 161–173\.External Links:ISSN 1532\-7752,[Link](http://dx.doi.org/10.1080/00223891.2019.1705464),[Document](https://dx.doi.org/10.1080/00223891.2019.1705464)Cited by:[1st item](https://arxiv.org/html/2607.08374#S2.I1.i1.p1.1)\.
- \[52\]P\. William and A\. Badholia\(2021\)Analysis of personality traits from text based answers using hexaco model\.In2021 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems \(ICSES\),Vol\.,pp\. 1–10\.External Links:[Document](https://dx.doi.org/10.1109/ICSES52305.2021.9633794)Cited by:[§II\-A](https://arxiv.org/html/2607.08374#S2.SS1.p2.1)\.
- \[53\]M\. Wu, Z\. Xu, and L\. Zheng\(2024\-10\)Heterogeneous graph contrastive learning with adaptive data augmentation for semi‐supervised short text classification\.Expert Systems42\(2\)\.External Links:ISSN 1468\-0394,[Link](http://dx.doi.org/10.1111/exsy.13744),[Document](https://dx.doi.org/10.1111/exsy.13744)Cited by:[§II\-B4](https://arxiv.org/html/2607.08374#S2.SS2.SSS4.p1.1)\.
- \[54\]T\. Yang, J\. Deng, X\. Quan, and Q\. Wang\(2022\)Orders are unwanted: dynamic deep graph convolutional network for personality detection\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2212.01515),[Link](https://arxiv.org/abs/2212.01515)Cited by:[TABLE V](https://arxiv.org/html/2607.08374#S4.T5.2.8.1.1.1)\.
- \[55\]T\. Yang, F\. Yang, H\. Ouyang, and X\. Quan\(2021\-08\)Psycholinguistic tripartite graph network for personality detection\.InProceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing \(Volume 1: Long Papers\),C\. Zong, F\. Xia, W\. Li, and R\. Navigli \(Eds\.\),Online,pp\. 4229–4239\.External Links:[Link](https://aclanthology.org/2021.acl-long.326),[Document](https://dx.doi.org/10.18653/v1/2021.acl-long.326)Cited by:[TABLE V](https://arxiv.org/html/2607.08374#S4.T5.2.6.1.1.1)\.
- \[56\]I\. Zettler, I\. Thielmann, B\. E\. Hilbig, and M\. Moshagen\(2020\-04\)The nomological net of the hexaco model of personality: a large\-scale meta\-analytic investigation\.Perspectives on Psychological Science15\(3\),pp\. 723–760\.External Links:ISSN 1745\-6924,[Link](http://dx.doi.org/10.1177/1745691619895036),[Document](https://dx.doi.org/10.1177/1745691619895036)Cited by:[§III\-A](https://arxiv.org/html/2607.08374#S3.SS1.p2.10)\.
- \[57\]T\. Zhong, Z\. Liu, Y\. Pan, Y\. Zhang, Y\. Zhou, S\. Liang, Z\. Wu, Y\. Lyu, P\. Shu, X\. Yu, C\. Cao, H\. Jiang, H\. Chen, Y\. Li, J\. Chen, H\. Hu, Y\. Liu, H\. Zhao, S\. Xu, H\. Dai, L\. Zhao, R\. Zhang, W\. Zhao, Z\. Yang, J\. Chen, P\. Wang, W\. Ruan, H\. Wang, H\. Zhao, J\. Zhang, Y\. Ren, S\. Qin, T\. Chen, J\. Li, A\. H\. Zidan, A\. Jahin, M\. Chen, S\. Xia, J\. Holmes, Y\. Zhuang, J\. Wang, B\. Xu, W\. Xia, J\. Yu, K\. Tang, Y\. Yang, B\. Sun, T\. Yang, G\. Lu, X\. Wang, L\. Chai, H\. Li, J\. Lu, L\. Sun, X\. Zhang, B\. Ge, X\. Hu, L\. Zhang, H\. Zhou, L\. Zhang, S\. Zhang, N\. Liu, B\. Jiang, L\. Kong, Z\. Xiang, Y\. Ren, J\. Liu, X\. Jiang, Y\. Bao, W\. Zhang, X\. Li, G\. Li, W\. Liu, D\. Shen, A\. Sikora, X\. Zhai, D\. Zhu, and T\. Liu\(2024\)Evaluation of openai o1: opportunities and challenges of agi\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2409.18486),[Link](https://arxiv.org/abs/2409.18486)Cited by:[§II\-B2](https://arxiv.org/html/2607.08374#S2.SS2.SSS2.p2.1)\.
- \[58\]H\. Zhu, X\. Zhang, J\. Lu, Y\. Wu, Z\. Bai, C\. Min, L\. Yang, B\. Xu, D\. Zhang, and H\. Lin\(2024\)Enhancing textual personality detection toward social media: integrating long\-term and short\-term perspectives\.arXiv\.External Links:[Document](https://dx.doi.org/10.48550/ARXIV.2404.15067),[Link](https://arxiv.org/abs/2404.15067)Cited by:[§II\-B4](https://arxiv.org/html/2607.08374#S2.SS2.SSS4.p1.1)\.

## Author Biographies

![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image1.png)Jing Jie Tanreceived his Bachelor of Computer Science \(Hons\) and PhD in Engineering, specializing in machine learning, from Universiti Tunku Abdul Rahman \(UTAR\)\. He is currently a Research Fellow at the National University of Singapore \(NUS\)\. His research interests include affective computing, health intelligence, natural language processing, computer vision, deep learning, large language models, and vision transformers\. He is passionate about translating research into practical applications, with the goal of leveraging technology to better serve society\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image2.png)Ban\-Hoe Kwanreceived the Bachelor of Engineering \(Electrical\), Master of Engineering Science, and Ph\.D\. degrees in Engineering from the University of Malaya \(UM\)\. He is currently an Associate Professor at Universiti Tunku Abdul Rahman \(UTAR\)\. His research interests include image processing, artificial intelligence, medical signal processing, the Internet of Things, and robotics\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image3.jpg)Danny Ng Wee Kiat\(Senior Member, IEEE\) received the Ph\.D\. degree in Engineering and is a registered Professional Engineer with the Board of Engineers Malaysia\. He is currently an Assistant Professor at Universiti Tunku Abdul Rahman \(UTAR\)\. His research focuses on robotics and artificial intelligence, particularly AI\-driven robotics, generative AI, and autonomous AI agents for industrial and enterprise applications\. In addition to his academic role, he serves as the Chief Executive Officer and Chief Technology Officer of Netizen Robotics and as the Technical Director of Netizen Experience, where he leads initiatives in advanced robotics and digital transformation\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image4.png)Yan Chai Hum\(Senior Member, IEEE\) received the Ph\.D\. degree in Engineering with specialization in artificial intelligence from Universiti Teknologi Malaysia\. He is currently an Associate Professor with the Department of Mechatronics and Biomedical Engineering, Lee Kong Chian Faculty of Engineering and Science, Universiti Tunku Abdul Rahman \(UTAR\)\. His research interests include artificial intelligence in healthcare, biomedical imaging, computer vision, Internet of Things systems, and intelligent sensing technologies\. His recent work focuses on AI\-driven diagnostic systems, multimodal medical data analysis, and autonomous sensing platforms\. He is also the founder of Promptiq Enterprise, an AI consultancy specializing in generative AI and intelligent systems\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image8.png)Shih\-Yu Lois an Associate Professor at the Institute of Communication Studies, National Yang Ming Chiao Tung University, Taiwan\. His research integrates cognitive psychology and human–computer interaction, focusing on how emerging technologies such as AI, virtual reality, and social robots shape memory, decision\-making, empathy, and social cognition\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image9.png)Po\-An Chenis a Professor and Director at the Institute of Information Management, National Yang Ming Chiao Tung University, Taiwan\. He is generally interested in economics and computation, artificial intelligence, and operations research, specifically including algorithmic game theory, theoretical online/reinforcement learning, social networks, and multiagent and distributed systems\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image5.png)Noriyuki Kawarazakireceived the Ph\.D\. degree in Engineering from Kyushu University\. He is currently a Professor and Department Chair of Information Systems at Kanagawa Institute of Technology, Japan\. His research interests include human\-robot interaction, image processing, and artificial intelligence in robotics\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image6.png)Kosuke Takanoreceived a B\.A\. degree in Environment and Information Studies from Keio University, Japan, and his M\.A\. and Ph\.D\. degrees in Media and Governance from Keio University\. He is currently a Professor in the Department of Information and Computer Sciences at Kanagawa Institute of Technology, Japan\. His research interests include emotional AI and multimodal affective computing, data management systems for real\-world monitoring, and AI\-driven educational systems\.![[Uncaptioned image]](https://arxiv.org/html/2607.08374v1/authors/image7.png)Anissa Mokraouireceived the state engineering degree in electrical engineering from national school of telecommunications in 1989 from Algeria, the M\.S degree in information technology in 1990 and the Ph\.D\. degree in 1994 both from University Paris 11, Orsay France\. From 1992 to 1994, she worked at the National Institute of Telecommunications \(INT, at Evry France\) where her research activities were on digital signal processing, fast filtering algorithms and implementation problems on DSP\. In 1997, she was appointed as assistant professor and in December 2011 as associate professor at Galilé Institute of University Paris 13, France\. Since 2013, she is full professor at Galilée Institute of Université Sorbonne Paris Nord \(USPN\), France\. From 2016 to 2024, she was the director of the L2TI laboratory of USPN\. Her current research interests include source coding \(image, video, multi\-view, stereoscopic\); joint source\-channel\-protocol decoding, robust mobile transmission, MIMO\-OFDM channel estimation \(massive\), computer vision, few\-shot object detection, cross\-domain\. She is co\-author of more than 150 contributions to journals and conference proceedings\. She served on program committees for conferences\. She acts as a reviewer for many IEEE and EURASIP conferences and journals\.

Similar Articles

Judge Circuits

arXiv cs.CL

This paper investigates the internal mechanisms of LLM-as-a-judge, finding a shared Latent Evaluator sub-graph in mid-to-late MLPs across models that handles abstract judging, while format-specific terminal branches map the judgment to output tokens, revealing the cause of format-induced inconsistency.