AI-guided stimuli discovery and generation to optimize facial emotion perception studies in autism

arXiv cs.AI Papers

Summary

This paper presents a model-guided framework using AI to discover and generate facial emotion stimuli that maximize perceptual differences between autistic and neurotypical individuals, demonstrating that group differences are concentrated in a small subset of expressions.

arXiv:2607.08533v1 Announce Type: new Abstract: Understanding perceptual differences between autistic and neurotypical adults requires behavioral assays that are sensitive, reliable, and mechanistically informative. Facial emotion perception is a useful test case because group differences have been reported, but findings vary across studies. Here we show that this variability may reflect image-level sparsity: autistic-neurotypical differences in emotion judgments were concentrated in a small subset of diagnostic facial expressions rather than spread uniformly across stimuli. We trained population-specific artificial neural network models to predict image-level judgments for autistic and neurotypical participants, then used these models to select novel faces predicted to maximize group separation. In an independent cohort, model-selected images produced larger behavioral differences than matched random images. We then used the same models with a generative adversarial network to transform diagnostic images toward greater predicted group agreement. In phenotype-matched validation, synthesized images reduced behavioral separation relative to their matched originals. These results establish a model-guided framework for discovering and transforming stimuli that reveal population-specific perceptual differences. More broadly, they show how behavioral phenotyping can move beyond averaging across fixed stimulus sets toward optimized assays that identify the conditions under which neurodivergent perception diverges or converges.
Original Article
View Cached Full Text

Cached at: 07/10/26, 06:09 AM

# AI-guided stimuli discovery and generation to optimize facial emotion perception studies in autism
Source: [https://arxiv.org/abs/2607.08533](https://arxiv.org/abs/2607.08533)
[View PDF](https://arxiv.org/pdf/2607.08533)

> Abstract:Understanding perceptual differences between autistic and neurotypical adults requires behavioral assays that are sensitive, reliable, and mechanistically informative\. Facial emotion perception is a useful test case because group differences have been reported, but findings vary across studies\. Here we show that this variability may reflect image\-level sparsity: autistic\-neurotypical differences in emotion judgments were concentrated in a small subset of diagnostic facial expressions rather than spread uniformly across stimuli\. We trained population\-specific artificial neural network models to predict image\-level judgments for autistic and neurotypical participants, then used these models to select novel faces predicted to maximize group separation\. In an independent cohort, model\-selected images produced larger behavioral differences than matched random images\. We then used the same models with a generative adversarial network to transform diagnostic images toward greater predicted group agreement\. In phenotype\-matched validation, synthesized images reduced behavioral separation relative to their matched originals\. These results establish a model\-guided framework for discovering and transforming stimuli that reveal population\-specific perceptual differences\. More broadly, they show how behavioral phenotyping can move beyond averaging across fixed stimulus sets toward optimized assays that identify the conditions under which neurodivergent perception diverges or converges\.

## Submission history

From: Kohitij Kar \[[view email](https://arxiv.org/show-email/70fa793c/2607.08533)\] **\[v1\]**Thu, 9 Jul 2026 14:29:31 UTC \(1,435 KB\)

Similar Articles

Generative Learning as a Tool to Improve Perception of Emotional Body Motion Expressions

arXiv cs.LG

This paper investigates using a Transformer-based generative model to learn emotional body motions from motion-capture data of Japanese actors, generating motions conditioned on discrete emotion labels. Evaluations show the generated motions improve emotion recognition when used for data augmentation and enable smooth transitions between emotion intensities.

ASD-Bench: A Four-Axis Comprehensive Benchmark of AI Models for Autism Spectrum Disorder

arXiv cs.LG

The article introduces ASD-Bench, a comprehensive benchmark evaluating AI models for Autism Spectrum Disorder screening across four axes: predictive performance, calibration, interpretability, and robustness. It analyzes various models across different age cohorts using AQ-10 data, highlighting the importance of multi-metric evaluation in clinical AI applications.

Evaluating multimodal emotion recognition in proactive conversational agents: A user study

arXiv cs.AI

This paper presents a multimodal emotion recognition module for proactive conversational agents, using facial recognition and linguistic analysis. A user study with 20 participants reveals a 'poker face' effect where visual cues are unreliable, while linguistic analysis proves more accurate; the study also shows agents can elicit emotions through conversational adaptation.