A VAE-Driven Multi-Task Satellite-Aided Semantic Communication Framework for 6G-Enabled Connected Autonomous Vehicles

arXiv cs.LG Papers

Summary

Proposes a VAE-based multi-task semantic communication framework for satellite-assisted autonomous driving, achieving significant bandwidth reduction while maintaining performance for traffic sign reconstruction and classification.

arXiv:2607.13494v1 Announce Type: new Abstract: The development of smart transportation systems and the introduction of 6G wireless communication technologies have significantly changed vehicle network topologies. Future connected autonomous vehicle (CAV) networks require bandwidth-efficient, reliable, and low-latency communication for safety-critical applications such as traffic sign recognition and decision-making. Conventional communication systems transmit raw data regardless of task relevance, which is inefficient in resource-constrained satellite channels where uplink bandwidth is scarce and propagation losses are large. Semantic communication addresses this limitation by transmitting task-relevant information instead of full signal representations. It extracts and conveys essential semantic features and leverages deep learning to optimize task performance at the receiver. Therefore, we present a Variational Autoencoder (VAE)-based multi-task semantic communication framework for satellite-assisted autonomous driving. Unlike deterministic autoencoder-based methods, the proposed model uses probabilistic latent representations for more robust and efficient encoding. The learned features are transmitted over noisy wireless channels to perform traffic sign reconstruction and classification. The framework is trained end-to-end to jointly optimize both tasks. Results show that the proposed approach achieves significant bandwidth reduction of up to 87.23\% to 98.17\% while maintaining stable performance across varying signal-to-noise ratio conditions.
Original Article
View Cached Full Text

Cached at: 07/16/26, 04:22 AM

# A VAE-Driven Multi-Task Satellite-Aided Semantic Communication Framework for 6G-Enabled Connected Autonomous Vehicles
Source: [https://arxiv.org/html/2607.13494](https://arxiv.org/html/2607.13494)
###### Abstract

The development of smart transportation systems and the introduction of 6G wireless communication technologies have significantly changed vehicle network topologies\. Future connected autonomous vehicle \(CAV\) networks require bandwidth\-efficient, reliable, and low\-latency communication for safety\-critical applications such as traffic sign recognition and decision\-making\. Conventional communication systems transmit raw data regardless of task relevance, which is inefficient in resource\-constrained satellite channels where uplink bandwidth is scarce and propagation losses are large\. Semantic communication addresses this limitation by transmitting task\-relevant information instead of full signal representations\. It extracts and conveys essential semantic features and leverages deep learning to optimize task performance at the receiver\. Therefore, we present a Variational Autoencoder \(VAE\)\-based multi\-task semantic communication framework for satellite\-assisted autonomous driving\. Unlike deterministic autoencoder\-based methods, the proposed model uses probabilistic latent representations for more robust and efficient encoding\. The learned features are transmitted over noisy wireless channels to perform traffic sign reconstruction and classification\. The framework is trained end\-to\-end to jointly optimize both tasks\. Results show that the proposed approach achieves significant bandwidth reduction of up to 87\.23% to 98\.17% while maintaining stable performance across varying signal\-to\-noise ratio conditions\.

## IIntroduction

Autonomous vehicles in rural or disaster areas increasingly depend on satellite communication to share vital data\. When a sender vehicle detects a traffic sign, it must transmit not just the image but actionable semantic information for the receiver vehicle to identify the sign in real time\. This procedure is difficult because of the limited bandwidth of satellites, propagation losses, and channel problems like fading and noise\. Conventional methods that separate compression, modulation, and inference are inefficient, as they transmit pixel\-level data without addressing the receiver’s needs\. In semantic communication, one learns compact representations that maintain the information related to the tasks\. The foundational work on joint source and channel coding \(JSCC\) demonstrated that end\-to\-end training of transmission and reception implicitly takes into account channel effects\. Most of the research efforts have been dedicated to single\-task problems, e\.g\., reconstruction and classification\[[1](https://arxiv.org/html/2607.13494#bib.bib1),[2](https://arxiv.org/html/2607.13494#bib.bib2),[4](https://arxiv.org/html/2607.13494#bib.bib4),[5](https://arxiv.org/html/2607.13494#bib.bib5)\]\. Few studies exist on joint task learning, and those that do typically use mean squared error \(MSE\) for reconstruction\[[3](https://arxiv.org/html/2607.13494#bib.bib3)\]\.

While MSE is convenient, it has limitations in perceptual quality\. Decoders minimizing pixel\-wise squared error often produce blurred outputs, averaging over plausible reconstructions instead of choosing a definitive option\. This is particularly problematic for traffic sign images, where precise geometry is crucial for distinguishing similar categories\. Blurred boundaries between characters or shapes reduce both the image quality and the discriminative signal necessary for effective classification, as both the decoder and classifier rely on the same latent vector\.

This work proposes a VAE\-based multi\-task semantic communication framework for satellite\-assisted vehicular networks, in which MSE\-only reconstruction is replaced by a composite perceptual loss combining MSE, structural similarity \(SSIM\), and image\-gradient terms\. A two\-branch decoder with a residual refinement sub\-network recovers detail suppressed by the communication bottleneck, and a deterministic inference strategy, substituting the posterior mean for a stochastic sample at test time, stabilizes reconstruction quality without sacrificing the benefits of probabilistic training\. The main contributions are as follows:

- •We propose a satellite\-assisted semantic communication framework for connected autonomous vehicles that enhances efficiency and robustness by using task\-oriented feature encoding instead of raw pixel\-level transmission\.
- •We employ a probabilistic latent representation with a dimension\-scaled Kullback\-Leibler \(KL\) weight to enhance robustness under high noise levels in satellite channels and to prevent posterior collapse at small codeword dimensions\.
- •We introduce a unified multi\-task framework that jointly optimizes reconstruction and classification, incorporating a two\-branch decoder with a residual refinement sub\-network that recovers fine\-grained edge detail suppressed by the communication bottleneck\.
- •We test our approach against conventional methods on different traffic sign datasets under different channel conditions, including shadowed and clear\-sky satellite propagation\.

The rest of the paper is organized as follows:[II](https://arxiv.org/html/2607.13494#S2)reviews related works in semantic communication and deep learning\-based communication systems\.[III](https://arxiv.org/html/2607.13494#S3)presents the system model\.[IV](https://arxiv.org/html/2607.13494#S4)describes the proposed methodology\.[IV\-G](https://arxiv.org/html/2607.13494#S4.SS7)details the experimental setup\.[V](https://arxiv.org/html/2607.13494#S5)presents the results and analysis, and finally,[VI](https://arxiv.org/html/2607.13494#S6)concludes the paper\.

## IIRelated Work

Deep joint source–channel coding \(DeepJSCC\)\[[1](https://arxiv.org/html/2607.13494#bib.bib1)\]replaces the conventional separation of source and channel coding with end\-to\-end learning over noisy channels, enabling graceful degradation under channel impairments\. Extensions have explored feedback mechanisms and advanced architectures such as transformers and diffusion\-based receivers, although their high computational cost and latency limit deployment in real\-time or resource\-constrained scenarios, where lightweight convolutional models remain more practical\. Moreover, most prior work focuses on terrestrial or Additive White Gaussian Noise \(AWGN\) channels, while satellite\-specific challenges such as large path loss, Doppler shifts in LEO systems, and two\-hop relay geometry remain underexplored, motivating this study\. Recent task\-oriented semantic communication methods\[[3](https://arxiv.org/html/2607.13494#bib.bib3)\]demonstrate shared latent spaces for joint reconstruction and classification, but reliance on pixel\-wise losses obscures the contribution of latent modeling versus architectural design; in contrast, this work introduces a composite perceptual loss and a matched deterministic baseline to isolate the effects of loss design and stochastic latent representations\. Furthermore, while MSE\-based objectives often yield overly smooth reconstructions, perceptual and structural metrics such as SSIM\[[7](https://arxiv.org/html/2607.13494#bib.bib7)\]and feature\-based losses\[[6](https://arxiv.org/html/2607.13494#bib.bib6)\], together with gradient\-based constraints\[[8](https://arxiv.org/html/2607.13494#bib.bib8)\], better preserve visual fidelity, motivating our composite loss formulation\.

## IIISystem Model and Problem Formulation

### III\-ATransmission Scenario

We consider a satellite\-assisted vehicular communication scenario where a sender autonomous vehicle captures a traffic sign image and transmits a compressed semantic codeword to a satellite relay, which forwards it to a receiver vehicle\. The end\-to\-end uplink–downlink path is modeled as a single equivalent flat\-fading AWGN channel using the standard two\-hop abstraction in satellite systems\[[3](https://arxiv.org/html/2607.13494#bib.bib3)\], valid under decode\- or amplify\-and\-forward relaying with an equivalent received signal\-to\-noise ratio \(SNR\) denoted asγ\\gamma\. Although satellite links often exhibit strong line\-of\-sight conditions, we adopt Rayleigh fading as a conservative worst\-case model to account for urban blockage, foliage shadowing, and low\-elevation passes, ensuring robust performance evaluation\. The transmitter maps an image𝐱∈\[0,1\]H×W\\mathbf\{x\}\\in\[0,1\]^\{H\\times W\}with class labelc∈𝒴=\{0,…,C−1\}c\\in\\mathcal\{Y\}=\\\{0,\\ldots,C\-1\\\}to a latent codeword𝐳∈ℝd\\mathbf\{z\}\\in\\mathbb\{R\}^\{d\}, which is transmitted over the channel\. The received signal𝐲∈ℝd\\mathbf\{y\}\\in\\mathbb\{R\}^\{d\}is then used to jointly reconstruct the image𝐱^\\hat\{\\mathbf\{x\}\}and predict the labelc^\\hat\{c\}\. A single fading coefficienthhis assumed constant across alldddimensions within one transmission interval, corresponding to a narrowband channel\.

### III\-BProblem Formulation

Letfϕ:ℝH×W→ℝdf\_\{\\phi\}:\\mathbb\{R\}^\{H\\times W\}\\rightarrow\\mathbb\{R\}^\{d\}denote the encoder with parametersϕ\\phi, and letgθ:ℝd→ℝH×Wg\_\{\\theta\}:\\mathbb\{R\}^\{d\}\\rightarrow\\mathbb\{R\}^\{H\\times W\}andqψ:ℝd→ℝCq\_\{\\psi\}:\\mathbb\{R\}^\{d\}\\rightarrow\\mathbb\{R\}^\{C\}denote the reconstruction and classification networks at the receiver, respectively\. The system is trained in an end\-to\-end manner by solving the following constrained optimization problem:

minϕ,θ,ψ𝔼𝐱,c,𝐲\[\\displaystyle\\min\_\{\\phi,\\,\\theta,\\,\\psi\}\\quad\\mathbb\{E\}\_\{\\mathbf\{x\},c,\\mathbf\{y\}\}\\Big\[α​ℒcls​\(qψ​\(𝐲\),c\)\+β​ℒrec​\(gθ​\(𝐲\),𝐱\)\\displaystyle\\alpha\\,\\mathcal\{L\}\_\{\\mathrm\{cls\}\}\\\!\\left\(q\_\{\\psi\}\(\\mathbf\{y\}\),c\\right\)\+\\beta\\,\\mathcal\{L\}\_\{\\mathrm\{rec\}\}\\\!\\left\(g\_\{\\theta\}\(\\mathbf\{y\}\),\\mathbf\{x\}\\right\)\(1\)\+γℒkl\(fϕ\(𝐱\)\)\],\\displaystyle\+\\gamma\\,\\mathcal\{L\}\_\{\\mathrm\{kl\}\}\\\!\\left\(f\_\{\\phi\}\(\\mathbf\{x\}\)\\right\)\\Big\],s\.t\.𝔼​\[‖𝐳‖22\]≤P,\\displaystyle\\mathbb\{E\}\\\!\\left\[\\\|\\mathbf\{z\}\\\|\_\{2\}^\{2\}\\right\]\\leq P,\(1a\)d≤dmax,\\displaystyle d\\leq d\_\{\\max\},\(1b\)𝐱^=gθ​\(𝐲\)∈\[0,1\]H×W,\\displaystyle\\hat\{\\mathbf\{x\}\}=g\_\{\\theta\}\(\\mathbf\{y\}\)\\in\[0,1\]^\{H\\times W\},\(1c\)𝐲=h​𝐳~\+𝐧,h∼Rayleigh,𝐧∼𝒩​\(𝟎,σn2​𝐈\),\\displaystyle\\mathbf\{y\}=h\\,\\tilde\{\\mathbf\{z\}\}\+\\mathbf\{n\},\\quad h\\sim\\mathrm\{Rayleigh\},\\;\\mathbf\{n\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\sigma\_\{n\}^\{2\}\\mathbf\{I\}\),\(1d\)where𝐳=fϕ​\(𝐱\)\\mathbf\{z\}=f\_\{\\phi\}\(\\mathbf\{x\}\)denotes the encoded latent representation and𝐳~\\tilde\{\\mathbf\{z\}\}is its power\-normalized version\. Constraint \([1a](https://arxiv.org/html/2607.13494#S3.Ex1)\) enforces a transmit power budgetPP, while \([1b](https://arxiv.org/html/2607.13494#S3.Ex2)\) limits the codeword dimension todmaxd\_\{\\max\}based on available bandwidth\. Constraint \([1c](https://arxiv.org/html/2607.13494#S3.Ex3)\) ensures valid pixel reconstruction, and \([1d](https://arxiv.org/html/2607.13494#S3.Ex4)\) defines the satellite channel model, whereσn2=1/\(2​γlin\)\\sigma\_\{n\}^\{2\}=1/\(2\\,\\mathrm\{\\gamma\}\_\{\\mathrm\{lin\}\}\)\. The objective jointly optimizes classification accuracy, reconstruction fidelity, and latent regularization, enabling robust end\-to\-end semantic communication over noisy wireless channels\. The regularization termℒkl​\(⋅\)\\mathcal\{L\}\_\{\\mathrm\{kl\}\}\(\\cdot\)is included only in the probabilistic VAE formulation and is omitted for the deterministic baseline\. In practice, the power constraint in \([1a](https://arxiv.org/html/2607.13494#S3.Ex1)\) is enforced by normalizing𝐳\\mathbf\{z\}to unit RMS amplitude before transmission, as detailed in the methodology Section[IV](https://arxiv.org/html/2607.13494#S4)\.

## IVProposed Framework

![Refer to caption](https://arxiv.org/html/2607.13494v1/methodology_diagram_final.png)Figure 1:VAE\-based multi\-task satellite\-aided semantic communication framework for 6G autonomous vehicles, featuring a refinement branch for better reconstruction and a parallel classifier for traffic sign recognition in noisy channels\.### IV\-AEncoder Architecture

![Refer to caption](https://arxiv.org/html/2607.13494v1/vae_driven_arch.png)Figure 2:Proposed encoder–decoder architecture of VAE with latent sampling and a refinement branch\.The encoderfϕf\_\{\\phi\}comprises three strided convolutional blocks that progressively reduce the spatial resolution, as shown in Fig\.[2](https://arxiv.org/html/2607.13494#S4.F2)\. Each block processes an input spatial map and produces a downsampled output\. The convolution blocks are denoted asC​\(k,s,p\)\\text\{C\}\(k,s,p\), wherekkis the kernel size,ssis the stride, andppis the padding\. The resulting feature volume is flattened into a vector𝐡∈ℝ8192\\mathbf\{h\}\\in\\mathbb\{R\}^\{8192\}, which is then passed through two separate fully connected layers to yield the posterior mean and log\-variance:

𝝁=𝐖μ​𝐡\+𝐛μ,log⁡𝝈2=𝐖v​𝐡\+𝐛v,\\boldsymbol\{\\mu\}=\\mathbf\{W\}\_\{\\mu\}\\mathbf\{h\}\+\\mathbf\{b\}\_\{\\mu\},\\quad\\log\\boldsymbol\{\\sigma\}^\{2\}=\\mathbf\{W\}\_\{v\}\\mathbf\{h\}\+\\mathbf\{b\}\_\{v\},\(2\)each producing add\-dimensional vector\. These two branches correspond to fully connected dense layers, specifically FC\(μ\\mu\) and FC\(σ\\sigma\) layers, as shown in Fig\.[2](https://arxiv.org/html/2607.13494#S4.F2)\.

### IV\-BReparameterization and Channel Model

During training, the latent vector is drawn via the reparameterization trick\[[9](https://arxiv.org/html/2607.13494#bib.bib9)\]:

𝐳=𝝁\+𝜺⊙𝝈,𝜺∼𝒩​\(𝟎,𝐈\),\\mathbf\{z\}=\\boldsymbol\{\\mu\}\+\\boldsymbol\{\\varepsilon\}\\odot\\boldsymbol\{\\sigma\},\\quad\\boldsymbol\{\\varepsilon\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\mathbf\{I\}\),\(3\)where𝝈=exp⁡\(0\.5​log⁡𝝈2\)\\boldsymbol\{\\sigma\}=\\exp\\\!\\left\(0\.5\\,\\log\\boldsymbol\{\\sigma\}^\{2\}\\right\)\. At inference, we substitute𝐳=𝝁\\mathbf\{z\}=\\boldsymbol\{\\mu\}for deterministic evaluation, eliminating stochastic reconstruction variance and consistently improving perceptual quality on the test set\. Before transmission,𝐳\\mathbf\{z\}is normalized by its root\-mean\-square amplitude to decouple signal power from input scale:

𝐳~=𝐳1d​∑i=1dzi2\.\\tilde\{\\mathbf\{z\}\}=\\frac\{\\mathbf\{z\}\}\{\\displaystyle\\sqrt\{\\frac\{1\}\{d\}\\sum\_\{i=1\}^\{d\}z\_\{i\}^\{2\}\}\}\.\(4\)
The channel introduces Rayleigh fading and AWGN:

𝐲=h​𝐳~\+𝐧,\\mathbf\{y\}=h\\,\\tilde\{\\mathbf\{z\}\}\+\\mathbf\{n\},\(5\)where the fading coefficient is drawn element\-wise as

h=hR2\+hI22,hR,hI∼𝒩​\(0,1\),h=\\sqrt\{\\frac\{h\_\{R\}^\{2\}\+h\_\{I\}^\{2\}\}\{2\}\},\\quad h\_\{R\},h\_\{I\}\\sim\\mathcal\{N\}\(0,1\),\(6\)and the noise is𝐧∼𝒩​\(𝟎,σn2​𝐈\)\\mathbf\{n\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\sigma\_\{n\}^\{2\}\\mathbf\{I\}\)with standard deviation

σn=12​γlin,γlin=10γdB/10\.\\sigma\_\{n\}=\\frac\{1\}\{\\sqrt\{2\\,\\gamma\_\{\\mathrm\{lin\}\}\}\},\\quad\\gamma\_\{\\mathrm\{lin\}\}=10^\{\\gamma\_\{\\mathrm\{dB\}\}/10\}\.\(7\)No channel state information is assumed at the transmitter; both the decoder and classifier learn to operate within the faded, noisy signal space defined by the training channel distribution\. The received signal𝐲\\mathbf\{y\}is rescaled by the original RMS power before being passed to the decoder and classifier\.

### IV\-CDecoder with Refinement Branch

The decoder transforms the vector𝐲\\mathbf\{y\}into image space through a fully connected projection and four transposed convolutional blocks, following the encoder’s downsampling hierarchy\. The first three blocks enhance spatial resolution while decreasing channel depth, while the fourth block keeps a64×6464\\times 64resolution and has a refinement branch\. Transposed convolution is defined asCT​\(k,s,p\)\\text\{CT\}\(k,s,p\)with kernel sizekk, stridess, and paddingpp, followed by a ReLU activation\. In the final stage, a base map𝐱base∈ℝ64×64\\mathbf\{x\}\_\{\\mathrm\{base\}\}\\in\\mathbb\{R\}^\{64\\times 64\}is generated using a3×33\\times 3convolution \(from3232to11channel\), alongside a three\-layer refinement sub\-network\.

𝐱detail∈\\displaystyle\\mathbf\{x\}\_\{\\mathrm\{detail\}\}\\inConv3×31→32→ReLU→\\displaystyle\\ \\mathrm\{Conv\}\_\{3\\times 3\}^\{1\\to 32\}\\rightarrow\\mathrm\{ReLU\}\\rightarrow\(8\)Conv3×332→32→ReLU→Conv3×332→1\\displaystyle\\ \\mathrm\{Conv\}\_\{3\\times 3\}^\{32\\to 32\}\\rightarrow\\mathrm\{ReLU\}\\rightarrow\\mathrm\{Conv\}\_\{3\\times 3\}^\{32\\to 1\}and the two branches are fused as:

𝐱^=σ​\(𝐱base\+0\.5​𝐱detail\),\\hat\{\\mathbf\{x\}\}=\\sigma\\\!\\left\(\\mathbf\{x\}\_\{\\mathrm\{base\}\}\+0\.5\\,\\mathbf\{x\}\_\{\\mathrm\{detail\}\}\\right\),\(9\)whereσ​\(⋅\)\\sigma\(\\cdot\)is the sigmoid function\.

### IV\-DClassifier Design

We use a classifierqψq\_\{\\psi\}to map the received signal𝐲\\mathbf\{y\}to class logits using two fully\-connected layers with dropout \(p=0\.25p=0\.25\), forming a compact nonlinear decision head:

ℝd→256→128→C\.\\mathbb\{R\}^\{d\}\\rightarrow 256\\rightarrow 128\\rightarrow C\.\(10\)

### IV\-EComposite Reconstruction Loss

To improve perceptual fidelity beyond pixel\-wise supervision, we design a composite reconstruction loss combining intensity, structural, and edge\-aware objectives:

ℒrec=0\.4​ℒ1\+0\.1​ℒMSE\+0\.3​\(1−SSIM\)\+0\.2​ℒedge\.\\mathcal\{L\}\_\{\\mathrm\{rec\}\}=0\.4\\,\\mathcal\{L\}\_\{1\}\+0\.1\\,\\mathcal\{L\}\_\{\\mathrm\{MSE\}\}\+0\.3\\,\(1\-\\mathrm\{SSIM\}\)\+0\.2\\,\\mathcal\{L\}\_\{\\mathrm\{edge\}\}\.\(11\)Whereℒ1\\mathcal\{L\}\_\{1\}preserves sharpness, MSE stabilizes optimization, SSIM\[[7](https://arxiv.org/html/2607.13494#bib.bib7)\]enforces structural similarity, and the edge loss preserves boundary information critical for traffic sign semantics\.

Algorithm 1Satellite\-Assisted Semantic Transmission and Inference0:Trained encoder

fϕf\_\{\\phi\}, decoder

gθg\_\{\\theta\}, classifier

qψq\_\{\\psi\}; test image

𝐱\\mathbf\{x\}; channel SNRtest

0:Reconstructed image

𝐱^\\hat\{\\mathbf\{x\}\}; predicted label

c^\\hat\{c\}
1:

\(𝝁,log⁡𝝈2\)←fϕ​\(𝐱\)\(\\boldsymbol\{\\mu\},\\log\\boldsymbol\{\\sigma\}^\{2\}\)\\leftarrow f\_\{\\phi\}\(\\mathbf\{x\}\)\{Encode at sender vehicle\}

2:

𝐳~←𝝁/1d​∑iμi2\\tilde\{\\mathbf\{z\}\}\\leftarrow\\boldsymbol\{\\mu\}\\,/\\,\\sqrt\{\\tfrac\{1\}\{d\}\\sum\_\{i\}\\mu\_\{i\}^\{2\}\}\{Power normalise; use mean \(no sampling\)\}

3:/\*Uplink: sender vehicle→\\rightarrowsatellite\*/

4:

h↑∼Rayleigh​\(1\)h\_\{\\uparrow\}\\sim\\mathrm\{Rayleigh\}\(1\);

𝐧↑∼𝒩​\(𝟎,σn2​𝐈\)\\mathbf\{n\}\_\{\\uparrow\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\sigma\_\{n\}^\{2\}\\mathbf\{I\}\)
5:

𝐫←h↑​𝐳~\+𝐧↑\\mathbf\{r\}\\leftarrow h\_\{\\uparrow\}\\,\\tilde\{\\mathbf\{z\}\}\+\\mathbf\{n\}\_\{\\uparrow\}\{Received signal at satellite\}

6:/\*Downlink: satellite→\\rightarrowreceiver vehicles\*/

7:

h↓∼Rayleigh​\(1\)h\_\{\\downarrow\}\\sim\\mathrm\{Rayleigh\}\(1\);

𝐧↓∼𝒩​\(𝟎,σn2​𝐈\)\\mathbf\{n\}\_\{\\downarrow\}\\sim\\mathcal\{N\}\(\\mathbf\{0\},\\sigma\_\{n\}^\{2\}\\mathbf\{I\}\)
8:

𝐲←h↓​𝐫\+𝐧↓\\mathbf\{y\}\\leftarrow h\_\{\\downarrow\}\\,\\mathbf\{r\}\+\\mathbf\{n\}\_\{\\downarrow\}\{Received signal at receiver vehicle\}

9:

𝐱^←gθ​\(𝐲\)\\hat\{\\mathbf\{x\}\}\\leftarrow g\_\{\\theta\}\(\\mathbf\{y\}\)\{Reconstruct image\}

10:

c^←arg⁡max⁡qψ​\(𝐲\)\\hat\{c\}\\leftarrow\\arg\\max\\;q\_\{\\psi\}\(\\mathbf\{y\}\)\{Classify traffic sign\}

11:return

𝐱^,c^\\hat\{\\mathbf\{x\}\},\\;\\hat\{c\}

Algorithm[1](https://arxiv.org/html/2607.13494#alg1)summarizes the inference procedure at deployment, explicitly showing the two\-hop satellite relay channel through which the semantic codeword passes before reconstruction and classification at the receiver vehicle\.

### IV\-FTraining Objective

The classification loss is defined using cross\-entropy with label smoothing:

ℒcls=−∑c=0C−1y~c​log⁡p^c\.\\mathcal\{L\}\_\{\\mathrm\{cls\}\}=\-\\sum\_\{c=0\}^\{C\-1\}\\tilde\{y\}\_\{c\}\\log\\hat\{p\}\_\{c\}\.\(12\)The latent regularization term is given by the KL divergence:

ℒKL=1d​\(−12​∑i=1d\(1\+log⁡σi2−μi2−σi2\)\),\\mathcal\{L\}\_\{\\mathrm\{KL\}\}=\\frac\{1\}\{d\}\\left\(\-\\frac\{1\}\{2\}\\sum\_\{i=1\}^\{d\}\(1\+\\log\\sigma\_\{i\}^\{2\}\-\\mu\_\{i\}^\{2\}\-\\sigma\_\{i\}^\{2\}\)\\right\),\(13\)with adaptive scaling:

γ​\(d\)=γ0⋅16d,γ0=0\.01\.\\gamma\(d\)=\\gamma\_\{0\}\\cdot\\frac\{16\}\{d\},\\quad\\gamma\_\{0\}=0\.01\.\(14\)The overall optimization objective is:

ℒtotal=α​ℒcls\+β​ℒrec\+γ​\(d\)​ℒKL,α=0\.8,β=1\.8\.\\mathcal\{L\}\_\{\\mathrm\{total\}\}=\\alpha\\,\\mathcal\{L\}\_\{\\mathrm\{cls\}\}\+\\beta\\,\\mathcal\{L\}\_\{\\mathrm\{rec\}\}\+\\gamma\(d\)\\,\\mathcal\{L\}\_\{\\mathrm\{KL\}\},\\quad\\alpha=0\.8,\\;\\beta=1\.8\.\(15\)

### IV\-GSimulation Setup

#### IV\-G1Dataset

We evaluate the proposed framework on two benchmark traffic sign datasets: the Chinese Traffic Sign dataset\[[10](https://arxiv.org/html/2607.13494#bib.bib10)\]and the German Traffic Sign Recognition Benchmark \(GTSRB\)\[[11](https://arxiv.org/html/2607.13494#bib.bib11)\]\. Both datasets consist of grayscale images resized to64×6464\\times 64pixels and cover multiple fine\-grained traffic sign categories\. To ensure sufficient class representation and training stability, we retain only categories with a minimum number of samples per class\. After filtering, 30 classes are selected from the Chinese dataset and 35 classes from GTSRB based on their sample frequency\. The dataset splits and training configurations are summarized in Table[I](https://arxiv.org/html/2607.13494#S4.T1)\.

TABLE I:Dataset and Training Configuration
#### IV\-G2Baselines

We compare the proposed method against two representative baselines:

1. 1\.Convolutional Autoencoder \(AE\): A deterministic semantic communication model that employs the same encoder–decoder architecture as the proposed method but excludes stochastic latent sampling and KL regularization\. The training objective includes reconstruction and classification losses only\.
2. 2\.Quadrature Amplitude Modulation \(QAM\): A conventional digital communication system in which images are quantized and transmitted using 16\-QAM modulation over a Rayleigh fading channel\. At the receiver, a linear equalizer is applied, followed by an RBF\-kernel SVM classifier, representing a classical separated source\-channel coding approach\.

#### IV\-G3Evaluation Metrics

We evaluate performance using accuracy, SSIM, bandwidth efficiency, and robustness under varying SNR conditions, as summarized in Table[II](https://arxiv.org/html/2607.13494#S4.T2)\.

TABLE II:Evaluation Metrics![Refer to caption](https://arxiv.org/html/2607.13494v1/chinese_org.png)\(a\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/german_org.png)\(b\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/chinese_vae.png)\(c\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/german_VAE.png)\(d\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/chinese_AE.png)\(e\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/german_AE.png)\(f\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/chinese_QAM.png)\(g\)
![Refer to caption](https://arxiv.org/html/2607.13494v1/german_QAM.png)\(h\)

Figure 3:Visual comparison of traffic sign reconstruction performance: \(a\) Chinese original, \(b\) German original, \(c\) Chinese reconstructed using VAE, \(d\) German reconstructed using VAE, \(e\) Chinese reconstructed using AE, \(f\) German reconstructed using AE, \(g\) Chinese reconstructed using QAM, and \(h\) German reconstructed using QAM\.

## VResults and Discussion

### V\-AClassification Accuracy vs\. SNR

TABLE III:Classification Accuracy \(%\) at Each Test SNR LevelTable[III](https://arxiv.org/html/2607.13494#S5.T3)shows the classification accuracy for both the German and Chinese datasets at different SNR levels\. Across all noise conditions, the proposed 4×\\timesVAE consistently outperforms the AE baseline in all noise conditions, and the performance gap increases in the low\-SNR regimes\. In the German dataset, the proposed method achieves an accuracy ranging from 74\.22% to 96\.68% across SNR values from \-10 dB to 30 dB\. Similar trends are observed for the Chinese dataset, where the proposed method achieves accuracies ranging from 46\.81% to 77\.56% over SNR values between \-10 dB and 30 dB\. The proposed method, VAE, maintains more robustness under severe channel noise\. At moderate and high SNR levels \(10\-30 dB\), both AE and VAE approaches converge; however, the proposed VAE still achieves marginal gains, indicating improved latent robustness and better feature preservation under channel perturbations\. The classical QAM baseline suffers from severe degradation, confirming the advantage of learned joint source\-channel representations\.

### V\-BReconstruction Quality \(SSIM\) vs\. SNR

TABLE IV:Structural Similarity at Each Test SNR LevelTable[IV](https://arxiv.org/html/2607.13494#S5.T4)shows SSIM results that reflect the perceptual quality of the reconstruction of transmitted images\. The proposed VAE outperforms with higher SSIM values for all SNRs and datasets\. The SSIM is 87\.2% in the German dataset and 68\.8% at 30dB in the Chinese dataset\. Compared to AE and QAM, the VAE preserves structural details more effectively, especially under low SNR conditions where AE and QAM performance drops noticeably\. This demonstrates that the stochastic latent representation of VAE leads to better robustness against channel noise, thereby providing better perceptual consistency for reconstructed images\.

### V\-CBandwidth Analysis

TABLE V:Bandwidth Analysis: Compressed Latent Payload vs\. Raw Image \(64×64×1=409664\{\\times\}64\{\\times\}1=4096bytes\)Table[V](https://arxiv.org/html/2607.13494#S5.T5)highlights that both AE and VAE can achieve a significant bandwidth reduction, with a maximum of 98\.17% saving compared to raw image transmission\. But efficiency in compression does not guarantee reliable performance\. The proposed VAE is consistently more robust to keep semantic and structural information in the noisy channel conditions, even with similar compression ratios\. On the other hand, the AE suffers a significant degradation in reconstruction quality and classification accuracy\. This emphasizes that bandwidth efficiency alone is not enough, and that a strong latent representation of the VAE is essential to reliable performance in a noisy channel environment\.

### V\-DQualitative Reconstruction

Fig\.[3](https://arxiv.org/html/2607.13494#S4.F3)shows behaviors beyond what SSIM scores can capture\. At1010dB and above, VAE outputs maintain stroke contours, numeric annotations, and boundary geometry for clear sign identification\. In contrast, the AE, despite having the same architecture, produces softer reconstructions, flattening interior details and blurring boundaries\. QAM\-16 reconstructions are severely degraded, primarily showing only coarse outlines due to channel noise\. This issue worsens at0dB and−10\-10dB, with VAE reconstructions maintaining structural coherence while AE outputs fall into low\-contrast patches and QAM\-16 results become nearly unrecognizable\. The difference arises from VAE’s probabilistic latent structure, allowing for better adaptation to noise compared to the deterministic AE and non\-adaptive QAM\-16\.

## VIConclusion

In this paper, we present a multi\-task semantic communication framework utilizing a VAE with a composite perceptual reconstruction loss\. By combiningL1L\_\{1\}, MSE, SSIM, and image\-gradient terms, our method improves reconstruction fidelity and classification robustness over the AE baseline and QAM transmission pipeline\. The decoder refinement branch enhances perceptual quality, while a deterministic inference reduces variability during testing\. We utilize a scaled KL\-weighting mechanism to tackle the issue of posterior collapse, which helps us maintain stable training across different compression rates\. Experimental results show that our VAE performs better than both the autoencoder baseline and the QAM\-16 scheme, especially in low SNR conditions\. We have successfully achieved a balance between classification accuracy, reconstruction quality, and bandwidth efficiency\. Our results demonstrate that probabilistic semantic encoding is a feasible and effective strategy for bandwidth\-limited satellite\-assisted vehicular networks, opening a principled path towards intelligent, task\-aware communication in next\-generation autonomous driving infrastructure\.

## References

- \[1\]Bourtsoulatze, E\., Kurka, D\. & Gündüz, D\. Deep joint source\-channel coding for wireless image transmission\.IEEE Transactions On Cognitive Communications And Networking\.5, 567\-579 \(2019\)
- \[2\]Xie, H\. & Qin, Z\. A lite distributed semantic communication system for Internet of Things\.IEEE Journal On Selected Areas In Communications\.39, 142\-153 \(2020\)
- \[3\]Eldeeb, E\., Shehab, M\. & Alves, H\. A multi\-task oriented semantic communication framework for autonomous vehicles\.IEEE Wireless Communications Letters\.13, 3469\-3473 \(2024\)
- \[4\]Raha, A\., Adhikary, A\., Dam, S\., Park, S\. & Hong, C\. A Goal\-Oriented Semantic Communication Framework for Connected and Autonomous Vehicular Network: A Deep Auto\-Encoder Approach\. pp\. 1017\-1019 \(2022\)
- \[5\]Raha, A\., Munir, M\., Adhikary, A\., Qiao, Y\., Park, S\. & Hong, C\. An artificial intelligent\-driven semantic communication framework for connected autonomous vehicular network\.2023 International Conference On Information Networking \(ICOIN\)\. pp\. 352\-357 \(2023\)
- \[6\]Johnson, J\., Alahi, A\. & Fei\-Fei, L\. Perceptual losses for real\-time style transfer and super\-resolution\.European Conference On Computer Vision\. pp\. 694\-711 \(2016\)
- \[7\]Wang, Z\., Bovik, A\., Sheikh, H\. & Simoncelli, E\. Image quality assessment: from error visibility to structural similarity\.IEEE Transactions On Image Processing\.13, 600\-612 \(2004\)
- \[8\]Ledig, C\., Theis, L\., Huszár, F\., Caballero, J\., Cunningham, A\., Acosta, A\., Aitken, A\., Tejani, A\., Totz, J\., Wang, Z\. & Others Photo\-realistic single image super\-resolution using a generative adversarial network\.Proceedings Of The IEEE Conference On Computer Vision And Pattern Recognition\. pp\. 4681\-4690 \(2017\)
- \[9\]Kingma, D\. & Welling, M\. Auto\-encoding variational bayes\.ArXiv Preprint ArXiv:1312\.6114\. \(2013\)
- \[10\]Yang, Y\., Luo, H\., Xu, H\. & Wu, F\. Towards real\-time traffic sign detection and classification\.IEEE Transactions On Intelligent Transportation Systems\.17, 2022\-2031 \(2015\)
- \[11\]Stallkamp, J\., Schlipsing, M\., Salmen, J\. & Igel, C\. The German traffic sign recognition benchmark: a multi\-class classification competition\.The 2011 International Joint Conference On Neural Networks\. pp\. 1453\-1460 \(2011\)

Similar Articles

Fast-dDrive: Efficient Block-Diffusion VLM for Autonomous Driving

arXiv cs.CL

Fast-dDrive is a block-diffusion VLA model for end-to-end autonomous driving that achieves state-of-the-art trajectory accuracy while delivering over 12x throughput speedup over autoregressive baselines, addressing the trade-off between high-fidelity planning and efficient inference for edge deployment.