Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference

arXiv cs.AI Papers

Summary

This paper proposes a joint optimization of memory and computing frequency for energy-efficient DNN inference on mobile devices, achieving up to 10.4% energy reduction compared to other methods.

arXiv:2608.13863v1 Announce Type: new Abstract: Deep neural network (DNN) inference on mobile devices often incurs high latency and energy consumption due to limited computing and memory resources. To enable energy-efficient DNN inference, most existing studies focus on dynamic voltage and frequency scaling (DVFS) for adjusting the computing frequency, while the impact of memory frequency on the inference performance has been greatly overlooked. In this paper, we consider the impact of memory frequency and computing frequency on DNN inference time, and jointly optimize these two frequencies together with communication resources for energy-efficient DNN inference. Based on a realistic inference time model, we formulate an optimization problem to minimize the energy consumption of all mobile devices under the deadline constraint. For local inference, we derive a near-optimal closed-form solution via convex optimization, while an optimal closed-form solution for transmission power is obtained for edge inference with the given bandwidth. Furthermore, we propose a low-complexity heuristic algorithm to effectively solve the overall problem with polynomial time complexity. Simulation results based on measured data show that the proposed near-optimal solution for local inference can achieve optimal performance under strict deadline constraints, with a performance gap of up to 2.5% compared with the optimal solution. Meanwhile, our proposed algorithm significantly reduces the energy consumption of devices by up to 10.4% compared to other methods.
Original Article
View Cached Full Text

Cached at: 08/17/26, 09:55 AM

# Joint Optimization of Memory and Computing Frequency for Energy-Efficient DNN Inference
Source: [https://arxiv.org/html/2608.13863](https://arxiv.org/html/2608.13863)
Yunchu Han1, Zhaojun Nan2, Sheng Zhou1, and Zhisheng Niu1Affiliation:1Beijing National Research Center for Information Science and Technology Department of Electronic Engineering, Tsinghua University, Beijing 100084, ChinaAffiliation:2School of Electronics and Internet of Things Chongqing Polytechnic University of Electronic Technology, Chongqing 401331, ChinaAffiliation:Emails: hyc23@mails\.tsinghua\.edu\.cn, nanzhaojun@cquet\.edu\.cn, \{sheng\.zhou@, niuzhs@\}tsinghua\.edu\.cn

###### Abstract

Deep neural network \(DNN\) inference on mobile devices often incurs high latency and energy consumption due to limited computing and memory resources\. To enable energy\-efficient DNN inference, most existing studies focus on dynamic voltage and frequency scaling \(DVFS\) for adjusting the computing frequency, while the impact of memory frequency on the inference performance has been greatly overlooked\. In this paper, we consider the impact of memory frequency and computing frequency on DNN inference time, and jointly optimize these two frequencies together with communication resources for energy\-efficient DNN inference\. Based on a realistic inference time model, we formulate an optimization problem to minimize the energy consumption of all mobile devices under the deadline constraint\. For local inference, we derive a near\-optimal closed\-form solution via convex optimization, while an optimal closed\-form solution for transmission power is obtained for edge inference with the given bandwidth\. Furthermore, we propose a low\-complexity heuristic algorithm to effectively solve the overall problem with polynomial time complexity\. Simulation results based on measured data show that the proposed near\-optimal solution for local inference can achieve optimal performance under strict deadline constraints, with a performance gap of up to2\.5%2\.5\\%compared with the optimal solution\. Meanwhile, our proposed algorithm significantly reduces the energy consumption of devices by up to10\.4%10\.4\\%compared to other methods\.

## IIntroduction

The rapid development of deep neural networks \(DNNs\) has significantly advanced computer vision and artificial intelligence applications\[[1](https://arxiv.org/html/2608.13863#bib.bib1)\],\[[2](https://arxiv.org/html/2608.13863#bib.bib2)\]\. However, the intensive computation and memory access requirements of DNN inference impose critical challenges for mobile devices with limited energy and computing resources\. To enable low\-latency and energy\-efficient DNN inference, mobile edge computing \(MEC\)\[[3](https://arxiv.org/html/2608.13863#bib.bib3)\]has emerged as a promising technology, allowing computation tasks to be offloaded from mobile devices to nearby edge servers\. Furthermore, edge intelligence\[[4](https://arxiv.org/html/2608.13863#bib.bib4)\]has been proposed as a new paradigm that enables real\-time and intelligent services at the wireless network edge \(e\.g\., base stations and road side units\)\. However, mobile devices still need to manage their local computing and memory resources efficiently to balance inference latency and energy consumption\.

To address this issue, the dynamic voltage and frequency scaling \(DVFS\)\[[5](https://arxiv.org/html/2608.13863#bib.bib5)\],\[[6](https://arxiv.org/html/2608.13863#bib.bib6)\]technique has been widely studied to achieve a tradeoff between latency and energy consumption by dynamically adjusting the operating frequency of processors\. Existing DVFS\-based approaches mainly focus on the adjustment of computing frequency \(e\.g\., CPU frequency, GPU frequency\) to reduce latency or energy consumption\. For example, the authors in\[[7](https://arxiv.org/html/2608.13863#bib.bib7)\]design a robust DNN partitioning and resource allocation algorithm to handle uncertain inference time, where DVFS is adopted to adjust the computing frequency for local inference\. In addition, DVFS can be combined with the batch processing technique to reduce the energy consumption\[[8](https://arxiv.org/html/2608.13863#bib.bib8)\]or increase the throughput\[[9](https://arxiv.org/html/2608.13863#bib.bib9)\]\.

![Refer to caption](https://arxiv.org/html/2608.13863v1/Intro_MemoryFreq.png)
Fig\. 1:Impact of memory frequency scaling on DNN inference time and energy consumption for ResNet152 and VGG19 on Jetson TX1\.However, recent studies have revealed that memory frequency scaling also plays a significant role in the overall latency, energy and accuracy characteristics of DNN inference, especially for memory\-intensive DNN models\[[10](https://arxiv.org/html/2608.13863#bib.bib10)\],\[[11](https://arxiv.org/html/2608.13863#bib.bib11)\],\[[12](https://arxiv.org/html/2608.13863#bib.bib12)\],\[[13](https://arxiv.org/html/2608.13863#bib.bib13)\]\. In\[[10](https://arxiv.org/html/2608.13863#bib.bib10)\], the impact of joint memory frequency and computing frequency scaling on DNN inference time for edge devices is characterized and analyzed\. In\[[11](https://arxiv.org/html/2608.13863#bib.bib11)\], the impact of memory frequency and computing frequency on energy efficiency of DNN inference is investigated, respectively, and a reinforcement learning algorithm is proposed to optimize these frequencies\. In\[[12](https://arxiv.org/html/2608.13863#bib.bib12)\], the authors mainly analyze the impact of memory frequency and computing frequency on kernel\-based applications\. In\[[13](https://arxiv.org/html/2608.13863#bib.bib13)\], the impact of memory voltage scaling on accuracy and resilience of DNNs for edge devices is presented\. To further investigate the impact of memory frequency scaling on latency and energy consumption of DNN inference, we deploy ResNet152\[[14](https://arxiv.org/html/2608.13863#bib.bib14)\]and VGG19\[[15](https://arxiv.org/html/2608.13863#bib.bib15)\]on Jetson TX1 to evaluate the corresponding performance, as shown in Fig\.[1](https://arxiv.org/html/2608.13863#S1.F1)\. It is observed that by increasing the memory frequency from0\.10\.1GHz to1\.61\.6GHz, the average inference time can be reduced by84%84\\%and93%93\\%for ResNet152 and VGG19, respectively\. Meanwhile,80%80\\%and92%92\\%reductions can be achieved for the average energy consumption by only adjusting the memory frequency\. Therefore, memory frequency scaling can also significantly impact the inference time and energy consumption\. Despite these potentials, the joint optimization of memory frequency and computing frequency for energy\-efficient DNN inference has not been fully studied\.

In this paper, we consider an edge intelligence system that adopts the joint optimization of memory frequency, computing frequency and communication resources to reduce the energy consumption of mobile devices\. Specifically, we derive an optimal solution to the local inference problem in some special cases\. Moreover, we analyze the upper bound of the corresponding problem and derive a near\-optimal closed\-form solution\. Meanwhile, the analysis for the edge inference problem provides an optimal closed\-form solution for the transmission power, and a heuristic algorithm is proposed to efficiently solve the overall optimization problem\. Simulation results show that the proposed near\-optimal solution achieves a performance within2\.5%2\.5\\%of the optimal result for local inference, and reduces the energy consumption by up to10\.4%10\.4\\%compared with other methods, demonstrating the effectiveness of the proposed approach\.

## IISystem Overview

### II\-ASystem Model

As shown in Fig\.[2](https://arxiv.org/html/2608.13863#S2.F2), we consider an edge intelligence system consisting ofNNmobile devices and an edge server\. The set of all mobile devices is denoted as𝒩≜\{1,2,…,N\}\\mathcal\{N\}\\triangleq\\\{1,2,\\dots,N\\\}\. The orthogonal frequency division multiple access \(OFDMA\) technology is adopted to reduce the interference among mobile devices, and we assume that the bandwidth allocated to each device does not overlap\. Each device needs to execute DNN inference tasks within the given deadlineDnD\_\{n\}\. We consider the binary offloading mode \(i\.e\.,xn∈\{0,1\}x\_\{n\}\\in\\\{0,1\\\}\) in this work, where mobile devicenncan either execute local inference \(i\.e\.,xn=1x\_\{n\}=1\) or edge inference by offloading the inference task \(i\.e\.,xn=0x\_\{n\}=0\)\. For local inference, mobile devices can adjust the memory frequency and computing frequency to save the energy consumption of DNN inference with the deadline constraint\. For edge inference, mobile devices can change the transmission power to improve the transmission energy while meeting the communication latency constraint\. The edge inference time is negligible due to the powerful computing capacity of the MEC server, and the energy consumption of edge inference is ignored here because the MEC server is usually powered by the grid\[[16](https://arxiv.org/html/2608.13863#bib.bib16)\]\. In addition, the latency of downloading inference results is ignored due to their small data volume\[[17](https://arxiv.org/html/2608.13863#bib.bib17)\]\.

![Refer to caption](https://arxiv.org/html/2608.13863v1/SystemOverview_icc26.png)
Fig\. 2:Illustration of an edge intelligence system that jointly optimizes memory and computing frequencies, transmission power and bandwidth\.
### II\-BInference Time and Energy Consumption Model

We perform real\-world experiments to obtain the average inference time under different combinations of memory frequencies and computing frequencies\[[10](https://arxiv.org/html/2608.13863#bib.bib10)\], and the impact of memory frequencyfn,memf\_\{n,\\mathrm\{mem\}\}and computing frequencyfn,comf\_\{n,\\mathrm\{com\}\}on DNN inference time is formulated as

tnloc=an​fn,mem−bn\+cn​fn,com−dn,∀n∈𝒩,t\_\{n\}^\{\\mathrm\{loc\}\}=a\_\{n\}f\_\{n,\\mathrm\{mem\}\}^\{\-b\_\{n\}\}\+c\_\{n\}f\_\{n,\\mathrm\{com\}\}^\{\-d\_\{n\}\},\\forall n\\in\\mathcal\{N\},\(1\)The dynamic power consumption of CMOS circuit is denoted byP=α​C​V2​fP=\\alpha CV^\{2\}f, whereα\\alpha,CC,VVandffdenote the activity factor, the capacity, the supply voltage and the frequency, respectively\[[18](https://arxiv.org/html/2608.13863#bib.bib18)\]\. Since the power consumption consists of the memory and computing power\[[19](https://arxiv.org/html/2608.13863#bib.bib19)\], the power consumption of mobile devicennfor executing inference is written as

pnloc=κn,mem​fn,mem3\+κn,com​fn,com3\+σn,∀n∈𝒩,\\displaystyle p\_\{n\}^\{\\mathrm\{loc\}\}=\\kappa\_\{n,\\rm\{mem\}\}f\_\{n,\\rm\{mem\}\}^\{3\}\+\\kappa\_\{n,\\rm\{com\}\}f\_\{n,\\rm\{com\}\}^\{3\}\+\\sigma\_\{n\},\\forall n\\in\\mathcal\{N\},\(2\)where the details are given in\[[10](https://arxiv.org/html/2608.13863#bib.bib10)\]\. Therefore, the energy consumption of mobile devicennfor executing inference is

enloc=pnloc​tnloc,∀n∈𝒩\.\\displaystyle e\_\{n\}^\{\\mathrm\{loc\}\}=p\_\{n\}^\{\\mathrm\{loc\}\}t\_\{n\}^\{\\mathrm\{loc\}\},\\forall n\\in\\mathcal\{N\}\.\(3\)

### II\-CTransmission Time and Energy Consumption Model

The transmission rate of mobile devicenncan be written as

rn=Bn​log2⁡\(1\+pn​hnσ2\),∀n∈𝒩,\\displaystyle r\_\{n\}=B\_\{n\}\\log\_\{2\}\\left\(1\+\\frac\{p\_\{n\}h\_\{n\}\}\{\\sigma^\{2\}\}\\right\),\\forall n\\in\\mathcal\{N\},\(4\)whereBnB\_\{n\},pnp\_\{n\},hnh\_\{n\}andσ2\\sigma^\{2\}denote the allocated bandwidth, transmission power, channel gain and noise power, respectively\. Then, the transmission latency for task offloading of mobile devicenncan be written as

tntran=snrn,∀n∈𝒩,\\displaystyle t\_\{n\}^\{\\mathrm\{tran\}\}=\\frac\{s\_\{n\}\}\{r\_\{n\}\},\\forall n\\in\\mathcal\{N\},\(5\)wheresns\_\{n\}is the data volume of the computation task\. The corresponding energy consumption of transmission is

entran=pn​tntran,∀n∈𝒩\.\\displaystyle e\_\{n\}^\{\\mathrm\{tran\}\}=p\_\{n\}t\_\{n\}^\{\\mathrm\{tran\}\},\\forall n\\in\\mathcal\{N\}\.\(6\)

## IIIProblem Formulation and Solutions

We focus on minimizing the sum of the energy consumption of all mobile devices by optimizing the binary offloading decisionxnx\_\{n\}, transmission powerpnp\_\{n\}, bandwidthBnB\_\{n\}, memory frequencyfn,memf\_\{n,\\mathrm\{mem\}\}and computing frequencyfn,comf\_\{n,\\mathrm\{com\}\}, while the deadline constraint should be satisfied\. The optimization problem can be formulated as

P1:minxn,pn,Bn,fn,mem,fn,com∑n∈𝒩\(xnenloc\+\(1−xn\)entran\)\\displaystyle\\textbf\{P1:\}\\min\_\{x\_\{n\},p\_\{n\},B\_\{n\},f\_\{n,\\mathrm\{mem\}\},f\_\{n,\\mathrm\{com\}\}\}\\sum\_\{n\\in\\mathcal\{N\}\}\\left\(x\_\{n\}e\_\{n\}^\{\\mathrm\{loc\}\}\+\\left\(1\-x\_\{n\}\\right\)e\_\{n\}^\{\\mathrm\{tran\}\}\\right\)\(7a\)s\.t\.​xn​tnloc\+\(1−xn\)​tntran≤Dn,∀n∈𝒩,\\displaystyle\\ \\text\{s\.t\.\}\\,x\_\{n\}t\_\{n\}^\{\\mathrm\{loc\}\}\+\\left\(1\-x\_\{n\}\\right\)t\_\{n\}^\{\\mathrm\{tran\}\}\\leq D\_\{n\},\\forall n\\in\\mathcal\{N\},\(7b\)fn,min≤fn,mem≤fn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,f\_\{n,\\min\}\\leq f\_\{n,\\mathrm\{mem\}\}\\leq f\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(7c\)Fn,min≤fn,com≤Fn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,F\_\{n,\\min\}\\leq f\_\{n,\\mathrm\{com\}\}\\leq F\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(7d\)pn,min≤pn≤pn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,p\_\{n,\\min\}\\leq p\_\{n\}\\leq p\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(7e\)xn∈\{0,1\},∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,x\_\{n\}\\in\\\{0,1\\\},\\forall n\\in\\mathcal\{N\},\(7f\)∑n∈𝒩xn​Bn≤B,\\displaystyle\\ \\quad\\ \\,\\sum\_\{n\\in\\mathcal\{N\}\}x\_\{n\}B\_\{n\}\\leq B,\(7g\)Bn≥0,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,B\_\{n\}\\geq 0,\\forall n\\in\\mathcal\{N\},\(7h\)where \([7b](https://arxiv.org/html/2608.13863#S3.E7.2)\) is the deadline constraint, \([7c](https://arxiv.org/html/2608.13863#S3.E7.3)\) is the memory frequency constraint, \([7d](https://arxiv.org/html/2608.13863#S3.E7.4)\) is the computing frequency constraint, \([7e](https://arxiv.org/html/2608.13863#S3.E7.5)\) is the transmission power constraint, \([7f](https://arxiv.org/html/2608.13863#S3.E7.6)\) is the binary offloading decision constraint, \([7g](https://arxiv.org/html/2608.13863#S3.E7.7)\) and \([7h](https://arxiv.org/html/2608.13863#S3.E7.8)\) denote the bandwidth constraint, respectively\. Since the variablesxnx\_\{n\}are binary and coupled in the objective function, Problem P1 is a mixed\-integer nonlinear programming \(MINLP\) problem\. To simplify Problem P1, we first focus on the single\-user scenario\. An optimal solution is solved under specific conditions, while a near\-optimal closed\-form solution is derived for more general cases\. Moreover, for edge inference, we derive an optimal closed\-form solution for the transmission power with the given bandwidth\. Finally, we propose a heuristic algorithm to solve Problem P1, which greedily searches possible devices to execute edge inference\. The detailed analysis and solution are presented as follows\.

First, consider a special single\-user case of Problem P1, and the corresponding problem is formulated as

P2:minxn,pn,Bn,fn,mem,fn,comxnenloc\+\(1−xn\)entran\\displaystyle\\textbf\{P2:\}\\min\_\{x\_\{n\},p\_\{n\},B\_\{n\},f\_\{n,\\mathrm\{mem\}\},f\_\{n,\\mathrm\{com\}\}\}x\_\{n\}e\_\{n\}^\{\\mathrm\{loc\}\}\+\\left\(1\-x\_\{n\}\\right\)e\_\{n\}^\{\\mathrm\{tran\}\}\(8a\)s\.t\.​xn​tnloc\+\(1−xn\)​tntran≤Dn,∀n∈𝒩,\\displaystyle\\ \\text\{s\.t\.\}\\,x\_\{n\}t\_\{n\}^\{\\mathrm\{loc\}\}\+\\left\(1\-x\_\{n\}\\right\)t\_\{n\}^\{\\mathrm\{tran\}\}\\leq D\_\{n\},\\forall n\\in\\mathcal\{N\},\(8b\)fn,min≤fn,mem≤fn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,f\_\{n,\\min\}\\leq f\_\{n,\\mathrm\{mem\}\}\\leq f\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(8c\)Fn,min≤fn,com≤Fn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,F\_\{n,\\min\}\\leq f\_\{n,\\mathrm\{com\}\}\\leq F\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(8d\)pn,min≤pn≤pn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,p\_\{n,\\min\}\\leq p\_\{n\}\\leq p\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(8e\)xn∈\{0,1\},∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,x\_\{n\}\\in\\\{0,1\\\},\\forall n\\in\\mathcal\{N\},\(8f\)0≤Bn≤B,∀n∈𝒩\.\\displaystyle\\ \\quad\\ \\,0\\leq B\_\{n\}\\leq B,\\forall n\\in\\mathcal\{N\}\.\(8g\)We first consider the case where mobile devicennperforms local inference \(i\.e\.,xn=1x\_\{n\}=1\)\. Then, we can obtain the following optimization problem:

P3:minfn,mem,fn,comenloc\\displaystyle\\textbf\{P3:\}\\min\_\{f\_\{n,\\mathrm\{mem\}\},f\_\{n,\\mathrm\{com\}\}\}e\_\{n\}^\{\\mathrm\{loc\}\}\(9a\)s\.t\.​an​fn,mem−bn\+cn​fn,com−dn≤Dn,∀n∈𝒩,\\displaystyle\\ \\text\{s\.t\.\}\\,a\_\{n\}f\_\{n,\\mathrm\{mem\}\}^\{\-b\_\{n\}\}\+c\_\{n\}f\_\{n,\\mathrm\{com\}\}^\{\-d\_\{n\}\}\\leq D\_\{n\},\\forall n\\in\\mathcal\{N\},\(9b\)fn,min≤fn,mem≤fn,max,∀n∈𝒩,\\displaystyle\\ \\quad\\ \\,f\_\{n,\\min\}\\leq f\_\{n,\\mathrm\{mem\}\}\\leq f\_\{n,\\max\},\\forall n\\in\\mathcal\{N\},\(9c\)Fn,min≤fn,com≤Fn,max,∀n∈𝒩\.\\displaystyle\\ \\quad\\ \\,F\_\{n,\\min\}\\leq f\_\{n,\\mathrm\{com\}\}\\leq F\_\{n,\\max\},\\forall n\\in\\mathcal\{N\}\.\(9d\)Notice that the constraints \([9b](https://arxiv.org/html/2608.13863#S3.E9.2)\), \([9c](https://arxiv.org/html/2608.13863#S3.E9.3)\) and \([9d](https://arxiv.org/html/2608.13863#S3.E9.4)\) are convex, but the objective function is not always convex\. However, by simple computation, we can prove that the objective function of Problem P3 is convex if0≤bn≤20\\leq b\_\{n\}\\leq 2and0≤dn≤20\\leq d\_\{n\}\\leq 2\. In this specific case, Problem P3 is a standard convex optimization problem, and the optimal solutions can be solved by optimization tools \(e\.g\., CVX\[[20](https://arxiv.org/html/2608.13863#bib.bib20)\]\)\.

Moreover, we try to analyze Problem P3 and give a closed\-form solution under a general case\. Since the inference timetnt\_\{n\}should be no larger than the deadlineDnD\_\{n\}, the upper bound of the objective function \([9a](https://arxiv.org/html/2608.13863#S3.E9.1)\) is given by replacingtnt\_\{n\}withDnD\_\{n\}\. The corresponding optimization problem is formulated as

P4:minfn,mem,fn,com\(κn,memfn,mem3\+κn,comfn,com3\+σn\)Dn\\displaystyle\\textbf\{P4:\}\\min\_\{f\_\{n,\\mathrm\{mem\}\},f\_\{n,\\mathrm\{com\}\}\}\\left\(\\kappa\_\{n,\\mathrm\{mem\}\}f\_\{n,\\mathrm\{mem\}\}^\{3\}\+\\kappa\_\{n,\\mathrm\{com\}\}f\_\{n,\\mathrm\{com\}\}^\{3\}\+\\sigma\_\{n\}\\right\)D\_\{n\}\(10a\)s\.t\.​\([9b](https://arxiv.org/html/2608.13863#S3.E9.2)\),\([9c](https://arxiv.org/html/2608.13863#S3.E9.3)\),\([9d](https://arxiv.org/html/2608.13863#S3.E9.4)\),\\displaystyle\\ \\text\{s\.t\.\}\\,\(\\mathrm\{\\ref\{eq:Problem3b\}\}\),\(\\mathrm\{\\ref\{eq:Problem3c\}\}\),\(\\mathrm\{\\ref\{eq:Problem3d\}\}\),\(10b\)which is a standard convex optimization problem\. Based on the Karush\-Kuhn\-Tucker \(KKT\) conditions\[[21](https://arxiv.org/html/2608.13863#bib.bib21)\], we can derive the optimal closed\-form solutions to Problem P4\. The details are given in the following lemma\.

*Lemma 1:*The optimal memory frequency and computing frequency to Problem P4 are given by

fn,mem∗=max⁡\(fn,min,f~n,mem\),\\displaystyle f\_\{n,\\mathrm\{mem\}\}^\{\\ast\}=\\max\(f\_\{n,\\min\},\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}\),\(11\)fn,com∗=max⁡\(Fn,min,f~n,com\),\\displaystyle f\_\{n,\\mathrm\{com\}\}^\{\\ast\}=\\max\(F\_\{n,\\min\},\\tilde\{f\}\_\{n,\\mathrm\{com\}\}\),\(12\)wheref~n,mem\\tilde\{f\}\_\{n,\\mathrm\{mem\}\},f~n,com\\tilde\{f\}\_\{n,\\mathrm\{com\}\}and the Lagrange multiplierλ~n\\tilde\{\\lambda\}\_\{n\}should satisfy

f~n,mem=\(λ~n​an​bn3​Dn​κn,mem\)1bn\+3,\\displaystyle\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}=\\left\(\\frac\{\\tilde\{\\lambda\}\_\{n\}a\_\{n\}b\_\{n\}\}\{3D\_\{n\}\\kappa\_\{n,\\mathrm\{mem\}\}\}\\right\)^\{\\frac\{1\}\{b\_\{n\}\+3\}\},\(13\)f~n,com=\(λ~n​cn​dn3​Dn​κn,com\)1dn\+3,\\displaystyle\\tilde\{f\}\_\{n,\\mathrm\{com\}\}=\\left\(\\frac\{\\tilde\{\\lambda\}\_\{n\}c\_\{n\}d\_\{n\}\}\{3D\_\{n\}\\kappa\_\{n,\\mathrm\{com\}\}\}\\right\)^\{\\frac\{1\}\{d\_\{n\}\+3\}\},\(14\)an​f~n,mem−bn\+cn​f~n,com−dn=Dn\.\\displaystyle a\_\{n\}\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}^\{\-b\_\{n\}\}\+c\_\{n\}\\tilde\{f\}\_\{n,\\mathrm\{com\}\}^\{\-d\_\{n\}\}=D\_\{n\}\.\(15\)
###### Proof\.

Denoteλn≥0\\lambda\_\{n\}\\geq 0as the Lagrange multiplier, and the Lagrange function can be written as

L⁡\(fn,mem,fn,com,λn\)=\\displaystyle L\(f\_\{n,\\mathrm\{mem\}\},f\_\{n,\\mathrm\{com\}\},\\lambda\_\{n\}\)=\(κn,mem​fn,mem3\+κn,com​fn,com3\+σn\)​Dn\+\\displaystyle\\left\(\\kappa\_\{n,\\mathrm\{mem\}\}f\_\{n,\\mathrm\{mem\}\}^\{3\}\+\\kappa\_\{n,\\mathrm\{com\}\}f\_\{n,\\mathrm\{com\}\}^\{3\}\+\\sigma\_\{n\}\\right\)D\_\{n\}\+λn​\(an​fn,mem−bn\+cn​fn,com−dn−Dn\)\.\\displaystyle\\lambda\_\{n\}\\left\(a\_\{n\}f\_\{n,\\mathrm\{mem\}\}^\{\-b\_\{n\}\}\+c\_\{n\}f\_\{n,\\mathrm\{com\}\}^\{\-d\_\{n\}\}\-D\_\{n\}\\right\)\.\(16\)Based on the KKT conditions, we have

∂L∂fn,mem\|f~n,mem=0,\\displaystyle\\frac\{\\partial L\}\{\\partial f\_\{n,\\mathrm\{mem\}\}\}\\Bigg\|\_\{\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}\}=0,\(17\)∂L∂fn,com\|f~n,com=0,\\displaystyle\\frac\{\\partial L\}\{\\partial f\_\{n,\\mathrm\{com\}\}\}\\Bigg\|\_\{\\tilde\{f\}\_\{n,\\mathrm\{com\}\}\}=0,\(18\)λ~n​\(an​f~n,mem−bn\+cn​f~n,com−dn−Dn\)=0\.\\displaystyle\\tilde\{\\lambda\}\_\{n\}\\left\(a\_\{n\}\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}^\{\-b\_\{n\}\}\+c\_\{n\}\\tilde\{f\}\_\{n,\\mathrm\{com\}\}^\{\-d\_\{n\}\}\-D\_\{n\}\\right\)=0\.\(19\)By simple computation, we can get \([13](https://arxiv.org/html/2608.13863#S3.E13)\) and \([14](https://arxiv.org/html/2608.13863#S3.E14)\)\. Since the frequency is positive, the Lagrange multiplier should satisfyλ~n\>0\\tilde\{\\lambda\}\_\{n\}\>0\. Combining with \([19](https://arxiv.org/html/2608.13863#S3.E19)\), we can get \([15](https://arxiv.org/html/2608.13863#S3.E15)\)\. Note that the left side of \([15](https://arxiv.org/html/2608.13863#S3.E15)\) is monotonically decreasing with the increasing ofλ~n\\tilde\{\\lambda\}\_\{n\}, there exists a unique solution for equation \([15](https://arxiv.org/html/2608.13863#S3.E15)\)\. In addition,f~n,mem\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}andf~n,com\\tilde\{f\}\_\{n,\\mathrm\{com\}\}should be in the feasible range, which means thatfn,mem∗f\_\{n,\\mathrm\{mem\}\}^\{\\ast\}\(fn,com∗f\_\{n,\\mathrm\{com\}\}^\{\\ast\}\) should take the larger one betweenfn,minf\_\{n,\\min\}\(Fn,minF\_\{n,\\min\}\) andf~n,mem\\tilde\{f\}\_\{n,\\mathrm\{mem\}\}\(f~n,com\\tilde\{f\}\_\{n,\\mathrm\{com\}\}\)\. Therefore, the optimal memory frequency and computing frequency are given by \([11](https://arxiv.org/html/2608.13863#S3.E11)\) and \([12](https://arxiv.org/html/2608.13863#S3.E12)\), respectively\. ∎

Subsequently, we focus on the optimization of transmission power with the given bandwidth whenxn=0x\_\{n\}=0, and the optimization problem is expressed as

P5:minpn⁡pn​snrn\\displaystyle\\min\_\{p\_\{n\}\}\\frac\{p\_\{n\}s\_\{n\}\}\{r\_\{n\}\}\(20a\)s\.t\.​snrn≤Dn,∀n∈𝒩,\\displaystyle\\ \\text\{s\.t\.\}\\,\\frac\{s\_\{n\}\}\{r\_\{n\}\}\\leq D\_\{n\},\\forall n\\in\\mathcal\{N\},\(20b\)pn,min≤pn≤pn,max,∀n∈𝒩\.\\displaystyle\\ \\quad\\ \\,p\_\{n,\\min\}\\leq p\_\{n\}\\leq p\_\{n,\\max\},\\forall n\\in\\mathcal\{N\}\.\(20c\)Although the constraint \([20b](https://arxiv.org/html/2608.13863#S3.E20.2)\) is convex, Problem P5 is not a convex optimization problem due to the non\-convexity of \([20a](https://arxiv.org/html/2608.13863#S3.E20.1)\)\. However, the objective function of Problem P5 is a monotonically increasing function of transmission powerpnp\_\{n\}\. Based on this observation, we can give an optimal closed\-form solution, and the details are shown as follows\.

*Lemma 2:*The optimal transmission power for Problem P5 is given by

pn∗=max⁡\(pn,min,p~n\),p\_\{n\}^\{\\ast\}=\\max\(p\_\{n,\\min\},\\tilde\{p\}\_\{n\}\),\(21\)where

p~n=\(2snbn​Dn−1\)​σ2hn\.\\tilde\{p\}\_\{n\}=\\frac\{\\left\(2^\{\\frac\{s\_\{n\}\}\{b\_\{n\}D\_\{n\}\}\}\-1\\right\)\\sigma^\{2\}\}\{h\_\{n\}\}\.\(22\)
###### Proof\.

Denotef⁡\(pn\)=pn​snrnf\(p\_\{n\}\)=\\frac\{p\_\{n\}s\_\{n\}\}\{r\_\{n\}\}as the objective function of Problem P5, wherern=Bn​log2⁡\(1\+pn​hnσ2\)r\_\{n\}=B\_\{n\}\\log\_\{2\}\\left\(1\+\\frac\{p\_\{n\}h\_\{n\}\}\{\\sigma^\{2\}\}\\right\)\. Then, we have

∂f∂pn=sn​log⁡2Bn​log⁡\(1\+pn​hnσ2\)−pn​hnpn​hn\+σ2log2⁡\(1\+pn​hnσ2\)\.\\frac\{\\partial f\}\{\\partial p\_\{n\}\}=\\frac\{s\_\{n\}\\log 2\}\{B\_\{n\}\}\\frac\{\\log\\left\(1\+\\frac\{p\_\{n\}h\_\{n\}\}\{\\sigma^\{2\}\}\\right\)\-\\frac\{p\_\{n\}h\_\{n\}\}\{p\_\{n\}h\_\{n\}\+\\sigma^\{2\}\}\}\{\\log^\{2\}\\left\(1\+\\frac\{p\_\{n\}h\_\{n\}\}\{\\sigma^\{2\}\}\\right\)\}\.\(23\)Sincelog⁡\(11\+x\)≤11\+x−1\\log\(\\frac\{1\}\{1\+x\}\)\\leq\\frac\{1\}\{1\+x\}\-1, we getlog⁡\(1\+x\)≥x1\+x\\log\\left\(1\+x\\right\)\\geq\\frac\{x\}\{1\+x\}\. Letx=pn​hnσ2x=\\frac\{p\_\{n\}h\_\{n\}\}\{\\sigma^\{2\}\}, we can prove that∂f∂pn≥0\\frac\{\\partial f\}\{\\partial p\_\{n\}\}\\geq 0, which shows that \([20a](https://arxiv.org/html/2608.13863#S3.E20.1)\) monotonically increases withpnp\_\{n\}\. The optimal value of Problem P5 is achieved at the minimumpnp\_\{n\}in the feasible range\. The deadline constraint \([20b](https://arxiv.org/html/2608.13863#S3.E20.2)\) requires that the transmission power should be equal or greater thanp~n\\tilde\{p\}\_\{n\}\. In addition,pn∗p\_\{n\}^\{\\ast\}should satisfy the constraint \([20c](https://arxiv.org/html/2608.13863#S3.E20.3)\), taking the larger value betweenp~n\\tilde\{p\}\_\{n\}andpn,minp\_\{n,\\min\}\. Therefore,pn∗p\_\{n\}^\{\\ast\}is given by \([21](https://arxiv.org/html/2608.13863#S3.E21)\)\. ∎

Based on the above analysis, we propose a heuristic algorithm to effectively solve Problem P1\. In each iteration, the total bandwidth is equally allocated among all offloading devices, and the optimal transmission power is obtained by solving Problem P5\. If the maximum transmission power among these devices satisfies the available power budgetpn,maxp\_\{n,\\max\}, Algorithm 1 terminates and the corresponding resource allocation is determined\. Otherwise, the device requiring the highest transmission power is assigned to perform local inference, and the algorithm is repeated for the remaining devices\. The detailed procedure is summarized in Algorithm[1](https://arxiv.org/html/2608.13863#alg1)\. Since each iteration involves solving convex optimization problems and the maximum number of iterations isNN, our proposed algorithm can solve Problem P1 with polynomial computational complexity\.

Algorithm 1Heuristic Algorithm for Solving Problem P10:Total bandwidth

BB, number of devices

NN, deadline

DnD\_\{n\}, channel gain

\{hj\}j=1N\\\{h\_\{j\}\\\}\_\{j=1\}^\{N\}, power budget

\{pj,max\}j=1N\\\{p\_\{j,\\max\}\\\}\_\{j=1\}^\{N\};

0:Offloading policy

xnx\_\{n\}, transmission power

pnp\_\{n\}, bandwidth

BnB\_\{n\}, memory frequency

fn,memf\_\{n,\\mathrm\{mem\}\}, computing frequency

fn,comf\_\{n,\\mathrm\{com\}\};

1:Initialize

𝒰←\{1,2,…,N\}\\mathcal\{U\}\\leftarrow\\\{1,2,\\ldots,N\\\};

2:whiletruedo

3:

Nact←\|𝒰\|N\_\{\\mathrm\{act\}\}\\leftarrow\|\\mathcal\{U\}\|;

4:Equally allocate bandwidth

Bn=B/NactB\_\{n\}=B/N\_\{\\mathrm\{act\}\},

∀n∈𝒰\\forall n\\in\\mathcal\{U\};

5:Compute the optimal

pn∗p\_\{n\}^\{\\ast\}for each device based on Lemma 2;

6:Find the maximum

pth=maxj∈𝒰⁡pjp\_\{\\mathrm\{th\}\}=\\max\_\{j\\in\\mathcal\{U\}\}p\_\{j\}and corresponding device

j⋆j^\{\\star\};

7:if

pth≤pn,maxp\_\{\\mathrm\{th\}\}\\leq p\_\{n,\\max\}then

8:break// All devices satisfy the power budget

9:else

10:Remove device

j⋆j^\{\\star\}from

𝒰\\mathcal\{U\}; // Eliminate the infeasible device

11:Solve the near\-optimal

fn,mem∗f\_\{n,\\mathrm\{mem\}\}^\{\\ast\}and

fn,com∗f\_\{n,\\mathrm\{com\}\}^\{\\ast\}based on Lemma 1; // Execute local inference

12:endif

13:if

𝒰=∅\\mathcal\{U\}=\\emptysetthen

14:break// No feasible offloading solution

15:endif

16:endwhile

17:Return

𝒰\\mathcal\{U\},

pn∗p\_\{n\}^\{\\ast\},

BnB\_\{n\},

fn,mem∗f\_\{n,\\mathrm\{mem\}\}^\{\\ast\},

fn,com∗f\_\{n,\\mathrm\{com\}\}^\{\\ast\}\.

TABLE I:Parameters of DNNs and Devices\.
## IVSimulation Results

We assume that there areN=12N=12mobile devices in a square area of400​m×400​m400~\\mathrm\{m\}\\times 400~\\mathrm\{m\}, and the total bandwidth isB=20B=20MHz\. The 3GPP channel modelhn=38\+30​log10​lnh\_\{n\}=38\+30\\log\_\{10\}l\_\{n\}\[[22](https://arxiv.org/html/2608.13863#bib.bib22)\]is adopted here, wherelnl\_\{n\}\(in meters\) andhnh\_\{n\}\(in dB\) are the distance and path loss, respectively\. The transmission power range is\[0\.1,1\]\[0\.1,1\]W\. ResNet152 and VGG19 are deployed on Jetson TX1 to execute DNN inference on CIFAR\-100 dataset\[[23](https://arxiv.org/html/2608.13863#bib.bib23)\]\. The detailed parameters are shown in Table[I](https://arxiv.org/html/2608.13863#S3.T1)\.

Fig\.[3](https://arxiv.org/html/2608.13863#S4.F3)presents the total energy consumption of mobile devices for optimal and near\-optimal solutions under various deadlines for local inference on Jetson TX1 with ResNet152 and VGG19\. The upper bound is given by executing local inference with the maximum memory frequency and computing frequency\. When the deadline is relatively small, the near\-optimal solution can achieve the optimal performance\. In this case, the optimal energy consumption is achieved when the inference time is equal to the deadline\. However, as the deadline further increases, the performance gap increases\. For ResNet152 withDn=0\.32D\_\{n\}=0\.32s and VGG19 withDn=0\.22D\_\{n\}=0\.22s, the near\-optimal solution leads to2\.5%2\.5\\%and2\.3%2\.3\\%errors, respectively\. Therefore, the performance of near\-optimal solution is guaranteed when the deadline is relatively small, where we can obtain the optimal performance with lower computational complexity\. In addition, the energy consumption of near\-optimal solution does not exceed the upper bound under various deadlines, which further shows the effectiveness of our proposed near\-optimal solution\.

![Refer to caption](https://arxiv.org/html/2608.13863v1/Energy_Deadline_ResNet152andVGG19_ICC2026.png)
Fig\. 3:Comparison for the local energy consumption of optimal and near\-optimal solutions under different deadlines\.In Fig\.[4](https://arxiv.org/html/2608.13863#S4.F4), we evaluate the corresponding memory frequency and computing frequency for optimal and near\-optimal solutions under different deadlines for local inference\. It can be observed that the near\-optimal memory frequency and computing frequency decrease as the deadline increases, since expressions \([13](https://arxiv.org/html/2608.13863#S3.E13)\) and \([14](https://arxiv.org/html/2608.13863#S3.E14)\) monotonically decrease with the deadlineDnD\_\{n\}\. However, the optimal memory frequency and computing frequency do not decrease but remain constant when the deadline exceeds a threshold, which is consistent with the results shown in Fig\.[3](https://arxiv.org/html/2608.13863#S4.F3)\. In this range, the reduction in power consumption caused by the decrease of frequencies can not compensate for the increase of inference time\. Specifically, for ResNet152 withDn=0\.32D\_\{n\}=0\.32s and VGG19 withDn=0\.22D\_\{n\}=0\.22s, the gap between optimal and near\-optimal memory frequency is15\.4%15\.4\\%and13\.7%13\.7\\%, while the computing frequency gap is20\.3%20\.3\\%and16\.0%16\.0\\%, respectively\.

![Refer to caption](https://arxiv.org/html/2608.13863v1/Freq_ICC_1110_New.png)
Fig\. 4:Comparison for the memory frequency and computing frequency of optimal and near\-optimal solutions under different deadlines\.Finally, we evaluate our proposed Algorithm 1 under different bandwidth resources and device numbers\. For comparison, we consider the following three benchmarks\.

- •Random: Instead of removing the device with the maximum transmission power, randomly remove one device from the set𝒰\\mathcal\{U\}\.
- •Only Compute\[[24](https://arxiv.org/html/2608.13863#bib.bib24)\]: Instead of jointly optimizing the two frequencies, only the computing frequency is optimized in Algorithm 1\.
- •No DVFS: Instead of jointly optimizing the two frequencies, the memory frequency and computing frequency remain at the maximum values in Algorithm 1\.

In Fig\.[5](https://arxiv.org/html/2608.13863#S4.F5), we present the energy consumption for different solving policies\. As the total bandwidth increases, more tasks are offloaded from devices to the edge server, which leads to further improvement in energy consumption for all policies\. Compared with the Only Compute and No DVFS policies, our proposed Algorithm 1 can achieve average energy savings of3\.6%3\.6\\%and10\.4%10\.4\\%, respectively, demonstrating the advantage of jointly optimizing the memory and computing frequency\. Furthermore, the proposed algorithm significantly outperforms the Random policy, since it fails to effectively exploit the channel characteristics\. It is also observed that when the number of devices is small or the available bandwidth is sufficiently large, the performance gap among different policies becomes less pronounced\.

![Refer to caption](https://arxiv.org/html/2608.13863v1/Energy_Bandwidth_New_0402.png)
Fig\. 5:Energy consumption under various bandwidth resources and devices\.
## VConclusion

In this paper, we have studied the joint optimization of memory frequency, computing frequency, bandwidth and transmission power for energy\-efficient DNN inference\. By integrating analytical modeling for DNN inference time and convex optimization methods, we derive the optimal solution for the local inference problem under specific cases, and a near\-optimal closed\-form solution is derived for general cases\. With the given bandwidth, an optimal closed\-form solution for transmission power is derived for the edge inference problem\. Finally, a heuristic algorithm is proposed to solve the problem with low computational complexity\. Simulation results further verify the characteristics of analytical solutions, where the proposed near\-optimal solution can achieve optimal performance in specific cases, and the performance gap with the optimal solution is no more than2\.5%2\.5\\%\. Compared with other methods, our proposed algorithm can substantially reduce the energy consumption of mobile devices\.

## VIAcknowledgement

This work is supported in part by the Open Fund of State Key Laboratory of Intelligent Green Vehicle and Mobility, Tsinghua University, and in part by the State Key Laboratory of Internet of Things for Smart City \(University of Macau\) Open Research Project under Grant SKL\-IoTSC\(UM\)/ORP04/2026, and in part by the Project of Tsinghua University\-Toyota Joint Research Center for AI Technology of Automated Vehicle under Grant TTAD\-2025\-08\.

## References

- \[1\]W\. Liu, Z\. Wang, X\. Liu, N\. Zeng, Y\. Liu, and F\. E\. Alsaadi, “A survey of deep neural network architectures and their applications,”Neurocomputing, vol\. 234, pp\. 11–26, 2017\.
- \[2\]Z\. Cao et al\., “Edge\-cloud collaborated object detection via bandwidth adaptive difficult\-case discriminator,”IEEE Trans\. Mobile Comput\., vol\. 24, no\. 2, pp\. 1181\-1196, Feb\. 2025\.
- \[3\]Y\. Mao, C\. You, J\. Zhang, K\. Huang, and K\. B\. Letaief, “A survey on mobile edge computing: The communication perspective,”IEEE Commun\. Surveys Tuts\., vol\. 19, no\. 4, pp\. 2322\-2358, 4th Quart\., 2017\.
- \[4\]Z\. Zhou, X\. Chen, E\. Li, L\. Zeng, K\. Luo, and J\. Zhang, “Edge intelligence: Paving the last mile of artificial intelligence with edge computing,”Proc\. IEEE, vol\. 107, no\. 8, pp\. 1738\-1762, Aug\. 2019\.
- \[5\]Y\. Han, Z\. Nan, S\. Zhou, and Z\. Niu, “DVFS\-aware DNN inference on GPUs: Latency modeling and performance analysis,” inProc\. IEEE Int\. Conf\. Commun\. \(ICC\), Jun\. 2025, pp\. 1274\-1279\.
- \[6\]J\. M\. Rabaey, A\. P\. Chandrakasan, and B\. Nikolić,Digital Integrated Circuits: A Design Perspective, vol\. 7\. Upper Saddle River, NJ, USA: Pearson, 2003\.
- \[7\]Z\. Nan, Y\. Han, S\. Zhou, and Z\. Niu, “Robust DNN partitioning and resource allocation under uncertain inference time,”IEEE Trans\. Mobile Comput\., vol\. 25, no\. 3, pp\. 3680\-3696, Mar\. 2026\.
- \[8\]W\. Shi, S\. Zhou, Z\. Niu, M\. Jiang, and L\. Geng, “Multiuser co\-inference with batch processing capable edge server,”IEEE Trans\. Wireless Commun\., vol\. 22, no\. 1, pp\. 286\-300, Jan\. 2023\.
- \[9\]S\. M\. Nabavinejad, S\. Reda, and M\. Ebrahimi, “Coordinated batching and DVFS for DNN inference on GPU accelerators,”IEEE Trans\. Parallel Distrib\. Syst\., vol\. 33, no\. 10, pp\. 2496\-2508, Oct\. 2022\.
- \[10\]Y\. Han, Z\. Nan, S\. Zhou, and Z\. Niu, “Joint memory frequency and computing frequency scaling for energy\-efficient DNN inference,” inProc\. IEEE Global Commun\. Conf\. \(GLOBECOM\), Dec\. 2025, pp\. 6105\-6110\.
- \[11\]Z\. Zhang, Y\. Zhao, H\. Li, C\. Lin, and J\. Liu, “DVFO: Learning\-based DVFS for energy\-efficient edge\-cloud collaborative inference,”IEEE Trans\. Mobile Comput\., vol\. 23, no\. 10, pp\. 9042\-9059, Oct\. 2024\.
- \[12\]Q\. Wang and X\. Chu, “GPGPU performance estimation with core and memory frequency scaling,”IEEE Trans\. Parallel Distrib\. Syst\., vol\. 31, no\. 12, pp\. 2865\-2881, Dec\. 2020\.
- \[13\]B\. W\. Denkinger et al\., “Impact of memory voltage scaling on accuracy and resilience of deep learning based edge devices,”IEEE Des\. Test, vol\. 37, no\. 2, pp\. 84\-92, Apr\. 2020\.
- \[14\]K\. He, X\. Zhang, S\. Ren, and J\. Sun, “Deep residual learning for image recognition,” inProc\. IEEE Conf\. Comput\. Vis\. Pattern Recognit\. \(CVPR\), Jun\. 2016, pp\. 770\-778\.
- \[15\]K\. Simonyan and A\. Zisserman, “Very deep convolutional networks for large\-scale image recognition,” inProc\. 3rd Int\. Conf\. Learn\. Represent\. \(ICLR\), May 2015, pp\. 1\-14\.
- \[16\]T\. X\. Tran and D\. Pompili, “Joint task offloading and resource allocation for multi\-server mobile\-edge computing networks,”IEEE Trans\. Veh\. Technol\., vol\. 68, no\. 1, pp\. 856\-868, Jan\. 2019\.
- \[17\]Z\. Nan, Y\. Han, J\. Yan, S\. Zhou, and Z\. Niu, “Robust task offloading and resource allocation under imperfect computing capacity information in edge intelligence systems,”IEEE Trans\. Mobile Comput\., vol\. 24, no\. 7, pp\. 6154\-6167, Jul\. 2025\.
- \[18\]J\. Haj\-Yahya, A\. Mendelson, Y\. B\. Asher, and A\. Chattopadhyay,Energy Efficient High Performance Processors: Recent Approaches for Designing Green High Performance Computing\. New York, U\.S: Springer, 2018\.
- \[19\]J\. Guerreiro, A\. Ilic, N\. Roma, and P\. Tomás, “Modeling and decoupling the GPU power consumption for cross\-domain DVFS,”IEEE Trans\. Parallel Distrib\. Syst\., vol\. 30, no\. 11, pp\. 2494\-2506, Nov\. 2019\.
- \[20\]M\. Grant and S\. Boyd, “CVX: MATLAB software for disciplined convex programming,” Sep\. 2013, \[Online\]\. Available:http://cvxr\.com/cvx\.
- \[21\]S\. Boyd and L\. Vandenberghe,Convex Optimization\. Cambridge, U\.K\.: Cambridge Univ\. Press, 2004, pp\. 243–247\.
- \[22\]3GPP\. \(Apr\. 2022\)\.TR 36\.931: Radio Frequency \(RF\) Requirements for LTE Pico Node B\.Version 17\.0\.0\. Accessed: Oct\. 2025\. \[Online\]\. Available:https://portal\.3gpp\.org/desktopmodules/Specifications/SpecificationDetails\.aspx?specificationId=2589
- \[23\]A\. Krizhevsky, “Learning multiple layers of features from tiny images,” M\.S\. thesis, Univ\. Toronto, Toronto, ON, CA, 2009\.
- \[24\]Z\. Nan, S\. Zhou, Y\. Jia, and Z\. Niu, “Joint task offloading and resource allocation for vehicular edge computing with result feedback delay,”IEEE Trans\. Wireless Commun\., vol\. 22, no\. 10, pp\. 6547\-6561, Oct\. 2023\.

Similar Articles

Efficient On-Device Diffusion LLM Inference with Mobile NPU

arXiv cs.LG

This paper presents llada.cpp, an NPU-aware inference framework for accelerating diffusion large language models (dLLMs) on smartphones. It introduces three techniques—Multi-Block Speculative Decoding, Dual-Path Progressive Revision, and Swap-Optimized Memory Runtime—to align dLLM inference with mobile NPU characteristics, achieving 17-42x latency reduction over CPU baseline.