LAPSE:2023.4401
Published Article

LAPSE:2023.4401
Joint Power and Channel Optimization of Agricultural Wireless Sensor Networks Based on Hybrid Deep Reinforcement Learning
February 23, 2023
Abstract
The reduction of maintenance costs in agricultural wireless sensor networks (WSNs) requires reducing energy consumption. At the same time, care should be taken not to affect communication quality and network lifetime. This paper studies a joint optimization algorithm for transmitted power and channel allocation based on deep reinforcement learning. First, an optimization model to measure network reward was established under the constraint of the signal-to-interference plus-noise-ratio (SINR) threshold, which includes continuous power variables and discrete channel variables. Secondly, considering the dynamic changes of agricultural WSNs, the network control is described as a Markov decision process with continuous state and action space. A deep deterministic policy gradient (DDPG) reinforcement learning scheme suitable for mixed variables was designed. This method could obtain a control scheme that maximizes network reward by means of black-box optimization for continuous transmitted power and discrete channel allocation. Experimental results indicated that the studied algorithm has stable convergence. Compared with traditional protocols, it can better control the transmitted power and allocate channels. The joint power and channel optimization provides a reference solution for constructing an energy-balanced network.
The reduction of maintenance costs in agricultural wireless sensor networks (WSNs) requires reducing energy consumption. At the same time, care should be taken not to affect communication quality and network lifetime. This paper studies a joint optimization algorithm for transmitted power and channel allocation based on deep reinforcement learning. First, an optimization model to measure network reward was established under the constraint of the signal-to-interference plus-noise-ratio (SINR) threshold, which includes continuous power variables and discrete channel variables. Secondly, considering the dynamic changes of agricultural WSNs, the network control is described as a Markov decision process with continuous state and action space. A deep deterministic policy gradient (DDPG) reinforcement learning scheme suitable for mixed variables was designed. This method could obtain a control scheme that maximizes network reward by means of black-box optimization for continuous transmitted power and discrete channel allocation. Experimental results indicated that the studied algorithm has stable convergence. Compared with traditional protocols, it can better control the transmitted power and allocate channels. The joint power and channel optimization provides a reference solution for constructing an energy-balanced network.
Record ID
Keywords
channel allocation, DDPG, mixed variable, power control
Suggested Citation
Han X, Wu H, Zhu H, Chen C. Joint Power and Channel Optimization of Agricultural Wireless Sensor Networks Based on Hybrid Deep Reinforcement Learning. (2023). LAPSE:2023.4401
Author Affiliations
Han X: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Wu H: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Zhu H: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Chen C: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Wu H: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Zhu H: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Chen C: National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China; Information Technology Research Center, Beijing Academy of Agriculture and Forestry Sciences, Beijing 100097, China; Key Laboratory of Agri-Informatics,
Journal Name
Processes
Volume
9
Issue
11
First Page
1919
Year
2021
Publication Date
2021-10-27
ISSN
2227-9717
Version Comments
Original Submission
Other Meta
PII: pr9111919, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.4401
This Record
External Link

https://doi.org/10.3390/pr9111919
Publisher Version
Download
Meta
Record Statistics
Record Views
368
Version History
[v1] (Original Submission)
Feb 23, 2023
Verified by curator on
Feb 23, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.4401
Record Owner
Auto Uploader for LAPSE
Links to Related Works
(0.1 seconds)
[0.11 s]
