LAPSE:2023.7462
Published Article

LAPSE:2023.7462
ECViST: Mine Intelligent Monitoring Based on Edge Computing and Vision Swin Transformer-YOLOv5
February 24, 2023
Abstract
Mine video surveillance has a key role in ensuring the production safety of intelligent mining. However, existing mine intelligent monitoring technology mainly processes the video data in the cloud, which has problems, such as network congestion, large memory consumption, and untimely response to regional emergencies. In this paper, we address these limitations by utilizing the edge-cloud collaborative optimization framework. First, we obtained a coarse model using the edge-cloud collaborative architecture and updated this to realize the continuous improvement of the detection model. Second, we further proposed a target detection model based on the Vision Swin Transformer-YOLOv5(ViST-YOLOv5) algorithm and improved the model for edge device deployment. The experimental results showed that the object detection model based on ViST-YOLOv5, with a model size of only 27.057 MB, improved the average detection accuracy is by 25% compared to the state-of-the-art model, which makes it suitable for edge-end deployment in mining workface. For the actual mine surveillance video, the edge-cloud collaborative architecture can achieve better performance and robustness in typical application scenarios, such as weak lighting and occlusion, which verifies the feasibility of the designed architecture.
Mine video surveillance has a key role in ensuring the production safety of intelligent mining. However, existing mine intelligent monitoring technology mainly processes the video data in the cloud, which has problems, such as network congestion, large memory consumption, and untimely response to regional emergencies. In this paper, we address these limitations by utilizing the edge-cloud collaborative optimization framework. First, we obtained a coarse model using the edge-cloud collaborative architecture and updated this to realize the continuous improvement of the detection model. Second, we further proposed a target detection model based on the Vision Swin Transformer-YOLOv5(ViST-YOLOv5) algorithm and improved the model for edge device deployment. The experimental results showed that the object detection model based on ViST-YOLOv5, with a model size of only 27.057 MB, improved the average detection accuracy is by 25% compared to the state-of-the-art model, which makes it suitable for edge-end deployment in mining workface. For the actual mine surveillance video, the edge-cloud collaborative architecture can achieve better performance and robustness in typical application scenarios, such as weak lighting and occlusion, which verifies the feasibility of the designed architecture.
Record ID
Keywords
edge-cloud collaboration, mine intelligent monitoring, object detection, vision swin transformer, YOLOv5
Subject
Suggested Citation
Zhang F, Tian J, Wang J, Liu G, Liu Y. ECViST: Mine Intelligent Monitoring Based on Edge Computing and Vision Swin Transformer-YOLOv5. (2023). LAPSE:2023.7462
Author Affiliations
Zhang F: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China; Key Laboratory of Intelligent Mining and Robotics, Ministry of Emergency Management of China, Beijing 100083, China; Institute of [ORCID]
Tian J: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Wang J: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Liu G: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Liu Y: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Tian J: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Wang J: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Liu G: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Liu Y: School of Mechanical Electronic & Information Engineering, China University of Mining and Technology, Beijing 100083, China
Journal Name
Energies
Volume
15
Issue
23
First Page
9015
Year
2022
Publication Date
2022-11-29
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15239015, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.7462
This Record
External Link

https://doi.org/10.3390/en15239015
Publisher Version
Download
Meta
Record Statistics
Record Views
208
Version History
[v1] (Original Submission)
Feb 24, 2023
Verified by curator on
Feb 24, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.7462
Record Owner
Auto Uploader for LAPSE
Links to Related Works
