LAPSE:2023.14605
Published Article

LAPSE:2023.14605
Manual Operation Evaluation Based on Vectorized Spatio-Temporal Graph Convolutional for Virtual Reality Training in Smart Grid
March 1, 2023
Abstract
The standard of manual operation in smart grid, which require accurate manipulation, is high, especially in experimental, practice, and training systems based on virtual reality (VR). In the VR training system, data gloves are often used to obtain the accurate dataset of hand movements. Previous works rarely considered the multi-sensor datasets, which collected from the data gloves, to complete the action evaluation of VR training systems. In this paper, a vectorized graph convolutional deep learning model is proposed to evaluate the accuracy of test actions. First, the kernel of vectorized spatio-temporal graph convolutional of the data glove is constructed with different weights for different finger joints, and the data dimensionality reduction is also achieved. Then, different evaluation strategies are proposed for different actions. Finally, a convolution deep learning network for vectorized spatio-temporal graph is built to obtain the similarity between test actions and standard ones. The evaluation results of the proposed algorithm are compared with the subjective ones labeled by experts. The experimental results verify that the proposed action evaluation method based on the vectorized spatio-temporal graph convolutional is efficient for the manual operation accuracy evaluation in VR training systems of smart grids.
The standard of manual operation in smart grid, which require accurate manipulation, is high, especially in experimental, practice, and training systems based on virtual reality (VR). In the VR training system, data gloves are often used to obtain the accurate dataset of hand movements. Previous works rarely considered the multi-sensor datasets, which collected from the data gloves, to complete the action evaluation of VR training systems. In this paper, a vectorized graph convolutional deep learning model is proposed to evaluate the accuracy of test actions. First, the kernel of vectorized spatio-temporal graph convolutional of the data glove is constructed with different weights for different finger joints, and the data dimensionality reduction is also achieved. Then, different evaluation strategies are proposed for different actions. Finally, a convolution deep learning network for vectorized spatio-temporal graph is built to obtain the similarity between test actions and standard ones. The evaluation results of the proposed algorithm are compared with the subjective ones labeled by experts. The experimental results verify that the proposed action evaluation method based on the vectorized spatio-temporal graph convolutional is efficient for the manual operation accuracy evaluation in VR training systems of smart grids.
Record ID
Keywords
graph convolutional neural network, manual operation accuracy evaluation, virtual reality
Suggested Citation
He F, Liu Y, Zhan W, Xu Q, Chen X. Manual Operation Evaluation Based on Vectorized Spatio-Temporal Graph Convolutional for Virtual Reality Training in Smart Grid. (2023). LAPSE:2023.14605
Author Affiliations
He F: School of Art and Design, Wuhan Polytechnic University, Wuhan 430023, China; School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Liu Y: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Zhan W: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Xu Q: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Chen X: School of Art and Media, China University of Geosciences, Wuhan 430074, China
Liu Y: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Zhan W: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Xu Q: School of Mechanical Engineering and Electronic Information, China University of Geosciences, Wuhan 430074, China
Chen X: School of Art and Media, China University of Geosciences, Wuhan 430074, China
Journal Name
Energies
Volume
15
Issue
6
First Page
2071
Year
2022
Publication Date
2022-03-11
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15062071, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.14605
This Record
External Link

https://doi.org/10.3390/en15062071
Publisher Version
Download
Meta
Record Statistics
Record Views
192
Version History
[v1] (Original Submission)
Mar 1, 2023
Verified by curator on
Mar 1, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
https://psecommunity.org/LAPSE:2023.14605
Record Owner
Auto Uploader for LAPSE
Links to Related Works
[0.4 s]
