LAPSE:2023.13081
Published Article

LAPSE:2023.13081
Self-Supervised Railway Surface Defect Detection with Defect Removal Variational Autoencoders
February 28, 2023
Abstract
In railway surface defect detection applications, supervised deep learning methods suffer from the problems of insufficient defect samples and an imbalance between positive and negative samples. To overcome these problems, we propose a lightweight two-stage architecture including the railway cropping network (RC-Net) and defects removal variational autoencoder (DR-VAE), which requires only normal samples for training to achieve defect detection. First, we design a simple and effective RC-Net to extract railway surfaces accurately from railway inspection images. Second, the DR-VAE is proposed for background reconstruction of railway surface images to detect defects by self-supervised learning. Specifically, during the training process, DR-VAE contains a defect random mask module (D-RM) to generate self-supervised signals and uses a structural similarity index measure (SSIM) as pixel loss. In addition, the decoder of DR-VAE also acts as a discriminator to implement introspective adversarial training. In the inference stage, we reduce the random error of reconstruction by introducing a distribution capacity attenuation factor, and finally use the residuals of the original and reconstructed images to achieve segmentation of the defects. The experiments, including core parameter exploration and comparison with other models, indicate that the model can achieve a high detection accuracy.
In railway surface defect detection applications, supervised deep learning methods suffer from the problems of insufficient defect samples and an imbalance between positive and negative samples. To overcome these problems, we propose a lightweight two-stage architecture including the railway cropping network (RC-Net) and defects removal variational autoencoder (DR-VAE), which requires only normal samples for training to achieve defect detection. First, we design a simple and effective RC-Net to extract railway surfaces accurately from railway inspection images. Second, the DR-VAE is proposed for background reconstruction of railway surface images to detect defects by self-supervised learning. Specifically, during the training process, DR-VAE contains a defect random mask module (D-RM) to generate self-supervised signals and uses a structural similarity index measure (SSIM) as pixel loss. In addition, the decoder of DR-VAE also acts as a discriminator to implement introspective adversarial training. In the inference stage, we reduce the random error of reconstruction by introducing a distribution capacity attenuation factor, and finally use the residuals of the original and reconstructed images to achieve segmentation of the defects. The experiments, including core parameter exploration and comparison with other models, indicate that the model can achieve a high detection accuracy.
Record ID
Keywords
background reconstruction, defects removal variational autoencoder, rail surface defects, self-supervised learning
Subject
Suggested Citation
Min Y, Li Y. Self-Supervised Railway Surface Defect Detection with Defect Removal Variational Autoencoders. (2023). LAPSE:2023.13081
Author Affiliations
Min Y: School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China [ORCID]
Li Y: School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
Li Y: School of Automation and Electrical Engineering, Lanzhou Jiaotong University, Lanzhou 730070, China
Journal Name
Energies
Volume
15
Issue
10
First Page
3592
Year
2022
Publication Date
2022-05-13
ISSN
1996-1073
Version Comments
Original Submission
Other Meta
PII: en15103592, Publication Type: Journal Article
Record Map
Published Article

LAPSE:2023.13081
This Record
External Link

https://doi.org/10.3390/en15103592
Publisher Version
Download
Meta
Record Statistics
Record Views
171
Version History
[v1] (Original Submission)
Feb 28, 2023
Verified by curator on
Feb 28, 2023
This Version Number
v1
Citations
Most Recent
This Version
URL Here
http://psecommunity.org/LAPSE:2023.13081
Record Owner
Auto Uploader for LAPSE
Links to Related Works
