Multi-fault recognition of air data system based on multi-head self-attention mechanism
1. Vocational and Technical Institute, Civil Aviation University of China, Tianjin 300300, China; 2. College of Electronic Information and Automation, Civil Aviation University of China, Tianjin 300300, China
Abstract:To solve the problems of strong time-varying, multiple types, complex faults in the air data, a fault diagnosis method was proposed based on the multi-head self-attention mechanism. The long short term memory (LSTM) was used to extract the time domain features of the faulty data, and the multi-head self-attention (MSA) was combined to extract the spatial location features between different types of data. The multilayer perceptron (MLP) was used to improve the generalization ability of the model, and the troubleshooting process was given. By the method, the fault mutual judgements between different types of data were obtained to realize multiple fault identification, and the method was fully verified by the atmospheric data. The experimental setup was given, and the grid search method with k-fold cross-validation was used to determine the optimal model parameters. To verify the performance of LSTM-MSA model, four deep learning models of MSA-LSTM, LSTM-MSA-P, LSTM-CNN and RNN-MSA were constructed for comparison experiments. To verify whether the diagnostic model can pinpoint faults, the fault classification confusion matrix was constructed using the predicted and true labels of the validation set. To further verify the diagnostic capability of the method, the visualization experiments were conducted based on t-SNE. The results show that the fault recognition accuracy of the proposed method is 96.696% with F1 of 96.777%, and the misclassification rates of all kinds of faults are controlled below 10%, which illuminates that the diagnosis model has high robustness.
王力1, 金辉2. 基于多头自注意力机制的大气数据系统多故障识别[J]. 江苏大学学报(自然科学版), 2023, 44(4): 444-451.
WANG Li1, JIN Hui2. Multi-fault recognition of air data system based on multi-head self-attention mechanism [J]. Journal of Jiangsu University(Natural Science Eidtion)
, 2023, 44(4): 444-451.
LU H T, WANG Z L.Development review of integrated avionics prognostics and health management technology[J]. Electronics Optics and Control,2015,22(8):60-65,86.(in Chinese)
[2]
YAN H M, MU H N, YI X J, et al. Fault diagnosis of wind turbine based on PCA and GSA-SVM[C]∥Proceedings of the 2019 Prognostics and System Health Management Conference. Piscataway: IEEE. 2019:13-17.
[3]
INTURI V, PRATYUSH A S, SABAREESH G R. Detection of local gear tooth defects on a multistage gearbox operating under fluctuating speeds using DWT and EMD analysis[J]. Arabian Journal for Science and Enginee-ring, DOI:10.1007/s13369-021-05807-0.
[4]
CHEN R X, HUANG X, YANG L X, et al. Intelligent fault diagnosis method of planetary gearboxes based on convolution neural network and discrete wavelet transform[J].Computers in Industry, 2019, 106:48-59.
[5]
ZHANG K, SU J P, SUN S A, et al. Compressor fault diagnosis system based on PCA-PSO-LSSVM algorithm[J]. Science Progress, DOI:10.1177/00368504211026110.
[6]
TANG H, YUAN Z X, DAI H L, et al. Fault diagnosis of rolling bearing based on probability box theory and GA-SVM[J]. IEEE Access, DOI:10.1109/ACCESS.2020.3024792.
[7]
YU L, QU J L, GAO F, et al. A novel hierarchical algorithm for bearing fault diagnosis based on stacked LSTM[J]. Shock and Vibration, DOI:10.1155/2019/2756284.
NIU Q, LIU Z Y, CHU J C, et al. Simulation system datas fault diagnosis based on long short-term memory network[J]. Journal of Detection & Control, 2019,41(5):25-29. (in Chinese)
YU Z K, WANG J F, TANG B H, et al. Research on the classification of cyber threat intelligence techniques and tactics based on attention mechanism and feature fusion[J]. Journal of Sichuan University (Natural Science Edition), DOI:10.19907/j.0490-6756.2022.053003. (in Chinese)
WANG Y Z, ZHAO W, XU H Y, et al. Multiple navigation sensor fault diagnose research based on multi-stage attention mechanism[J]. Acta Automatica Sinica, 2021, 47(12):2784-2790. (in Chinese)
WEN C L, LYU F Y, BAO Z J, et al. A review of data driven-based incipient fault diagnosis[J]. Acta Automatica Sinica, 2016, 42(9): 1285-1299. (in Chinese)
QIU Y X, CAI Y, CHEN L, et al. Multidimensional time series analysis based on autoregressive neural network[J]. Journal of Jilin University (Science Edition), 2022,60(5): 1143-1152. (in Chinese)
[14]
MENG Z, TIAN S W, YU L, et al. Joint extraction of entities and relations based on character graph convolutional network and multi-head self-attention mechanism[J]. Journal of Experimental & Theoretical Artificial Intelligence, DOI: 10.1080/0952813X.2020.1744198.
KONG Z Q, DENG L, TANG B P, et al. Fault diagnosis of planetary gearbox based on deep learning with time-frequency fusion and attention mechanism[J]. Chinese Journal of Scientific Instrument, 2019,40(6):221-227. (in Chinese)