Skip to main content

Semi-supervised Learning Enabled Fault Analysis Method for Power Distribution Network Based on LSTM Autoencoder and Attention Mechanism

  • Conference paper
  • First Online:
Big Data and Security (ICBDS 2022)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1796))

Included in the following conference series:

  • 486 Accesses

Abstract

By upgrading the existing distribution network fault statistical analysis system of Shanghai Institute of Electrical Science and Technology, comprehensive research is needed to investigate the hardware configuration and system functions of the system, optimize the system structure, meet the needs of the company’s distribution network business department, and provide strong support for the daily operation and management of the distribution network. In this paper, we present a semi-supervised learning enabled fault analysis method for power distribution network based on LSTM autoencoder and attention mechanism. We make the LSTM autoencoder’s loss function more robust so that it may be affected by both labeled and unlabeled input. Next, by minimizing the loss function, we can learn how the distribution of both types of data is distributed. We also added an attention mechanism to make the model performance more stable as the weight of the marked data changes. We apply the improved experience of LSTM autoencoder to the LSTM prediction model and realize the LSTM prediction model under semi-supervised learning. The proposed algorithm can effectively solve the problems of strong dependence of time series data and high cost of marking, so as to obtain better fault detection results of power distribution network.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Chandola, V., Banerjee, A., Kumar, V.: Anomaly detection: a survey. ACM Comput. Surv. 41(3), 1–58 (2009)

    Article  Google Scholar 

  2. Cook, A., Misirli, G., Fan, Z.: Anomaly detection for IoT time-series data: a survey. IEEE Internet Things J. 7(7), 6481–6494 (2019)

    Article  Google Scholar 

  3. Ian, G., Yoshua, B., Aaron, C.: Deep Learning. The MIT Press (2016)

    Google Scholar 

  4. Kim, J., Kim, J., Thu, H.L.T., et al.: Long short term memory recurrent neural network classifier for intrusion detection. In: 2016 International Conference on Platform Technology and Service (PlatCon), pp. 1–5. IEEE (2016)

    Google Scholar 

  5. Malhotra, P., Vig, L., Shroff, G., et al.: Long short term memory networks for anomaly detection in time series. In: Proceedings, vol. 89, pp. 89-94. Presses universitaires de Louvain (2015)

    Google Scholar 

  6. Fox, A.J.: Outliers in time series. J. Roy. Stat. Soc.: Ser. B (Methodol.) 34(3), 350–363 (1972)

    MathSciNet  MATH  Google Scholar 

  7. Burman, J P., Otto, M.C.: Census bureau research project: Outliers in time series. Bureau of the Census, SRD Res. Rep. CENSUS/SRD/RR-88114 (1988)

    Google Scholar 

  8. Vallis, O., Hochenbaum, J., Kejariwal, A.: A novel technique for long-term anomaly detection in the cloud. 6th {USENIX} workshop on hot topics in cloud computing (HotCloud 14) (2014)

    Google Scholar 

  9. Wold, H.: A Study in the Analysis of Stationary Time Series. Almqvist & Wiksell (1938)

    Google Scholar 

  10. Kadri, F., Harrou, F., Chaabane, S., et al.: Seasonal ARMA-based SPC charts for anomaly detection: application to emergency department systems. Neurocomputing 173, 2102–2114 (2016)

    Article  Google Scholar 

  11. Zhang, G.P., Qi, M.: Neural network forecasting for seasonal and trend time series. Eur. J. Oper. Res. 160(2), 501–514 (2005)

    Article  MATH  Google Scholar 

  12. Chou, J.S., Telaga, A.S.: Real-time detection of anomalous power consumption. Renew. Sustain. Energy Rev. 33, 400–411 (2014)

    Article  Google Scholar 

  13. Fu, R., Zhang, Z., Li, L.: Using LSTM and GRU neural network methods for traffic flow prediction. In: 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC), pp. 324–328. IEEE (2016)

    Google Scholar 

  14. Shipmon, D.T., Gurevitch, J.M., Piselli, P.M., et al.: Time series anomaly detection; detection of anomalous drops with limited features and sparse examples in noisy highly periodic data. arXiv preprint arXiv:1708.03665 (2017)

  15. Saurav, S., et al.: Online anomaly detection with concept drift adaptation using recurrent neural networks. In: Proceedings of the ACM India Joint International Conference on Data Science and Management of Data, pp. 78–87 (2018)

    Google Scholar 

  16. Xie, X., Wu, D., Liu, S., et al.: IoT data analytics using deep learning. arXiv preprint arXiv:1708.03854 (2017)

  17. Bontemps, L., McDermott, J., Le-Khac, N.A.: Collective anomaly detection based on long short-term memory recurrent neural networks. In: International Conference on Future Data and Security Engineering, pp. 141-152. Springer, Cham (2016)

    Google Scholar 

  18. Hundman, K., Constantinou, V., Laporte, C., et al.: Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. In: Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 387–395 (2018)

    Google Scholar 

  19. Luo, T., Nagarajan, S.G.: Distributed anomaly detection using autoencoder neural networks in wsn for iot. In: 2018 IEEE International Conference on Communications (ICC), pp. 1–6. IEEE (2018)

    Google Scholar 

  20. Wang, W., Zhu, M., Wang, J., et al.: End-to-end encrypted traffic classification with one-dimensional convolution neural networks. In: 2017 IEEE International Conference on Intelligence and Security Informatics (ISI), pp. 43–48. IEEE (2017)

    Google Scholar 

  21. Liu, C.L., Hsaio, W.H., Tu, Y.C.: Time series classification with multivariate convolutional neural network. IEEE Trans. Industr. Electron. 66(6), 4788–4797 (2018)

    Article  Google Scholar 

  22. Kim, T.Y., Cho, S.B.: Web traffic anomaly detection using C-LSTM neural networks. Expert Syst. Appl. 106, 66–76 (2018)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Haining Xie .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Xie, H., Zhuang, L., Wang, X. (2023). Semi-supervised Learning Enabled Fault Analysis Method for Power Distribution Network Based on LSTM Autoencoder and Attention Mechanism. In: Tian, Y., Ma, T., Jiang, Q., Liu, Q., Khan, M.K. (eds) Big Data and Security. ICBDS 2022. Communications in Computer and Information Science, vol 1796. Springer, Singapore. https://doi.org/10.1007/978-981-99-3300-6_18

Download citation

  • DOI: https://doi.org/10.1007/978-981-99-3300-6_18

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-99-3299-3

  • Online ISBN: 978-981-99-3300-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics