Application of Data Analytics for Defect Detection in Power Systems
The characterizations of big data, smart grids as well as huge amount of data collection are firstly discussed as a prelude to illustrating the motivation and potential advantages of implementing advanced data analytics in smart grids.
Based on a comprehensive study of power system and Big Data, several challenges are summarized to unlock the potential of Big Data technology in the application of smart grid. This paper proposed a modified and optimized structure of the Big Data processing platform according to the power data sources and different structures. Numerous open-sourced Big Data analytical tools and software are integrated as modules of the analytic engine, and self-developed advanced algorithms are also designed. The proposed framework comprises a data interface, a Big Data management, analytic engine as well as the applications, and display module.
New forms of methods and technologies are required to analyse and process these data. This need has motivated the development of Big Data analytics in this thesis. To cite (Jagadish et al. 2014): “While the potential benefits of Big Data are real and significant, and some initial successes have already been achieved, there remain many technical challenges that must be addressed to fully realize this potential.”
Future research directions are also discussed to better facilitate the transition of DL
Zhang, L., Lin, J. and Karim, R., 2015. An Angle-based Subspace Anomaly Detection Approach to High-dimensional Data: With an Application to Industrial Fault Detection. Reliability Engineering & System Safety, 142, pp.482-497.
Levrat, E., Iung, B. & Marquez, A.C., 2008. E-maintenance: review and conceptual framework. Production Planning & Control, 19(4), pp.408–429.
Kriegel, H.-P. & Zimek, A., 2008. Angle-based outlier detection in high-dimensional data. Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining, pp.444–452.
Zhang, L., Lin, J. and Karim, R., 2016. Sliding Window-based Fault Detection from High-dimensional Data Streams. IEEE Transactions on Systems, Man, and Cybernetics: System, Published online.
Zhang, L., Lin, J. and Karim, R., 2016. Adaptive Kernel Density-based Anomaly Detection for Nonlinear Systems.