[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3538637.3538851acmconferencesArticle/Chapter ViewAbstractPublication Pagese-energyConference Proceedingsconference-collections
research-article
Open access

Enhancing anomaly detection methods for energy time series using latent space data representations

Published: 28 June 2022 Publication History

Abstract

The increasing number of recorded energy time series calls for an automated operation of smart grid applications such as load forecasting and load management. While these applications require anomaly-free data to perform well, the recorded data often contains anomalies. The numerous methods to detect these anomalies are typically applied directly to the recorded data. However, for other tasks such as forecasting, promising performance has been achieved when directly applying methods to a meaningful feature space of the data, i.e., the latent space data representation. We, therefore, propose a novel approach to generally enhance anomaly detection methods for energy time series by taking advantage of their latent space representation. We create latent space data representations using a conditional Invertible Neural Network (cINN) and a conditional Variational Autoencoder (cVAE) and directly apply existing supervised and unsupervised detection methods to this representation. We evaluate the latent space data representation qualitatively by visualizing the separation of anomalies and non-anomalous data. We also quantitatively evaluate our approach by applying supervised and unsupervised detection methods to real-world load data containing two groups of artificially inserted anomalies: technical faults and unusual consumption. We show that our approach generally improves the anomaly detection performance of the considered methods while only moderately increasing computational cost.

References

[1]
Damminda Alahakoon and Xinghuo Yu. 2016. Smart Electricity Meter Data Intelligence for Future Energy Systems: A Survey. IEEE Transactions on Industrial Informatics 12, 1 (2016), 425--436.
[2]
Lynton Ardizzone, Carsten Lüth, Jakob Kruse, Carsten Rother, and Ullrich Köthe. 2019. Guided Image Generation with Conditional Invertible Neural Networks. (2019). arXiv:1907.02392
[3]
Leo Breiman. 2001. Random Forests. Machine Learning 45, 1 (2001), 5--32.
[4]
Markus M Breunig, Hans-Peter Kriegel, Raymond T. Ng, and Jörg Sander. 2000. LOF: Identifying Density-Based Local Outliers. In Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data. ACM, 93--104.
[5]
Varun Chandola, Arindam Banerjee, and Vipin Kumar. 2009. Anomaly Detection: A Survey. Comput. Surveys 41, 3 (2009), 15:1--15:58.
[6]
Tianqi Chen and Carlos Guestrin. 2016. XGBoost: A Scalable Tree Boosting System. In Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. ACM, 785--794.
[7]
T. Cover and P. Hart. 1967. Nearest neighbor pattern classification. IEEE Transactions on Information Theory 13, 1 (1967), 21--27.
[8]
Dheeru Dua and Casey Graff. 2019. UCI Machine Learning Repository. http://archive.ics.uci.edu/ml
[9]
Trevor Hastie, Robert Tibshirani, and Jerome Friedman. 2009. The Elements of Statistical Learning (2 ed.). Springer, New York.
[10]
Benedikt Heidrich, Andreas Bartschat, Marian Turowski, Oliver Neumann, Kaleb Phipps, Stefan Meisenbacher, Kai Schmieder, Nicole Ludwig, Ralf Mikut, and Veit Hagenmeyer. 2021. pyWATTS: Python Workflow Automation Tool for Time Series. arXiv:2106.10157 (2021).
[11]
Benedikt Heidrich, Marian Turowski, Kaleb Phipps, Kai Schmieder, Wolfgang Süß, Ralf Mikut, and Veit Hagenmeyer. 2022. Controlling Non-Stationarity and Periodicities in Time Series Generation Using Conditional Invertible Neural Networks. Applied Intelligence (2022).
[12]
Yassine Himeur, Khalida Ghanem, Abdullah Alsalemi, Faycal Bensaali, and Abbes Amira. 2021. Artificial intelligence based anomaly detection of energy consumption in buildings: A review, current trends and new perspectives. Applied Energy 287 (2021), 116601.
[13]
Chia-Man Hung, Shaohong Zhong, Walter Goodwin, Oiwi Parker Jones, Martin Engelcke, Ioannis Havoutis, and Ingmar Posner. 2022. Reaching Through Latent Space: From Joint Statistics to Path Planning in Manipulation. IEEE Robotics and Automation Letters 7, 2 (2022), 5334--5341.
[14]
Jin-Young Kimand Sung-Bae Cho. 2021. Explainable prediction of electric energy demand using a deep autoencoder with interpretable latent space. Expert Systems with Applications 186 (2021), 115842.
[15]
Diederik P. Kingma and Jimmy Lei Ba. 2015. Adam: A Method for Stochastic Optimization. In 3rd International Conference on Learning Representations (ICLR 2015), Yoshua Bengio and Yann LeCun (Eds.). http://arxiv.org/abs/1412.6980
[16]
Diederik P. Kingma and Prafulla Dhariwal. 2018. Glow: Generative Flow with Invertible1x1 Convolutions. In Advances in Neural Information Processing Systems, S. Bengio, H. Wallach, H. Larochelle, K. Grauman, N. Cesa-Bianchi, and R. Garnett (Eds.), Vol. 31. 10215--10224. https://proceedings.neurips.cc/paper/2018/file/d139db6a236200b21cc7f752979132d0-Paper.pdf
[17]
Diederik P. Kingma and Max Welling. 2014. Auto-Encoding Variational Bayes. (2014). arXiv:1312.6114v10
[18]
S. Kullback and R. A. Leibler. 1951. On Information and Sufficiency. Annals of Mathematical Statistics 22, 1 (1951), 79--86.
[19]
K. Kutsuzawa, S. Sakaino, and T. Tsuji. 2019. Trajectory adjustment for nonprehensile manipulation using latent space of trained sequence-to-sequence model. Advanced Robotics 33, 21 (2019), 1144--1154.
[20]
Fangxing Li, Wei Qiao, Hongbin Sun, Hui Wan, Jianhui Wang, Yan Xia, Zhao Xu, and Pei Zhang. 2010. Smart Transmission Grid: Vision and Framework. IEEE Transactions on Smart Grid 1, 2 (2010), 168--177.
[21]
Fei Tony Liu, Kai Ming Ting, and Zhi-Hua Zhou. 2008. Isolation Forest. In 2008 Eighth IEEE International Conference on Data Mining. IEEE, 413--422.
[22]
Sachit Menon, Alexandru Damian, Shijia Hu, Nikhil Ravi, and Cynthia Rudin. 2020. PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Models. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2437--2445.
[23]
Tom Mitchell. 1997. Machine Learning. McGraw-Hill, New York.
[24]
Nam Nguyen and Brian Quanz. 2021. Temporal Latent Auto-Encoder: A Method for Probabilistic Multivariate Time Series Forecasting. In The Thirty-Fifth AAAI Conference on Artificial Intelligence (AAAI-21). 9117--9125. https://ojs.aaai.org/index.php/AAAI/article/view/17101/16908
[25]
Christian Nordahl, Marie Persson, and Håkan Grahn. 2017. Detection of residents' abnormal behaviour by analysing energy consumption of individual households. In 2017 IEEE International Conference on Data Mining Workshops (ICDMW). IEEE, 729--738.
[26]
Adam Paszke, Sam Gross, Francisco Massa, Adam Lerer, James Bradbury, Gregory Chanan, Trevor Killeen, Zeming Lin, Natalia Gimelshein, Luca Antiga, Alban Desmaison, Andreas Kopf, Edward Yang, Zachary DeVito, Martin Raison, Alykhan Tejani, Sasank Chilamkurthy, Benoit Steiner, Lu Fang, Junjie Bai, and Soumith Chintala. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, H. Wallach, H. Larochelle, A. Beygelzimer, F. D'Alché-Buc, E. Fox, and R. Garnett (Eds.), Vol. 32. 8024--8035.
[27]
Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12, 85 (2011), 2825--2830. http://jmlr.org/papers/v12/pedregosa11a.html
[28]
João Pereira and Margarida Silveira. 2019. Learning Representations from Healthcare Time Series Data for Unsupervised Anomaly Detection. In 2019 IEEE International Conference on Big Data and Smart Computing (BigComp). IEEE.
[29]
Rafael Rafailov, Tianhe Yu, Aravind Rajeswaran, and Chelsea Finn. 2021. Offline Reinforcement Learning from Images with Latent Space Models. In Proceedings of the 3rd Conference on Learning for Dynamics and Control. PMLR, 1154--1168. https://doi.org/v144/rafailov21a.html
[30]
Bruno Rossi and Stanislav Chren. 2020. Smart Grids Data Analysis: A Systematic Mapping Study. IEEE Transactions on Industrial Informatics 16, 6 (2020), 3619--3639.
[31]
David E. Rumelhart, Geoffrey E. Hintont, and Ronald J. Williams. 1986. Learning Representations by Back-Propagating Errors. Nature 323 (1986), 533--536.
[32]
Kihyuk Sohn, Xinchen Yan, and Honglak Lee. 2015. Learning Structured Output Representation using Deep Conditional Generative Models. In Advances in Neural Information Processing Systems, C. Cortes, N. Lawrence, D. Lee, M. Sugiyama, and R. Garnett (Eds.), Vol. 28. 3483--3491.
[33]
Pang-Ning Tan, Michael Steinbach, Anuj Karpatne, and Vipin Kumar. 2019. Introduction to Data Mining (2nd global ed.). Pearson, New York.
[34]
Marian Turowski, Moritz Weber, Oliver Neumann, Benedikt Heidrich, Kaleb Phipps, Hüseyin K. Çakmak, Ralf Mikut, and Veit Hagenmeyer. 2022. Modeling and Generating Synthetic Anomalies for Energy and Power Time Series. In The Thirteenth ACM International Conference on Future Energy Systems (e-Energy '22). ACM.
[35]
Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing Data using t-SNE. Journal of Machine Learning Research 9, 86 (2008), 2579--2605. http://jmlr.org/papers/v9/vandermaaten08a.html
[36]
Vladimir N. Vapnik. 2000. The Nature of Statistical Learning Theory (2 ed.). Springer, New York.
[37]
Long Wang, Marian Turowski, Meng Zhang, Till Riedel, Michael Beigl, Ralf Mikut, and Veit Hagenmeyer. 2020. Point and contextual anomaly detection in building load profiles of a university campus. In 2020 IEEE PES Innovative Smart Grid Technologies Europe (ISGT-Europe). IEEE, 11--15.
[38]
Yi Wang, Qixin Chen, Tao Hong, and Chongqing Kang. 2019. Review of Smart Meter Data Analytics: Applications, Methodologies, and Challenges. IEEE Transactions on Smart Grid 10, 3 (2019), 3125--3148.
[39]
Paul Werbos. 1975. Beyond regression: New tools for prediction and analysis in the behavioral sciences. Ph.D. thesis. Harvard University.
[40]
Sook-Chin Yip, Wooi-Nee Tan, ChiaKwang Tan, Ming-Tao Gan, and KokSheik Wong. 2018. An anomaly detection framework for identifying energy theft and defective meters in smart grids. International Journal of Electrical Power and Energy Systems 101 (2018), 189--203.

Cited By

View all

Index Terms

  1. Enhancing anomaly detection methods for energy time series using latent space data representations

        Recommendations

        Comments

        Please enable JavaScript to view thecomments powered by Disqus.

        Information & Contributors

        Information

        Published In

        cover image ACM Conferences
        e-Energy '22: Proceedings of the Thirteenth ACM International Conference on Future Energy Systems
        June 2022
        630 pages
        ISBN:9781450393973
        DOI:10.1145/3538637
        This work is licensed under a Creative Commons Attribution International 4.0 License.

        Sponsors

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 28 June 2022

        Check for updates

        Author Tags

        1. anomaly detection
        2. energy time series
        3. latent space data representation

        Qualifiers

        • Research-article

        Funding Sources

        • German Research Foundation (DFG)
        • Helmholtz Association
        • Helmholtz Metadata Collaboration
        • Helmholtz Association?s Initiative and Networking Fund

        Conference

        e-Energy '22
        Sponsor:

        Acceptance Rates

        Overall Acceptance Rate 160 of 446 submissions, 36%

        Upcoming Conference

        E-Energy '25

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 622
          Total Downloads
        • Downloads (Last 12 months)216
        • Downloads (Last 6 weeks)20
        Reflects downloads up to 23 Dec 2024

        Other Metrics

        Citations

        Cited By

        View all

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media