[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3465480.3466928acmconferencesArticle/Chapter ViewAbstractPublication PagesdebsConference Proceedingsconference-collections
research-article

The synergy of complex event processing and tiny machine learning in industrial IoT

Published: 28 June 2021 Publication History

Abstract

Focusing on comprehensive networking, the Industrial Internet-of-Things (IIoT) facilitates efficiency and robustness in factory operations. Various intelligent sensors play a central role, as they generate a vast amount of real-time data that can provide insights into manufacturing. Complex event processing (CEP) and machine learning (ML) have been developed actively in the last years in IIoT to identify patterns in heterogeneous data streams and fuse raw data into tangible facts. In a traditional compute-centric paradigm, the raw field data are continuously sent to the cloud and processed centrally. As IIoT devices become increasingly pervasive, concerns are raised since transmitting such an amount of data is energy-intensive, vulnerable to be intercepted, and subjected to high latency. Decentralized on-device ML and CEP provide a solution where data is processed primarily on edge devices. Thus communications can be minimized. However, this is no mean feat because most IIoT edge devices are resource-constrained with low power consumption. This paper proposes a framework that exploits ML and CEP's synergy at the edge in distributed sensor networks. By leveraging tiny ML and μCEP, we now shift the computation from the cloud to the resource-constrained IIoT devices and allow users to adapt on-device ML models and CEP reasoning rules flexibly on the fly. Lastly, we demonstrate the proposed solution and show its effectiveness and feasibility using an industrial use case of machine safety monitoring.

References

[1]
Darko Anicic, Sebastian Rudolph, Paul Fodor, and Nenad Stojanovic. 2012. Stream Reasoning and Complex Event Processing in ETALIS. Semantic Web 3, 4 (2012), 397--407.
[2]
Arduino. 2021. Arduino Nano 33 BLE Sense. Retrieved Feb 27, 2021 from https://store.arduino.cc/arduino-nano-33-ble-sense
[3]
Ralf Bruns, Jürgen Dunkel, and Norman Offel. 2019. Learning of Complex Event Processing Rules with Genetic Programming. Expert Systems with Applications 129 (2019), 186--199.
[4]
Chingyu Chen, JuiHsi Fu, Today Sung, and Ping-Feng Wang. 2014. Complex Event Processing for the Internet of Things and Its Applications. In 2014 IEEE International Conference on Automation Science and Engineering (CASE). IEEE, New Taipei, Taiwan, 1144--1149.
[5]
Miguel de Prado et al. 2020. Robust Navigation with tinyML for Autonomous Mini-Vehicles. arXiv:2007.00302 [cs.LG]
[6]
Marcos Dias de Assunção, Alexandre da Silva Veith, and Rajkumar Buyya. 2018. Distributed Data Stream Processing and Edge Computing: A Survey on Resource Elasticity and Future Directions. Journal of Network and Computer Applications 103 (2018), 1--17.
[7]
Aidan Hogan et al. 2021. Knowledge Graphs. arXiv:2003.02320 [cs.AI]
[8]
Adam Paszke et al. 2019. PyTorch: An Imperative Style, High-Performance Deep Learning Library. In Advances in Neural Information Processing Systems, Vol. 32. Curran Associates, Inc., Canada. https://proceedings.neurips.cc/paper/2019/file/bdbca288fee7f92f2bfa9f7012727740-Paper.pdf
[9]
Bert Moons et al. 2018. BinarEye: An Always-on Energy-Accuracy-Scalable Binary CNN Processor with All Memory on Chip in 28nm CMOS. In 2018 IEEE Custom Integrated Circuits Conference (CICC). IEEE, IEEE, San Diego, CA, USA, 1--4.
[10]
Jinook Song et al. 2019. 7.1 an 11.5 tops/w 1024-mac butterfly structure dual-core sparsity-aware neural processing unit in 8nm flagship mobile soc. In 2019 IEEE International Solid-State Circuits Conference (ISSCC). IEEE, IEEE, San Francisco, CA, USA, 130--132.
[11]
Lars Brenna et al. 2007. Cayuga: A High-Performance Event Processing Engine. In Proceedings of the 2007 ACM SIGMOD International Conference on Management of Data (Beijing, China) (SIGMOD '07). Association for Computing Machinery, New York, NY, USA, 1100--1102.
[12]
Lajos Jenő Fülöp et al. 2010. Survey on Complex Event Processing and Predictive Analytics. In Proceedings of the Fifth Balkan Conference in Informatics. Citeseer, Association for Computing Machinery, New York, NY, USA, 26--31.
[13]
Lina Lan et al. 2019. A Universal Complex Event Processing Mechanism Based on Edge Computing for Internet of Things Real-Time Monitoring. IEEE Access 7 (2019), 101865--101878.
[14]
Martín Abadi et al. 2015. TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems. https://www.tensorflow.org/ Software available from tensorflow.org.
[15]
Nijat Mehdiyev et al. 2015. Determination of Rule Patterns in Complex Event Processing Using Machine Learning Techniques. Procedia Computer Science 61 (2015), 395--401.
[16]
Pablo Graubner et al. 2018. Multimodal Complex Event Processing on Mobile Devices. In Proceedings of the 12th ACM International Conference on Distributed and Event-Based Systems (Hamilton, New Zealand) (DEBS '18). Association for Computing Machinery, New York, NY, USA, 112--123.
[17]
Robert David et al. 2020. Tensorflow Lite Micro: Embedded Machine Learning on tinyML Systems. arXiv:1801.06601 [cs.LG]
[18]
Tianqi Chen et al. 2018. TVM: An Automated End-to-End Optimizing Compiler for Deep Learning. In 13th USENIX Symposium on Operating Systems Design and Implementation (OSDI 18). USENIX Association, USA, 578--594.
[19]
Tianwei Xing et al. 2019. Deepcep: Deep Complex Event Processing Using Distributed Multimodal Information. In 2019 IEEE International Conference on Smart Computing (SMARTCOMP). IEEE, Washington, DC, USA, 87--92.
[20]
TinyML Foundation. 2021. tinyML.org. Retrieved Feb 27, 2021 from https://www.tinyml.org
[21]
The Apache Software Fundation. 2021. Apache Flink. Retrieved Feb 27, 2021 from https://ci.apache.org/projects/flink/flink-docs-release-1.12
[22]
Nikos Giatrakos, Elias Alevizos, Alexander Artikis, Antonios Deligiannakis, and Minos Garofalakis. 2020. Complex Event Recognition in the Big Data Era: A Survey. The VLDB Journal 29 (01 2020).
[23]
Google. 2021. Tensorflow Lite Micro Guide. Retrieved Feb 27, 2021 from https://www.tensorflow.org/lite/microcontrollers
[24]
Nithyashri Govindarajan, Yogesh Simmhan, Nitin Jamadagni, and Prasant Misra. 2014. Event Processing Across Edge and the Cloud for Internet of Things Applications. In Proceedings of the 20th International Conference on Management of Data (Hyderabad, India) (COMAD '14). Computer Society of India, Mumbai, Maharashtra, IND, 101--104.
[25]
Son Han, Huizi Mao, and William J. Dally. 2015. Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding. arXiv:1510.00149 [cs.LG]
[26]
Liangzhen Lai, Naveen Suda, and Vikas Chandra. 2018. Cmsis-nn: Efficient Neural Network Kernels for Arm Cortex-M CPUs. arXiv:1801.06601 [cs.LG]
[27]
Nader Mohamed and Jameela Al-Jaroodi. 2014. Real-time big data analytics: Applications and challenges. In 2014 International Conference on High Performance Computing Simulation (HPCS). IEEE, Bologna, Italy, 305--310.
[28]
Raef Mousheimish, Yehia Taher, and Karine Zeitouni. 2017. Automatic Learning of Predictive CEP Rules: Bridging the Gap Between Data Mining and Complex Event Processing. In Proceedings of the 11th ACM International Conference on Distributed and Event-based Systems. Association for Computing Machinery, New York, NY, USA, 158--169.
[29]
OmniVision. 2021. OV7675 Image Sensor. Retrieved Feb 27, 2021 from https://www.ovt.com/sensors/OV7675
[30]
Alexander Power and Gerald Kotonya. 2019. Providing Fault Tolerance via Complex Event Processing and Machine Learning for IoT Systems. In Proceedings of the 9th International Conference on the Internet of Things. Association for Computing Machinery, New York, NY, USA, 1--7.
[31]
Mark Proctor. 2012. Drools: A Rule Engine for Complex Event Processing. In Applications of Graph Transformations with Industrial Relevance, Andy Schürr and Dániel Varró (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 2--2.
[32]
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, and Ali Farhadi. 2016. Xnor-Net: Imagenet Classification Using Binary Convolutional Neural Networks. In European Conference on Computer Vision. Springer, Springer, Cham, Amsterdam, The Netherlands, 525--542.
[33]
Haoyu Ren, Darko Anicic, and Thomas Runkler. 2021. TinyOL: TinyML with Online-Learning on Microcontrollers. arXiv:2103.08295 [cs.LG]
[34]
Ramon Sanchez-Iborra and Antonio F. Skarmeta. 2020. TinyML-Enabled Frugal Smart Objects: Challenges and Opportunities. IEEE Circuits and Systems Magazine 20, 3 (2020), 4--18.
[35]
José Angel Carvajal Soto, Marc Jentsch, Davy Preuveneers, and Elisabeth Ilie-Zudor. 2016. CEML: Mixing and Moving Complex Event Processing and Machine Learning to the Edge of the Network for IoT Applications. In Proceedings of the 6th International Conference on the Internet of Things. Association for Computing Machinery, New York, NY, USA, 103--110.
[36]
STMicroelectronics. 2021. AI expansion pack for STM32CubeMX. Retrieved Feb 27, 2021 from https://www.st.com/en/embedded-software/x-cube-ai.html
[37]
TIBCO. 2021. TIBCO. Retrieved Feb 27, 2021 from https://www.tibco.com
[38]
Mira Vrbaski, Miodrag Bolic, and Shikharesh Majumdar. 2018. Complex Event Recognition Notification Methodology for Uncertain IoT Systems Based on Micro-Service Architecture. In 2018 IEEE 6th International Conference on Future Internet of Things and Cloud (FiCloud). IEEE, Barcelona, Spain, 184--191.
[39]
Yongheng Wang, Hui Gao, and Guidan Chen. 2018. Predictive Complex Event Processing Based on Evolving Bayesian Networks. Pattern Recognition Letters 105 (2018), 207--216.
[40]
Jonas Wanner, Christopher Wissuchek, and Christian Janiesch. 2019. Machine Learning and Complex Event Processing. A Review of Real-time Data Analytics for the Industrial Internet of Things. Enterprise Modelling and Information Systems Architectures (EMISAJ) - International Journal of Conceptual Modeling 15, 1 (2019), 1--27.

Cited By

View all
  • (2024)TinyNS: Platform-aware Neurosymbolic Auto Tiny Machine LearningACM Transactions on Embedded Computing Systems10.1145/360317123:3(1-48)Online publication date: 11-May-2024
  • (2024)Anomaly detection based on Artificial Intelligence of Things: A Systematic Literature MappingInternet of Things10.1016/j.iot.2024.10106325(101063)Online publication date: Apr-2024
  • (2023)Energy-Sustainable IoT Connectivity: Vision, Technological Enablers, Challenges, and Future DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2023.33238324(2609-2666)Online publication date: 2023
  • Show More Cited By

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
DEBS '21: Proceedings of the 15th ACM International Conference on Distributed and Event-based Systems
June 2021
207 pages
ISBN:9781450385558
DOI:10.1145/3465480
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 June 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. complex event processing
  2. industrial IoT
  3. tiny machine learning

Qualifiers

  • Research-article

Conference

DEBS '21

Acceptance Rates

DEBS '21 Paper Acceptance Rate 7 of 26 submissions, 27%;
Overall Acceptance Rate 145 of 583 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)56
  • Downloads (Last 6 weeks)6
Reflects downloads up to 13 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)TinyNS: Platform-aware Neurosymbolic Auto Tiny Machine LearningACM Transactions on Embedded Computing Systems10.1145/360317123:3(1-48)Online publication date: 11-May-2024
  • (2024)Anomaly detection based on Artificial Intelligence of Things: A Systematic Literature MappingInternet of Things10.1016/j.iot.2024.10106325(101063)Online publication date: Apr-2024
  • (2023)Energy-Sustainable IoT Connectivity: Vision, Technological Enablers, Challenges, and Future DirectionsIEEE Open Journal of the Communications Society10.1109/OJCOMS.2023.33238324(2609-2666)Online publication date: 2023
  • (2023)TinyML-enabled edge implementation of transfer learning framework for domain generalization in machine fault diagnosisExpert Systems with Applications: An International Journal10.1016/j.eswa.2022.119016213:PBOnline publication date: 1-Mar-2023
  • (2023)An automatic complex event processing rules generation system for the recognition of real-time IoT attack patternsEngineering Applications of Artificial Intelligence10.1016/j.engappai.2023.106344123:PBOnline publication date: 1-Aug-2023
  • (2023)An automatic unsupervised complex event processing rules generation architecture for real-time IoT attacks detectionWireless Networks10.1007/s11276-022-03219-y30:6(5127-5144)Online publication date: 16-Jan-2023
  • (2022)TinyML for Ultra-Low Power AI and Large Scale IoT Deployments: A Systematic ReviewFuture Internet10.3390/fi1412036314:12(363)Online publication date: 6-Dec-2022
  • (2022)Incremental Online Learning Algorithms Comparison for Gesture and Visual Smart Sensors2022 International Joint Conference on Neural Networks (IJCNN)10.1109/IJCNN55064.2022.9892356(1-8)Online publication date: 18-Jul-2022
  • (2022)TinyML: A Systematic Review and Synthesis of Existing Research2022 International Conference on Artificial Intelligence in Information and Communication (ICAIIC)10.1109/ICAIIC54071.2022.9722636(269-274)Online publication date: 21-Feb-2022
  • (2022)From self-aware to self-healing for perpetual manufacturingManufacturing Letters10.1016/j.mfglet.2022.08.01534(53-57)Online publication date: Oct-2022
  • Show More Cited By

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media