A comparative study to deep learning for pattern recognition, by using online and batch learning; taking cybersecurity as a case
Pages 907 - 912
Abstract
Many models have been proposed to address deep learning problem. Most deep learning models are influenced by presentation order, complex shapes, architecture configuration and learning instability. This paper provides comparative study to deep learning for pattern recognition. Two types of supervised learning techniques were tested which are used for comparison purpose. They correspond to Batch Gradient Descent and Stochastic Gradient Descent. In order to obtain an accurate results with both methods, we used a re-sampling method based on k-fold cross-validation. Experimental Results show that Stochastic Gradient Descent gives good results in comparison to Batch Gradient Descent. The recognition accuracies are seen to improve significantly when Stochastic Gradient Descent is applied for intrusion detection.
References
[1]
L. Deng, D. Yu et al., "Deep learning: methods and applications," Foundations and Trends® in Signal Processing, vol. 7, no. 3--4, pp. 197--387, 2014.
[2]
R. O. Duda, P. E. Hart, and D. G. Stork, Pattern classification. John Wiley & Sons, 2012.
[3]
W. Liu, Z. Wang, X. Liu, N. Zeng, Y. Liu, and F. E. Alsaadi, "A survey of deep neural network architectures and their applications," Neurocomputing, vol. 234, pp. 11--26, 2017.
[4]
B. Bai, Y. Fan, W. Tan, and J. Zhang, "Dltsr: A deep learning framework for recommendation of long-tail web services," IEEE Transactions on Services Computing, 2017.
[5]
A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang, T. Weyand, M. Andreetto, and H. Adam, "Mobilenets: Efficient convolutional neural networks for mobile vision applications," arXiv preprint arXiv:1704.04861, 2017.
[6]
J. Yang, M. N. Nguyen, P. P. San, X. L. Li, and S. Krishnaswamy, "Deep convolutional neural networks on multichannel time series for human activity recognition," in Twenty-Fourth International Joint Conference on Artificial Intelligence, 2015.
[7]
P. Li, J. Li, Z. Huang, T. Li, C.-Z. Gao, S.-M. Yiu, and K. Chen, "Multi-key privacy-preserving deep learning in cloud computing," Future Generation Computer Systems, vol. 74, pp. 76--85, 2017.
[8]
E. Hodo, X. Bellekens, A. Hamilton, P.-L. Dubouilh, E. Iorkyase, C. Tachtatzis, and R. Atkinson, "Threat analysis of iot networks using artificial neural network intrusion detection system," in 2016 International Symposium on Networks, Computers and Communications (ISNCC). IEEE, 2016, pp. 1--6.
[9]
M. I. AlHajri, N. T. Ali, and R. M. Shubair, "Classification of indoor environments for iot applications: A machine learning approach," IEEE Antennas and Wireless Propagation Letters, vol. 17, no. 12, pp. 2164--2168, 2018.
[10]
V. Mnih, K. Kavukcuoglu, D. Silver, A. Graves, I. Antonoglou, D. Wierstra, and M. Riedmiller, "Playing atari with deep reinforcement learning," arXiv preprint arXiv:1312.5602, 2013.
[11]
Y. Wang, B. Widrow, L. A. Zadeh, N. Howard, S. Wood, V. C. Bhavsar, G. Budin, C. Chan, R. A. Fiorini, M. L. Gavrilova et al., "Cognitive intelligence: Deep learning, thinking, and reasoning by brain-inspired systems," International Journal of Cognitive Informatics and Natural Intelligence (IJCINI), vol. 10, no. 4, pp. 1--20, 2016.
[12]
I. Lenz, H. Lee, and A. Saxena, "Deep learning for detecting robotic grasps," The International Journal of Robotics Research, vol. 34, no. 4-5, pp. 705--724, 2015.
[13]
C. Hu, R. Ju, Y. Shen, P. Zhou, and Q. Li, "Clinical decision support for alzheimer's disease based on deep learning and brain network," in 2016 IEEE International Conference on Communications (ICC). IEEE, 2016, pp. 1--6.
[14]
H. Zou, H. Jiang, X. Lu, and L. Xie, "An online sequential extreme learning machine approach to wifi based indoor positioning," in 2014 IEEE World Forum on Internet of Things (WF-IoT). IEEE, 2014, pp. 111--116.
[15]
M. Lopez-Martin, B. Carro, A. Sanchez-Esguevillas, and J. Lloret, "Network traffic classifier with convolutional and recurrent neural networks for internet of things," IEEE Access, vol. 5, pp. 18 042--18 050, 2017.
[16]
A. A. Diro and N. Chilamkurti, "Distributed attack detection scheme using deep learning approach for internet of things," Future Generation Computer Systems, vol. 82, pp. 761--768, 2018.
Recommendations
A Comparative Study Between Deep Learning and Traditional Machine Learning Techniques for Facial Biometric Recognition
Advances in Artificial Intelligence – IBERAMIA 2018AbstractThere is a growing incentive to use biometric technology to improve and even replace traditional security methods. Biometric modalities are characteristics drawn from the human body, which are unique to each individual and can be used to establish ...
Annealed gradient descent for deep learning
AbstractIn this paper, we propose a novel annealed gradient descent (AGD) algorithm for deep learning. AGD optimizes a sequence of gradually improving smoother mosaic functions that approximate the original non-convex objective function according to an ...
A Pattern Recognition Method of Personalized Adaptive Learning in Online Education
AbstractIn order to effectively identify the pattern of personalized adaptive learning in online education and improve the recommendation satisfaction of personalized learning resources in online education platform, this paper studies the pattern ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
August 2019
1228 pages
Copyright © 2019 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
In-Cooperation
- IEEE CS
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 15 January 2020
Check for updates
Author Tags
Qualifiers
- Short-paper
Conference
ASONAM '19
Sponsor:
ASONAM '19: International Conference on Advances in Social Networks Analysis and Mining
August 27 - 30, 2019
British Columbia, Vancouver, Canada
Acceptance Rates
ASONAM '19 Paper Acceptance Rate 41 of 286 submissions, 14%;
Overall Acceptance Rate 116 of 549 submissions, 21%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 99Total Downloads
- Downloads (Last 12 months)7
- Downloads (Last 6 weeks)0
Reflects downloads up to 11 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in