Abstract
Self-organizing Map (SOM) is a very popular algorithm that has been used as clustering algorithm and data exploration. SOM consists of complex calculations where the calculation of complexity depending on the circumstances. Many researchers have managed to improve online SOM processing speed using discrete Graphic Processing Units (GPU). In spite of excellent performance using GPU, there is a situation that causes computer hardware underutilized when executing online SOM variant on GPU architecture. In details, the situation occurs when number of cores is larger than the number of neurons on map. Moreover, the complexities of SOM steps also increase the usage of high memory capacity which leads to high rate memory transfer. Recently, Heterogeneous System Architecture (HSA), that integrated Central Processing Unit (CPU) and GPU together on a single chip are rapidly attractive the design paradigm for recent platform because of their remarkable parallel processing abilities. Therefore, the main goal of this study is to reduce computation time of SOM training through adapting HSA platform and combining two SOM training processes. This study attempts to enhance the processing of SOM algorithm using multiple stimuli approach. The data used in this study are benchmark datasets from UCI Machine Learning repository. As a result, the enhanced parallel SOM algorithm that executed on HSA platform is able to score a promising speed up for different parameter size compared to standard parallel SOM on HSA platform.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Kohonen, T.: Essentials of the self-organizing map. Neural Netw. 37, 52–65 (2013)
Llanos, J., Morales, R., Núñez, A., Sáez, D., Lacalle, M., Marín, L.G., Hernández, R., Lanas, F.: Load estimation for microgrid planning based on a self-organizing map methodology. Appl. Soft Comput. 53, 323–335 (2017)
Matic, F., Kovac, Z., Vilibic, I., Mihanovic, H., Morovic, M., Grbec, B., Leder, N., Dzoic, T.: Oscillating adriatic temperature and salinity regimes mapped using the self-organizing maps method. Cont. Shelf Res. 132, 11–18 (2017)
McConnell, S., Sturgeon, R., Henry, G., Mayne, A., Hurley, R.: Scalability of self-organizing maps on a GPU cluster using OpenCL and CUDA. J. Phys: Conf. Ser. 341, 12018 (2012)
Hasan, S., Shamsuddin, S.M., Lopes, N.: Machine learning big data framework and analytics for big data problems. Int. J. Adv. Soft Comput. Appl. 6, 1–17 (2014)
Kurdthongmee, W.: A novel Kohonen SOM-based image compression architecture suitable for moderate density {FPGAs}. Image Vis. Comput. 26, 1094–1105 (2008)
Kurdthongmee, W.: A low latency minimum distance searching unit of the SOM based hardware quantizer. Microprocess. Microsyst. 39, 135–143 (2015)
Moraes, F.C., Botelho, S.C., Filho, N.D., Gaya, J.F.O.: Parallel high dimensional self organizing maps using CUDA. In: 2012 Brazilian Robotics Symposium and Latin American Robotics Symposium, pp. 302–306 (2012)
Sul, S.J., Tovchigrechko, A.: Parallelizing BLAST and SOM Algorithms with MapReduce-MPI library. In: 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum, pp. 481–489 (2011)
Mojarab, M., Memarian, H., Zare, M., Hossein Morshedy, A., Hossein Pishahang, M.: Modeling of the seismotectonic provinces of Iran using the self-organizing map algorithm. Comput. Geosci. 67, 150–162 (2014)
Richardson, T., Winer, E.: Extending parallelization of the self-organizing map by combining data and network partitioned methods. Adv. Eng. Softw. 88, 1–7 (2015)
Garcia, C., Prieto, M., Pascual-Montano, A.: A speculative parallel algorithm for self-organizing maps. In: Proceedings of Parallel Computing 2005 (ParCo 2005), vol. 33, pp. 615–622 (2005)
MacLean, D., Valova, I.: Parallel growing SOM monitored by genetic algorithm. In: 2007 International Joint Conference on Neural Networks, pp. 1697–1702 (2007)
Dlugosz, R., Kolasa, M., Pedrycz, W., Szulc, M.: Parallel programmable asynchronous neighborhood mechanism for kohonen SOM implemented in CMOS technology. IEEE Trans. Neural Netw. 22, 2091–2104 (2011)
Khalifa, K.B., Girau, B., Alexandre, F., Bedoui, M.H.: Parallel FPGA implementation of self-organizing maps. In: Proceedings of the 16th International Conference on Microelectronics, ICM 2004, pp. 709–712 (2004)
Yang, M.-H., Ahuja, N.: A data partition method for parallel self-organizing map. In: International Joint Conference on Neural Networks, IJCNN 1999, vol. 3, pp. 1929–1933 (1999)
Schabauer, H., Schikuta, E., Weishäupl, T.: Solving very large traveling salesman problems by SOM parallelization on cluster architectures. In: Proceedings of Parallel and Distributed Computing, Applications and Technologies, PDCAT, pp. 954–958 (2005)
Gajdos, P., Platos, J.: GPU based parallelism for self-organizing map. In: Kudělka, M., Pokorný, J., Snášel, V., Abraham, A. (eds.) Intelligent Human Computer Interaction. Advances in Intelligent Systems and Computing, vol. 179, pp. 3–12. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-31603-6_20
Nguyen, V.T., Hagenbuchner, M., Tsoi, A.C.: High resolution self-organizing maps. In: Kang, B.H., Bai, Q. (eds.) AI 2016. LNCS, vol. 9992, pp. 441–454. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-50127-7_38
Lachmair, J., Merényi, E., Porrmann, M., Rückert, U.: A reconfigurable neuroprocessor for self-organizing feature maps. Neurocomputing 112, 189–199 (2013)
Asanović, K.: A fast Kohonen net implementation for spert-II. In: Mira, J., Moreno-Díaz, R., Cabestany, J. (eds.) IWANN 1997. LNCS, vol. 1240, pp. 792–800. Springer, Heidelberg (1997). https://doi.org/10.1007/BFb0032538
Porrmann, M., Witkowski, U., Ruckert, U.: A massively parallel architecture for self-organizing feature maps. IEEE Trans. Neural Netw. 14, 1110–1121 (2003)
Perelygin, K., Lam, S., Wu, X.: Graphics processing units and open computing language for parallel computing. Comput. Electr. Eng. 40, 241–251 (2014)
Kirk, D.B., Hwu, W.W.: Programming Massively Parallel Processors. Elsevier, Amsterdam (2013)
Rauber, T., Rünger, G.: Parallel Programming: For Multicore and Cluster Systems. Springer, Heidelberg (2010). https://doi.org/10.1007/978-3-642-04818-0
Mittal, S., Vetter, J.S.: A survey of CPU-GPU heterogeneous computing techniques. ACM Comput. Surv. 47, 69:1–69:35 (2015)
De, A., Zhang, Y., Guo, C.: A parallel image segmentation method based on SOM and GPU with application to MRI image processing. Neurocomputing 198, 180–189 (2016)
Mukherjee, S., Sun, Y., Blinzer, P., Ziabari, A.K., Kaeli, D.: A comprehensive performance analysis of HSA and OpenCL 2.0. In: 2016 IEEE International Symposium on Performance Analysis of Systems and Software (2016)
Khronos OpenCL: OpenCL Specification (2014)
Lichman, M.: UCI Machine Learning Repository. http://archive.ics.uci.edu/ml
Mustapha, M.F., Abd Khalid, N.E., Ismail, A.: Evaluation of parallel self-organizing map using heterogeneous system platform. J. Appl. Sci. 17, 204–211 (2017)
Yasunaga, M., Tominaga, K., Kim, J.H.: Parallel self-organization map using multiple stimuli. In: International Joint Conference on Neural Networks, IJCNN 1999 (Cat. No. 99CH36339), vol. 2, pp. 1127–1130 (1999)
Fränti, P., et al.: Clustering datasets. http://cs.uef.fi/sipu/datasets/
Moro, S., Cortez, P., Rita, P.: A data-driven approach to predict the success of bank telemarketing. Decis. Support Syst. 62, 22–31 (2014)
Berkhin, P.: A survey of clustering data mining techniques. Group. Multidimens. Data 25, 71 (2006)
Han, J., Kamber, M., Pei, J.: Data preprocessing. In: Data Mining Concept and Techniques, pp. 83–134 (2012)
Nawi, N.M., Atomi, W.H., Rehman, M.Z.: The effect of data pre-processing on optimized training of artificial neural networks. Procedia Technol. 11, 32–39 (2013)
Hennessy, J.L., Patterson, D.A.: Computer Architecture, Fourth Edition: A Quantitative Approach. Morgan Kaufmann Publishers Inc., San Francisco (2006)
Acknowledgement
This study was funded by Ministry of Higher Education (MOHE) of Malaysia, under the FRGS, grant no. FRGS/1/2015/ICT02/UITM/02/6 and Academic Staff Bumiputera Training Scheme (SLAB). The authors also would like to thank the Universiti Teknologi MARA for supporting this study.
Author information
Authors and Affiliations
Corresponding authors
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Mustapha, M.F., Abd Khalid, N.E., Ismail, A., Manaf, M. (2017). Enhancing Parallel Self-organizing Map on Heterogeneous System Architecture. In: Mohamed, A., Berry, M., Yap, B. (eds) Soft Computing in Data Science. SCDS 2017. Communications in Computer and Information Science, vol 788. Springer, Singapore. https://doi.org/10.1007/978-981-10-7242-0_14
Download citation
DOI: https://doi.org/10.1007/978-981-10-7242-0_14
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-10-7241-3
Online ISBN: 978-981-10-7242-0
eBook Packages: Computer ScienceComputer Science (R0)