[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3457784.3457828acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicscaConference Proceedingsconference-collections
research-article

Local Mean k-General Nearest Neighbor Classifier

Published: 30 July 2021 Publication History

Abstract

The well-known k-Nearest Neighbor classifier is a simple and flexible algorithm that has sparked wide interest in pattern classification. In spite of its straightforward implementation, the kNN is sensitive to the presence of noisy training samples and variance of the distribution. Local mean based k-nearest neighbor rule has been developed to overcome the negative effect of the noisy training sample. In this article, the local mean rule is implemented with the general nearest neighbors that are selected in a more generalized way. A new local mean based nearest neighbor classifier is proposed termed Local Mean k-General Nearest Neighbor (LMkGNN). The proposed LMkGNN classifier finds the local mean vector from general nearest neighbors of each class and classifies the test sample based on the distances between the test sample and local mean vectors. Fifteen real-world datasets from the UCI machine learning repository are used to assess and evaluate the classification performance of the proposed classifier. The performance comparison is also made with five benchmark classifiers (kNN, PNN, LMkNN, LMPNN and kGNN) in terms of the classification accuracy. Experimental results demonstrate that the proposed LMkGNN classifier performs significantly well and obtain the best classification accuracy com-pared to the five competing classifiers.

References

[1]
D. Dua and C. Graff. 2019. UCI Machine Learning Repository.
[2]
E. Fix and J. L. Hodges. 1951. Discriminatory Analysis - Nonparametric discrimination consistency properties. Usaf Sch. Aviat. Med. Randolph Field, Texas May (1951), 1–21. https://doi.org/10.2307/1403797
[3]
Jianping Gou, Hongxing Ma, Weihua Ou, Shaoning Zeng, Yunbo Rao, and Hebiao Yang. 2019. A generalized mean distance-based k-nearest neighbor classifier. Expert Syst. Appl. 115, (2019), 356–372. https://doi.org/10.1016/j.eswa.2018.08.021
[4]
Jianping Gou, Zhang Yi, Lan Du, and Taisong Xiong. 2012. A local mean-based k-nearest centroid neighbor classifier. Comput. J. 55, 9 (2012), 1058–1071. https://doi.org/10.1093/comjnl/bxr131
[5]
Jianping Gou, Yongzhao Zhan, Yunbo Rao, Xiangjun Shen, Xiaoming Wang, and Wu He. 2014. Improved pseudo nearest neighbor classification. Knowledge-Based Syst. 70, (2014), 361–375. https://doi.org/10.1016/j.knosys.2014.07.020
[6]
Wei Li, Yumin Chen, and Yuping Song. 2020. Boosted K-nearest neighbor classifiers based on fuzzy granules. Knowledge-Based Syst. 195, (2020), 105606. https://doi.org/10.1016/j.knosys.2020.105606
[7]
Huawen Liu and Shichao Zhang. 2012. Noisy data elimination using mutual k-nearest neighbor for classification mining. J. Syst. Softw. 85, 5 (2012), 1067–1074. https://doi.org/10.1016/j.jss.2011.12.019
[8]
Mahinda Mailagaha Kumbure, Pasi Luukka, and Mikael Collan. 2020. A new fuzzy k-nearest neighbor classifier based on the Bonferroni mean. Pattern Recognit. Lett. 140, (2020), 172–178. https://doi.org/10.1016/j.patrec.2020.10.005
[9]
Y. Mitani and Y. Hamamoto. 2006. A local mean-based nonparametric classifier. Pattern Recognit. Lett. 27, 10 (2006), 1151–1159. https://doi.org/10.1016/j.patrec.2005.12.016
[10]
Z. Pan, Y. Wang, and W. Ku. 2017. A new k-harmonic nearest neighbor classifier based on the multi-local means. Expert Syst. Appl. 67, (2017), 115–125. https://doi.org/10.1016/j.eswa.2016.09.031
[11]
Zhibin Pan, Yidi Wang, and Weiping Ku. 2017. A new general nearest neighbor classification based on the mutual neighborhood information. Knowledge-Based Syst. 121, (2017), 142–152. https://doi.org/10.1016/j.knosys.2017.01.021
[12]
Zhibin Pan, Yikun Wang, and Yiwei Pan. 2020. A new locally adaptive k-nearest neighbor algorithm based on discrimination class. Knowledge-Based Syst. 204, (2020), 106185. https://doi.org/10.1016/j.knosys.2020.106185
[13]
Niloofar Rastin, Mansoor Zolghadri Jahromi, and Mohammad Taheri. 2020. A Generalized Weighted Distance k-Nearest Neighbor for Multi-label Problems. Pattern Recognit. (2020), 107526. https://doi.org/10.1016/j.patcog.2020.107526
[14]
K N Stevens, T M Cover, and P E Hart. 1967. Nearest Neighbor. IEEE Trans. Inf. Theory I, (1967).
[15]
Bo Tang and Haibo He. 2015. ENN: Extended Nearest Neighbor Method for Pattern Recognition [Research Frontier]. IEEE Comput. Intell. Mag. 10, 3 (2015), 52–60. https://doi.org/10.1109/MCI.2015.2437512
[16]
Bo Tang, Haibo He, and Song Zhang. 2020. MCENN: A variant of Extended Nearest Neighbor method for pattern recognition. Pattern Recognit. Lett. (2020). https://doi.org/10.1016/j.patrec.2020.01.015
[17]
Yong Zeng, Yupu Yang, and Liang Zhao. 2009. Pseudo nearest neighbor rule for pattern classification. Expert Syst. Appl. 36, 2 (2009), 3587–3595. https://doi.org/10.1016/j.eswa.2008.02.003

Cited By

View all
  • (2024)Performance comparison of k nearest neighbor classifier with different distance functionsTHE 7TH BIOMEDICAL ENGINEERING’S RECENT PROGRESS IN BIOMATERIALS, DRUGS DEVELOPMENT, AND MEDICAL DEVICES: The 15th Asian Congress on Biotechnology in conjunction with the 7th International Symposium on Biomedical Engineering (ACB-ISBE 2022)10.1063/5.0192229(040010)Online publication date: 2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICSCA '21: Proceedings of the 2021 10th International Conference on Software and Computer Applications
February 2021
325 pages
ISBN:9781450388825
DOI:10.1145/3457784
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 July 2021

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Classifier
  2. Local mean k-general nearest neighbor
  3. Local mean k-nearest neighbor
  4. k-general nearest neighbor
  5. k-nearest neighbor

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICSCA 2021

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)9
  • Downloads (Last 6 weeks)1
Reflects downloads up to 25 Dec 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Performance comparison of k nearest neighbor classifier with different distance functionsTHE 7TH BIOMEDICAL ENGINEERING’S RECENT PROGRESS IN BIOMATERIALS, DRUGS DEVELOPMENT, AND MEDICAL DEVICES: The 15th Asian Congress on Biotechnology in conjunction with the 7th International Symposium on Biomedical Engineering (ACB-ISBE 2022)10.1063/5.0192229(040010)Online publication date: 2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media