Abstract
Discriminative feature selection helps enhance the performance, efficiency, and interpretability of models, rendering it one of the crucial steps in machine learning and pattern recognition. However, when samples from different classes are close to each other in the data, current discriminative feature selection methods often overlook many features with strong predictive power, resulting in suboptimal feature selection outcomes. To address this issue, we propose a novel discriminative feature selection method that utilizes grouping relative comparison from the perspective of relative distance metrics. In this approach, an anchor is initially selected to form a triplet by comparing the similarity gaps between pairs of data. To reduce triplet calculations and integrate overall information, the triplets consist of groups of samples rather than individual ones. Additionally, the determination of loss values shifts from hard judgment to soft judgment to account for data compactness within classes, thereby enhancing feature discrimination. Furthermore, sparse learning is employed in the proposed approach to constrain discriminative features and determine feature weights. Comprehensive experiments are conducted on various benchmark datasets, including face images, biomedical data, and speech letter recognition data, to validate the effectiveness of the proposed method. The source code of the proposed algorithm is available at https://github.com/xhchangsha/FS.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Chapados, N., Bengio, Y., Vincent, P., Ghosn, J., Dugas, C., Takeuchi, I., Meng, L.: Estimating car insurance premia: a case study in high-dimensional data inference. Adv. Neural Inf. Process. Syst. 14 (2001)
Cui, X., Li, Y., Fan, J., Wang, T.: A novel filter feature selection algorithm based on relief. Appl. Intell. 52(5), 5063–5081 (2022)
Dokeroglu, T., Deniz, A., Kiziloz, H.E.: A comprehensive survey on recent metaheuristics for feature selection. Neurocomputing (2022)
Fan, M., Zhang, X., Hu, J., Gu, N., Tao, D.: Adaptive data structure regularized multiclass discriminative feature selection. IEEE Trans. Neural Netw. Learn. Syst. 33(10), 5859–5872 (2021)
Fonti, V., Belitser, E.: Feature selection using lasso. VU Amsterdam research paper in business analytics 30, 1–25 (2017)
Hashemi, A., Dowlatshahi, M.B., Nezamabadi-pour, H.: An efficient pareto-based feature selection algorithm for multi-label classification. Inf. Sci. 581, 428–447 (2021)
He, X., Cai, D., Niyogi, P.: Laplacian score for feature selection. Adv. Neural Inf. Process. Syst. 18 (2005)
Li, J., Li, Y., Song, J., Zhang, J., Zhang, S.: Quantum support vector machine for classifying noisy data. IEEE Trans. Comput. 1–14 (2024). https://doi.org/10.1109/TC.2024.3416619
Li, J., Xu, H., Yu, H., Li, W., Zhang, S.: Anti-noise muiti-view feature selection with sample constraints. In: 2023 IEEE International Conference on Data Mining (ICDM), pp. 259–268. IEEE (2023)
Li, J., Zhang, J., Zhang, J., Zhang, S.: Quantum knn classification with k value selection and neighbor selection. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 43(5), 1332–1345 (2024). https://doi.org/10.1109/TCAD.2023.3345251
Lindenbaum, O., Shaham, U., Peterfreund, E., Svirsky, J., Casey, N., Kluger, Y.: Differentiable unsupervised feature selection based on a gated Laplacian. Adv. Neural. Inf. Process. Syst. 34, 1530–1542 (2021)
Ma, J., Xu, F., Rong, X.: Discriminative multi-label feature selection with adaptive graph diffusion. Pattern Recogn. 148, 110154 (2024)
Nie, F., Ma, Z., Wang, J., Li, X.: Fast sparse discriminative k-means for unsupervised feature selection. IEEE Trans. Neural Netw. Learn. Syst. 1–15 (2023). https://doi.org/10.1109/TNNLS.2023.3238103
Nie, F., Wang, Z., Tian, L., Wang, R., Li, X.: Subspace sparse discriminative feature selection. IEEE Trans. Cybern. (2020)
Roffo, G., Melzi, S., Castellani, U., Vinciarelli, A., Cristani, M.: Infinite feature selection: a graph-based feature filtering approach. IEEE Trans. Pattern Anal. Mach. Intell. 43(12), 4396–4410 (2020)
Tao, H., Hou, C., Nie, F., Jiao, Y., Yi, D.: Effective discriminative feature selection with nontrivial solution. IEEE Trans. Neural Netw. Learn. Syst. 27(4), 796–808 (2015)
Wen, Y., Zhang, K., Li, Z., Qiao, Y.: A discriminative feature learning approach for deep face recognition. In: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII 14, pp. 499–515. Springer (2016)
Yan, W., Xu, J., Liu, J., Yue, G., Tang, C.: Bipartite graph-based discriminative feature learning for multi-view clustering. In: Proceedings of the 30th ACM International Conference on Multimedia, pp. 3403–3411 (2022)
Yang, Z., Ye, Q., Chen, Q., Ma, X., Fu, L., Yang, G., Yan, H., Liu, F.: Robust discriminant feature selection via joint l2, 1-norm distance minimization and maximization. Knowl.-Based Syst. 207, 106090 (2020)
Yuan, L., Yang, G., Xu, Q., Lu, T.: Discriminative feature selection with directional outliers correcting for data classification. Pattern Recogn. 126, 108541 (2022)
Zhang, J., Luo, Z., Li, C., Zhou, C., Li, S.: Manifold regularized discriminative feature selection for multi-label learning. Pattern Recogn. 95, 136–150 (2019)
Zhang, J., Wu, H., Jiang, M., Liu, J., Li, S., Tang, Y., Long, J.: Group-preserving label-specific feature selection for multi-label learning. Expert Syst. Appl. 213, 118861 (2023)
Zhang, S., Li, J., Li, Y.: Reachable distance function for knn classification. IEEE Trans. Knowl. Data Eng. 35(7), 7382–7396 (2023). https://doi.org/10.1109/TKDE.2022.3185149
Acknowledgment
This work was supported by the Project of Guangxi Science and Technology (GuiKeAB23026040) and Research Fund of Guangxi Key Lab of Multi-source Information Mining & Security (MIMS24-04).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2025 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Xu, H., Li, J. (2025). Efficient Discriminative Feature Selection with Grouping Relative Comparison. In: Lin, Z., et al. Pattern Recognition and Computer Vision. PRCV 2024. Lecture Notes in Computer Science, vol 15041. Springer, Singapore. https://doi.org/10.1007/978-981-97-8795-1_6
Download citation
DOI: https://doi.org/10.1007/978-981-97-8795-1_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-8794-4
Online ISBN: 978-981-97-8795-1
eBook Packages: Computer ScienceComputer Science (R0)