One-step Multi-view Clustering with Consensus Graph and Data Representation Convolution
Author: 
F. DornaikaAuthors Info & Claims
Article No.: 6, Pages 1 - 24
Abstract
Multi-view clustering aims to partition unlabeled patterns into disjoint clusters using consistent and complementary information derived from features of patterns in multiple views. Downstream methods perform this clustering sequentially: estimation of individual or consistent similarity matrices, spectral embedding, and clustering. In this article, we present an approach that can address some of the shortcomings of previous multiview clustering methods. We propose a single objective function whose optimization can jointly provide the consistent graph matrix for all views, the unified spectral data representation, the cluster assignments, and the view weights. We propose a new constraint term that sets the cluster index matrix to the convolution of the consistent spectral projection matrix over the consistent graph. Our proposed scheme has two interesting properties that the recent works do not have simultaneously. First, the cluster assignments can be estimated directly without the need for an additional clustering phase, which depends heavily on initialization. Second, the soft cluster assignments are directly linked to the kernel representation of the features of the views. Moreover, our method automatically computes the weights of each view, requiring fewer hyperparameters. We have conducted a series of experiments on real datasets. These demonstrate the effectiveness of the proposed approach, which compares favorably to many competing multi-view clustering methods.
References
[1]
M. Y. Ansari, A. Ahmad, S. S. Khan, G. Bhushan, and Mainuddin. 2020. Spatiotemporal clustering: A review. Artif. Intell. Rev. 53 (2020), 2381–2423.
[2]
Xiaochun Cao, Changqing Zhang, Huazhu Fu, Si Liu, and Hua Zhang. 2015. Diversity-induced multi-view subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 586–594.
[3]
Kamalika Chaudhuri, Sham M. Kakade, Karen Livescu, and Karthik Sridharan. 2009. Multi-view clustering via canonical correlation analysis. In Proceedings of the 26th Annual International Conference on Machine Learning. 129–136.
[4]
Corinna Cortes, Mehryar Mohri, and Afshin Rostamizadeh. 2009. Learning non-linear combinations of kernels. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 396–404.
[5]
S. El Hajjar, F. Dornaika, and F. Abdallah. 2022. Multi-view spectral clustering via constrained nonnegative embedding. Inf. Fusion 78 (2022).
[6]
Ehsan Elhamifar and Rene Vidal. 2013. Sparse subspace clustering: Algorithm, theory, and applications. IEEE Trans. Pattern Anal. Mach. Intell. 35, 11 (2013), 2765–2781.
[7]
Hongchang Gao, Feiping Nie, Xuelong Li, and Heng Huang. 2015. Multi-view subspace clustering. In Proceedings of the IEEE International Conference on Computer Vision. 4238–4246.
[8]
Athinodoros S. Georghiades, Peter N. Belhumeur, and David J. Kriegman. 2001. From few to many: Illumination cone models for face recognition under variable lighting and pose. IEEE Trans. Pattern Anal. Mach. Intell. 23, 6 (2001), 643–660.
[9]
Derek Greene and Pádraig Cunningham. 2006. Practical solutions to the problem of diagonal dominance in kernel document clustering. In Proceedings of the 23rd International Conference on Machine Learning. 377–384.
[10]
Derek Greene and Pádraig Cunningham. 2009. A matrix factorization approach for integrating multiple data views. In Proceedings of the Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 423–438.
[11]
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’16). 770–778.
[12]
T. He, Y. Liu, T. H. Ko, K. C. C. Chan, and Y. Ong. 2019. Contextual correlation preserving multiview featured graph clustering. IEEE Trans. Cybern. 50, 10 (2019), 1–14.
[13]
Mitsuhiko Horie and Hiroyuki Kasai. 2021. Consistency-aware and inconsistency-aware graph-based multi-view clustering. In Proceedings of the 28th European Signal Processing Conference (EUSIPCO’21). IEEE, 1472–1476.
[14]
Zhanxuan Hu, Feiping Nie, Wei Chang, Shuzheng Hao, Rong Wang, and Xuelong Li. 2020. Multi-view spectral clustering via sparse graph learning. Neurocomputing 384 (2020), 1–10.
[15]
Zhanxuan Hu, Feiping Nie, Rong Wang, and Xuelong Li. 2020. Multi-view spectral clustering via integrating nonnegative embedding and spectral embedding. Inf. Fusion 55 (2020), 251–259.
[16]
Hsin-Chien Huang, Yung-Yu Chuang, and Chu-Song Chen. 2012. Affinity aggregation for spectral clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 773–780.
[17]
Shudong Huang, Zhao Kang, Ivor W. Tsang, and Zenglin Xu. 2019. Auto-weighted multi-view clustering via kernelized graph learning. Pattern Recog. 88 (2019), 174–184.
[18]
Lawrence Hubert and Phipps Arabie. 1985. Comparing partitions. J. Classif. 2, 1 (1985), 193–218.
[19]
S. Jing-Tao and Z. Qiu-Yu. 2020. Completion of multiview missing data based on multi-manifold regularised non-negative matrix factorisation. Artif. Intell. Rev. 53 (2020), 5411–5428.
[20]
Zhao Kang, Chong Peng, and Qiang Cheng. 2017. Kernel-driven similarity learning. Neurocomputing 267 (2017), 210–219.
[21]
Zhao Kang, Chong Peng, and Qiang Cheng. 2017. Twin learning for similarity and clustering: A unified kernel approach. arXiv preprint arXiv:1705.00678 (2017).
[22]
Zhao Kang, Guoxin Shi, Shudong Huang, Wenyu Chen, Xiaorong Pu, Joey Tianyi Zhou, and Zenglin Xu. 2020. Multi-graph fusion for multi-view spectral clustering. Knowledge-based Syst. 189 (2020), 105102.
[23]
M. T. Kejani, F. Dornaika, and H. Talebi. 2020. Graph convolution networks with manifold regularization for semi-supervised learning. Neural Netw. 127 (2020).
[24]
Ghufran Ahmad Khan, Jie Hu, Tianrui Li, Bassoma Diallo, and Shengdong Du. 2023. Multi-view subspace clustering for learning joint representation via low-rank sparse representation. Appl. Intell. 53 (2023).
[25]
Abhishek Kumar and Hal Daume. 2011. A co-training approach for multi-view spectral clustering. In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML’11). Omnipress, Madison, WI, 393–400.
[26]
Abhishek Kumar, Piyush Rai, and Hal Daumé. 2011. Co-regularized multi-view spectral clustering. In Proceedings of the 24th International Conference on Neural Information Processing Systems (NIPS’11). Curran Associates Inc., Red Hook, NY, 1413–1421.
[27]
Yann LeCun and Corinna Cortes. 2010. MNIST handwritten digit database. Retrieved from http://yann.lecun.com/exdb/mnist/
[28]
Jia Li and James Z. Wang. 2008. Real-time computerized annotation of pictures. IEEE Trans. Pattern Anal. Mach. Intell. 30, 6 (2008), 985–1002.
[29]
B. Liu, L. Huang, C. Wang, S. Fan, and P. S. Yu. 2019. Adaptively weighted multiview proximity learning for clustering. IEEE Trans. Cybern. 51, 3 (2019), 1–15.
[30]
Xinwang Liu, Xinzhong Zhu, Miaomiao Li, Lei Wang, Chang Tang, Jianping Yin, Dinggang Shen, Huaimin Wang, and Wen Gao. 2019. Late fusion incomplete multi-view clustering. IEEE Trans. Pattern Anal. Mach. Intell. 41, 10 (2019), 2410–2423.
[31]
Laurens van der Maaten and Geoffrey Hinton. 2008. Visualizing data using t-SNE. J. Mach. Learn. Res. 9, Nov. (2008), 2579–2605.
[32]
V. Mehta, S. Bawa, and J. Singh. 2020. Analytical review of clustering techniques and proximity measures. Artif. Intell. Rev. 53 (2020), 5995–6023.
[33]
Amir Monadjemi, B. T. Thomas, and Majid Mirmehdi. 2002. Experiments on High Resolution Images towards Outdoor Scene Classification. Technical Report, University of Bristol.
[34]
Sameer A. Nene, Shree K. Nayar, and Hiroshi Murase. 1996. Columbia object image library (coil-100). Technical Report No. CUCS-006-96, University of Columbia.
[35]
Feiping Nie, Guohao Cai, and Xuelong Li. 2017. Multi-view clustering and semi-supervised classification with adaptive neighbours. In Proceedings of the 31st AAAI Conference on Artificial Intelligence.
[36]
Feiping Nie, Jing Li, and Xuelong Li. 2016. Parameter-free auto-weighted multiple graph learning: A framework for multiview clustering and semi-supervised classification. In Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI’16). 1881–1887.
[37]
Feiping Nie, Jing Li, and Xuelong Li. 2017. Self-weighted multiview clustering with multiple graphs. In Proceedings of the 26th International Joint Conference on Artificial Intelligence (IJCAI’17).
[38]
Feiping Nie, Lai Tian, and Xuelong Li. 2018. Multiview clustering via adaptively weighted procrustes. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2022–2030.
[39]
F. Nie, X. Wang, M. Jordan, and H. Huang. 2016. The constrained Laplacian rank algorithm for graph-based clustering. In Proceedings of the 30th AAAI Conference on Artificial Intelligence (AAAI’16).
[40]
Xi Peng, Zhenyu Huang, Jiancheng Lv, Hongyuan Zhu, and Tianyi Joey Zhou. 2019. COMIC: Multi-view clustering without parameter selection. In Proceedings of the International Conference on Machine Learning.
[41]
Zhenwen Ren, Haoyun Lei, Quansen Sun, and Chao Yang. 2021. Simultaneous learning coefficient matrix and affinity graph for multiple kernel clustering. Inf. Sci. 547 (2021), 289–306.
[42]
Zhenwen Ren, Haoran Li, Chao Yang, and Quansen Sun. 2020. Multiple kernel subspace clustering with local structural graph and low-rank consensus kernel learning. Knowl.-based Syst. 188 (2020), 105040.
[43]
Alex Rodriguez and Alessandro Laio. 2014. Clustering by fast search and find of density peaks. Science 344, 6191 (2014), 1492–1496.
[44]
Ferdinando S. Samaria and Andy C. Harter. 1994. Parameterisation of a stochastic model for human face identification. In Proceedings of the IEEE Workshop on Applications of Computer Vision. IEEE, 138–142.
[45]
Uri Shaham, Kelly Stanton, Henry Li, Ronen Basri, Boaz Nadler, and Yuval Kluger. 2018. SpectralNet: Spectral clustering using deep neural networks. In Proceedings of the International Conference on Learning Representations.
[46]
Shaojun Shi, Feiping Nie, Rong Wang, and Xuelong Li. 2020. Auto-weighted multi-view clustering via spectral embedding. Neurocomputing 399 (2020).
[47]
Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014).
[48]
H. Tao, C. Hou, D. Yi, J. Zhu, and D. Hu. 2019. Joint embedding learning and low-rank approximation: A framework for incomplete multiview learning. IEEE Trans. Cybern. 51, 3 (2019), 1–14.
[49]
Grigorios Tzortzis and Aristidis Likas. 2012. Kernel-based weighted multi-view clustering. In Proceedings of the IEEE 12th International Conference on Data Mining. IEEE, 675–684.
[50]
René Vidal. 2011. Subspace clustering. IEEE Sig. Process. Mag. 28, 2 (2011), 52–68.
[51]
Ulrike Von Luxburg. 2007. A tutorial on spectral clustering. Stat. Comput. 17, 4 (2007), 395–416.
[52]
X. Wang, T. Zhang, and X. Gao. 2019. Multiview clustering based on non-negative matrix factorization and pairwise measurements. IEEE Trans. Cybern. 49, 9 (2019), 3333–3346.
[53]
J. Wen, Z. Zhang, Z. Zhang, L. Fei, and M. Wang. 2020. Generalized incomplete multiview clustering with flexible locality structure diffusion. IEEE Trans. Cybern. 51, 1 (2020), 1–14.
[54]
Martha White, Xinhua Zhang, Dale Schuurmans, and Yao-liang Yu. 2012. Convex multi-view subspace learning. In Proceedings of the International Conference on Advances in Neural Information Processing Systems. 1673–1681.
[55]
John Winn and Nebojsa Jojic. 2005. Locus: Learning object classes with unsupervised segmentation. In Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV’05). IEEE, 756–763.
[56]
Z. Wu, S. Liu, C. Ding, Z. Ren, and S. Xie. 2019. Learning graph similarity with large spectral gap. IEEE Trans. Syst., Man, Cybern.: Syst. (2019), 1–11.
[57]
Tian Xia, Dacheng Tao, Tao Mei, and Yongdong Zhang. 2010. Multiview spectral embedding. IEEE Trans. Syst., Man, Cybern., Part B (Cybern.) 40, 6 (2010), 1438–1446.
[58]
D. Xie, X. Zhang, Q. Gao, J. Han, S. Xiao, and X. Gao. 2020. Multiview clustering by joint latent representation and similarity learning. IEEE Trans. Cybern. 50, 11 (2020), 1–7.
[59]
L. Xing, B. Chen, S. Du, Y. Gu, and N. Zheng. 2021. Correntropy-based multiview subspace clustering. IEEE Trans. Cybern. 51, 6 (2021), 1–14.
[60]
Chang Xu, Dacheng Tao, and Chao Xu. 2015. Multi-view self-paced learning for clustering. In Proceedings of the 24th International Joint Conference on Artificial Intelligence.
[61]
Z. Yang, N. Liang, W. Yan, Z. Li, and S. Xie. 2021. Uniform distribution non-negative matrix factorization for multiview clustering. IEEE Trans. Cybern. 51, 6 (2021), 1–14.
[62]
Qiyue Yin, Shu Wu, Ran He, and Liang Wang. 2015. Multi-view clustering via pairwise sparse subspace representation. Neurocomputing 156 (2015), 12–21.
[63]
Kun Zhan, Feiping Nie, Jing Wang, and Yi Yang. 2019. Multiview consensus graph clustering. IEEE Trans. Image Process. 28, 3 (2019), 1261–1270.
[64]
K. Zhan, C. Zhang, J. Guan, and J. Wang. 2018. Graph learning for multiview clustering. IEEE Trans. Cybern. 48, 10 (2018), 2887–2895.
[65]
Changqing Zhang, Huazhu Fu, Si Liu, Guangcan Liu, and Xiaochun Cao. 2015. Low-rank tensor constrained multiview subspace clustering. In Proceedings of the IEEE international Conference on Computer Vision. 1582–1590.
[66]
Changqing Zhang, Qinghua Hu, Huazhu Fu, Pengfei Zhu, and Xiaochun Cao. 2017. Latent multi-view subspace clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4279–4287.
[67]
Zhao Zhang, Jiahuan Ren, Sheng Li, Richang Hong, Zhengjun Zha, and Meng Wang. 2019. Robust subspace discovery by block-diagonal adaptive locality-constrained representation. In Proceedings of the 27th ACM International Conference on Multimedia. 1569–1577.
[68]
Yilu Zheng, X. Zhang, Yinlong Xu, Mingwei Qin, Zhenwen Ren, and Xuqian Xue. 2020. Robust multi-view subspace clustering via weighted multi-kernel learning and co-regularization. IEEE Access 8 (2020), 113030–113041.
[69]
Guo Zhong and Chi-Man Pun. 2020. Subspace clustering by simultaneously feature selection and similarity learning. Knowl.-based Syst. 193 (2020), 105512.
[70]
Guo Zhong and Chi-Man Pun. 2023. Self-taught multi-view spectral clustering. Pattern Recog. 138 (2023), 109349.
[71]
T. Zhou, Changqing Zhang, Xi Peng, H. Bhaskar, and J. Yang. 2020. Dual shared-specific multiview subspace clustering. IEEE Trans. Cybern. 50 (2020), 3517–3530.
[72]
Xiaofeng Zhu, Yonghua Zhu, and Wei Zheng. 2020. Spectral rotation for deep one-step clustering. Pattern Recog. 105 (2020), 107175.
[73]
A. Zubaroglu and V. Atalay. 2021. Data stream clustering: A review. Artif. Intell. Rev. 54 (2021), 1201–1236.
Recommendations
Direct multi-view spectral clustering with consistent kernelized graph and convolved nonnegative representation
AbstractMulti-view clustering attempts to partition unlabeled objects into clusters by making full use of complementary and consistent information in the features of multiple views. Most existing methods perform this task in three sequential phases: ...
Consensus graph and spectral representation for one-step multi-view kernel based clustering
AbstractRecently, multi-view clustering has received much attention in the fields of machine learning and pattern recognition. Spectral clustering for single and multiple views has been the common solution. Despite its good clustering ...
One step multi-view spectral clustering via joint adaptive graph learning and matrix factorization
AbstractMulti-view clustering based on graph learning has attracted extensive attention due to its simplicity and efficiency in recent years. However, there are still some issues in most of the existing graph-based multi-view clustering ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 19 December 2023
Online AM: 27 October 2023
Accepted: 25 September 2023
Revised: 05 July 2023
Received: 09 July 2022
Published in TIST Volume 15, Issue 1
Check for updates
Author Tags
Qualifiers
- Research-article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 231Total Downloads
- Downloads (Last 12 months)170
- Downloads (Last 6 weeks)12
Reflects downloads up to 18 Jan 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in