Abstract
In machine learning, we presume datasets to be labeled while performing any operation. But, is it true in real-life scenarios? To its contrary, we have an enormous amount of unlabeled datasets available in the form of images, videos, audios, articles, and many more. The major challenge we face is to train our classification model with primitive machine learning algorithms because these algorithms only expect labeled data. To overcome these limitations visual domain adaptation algorithms such as MEDA (Manifold Embedded Distribution Alignment) have been introduced. The main motto of MEDA is to minimize the distribution difference between the source domain (an application that contains enough labeled data) and the target domain (an application that contains only unlabeled data). In this way, the source domain labeled data can be utilized to enhance the performance of the target domain classifier. Though MEDA (Manifold Embedded Distribution Alignment) approach shows remarkable improvement in classification accuracy, but still there is considerable scope of improvement. There are plenty of irrelevant features in both domains. These irrelevant features create a hole for this algorithm and prevent the target domain classifier from becoming more robust. Therefore, for the purpose of filling this hole, we propose a new feature selection based visual domain adaptation (FSVDA) method which uses particle swarm optimization (PSO), where the MEDA method is considered as a fitness function that leads to automatically select a good subset of features over both the domains. Extensive experimental results on two real-world domain adaptation (DA) data sets such as object recognition and digit recognition demonstrate that our proposed method outperforms state-of-the-art primitive and domain DA algorithms. It is a big challenge to train the classifier for a new unlabeled image dataset in image classification and computer vision. The two magnificent solutions to this challenge are transfer learning and domain adaptation. By transfer learning, we can use our knowledge from previously trained models for training newer models.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Fernando, B., Habrard, A., Sebban, M., Tuytelaars, T.: Unsupervised visual domain adaptation using subspace alignment. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2960–2967 (2013)
Ghifary, M., Balduzzi, D., Kleijn, W.B., Zhang, M.: Scatter component analysis: a unified framework for domain adaptation and domain generalization. IEEE Tran. Pattern Anal. Mach. Intell. 39(7), 1414–1430 (2016)
Gong, B., Shi, Y., Sha, F., Grauman, K.: Geodesic flow kernel for unsupervised domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2012), pp. 2066–2073. IEEE (2012)
Ionescu, B., Lupu, M., Rohm, M., Gînsca, A.L., Müller, H.: Datasets column: diversity and credibility for social images and image retrieval. ACM SIGMultimedia Rec. 9(3), 7 (2018)
Long, M., Wang, J., Ding, G., Pan, S.J., Philip, S.Y.: Adaptation regularization: a general framework for transfer learning. IEEE Trans. Knowl. Data Eng. 26(5), 1076–1089 (2014)
Long, M., Wang, J., Ding, G., Sun, J., Yu, P.S.: Transfer feature learning with joint distribution adaptation. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2200–2207 (2013)
Nguyen, B.H., Xue, B., Andreae, P.: A particle swarm optimization based feature selection approach to transfer learning in classification. In: Proceedings of the Genetic and Evolutionary Computation Conference, pp. 37–44 (2018)
Pan, S.J., Tsang, I.W., Kwok, J.T., Yang, Q.: Domain adaptation via transfer component analysis. IEEE Trans. Neural Networks 22(2), 199–210 (2011)
Sanodiya, R.K., Mathew, J.: A framework for semi-supervised metric transfer learning on manifolds. Knowl.-Based Syst. 176, 1–14 (2019)
Shawe-Taylor, J., Bartlett, P.L., Williamson, R.C., Anthony, M.: Structural risk minimization over data-dependent hierarchies. IEEE Trans. Inf. Theory 44(5), 1926–1940 (1998)
Sun, B., Saenko, K.: Subspace distribution alignment for unsupervised domain adaptation. BMVC. 4, 24–1 (2015)
Wang, J., Feng, W., Chen, Y., Yu, H., Huang, M., Yu, P.S.: Visual domain adaptation with manifold embedded distribution alignment. In: 2018 ACM Multimedia Conference on Multimedia Conference, pp. 402–410. ACM (2018)
Zeugmann, T., et al.: Particle swarm optimization, Encyclopedia of machine learning, Springer, US, pp. 760–766 (2011)
Zhang, J., Li, W., Ogunbona, P.: Joint geometrical and statistical alignment for visual domain adaptation. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1859–1867 (2017)
Zhang, J., Li, W., Ogunbona, P.: Transfer learning for cross-dataset recognition: a survey. arXiv preprint arXiv:1705.04396 (2017)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Sanodiya, R.K., Paul, D., Yao, L., Mathew, J., Juhi, A. (2020). A Feature Selection Approach to Visual Domain Adaptation in Classification. In: Yang, H., Pasupa, K., Leung, A.CS., Kwok, J.T., Chan, J.H., King, I. (eds) Neural Information Processing. ICONIP 2020. Lecture Notes in Computer Science(), vol 12533. Springer, Cham. https://doi.org/10.1007/978-3-030-63833-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-030-63833-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-63832-0
Online ISBN: 978-3-030-63833-7
eBook Packages: Computer ScienceComputer Science (R0)