Abstract
In this paper, based on the extension to the standard Support Vector Machines Plus (SVM+) model for the Learning Using Privileged Information (LUPI) paradigm, a new SVM+ThinkTank (SVM+TT) model, is proposed for Learning Using Multiple-Type Privileged Information (LUMTPI). In cases that Multiple-Type Privileged Information (MTPI) from different perspectives is available for interpreting those training samples, such as in Big Data Analytics, it could be beneficial to leverage all these different types of Privileged Information collectively to construct multiple correcting spaces simultaneously for training the maximum margin based separating hyperplane of SVM model. In fact, from the practical point of view, organising Privileged Information from different perspectives might be a relatively easier task than finding a single type perfect Privileged Information for those hardest training samples. The MTPI collectively plays the role of a think tank as the single type Privileged Information plays the role of a single perfect master class teacher. The preliminary experimental results presented and analysed in this paper demonstrate that SVM+TT, as a new learning instrument for the proposed LUMTPI paradigm, is capable of improving the generalisation ability of the standard SVM+ in learning from a small amount of training samples but incorporating with the MTPI interpretations to these samples for improved learning performance.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Vapnik, V., Izmailov, R.: Learning using privileged information: similarity control and knowledge transfer. J. Mach. Learn. Res. 16, 2023–2049 (2015)
Vapnik, V., Izmailov, R.: Learning with intelligent teacher. In: Gammerman, A., Luo, Z., Vega, J., Vovk, V. (eds.) COPA 2016. LNCS, vol. 9653, pp. 3–19. Springer, Heidelberg (2016). doi:10.1007/978-3-319-33395-3_1
Wang, S., Yang, J.: Learning to transfer privileged ranking attribute for object classification. J. Inf. Comput. Sci. 12(1), 367–380 (2015)
Liu, J., Zhu, W., Zhong, P.: A new multi-class support vector algorithm based on privileged information. J. Inf. Comput. Sci. 10(2), 443–450 (2013)
Sharmanska, V., Quadrianto, N., Lampert, C.: Learning to Transfer Privileged Information, CoRR, October 2014
Sharmanska, V., Quadrianto, N., Lampert, C.: Learning to rank using privileged information. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV 2013), 1–8 December 2013
Serra-Toro, C., Traver, V., Pla, F.: Exploring some practical issues of SVM+: is really privileged information that helps? Pattern Recogn. Lett. 42, 40–46 (2014)
Vapnik, V.: Statistical Learning Theory. Wiley, New York (1998)
Cai, F.: Advanced Learning Approaches Based on SVM+ Methodology. Ph.D. thesis, the University of Minnesota, July 2011
Liang, L., Cherkassky, V.: Connection between SVM+ and multi-task learning. In: Proceedings of the IJCNN (2008)
Evgeniou, T., Pontil, M.: Regularized multi-task learning. In: Proceedings of the 17th SIGKDD Conference on Knowledge Discovery and Data Mining (2004)
Ji, Y., Sun, S., Lu, Y.: Multitask multiclass privileged information support vector machines. In: Proceedings of the ICPR, pp. 2323–2326. IEEE (2012)
Lapin, M., Hein, M., Schiele, B.: Learning using privileged information: SVM+ and weighted SVM. Neural Netw. (2014)
Zhang, Y., Zhang, L., Hossain, A.: Adaptive 3D facial action intensity estimation and emotion recognition. Expert Syst. Appl. 42(3), 1446–1464 (2015)
Zhang, Y., Zhang, L., Neoh, S.C., Mistry, K., Hossain, A.: Intelligent affect regression for bodily expressions using hybrid particle swarm optimization and adaptive ensembles. Expert Syst. Appl. 42(22), 8678–8697 (2015)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing AG
About this paper
Cite this paper
Jiang, M., Zhang, L. (2017). Learning Using Multiple-Type Privileged Information and SVM+ThinkTank. In: Angelov, P., Manolopoulos, Y., Iliadis, L., Roy, A., Vellasco, M. (eds) Advances in Big Data. INNS 2016. Advances in Intelligent Systems and Computing, vol 529. Springer, Cham. https://doi.org/10.1007/978-3-319-47898-2_9
Download citation
DOI: https://doi.org/10.1007/978-3-319-47898-2_9
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-47897-5
Online ISBN: 978-3-319-47898-2
eBook Packages: EngineeringEngineering (R0)