Abstract
Multibiometric system employs two or more behavioral or physical information from a person’s traits for the verification and identification processes. Many researches have proved that multibiometric system can improve the performances of single biometric system. In this study, three types of fusion levels i.e feature level fusion, score level fusion and decision level fusion have been tested. Feature level fusion involves feature concatenation of the features from two modalities before the pattern matching process while score level fusion is executed by calculating the mean score from both biometrics scores produced after the pattern matching. Finally, for the decision level fusion, the logic AND and OR are performed on the final decision of the two modalities. In this study, speech signal is used as a biometric trait to the biometric verification system while lipreading image is used as a second modality to assist the performance of the single modal system. For speech signal, Mel Frequency Ceptral Coefficient (MFCC) is used as speech features while region of interest (ROI) of lipreading is used as visual features. Consequently, support vector machine (SVM) is executed as classifier. Performances of the systems for each fusion level is compared based on accuracy percentage and Receiver Operation Characteristic (ROC) curve by plotting Genuine Acceptance Rate (GAR) versus False Acceptance Rate (FAR. Experimental results show that score level fusion performance is the most outstanding method followed by feature level fusion and finally the decision level fusion. The accuracy percentages using 20 training data are observed as 99.9488%, 99.7534% and 99.6639% for the score level fusion, feature level fusion and decision level fusion, respectively.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Jain, A.K., Ross, A., Prabhakar, S.: An Introduction to Biometric Recognition. IEEE Transactions on Circuits and Systems for Video Technology 14(1), 4–20 (2004)
Reynolds, D.A.: An Overview of Automatic Speaker Recognition Technology. IEEE Transactions on Acoustic, Speech and Signal Processing 4, 4072–4075 (2002)
Ramli, D.A., Samad, S.A., Hussain, A.: A Multibiometric Speaker Authentication System with SVM Audio Reliability Indicator. IAENG International Journal of Computer Science 36(4), 313–321 (2008)
Kong, S.G., Heo, J., Abidi, B.R., Paik, J., Abidi, M.A.: Recent Advances in Visual and Infrared Face Recognition–A Review. Computer Vision an Image Understanding 97(1), 103–135 (2005)
Marcialis, G.L., Roli, F.: Fingerprint Verification by Fusion of Optical and Capacitive Sensors. Pattern Recognition Letters 25, 1315–1322 (2004)
Yong, F.A., Xiao, Y.J., Hau, S.W.: Face and Palmprint Feature Level Fusion for Single Sample Biometrics Recognition. Neurocomputing 70, 1582–1586 (2007)
Zhou, X., Bhanu, B.: Feature Fusion of Side Face and Gait for Video based Human Identification. Pattern Recognition 41, 778–795 (2008)
Jain, A., Nandakumar, K., Ross, A.: Score Normalization in Multimodal Biometric Systems. Pattern Recognition 38, 2270–2285 (2005)
Cetingul, H.E., Erzin, E., Yemez, Y., Tekalp, A.M.: Multimodal Speaker/Speech Recognition using Lip Motion, Lip Texture and Audio. Signal Processing 86, 3549–3558 (2006)
Patra, A., Das, S.: Enhancing Decision Combination of Face and Fingerprint by Exploitation of Individual Classifier Space, an Approach to Multi-Modal Biometry. Pattern Recognition 41, 2298–2308 (2008)
Sanderson, C., Paliwal, K.K.: Noise Compensation in a Multi-Modal Verification System. In: Proceeding of International Conference on Acoustic, Speech and Signal Processing, pp. 157–160 (2001)
Becchetti, C., Ricotti, L.R.: Speech Recognition: Theory and C++ Implementation. John Wiley & Son Ltd., England (1999)
Furui, S.: Cepstral Analysis Technique for Automatic Speaker Verification. IEEE Transactions on Acoustic, Speech Signal processing 29(2), 254–272 (1981)
Samad, S.A., Ramli, D., Hussain, A.: Person Identification Using Lip Motion Sequence. In: Apolloni, B., Howlett, R.J., Jain, L. (eds.) KES 2007, Part I. LNCS (LNAI), vol. 4692, pp. 839–846. Springer, Heidelberg (2007)
Gunn, S.R.: 2005.Support Vector Machine for Classification and Regression. Technical report. Faculty of Engineering, Science and Mathematics, University of Southampton (2005)
Vapnik, V.N.: The nature of statistical learning theory. Springer, Heidelberg (1995)
Hauck, W.W., Koch, W., Abernethy, D., Williams, R.L.: Making Sense of Trueness, Precision, Accuracy, and Uncertainty. Pharmacopeial Forum 34(3), 838–842 (2008)
Fawcett, T.: An Introduction to ROC Analysis. Pattern Recognition Letters 27, 861–874 (2006)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag GmbH Berlin Heidelberg
About this chapter
Cite this chapter
Lip, C.C., Ramli, D.A. (2012). Comparative Study on Feature, Score and Decision Level Fusion Schemes for Robust Multibiometric Systems. In: Sambath, S., Zhu, E. (eds) Frontiers in Computer Education. Advances in Intelligent and Soft Computing, vol 133. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-27552-4_123
Download citation
DOI: https://doi.org/10.1007/978-3-642-27552-4_123
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-27551-7
Online ISBN: 978-3-642-27552-4
eBook Packages: EngineeringEngineering (R0)