Abstract
This paper concerns the generalizability of biometric identification results from small-sized closed systems to larger open systems. Many researchers have claimed high identification accuracies on closed system consisting of a few hundred or thousand members. Here, we consider what happens to these closed identification systems as they are opened to non-members. We claim that these systems do not generalize well as the non-member population increases. To support this claim, we present experimental results on writer and iris biometric databases using Support Vector Machine (SVM) and Nearest Neighbor (NN) classifiers. We find that system security (1-FAR) decreases rapidly for closed systems when they are tested in open-system mode as the number of non members tested increases. We also find that, although systems can be trained for greater closed-system security using SVM rather than NN classifiers, the NN classifiers are better for generalizing to open systems due to their superior capability of rejecting non-members.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Bolle, R.M., Connell, J.H., Pankanti, S., Ratha, N.K., Senior, A.W.: Guide to Biometrics. Springer, Heidelberg (2004)
Burges, C.: A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery 2, 121–167 (1998)
Cha, S.-H., Srihari, S.N.: Writer Identification: Statistical Analysis and Dichotomizer. In: Amin, A., Pudil, P., Ferri, F., Iñesta, J.M. (eds.) SPR 2000 and SSPR 2000. LNCS, vol. 1876, p. 123. Springer, Heidelberg (2000)
Cha, S.-H., Srihari, S.N.: Handwritten Document Image DatabaseConstruction and Retrieval System. In: Proceedings of SPIE Document Recognition and Retrieval VIII, San Jose, vol. 4307 (2001)
Duda, R.O., Hart, P.E., Stork, D.G.: Pattern Classification. John Wiley & Sons, Chichester (2001)
Gibbons, M.: On Evaluating Open Biometric Identification Systems. Master.s Thesis, CSIS Department, Pace University (2005)
Grother, P., Phillips, P.J.: Models of Large Population Recognition Performance. In: 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2004), Washington, D.C, vol. 2, pp. 68–77 (2004)
Hsu, C.-W., Chang, C.-C., Len, C.-J.: A Practical Guide to Support Vector Classification
Kee, G., Byun, Y., Lee, K., Lee, Y.: Improved Techniques for an Iris Recognition System with High Performance. Lecture Notes Artificial Intelligence. Springer, Heidelberg (2001)
Krichen, E., Mellakh, M.A., Garcia-Salicetti, S., Dorizzi, B.: Iris Identification Using Wavelet Packets. In: 17th International Conference on Pattern Recognition (ICPR 2004), pp. 335–338 (2004)
Kung, S.Y., Mak, M.W., Lin, S.H.: Biometric Authentication: A Machine Learning Approach. Pearson Education Company (2004)
Ma, Y., Pollick, F., Hewitt, W.T.: Using B-Spline Curves for Hand Recognition. In: 17th International Conference on Pattern Recognition (ICPR 2004), Cambridge UK, vol. 3, pp. 274–277 (2004)
Osuna, E., Freund, R., Girosi, F.: Support Vector Machines: Training and Applications. MIT Artificial Intelligence Laboratory and Center for Biological and Computational Learning Department of Brain and Cognitive Sciences. A.I. Memo No 1602, C.B.C.L. Paper No 144 (1997)
Prabhakar, S., Pankanti, S., Jain, A.K.: Biometric Recognition: Security & Privacy Concerns. IEEE Security and Privacy Magazine 1(2), 33–42 (2003)
Schlapbach, A., Bunke, H.: Off-line Handwriting Identification Using HMM Based Recognizers. In: 17th International Conference on Pattern Recognition (ICPR 2004), Cambridge UK, vol. 2, pp. 654–658 (2004)
Woodford, B.J., Deng, D., Benwell, G.L.: A Wavelet-based Neuro-fuzzy System forData Mining Small Image Sets
Zhang, D., Kong, W.-K., You, J., Wong, M.: Online Palmprint Identification. IEEE Transactions on Pattern Analysis and Machine Intelligence 25(9), 1041–1050 (2003)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Gibbons, M., Yoon, S., Cha, SH., Tappert, C. (2005). Evaluation of Biometric Identification in Open Systems. In: Kanade, T., Jain, A., Ratha, N.K. (eds) Audio- and Video-Based Biometric Person Authentication. AVBPA 2005. Lecture Notes in Computer Science, vol 3546. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11527923_86
Download citation
DOI: https://doi.org/10.1007/11527923_86
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-27887-0
Online ISBN: 978-3-540-31638-1
eBook Packages: Computer ScienceComputer Science (R0)