Multimodal Biometric System Based on Near- Infra-Red Dorsal Hand Geometry and Fingerprints for Single and Whole Hands

Prior research evidenced that unimodal biometric systems have several tradeoffs like noisy data, intra-class variations, restricted degrees of freedom, non-universality, spoof attacks, and unacceptable error rates. In order for the biometric system to be more secure and to provide high performance accuracy, more than one form of biometrics are required. Hence, the need arise for multimodal biometrics using combinations of different biometric modalities. This paper introduces a multimodal biometric system (MMBS) based on fusion of whole dorsal hand geometry and fingerprints that acquires right and left (Rt/Lt) near-infra-red (NIR) dorsal hand geometry (HG) shape and (Rt/Lt) index and ring fingerprints (FP). Database of 100 volunteers were acquired using the designed prototype. The acquired images were found to have good quality for all features and patterns extraction to all modalities. HG features based on the hand shape anatomical landmarks were extracted. Robust and fast algorithms for FP minutia points feature extraction and matching were used. Feature vectors that belong to similar biometric traits were fused using feature fusion methodologies. Scores obtained from different biometric trait matchers were fused using the Min-Max transformation-based score fusion technique. Final normalized scores were merged using the sum of scores method to obtain a single decision about the personal identity based on multiple independent sources. High individuality of the fused traits and user acceptability of the designed system along with its experimental high performance biometric measures showed that this MMBS can be considered for med-high security levels biometric identification purposes.

Authors:

• Mohamed K. Shahin
• Ahmed M. Badawi
• Mohamed E. M. Rasmy

Keywords:

• Unimodal
• Multi-Modal
• Biometric System
• NIR Imaging
• Dorsal Hand Geometry
• Fingerprint
• Whole Hands
• Feature Extraction
• Feature Fusion
• Score Fusion

References:

[1] S. Pankanti, S. Prabhakar, and A. K. Jain, "On the individuality of
fingerprints," IEEE Transactions on Pattern Analysis and Machine
Intelligence, vol. 24, pp. 1010-1025, 2002.
[2] A. K. Jain, A. Ross, and S. Prabhakar, "An introduction to biometric
recognition," IEEE Transactions on Circuits and Systems for Video
Technology, Special Issue on Image- and Video-Based Biometrics,
vol. 14, pp. 4-21, January 2004.
[3] M. Golfarelli, D. Maio, and D. Maltoni, "On the error-reject tradeoff
in biometric verification systems," IEEE Trans. on Pattern Anal.
and Mach. Intell., vol. 19, pp. 786-796, July 1997.
[4] A. Ross and A. K. Jain, "Multimodal biometrics: An overview,"
Proc. of 12th European Signal Processing Conference (EUSIPCO),
Vienna, Austria, pp. 1221-1224, September 2004.
[5] J. Cui, J. P. Li, and X. J. Lu, "Study on multi-Biometric feature
fusion and recognition model," Proc. of International Conference on
Apperceiving Computing and Intelligence Analysis (ICACIA),
Chengdu, China, pp. 66-69, 2009.
[6] A. K. Jain, "Biometric recognition: Overview and recent advances,"
Progress in Pattern Recognition, Image Analysis and Applications,
pp. 13-19, 2007.
[7] D. Maltoni, D. Maio, A. K. Jain, and S. Prabhakar, "Handbook of
fingerprint recognition," Springer-Verlag, 2003.
[8] V. M. Mane and D. V. Jadhav, "Review of multimodal biometrics:
Applications, challenges and research areas," Int. Journal of
Biometrics and Bioinformatics (IJBB), vol. 3, 2009.
[9] M. M. Monwar and M. L. Gavrilova, "Multimodal biometric system
using rank-level fusion approach," IEEE Transactions on Systems
Man and Cybernetics Part B (Cybernetics), vol. 39, pp. 867-878,
2009.
[10] A. Ross and A. K. Jain, "Information fusion in biometrics," Pattern
Recognition Letters, vol. 24, pp. 2115-2125, Sep. 2003.
[11] A. Ross, K. Nandakumar, and A. K. Jain, "Handbook of
multibiometrics," New York: Springer-Verlag, 2006.
[12] M. F. Zanuy, J. F. Aguilar, J. O. Garcia, and J. G. Rodriguez,
"Multimodal biometric databases: An overview," Conference
Report, IEEE 39th International Carnahan Conf. on Security
Technology, Las Palmas de Gran Canary, Spain, October 2005.
[13] K. W. Bowyer, K. I. Chang, P. Yan, P. J. Flynn, E. Hansley, and S.
Sarkar, "Multi-modal biometrics: An overview," 2nd Workshop on
Multi-Modal User Authentication, France., 2006.
[14] A. K. Jain and A. Ross, "Fingerprint mosaicking," IEEE
International Conference on Acoustics, Speech, and Signal
Processing, Orlando, USA, vol. 4, pp. 4064-4067, 2002.
[15] T. Kinnunen, V. Hautamaki, and P. Franti, "Fusion of spectral
feature sets for accurate speaker identification," Proc. of 9th Conf.
Speech Comput., Russia, pp. 361-365, 2004.
[16] A. Kumar, D. C. M. Wong, H. C. Shen, and A. K. Jain, "Personal
verification using palmprint and hand geometry biometric," in
Audio- and Video-Based Biometric Person Authentication. vol.
2688, ed: Springer Berlin Heidelberg, 2003, pp. 668-678.
[17] A. Kumar and D. Zhang, "Combining fingerprint, palmprint and
hand-shape for user authentication," Proc. of International
Conference of Pattern Recognition (ICPR), pp. 549-552, 2006.
[18] A. Kumar and D. Zhang, "Personal recognition using hand shape
and texture," IEEE Trans. on Image Processing, vol. 15, pp. 2454-
2461, August 2006.
[19] K. Nandakumar, A. K. Jain, and A. Ross, "Fusion in Multibiometric
identification systems: What about the missing data?" Proc. of the
3rd IAPR/IEEE International Conference on Biometrics (ICB),
Alghero, Italy, June 2009.
[20] K. Nandakumar, A. Ross, and A. K. Jain, "Incorporating ancillary
information in multibiometric systems," Handbook of Biometrics.
New York: Springer-Verlag, pp. 335-355, 2007.
[21] N. Poh and S. Bengio, "How do correlation and variance of baseexperts
affect fusion in biometric authentication tasks?," IEEE
Transactions on Signal Processing, vol. 53, pp. 4384-4396, 2005.
[22] S. Ribaric and I. Fratric, "Experimental evaluation of matchingscore
normalization techniques on different multimodal biometric
systems," IEEE MELECON, Malaga, Spain, 2006.
[23] A. Ross and R. Govindarajan, "Feature level fusion using hand and
face biometrics," Proc. of SPIE Conference on Biometric
Technology for Human Identification II, Orlando, USA, vol. 5779,
pp. 196-204, 2005.
[24] R. K. Rowe, U. Uludag, M. Demirkus, S. Parthasaradhi, and A. K.
Jain, "A multispectral whole-hand biometric authentication system,"
Proc. of Biometric Symposium, Biometric Consortium Conference,
Baltimore, September 2007.
[25] B. Schouten and B. Jacobs, "Biometrics and their use in epassports,"
Image and Vision Computing, vol. 27, pp. 305-312,
February 2009.
[26] M. K. Shahin, A. M. Badawi, and M. E. Rasmy, "A multimodal
hand vein, hand geometry, and fingerprint prototype design for high
security biometrics," Proc. of 4th IEEE Cairo Int. Biomedical
Engineering Conf. (CIBEC2008), Egypt, Dec. 2008.
[27] T. Sim, S. Zhang, R. Janakiraman, and S. Kumar, "Continuous
verification using multimodal biometrics," IEEE Transactions on
Pattern Analysis and Machine Intelligence, vol. 29, pp. 687-700,
2007.
[28] R. Snelick, U. Uludag, A. Mink, M. Indovina, and A. K. Jain,
"Large-scale evaluation of multimodal biometric authentication
using state-of-the-art systems," IEEE Transactions on Pattern
Analysis and Machine Intelligence, vol. 27, pp. 450-455, 2005.
[29] K. A. Toh, "Error-rate based biometrics fusion," S.W. Lee and S.Z.
Li (Eds): ICB 2007, LNCS, Springer-Verlag Berlin/Heidelberg, vol.
4642, pp. 191-200, 2007.
[30] X. Y. Wei, D. Xu, and C. W. Ngo, "Multibiometrics based on
palmprint and hand geometry," Proc. of 4th International Conf. on
Computer and Information Science (ICIS-05), 2005.
[31] X. Wu, K. Wang, F. Zhang, and D. Zhang, "Fusion of phase and
orientation information for palmprint authentication," Proc. of Int.
Conf. on Image Processing (ICIP), September 2005.
[32] L. Q. Zhu and S. Y. Zhang, "Multimodal biometric identification
system based on finger geometry, knuckle print, and palm print,"
Pattern Recog. Letters, On-Line, June 2010.
[33] J. Ortega-Garcia, J. Fierrez-Aguilar, D. Simon, J. Gonzalez-
Rodriguez, M. Faundez, V. Espinosa, A. Satue, I. Hernaez, J. J.
Igarza, C. Vivaracho, D. Escudero, and Q. I. Moro, "MCYT
baseline corpus: A bimodal biometric database," IEE Proc. on
Vision, Image and Signal Proc., Special Issue on Biometrics on the
Internet, vol. 150, pp. 395-401, December, 2003.
[34] M. K. Shahin, A. M. Badawi, and M. S. Kamel, "Biometric
authentication using fast correlation of hand vein patterns," Proc. of
3rd IEEE Cairo International Biomedical Engineering Conference
(CIBEC06), Cairo, Egypt, December 2006.
[35] M. K. Shahin, A. M. Badawi, and M. S. Kamel, "Biometric
authentication using fast correlation of near infrared hand vein
patterns," International Journal of Biological and Life Sciences, vol.
2, pp. 141-148, 2007.
[36] J. Egan, "Signal detection theory and ROC analysis," Academic
Press, New York, 1975.
[37] http://www.securityfocus.com/news/6717, Accessed June 2006.
[38] H. Chen, H. Valizadegan, C. Jackson, S. Soltysiak, and A. K. Jain,
"Fake hands: Spoofing hand geometry systems," Biometric
Consortium, Washington DC, September 2005.
[39] N. Abd-El-Rahman, "A prototype of automatic hand geometry
verification system," Master Thesis, Cairo University, Faculty of
Engineering, Systems and Biomedical Dept., 2002.
[40] M. K. Shahin, A. M. Badawi, and M. S. kamel, "On-line, low-cost
and PC-based fingerprint verification system based on solid-state
capacitance sensor," Proc. of IEEE International Conference on
Industrial Electronics, Technology and Automation
(IETA2001),Cairo Egypt, December 2001.
[41] http://www.veridicom.com/, Accessed January 2005.
[42] http://www.elexol.com/, Accessed April 2006.
[43] A. Badawi and M. Kamel, "Freestyle hand geometry verification
system," Proc. of 46th IEEE Midwest Symposium on circuits and
systems, 2003.
[44] A. M. Badawi, S. A. El-Naggar, and M. S. Kamel, "Freestyle nonguided
true-anatomical biometrics: A fusion of hand geometry and
texture features," Proc. of 3rd IEEE Cairo Int. Biomedical
Engineering Conf. (CIBEC2006), Cairo, Eygpt, December 2006.
[45] S. El-Naggar, "Freestyle hand biometric system based on geometry
and texture features," Master Thesis, Cairo Univ., Faculty of
Engineering, Systems and Biomedical Dept., 2005.
[46] A. M. Badawi and M. K. Shahin, "Frequency domain spectral hand
vein patterns authentication," Proc. of 3rd IEEE Cairo Int.
Biomedical Engineering Conf. (CIBEC2006), Egypt, December
2006.
[47] M. K. Shahin, "Hand vein based biometric verification system,"
Master Thesis, Cairo University, Faculty of Engineering, Systems
and Biomedical Dept., 2005.
[48] S. Chikkerur, "Online fingerprint verification system," Master
Thesis, the State University of New York at Buffalo, 2005.
[49] C. I. Watson, M. D. Garris, E. Tabassi, C. L. Wilson, R. M.
McCabe, S. Janet, and K. Ko, "User's guide to NIST biometric
image software (NBIS)," Technical Report National Institute of
Standards and Technology, 2008.
[50] S. Chikkerur, A. N. Cartwright, and V. Govindaraju, "K-plet and
coupled BFS: A graph based fingerprint representation and
matching algorithm," International Conference on Biometrics (ICB),
pp. 309-315, 2006.
[51] A. K. Jain, A. Ross, and S. Pankanti, "A prototype Hand geometrybased
verification system," Proc. of 2nd International Conference
on Audio- and Video-based Biometric Person Authentication,
Washington D.C., pp. 166-171, March 1999.
[52] "The Facial Recognition Technology (FERET) Database,"
http://www.itl.nist.gov/iad/humanid/feret/feret_master.html, 2004.