Color View Synthesis for Animated Depth Security X-ray Imaging

We demonstrate the synthesis of intermediary views within a sequence of color encoded, materials discriminating, X-ray images that exhibit animated depth in a visual display. During the image acquisition process, the requirement for a linear X-ray detector array is replaced by synthetic image. Scale Invariant Feature Transform, SIFT, in combination with material segmented morphing is employed to produce synthetic imagery. A quantitative analysis of the feature matching performance of the SIFT is presented along with a comparative study of the synthetic imagery. We show that the total number of matches produced by SIFT reduces as the angular separation between the generating views increases. This effect is accompanied by an increase in the total number of synthetic pixel errors. The trends observed are obtained from 15 different luggage items. This programme of research is in collaboration with the UK Home Office and the US Dept. of Homeland Security.

Authors:

• O. Abusaeeda
• J. P. O Evans
• D. Downes

Keywords:

• X-ray
• kinetic depth
• view synthesis
• KDE

References:

[1] J.P.O. Evans, "Stereoscopic imaging using folded linear dual-energy
X-ray detectors," Institute of Physics (IOP) Journal Meas. Sc. & Tech,
vol. 13, no. 9, pp. 1388-1397, 2002.
[2] J.P.O. Evans, M. Robinson, and S.X. Godber, "A new stereoscopic
X-ray imaging technique using a single X-ray source: theoretical
analysis," Non-Destructive Testing and Evaluation Int. (NDT&E), vol.
29, no. 1, pp. 27-35, 1996.
[3] J.P.O. Evans, and M. Robinson, "Design of a stereoscopic X-ray
imaging system using a single X-ray source," Non-Destructive Testing
and Evaluation Int. (NDT&E), vol. 33, no. 5, pp. 325-332, 2000.
[4] J.P.O. Evans and H. W. Hon, "Dynamic stereoscopic X-ray imaging," J.
of NDT&E, vol. 35, no. 5, pp. 337-345, 2002.
[5] J.P.O. Evans, Y. Liu and J. W. Chan, "Depth from motion 3D X-ray
imaging for security screening," in IEE ICDP, pp. 5-8, 2005.
[6] J.P.O. Evans, Y. Liu, J. W. Chan, and D. Downes, "View synthesis for
depth from motion 3D X-ray imaging," Pattern Recognit. Lett, vol. 27,
no. 15, pp. 1863-1873, 2006.
[7] D.G. Lowe, "Distinctive image features from scale-invariant keypoints,"
International Journal of Computer Vision, vol. 60, no. 2, pp. 91-110,
2004.
[8] H. Moravec, "Rover visual obstacle avoidance," International Joint
Conference on Artificial Intelligence Vancouver, Canada, pp. 785-790,
1981.
[9] C. Harris, "Geometry from visual motion," Active vision, MIT Press, pp.
263- 284, 1993.
[10] Z. Zhang, R. Deriche, O.Faugeras, and Q.T. Luong, "A robust technique
for matching two uncalibrated images through the recovery of the
unknown epipolar geometry," Artificial Intelligence, vol. 78, no 1-2,
pp. 87-119, 1995.
[11] K. Mikolajczyk, and C. Schmid, "An affine invariant interest point
detector," European Conference on Computer Vision, pp. 128-142,
2002.
[12] M. Brown, and D.G. Lowe, "Invariant features from interest point
groups," British Machine Vision Conference, Cardiff, Wales, Citeseer,
pp. 656-665, 2002.
[13] Y. Ke, and R. Sukthankar, "PCA-SIFT: A more distinctive
representation for local image descriptors," Conference on Computer
Vision and Pattern Recognition, Washington, USA, pp. 511-517, 2004.
[14] L. Juan, and O. Gwon, "A Comparison of SIFT, PCA-SIFT and SURF,"
International Journal of Image Processing (IJIP), vol. 3, no. 4, pp.
143-152, 2009.
[15] H. Bay, T. Tuytelaars, and L. Van Gool, "Speeded-up robust features
(SURF)," Computer Vision and Image Understanding, vol. 110, no. 3,
pp. 346-359, 2008.
[16] Z. Feng, B.Yang, Y.Chen, Y. Zheng, and T. Xu, "Features extraction
from hand images based on new detection operators," Pattern
Recognition, vol. 44, no. 5, pp. 1089-1105, 2010.
[17] J. W. Chan O. Abusaeeda, J.P.O. Evans, D. Downes, X. Wang and
L.Yong, "Feasibility of SIFT to Synthesise KDEX Imagery for Aviation
Luggage Security Screening," IET The Crime and Security Conference:
Imaging for Crime Detection and Prevention, ISBN 978-1-84919-207-1,
2009.
[18] S. Seitz, and C. Dyer, "View morphing," the 23rd annual conference on
Computer graphics and interactive techniques ACM SIGGRAPH,
pp. 21-30 1996.
[19] E. Shechtman, A. Rav-Acha, M. Irani, and S.M. Seitz, "Regenerative
morphing," IEEE computer society conferene on Computer Vision and
Pattern Recognition, San Francisco, CA, USA, pp. 1-8, 2010.
[20] B. Zitova, and J. Flusser, "Image registration methods: a survey," Image
Vision Comput, vol. 21, no. 11, pp. 977-1000, 2003.
[21] C.A.Glasbey, and K.V. Mardia, "A review of image-warping methods,"
Journal of applied statistics, vol. 25, no. 2, pp. 155-172, 1998.
[22] G. Wolberg, "Image morphing: a survey," The Visual Computer, vol. 14,
no. 8, pp. 360-372, 1998.
[23] Z. Zhang, L. Wang, B. Guo, and H.Y. Shum, "Feature-based light field
morphing," ACM Transactions on Graphics, vol. 21, no. 3, pp. 457-464,
2002.
[24] R. Manning, and C. Dyer, "Interpolating view and scene motion by
dynamic view morphing," Proc. CVPR, pp. 388-394, 1999.
[25] J.P.O. Evans, Y. Liu and J. W. Chan, "Depth from motion 3D X-ray
imaging for security screening," Conference, in IEE ICDP, pp. 5-8,
2005.
[26] Wang T. W. and Evans J. P. O., "Stereoscopic dual-energy x-ray
imaging for target materials identification", Conference, in IEE
Proceedings Vision Image Processing, Vol. 150, no. 2, pp. 122-130,
April 2003.
[27] J. Gomes, L. Darsa, B. Costa, and L. Velho, "Warping and Morphing of
Graphical Objects," Morgan Kaufmann, San Francisco, Calif., (1998).
[28] Z. Zhang, L. Wang, B. Guo, and H.Y. Shum, "Feature-based light field
morphing," ACM Transactions on Graphics,Vol. 21, no. 3, pp. 457-464,
2002.