3D Star Skeleton for Fast Human Posture Representation

In this paper, we propose an improved 3D star skeleton technique, which is a suitable skeletonization for human posture representation and reflects the 3D information of human posture. Moreover, the proposed technique is simple and then can be performed in real-time. The existing skeleton construction techniques, such as distance transformation, Voronoi diagram, and thinning, focus on the precision of skeleton information. Therefore, those techniques are not applicable to real-time posture recognition since they are computationally expensive and highly susceptible to noise of boundary. Although a 2D star skeleton was proposed to complement these problems, it also has some limitations to describe the 3D information of the posture. To represent human posture effectively, the constructed skeleton should consider the 3D information of posture. The proposed 3D star skeleton contains 3D data of human, and focuses on human action and posture recognition. Our 3D star skeleton uses the 8 projection maps which have 2D silhouette information and depth data of human surface. And the extremal points can be extracted as the features of 3D star skeleton, without searching whole boundary of object. Therefore, on execution time, our 3D star skeleton is faster than the “greedy" 3D star skeleton using the whole boundary points on the surface. Moreover, our method can offer more accurate skeleton of posture than the existing star skeleton since the 3D data for the object is concerned. Additionally, we make a codebook, a collection of representative 3D star skeletons about 7 postures, to recognize what posture of constructed skeleton is.

Authors:

• Sungkuk Chun
• Kwangjin Hong
• Keechul Jung

Keywords:

• computer vision
• gesture recognition
• skeletonization
• human posture representation.

References:

[1] Nicu D. Cornea, Deborah Silver, Patrick Min, "Curve-Skeleton Properties,
Application, and Algorithms," IEEE Trans. Visualization and
Computer Graphics, vol. 13, 2007, pp. 530-548.
[2] Gunilla Borgefors, "Distance transformations in digital images," Computer
Vision, Graphics, and Image Processing, vol. 34, 1986, pp.
344-371.
[3] Gunilla Borgefors, "Distance transformation in arbitrary dimensions,"
Computer Vision, Graphics, and Image Processing, vol. 27, 1984, pp.
321-345.
[4] Gunilla Borgefors, "On digital distance transforms in three dimensions,"
Computer Vision and Image Understanding, vol. 64, 1996, pp. 368-376.
[5] Frank Y.Shih and Christopher C.Pu, "A skeletonization algorithm by
maxima tracking on Euclidean distance transform", J. Pattern Recognition,
vol. 28, 1995, pp. 331-341.
[6] Franz Aurenhammer, "Voronoi diagrams - A Survey of a fundamental
geometric data structure," ACM Conputing Surveys, vol. 23, 1991, pp.
345-405.
[7] Jonathan W. Brandt and V. Ralph Algazi, "Continuous skeleton computation
by Voronoi diagram," CVGIP : Image Understanding, vol. 55,
1991, pp. 329-338.
[8] Kenneth E. Hoff III, Tim Culver, John Keyser, Ming Lin and Dinesh
Manocha "Fast computation of generalized Voronoi diagrams using
graphic hardware," in Proc. 26th annual Conf. Computer graphics and
interactive technique, 1999, pp. 277-286.
[9] Kalman Palagyi, Erich Sorantin, Emese Balogh, Attila Kuba, Csongor
Halmai1, Balazs Erdohelyi, and Klaus Hausegger, "A Sequential 3D
Thinning Algorithm and Its Medical Applications," in Proc. 17th international
Conf. IPMI, vol. 2082, 2001, pp. 409-415.
[10] Kalman Palagyi and Attila Kuba, "A 3D 6-subiteration thinning algorithm
for extracting medial lines," Pattern Recognition Letters, vol. 19,
1998, pp. 613-627.
[11] Kalman Palagyi and Attila Kuba, "Directional 3D thinning using 8
subiterations," in Proc. 8th international Conf. DGCI, vol. 1568, 1999,
pp. 325-336.
[12] Ta-Chih Lee, Rangasami L. Kashyap and Chong-Nam Chu, "Building
skeleton models via 3-D medial surface/axis thinning algorithms,"
CVGIP : Graphical Models and Image Processing, vol. 56, 1994, pp.
462-478.
[13] H. Fujiyoshi and A. J. Lipton, "Real-time human motion analysis by
image skeletonization," 4th IEEE Workshop on Application of Computer
Vision, 1998, pp. 15-21.
[14] Hsuan-Sheng Chen, Hua-Tsung Chen, Yi-Wen Chen and Suh-Yin Lee,
"Human Action Recognition Using Star Skeleton," in Proc. 4th ACM
international workshop on Video surveillance and sensor networks,
2006, pp. 171-178.