Mean Shift-based Preprocessing Methodology for Improved 3D Buildings Reconstruction

In this work, we explore the capability of the mean shift algorithm as a powerful preprocessing tool for improving the quality of spatial data, acquired from airborne scanners, from densely built urban areas. On one hand, high resolution image data corrupted by noise caused by lossy compression techniques are appropriately smoothed while at the same time preserving the optical edges and, on the other, low resolution LiDAR data in the form of normalized Digital Surface Map (nDSM) is upsampled through the joint mean shift algorithm. Experiments on both the edge-preserving smoothing and upsampling capabilities using synthetic RGB-z data show that the mean shift algorithm is superior to bilateral filtering as well as to other classical smoothing and upsampling algorithms. Application of the proposed methodology for 3D reconstruction of buildings of a pilot region of Athens, Greece results in a significant visual improvement of the 3D building block model.

Authors:

• Nikolaos Vassilas
• Theocharis Tsenoglou
• Djamchid Ghazanfarpour

Keywords:

• 3D buildings reconstruction
• data fusion
• data upsampling
• mean shift.

References:

[1] C. Tomasi, and R. Manduchi, “Bilateral filtering for gray and color
images,” in Proc. 6th International Conference on Computer Vision
(ICCV ’98), pp. 839-846, Bombay, India, Jan. 1998.
[2] D. Comaniciu, and P. Meer, “Mean shift: A robust approach toward
feature space analysis,” IEEE Transactions on Pattern Analysis and
Machine Intelligence, vol. 24, no. 5, pp. 603–619, 2002.
[3] S. Paris, P. Kornprobst, J. Tumblin, and F. Durand, “Bilateral filtering:
Theory and applications,” Computer Graphics and Vision, vol. 1, pp. 1-
73, 2008.
[4] D. Barash, and D. Comaniciu, “A common framework for nonlinear
diffusion, adaptive smoothing, bilateral filtering and mean shift,” Image
and Vision Computing, vol. 22, no. 1, pp. 73-81, 2004.
[5] J. Kopf, M.F. Cohen, D. Lischinski, and M. Uyttendaele, “Joint bilateral
upsampling,” ACM Transactions on Graphics (Proc. SIGGRAPH), vol.
26, pp. 673-678, San Diego, Aug. 2007.
[6] E. Eisemann, and F. Durand, “Flash Photography Enhancement via
Intrinsic Relighting, ACM Transactions on Graphics (Proc.
SIGGRAPH), vol. 23, pp. 673-678, Los Angeles, Aug. 2004.
[7] G. Petschnigg, M. Agrawala, H. Hoppe, R. Szeliski, M. Cohen, and K.
Toyama, “Digital Photography with Flash and No-Flash Image Pairs,”
ACM Transactions on Graphics (Proc. SIGGRAPH), vol. 23, pp. 664-
672, Los Angeles, Aug. 2004.
[8] J. Solomon, K. Crane, A. Butscher, and C. Wojtan, “A general
framework for bilateral and mean shift filtering,” CoRR, 2014.
[9] K. Fukunaga, and L. Hostetler, “The estimation of the gradient of a
density function, with applications in pattern recognition,” IEEE
Transactions on InformationTheory, vol. 21, no. 1, pp. 32–40, 1975.
[10] Y. Cheng, “Mean shift, mode seeking, and clustering,” IEEE
Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no.
8, pp. 790–799, 1995.
[11] J. van de Weijer, and R. van den Boomgaard, “Local Mode Filtering,” in
Proc. Computer Vision and Pattern Recognition (CVPR 2001), Vol. II,
pp. 428-433, Hawaii, USA, Dec. 2001.