Adaptive Kernel Filtering Used in Video Processing

In this paper we present a noise reduction filter for video processing. It is based on the recently proposed two dimensional steering kernel, extended to three dimensions and further augmented to suit the spatial-temporal domain of video processing. Two alternative filters are proposed - the time symmetric kernel and the time asymmetric kernel. The first reduces the noise on single sequences, but to handle the problems at scene shift the asymmetric kernel is introduced. The performance of both are tested on simulated data and on a real video sequence together with the existing steering kernel. The proposed kernels improves the Rooted Mean Squared Error (RMSE) compared to the original steering kernel method on video material.

• Rasmus Engholm
• Eva B. Vedel Jensen
• Henrik Karstoft

• Adaptive image filtering
• noise reduction
• kernel methods
• video processing.

[1] H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image
processing and reconstruction," IEEE Transactions on Image Processing,
vol. 16, no. 2, pp. 349-366, 2007.
[2] C. Tomasi and R. Manduchi, "Bilateral filtering for gray and color
images," Proc. 6th Int. Conf. Computer Vision, New Delhi, India, pp.
839-846, 1998.
[3] M. Elad, "On the origin of the bilateral filter and ways to improve it,"
Image Processing, IEEE Transactions on, vol. 11, no. 10, pp. 1141-1151,
2002.
[4] D. Barash, "Fundamental relationship between bilateral filtering, adaptivesmoothing,
and the nonlinear diffusion equation," PAMI, IEEE Transactions
on, vol. 24, no. 6, pp. 844-847, 2002.
[5] D. Barash and D. Comaniciu, "A common framework for nonlinear
diffusion, adaptive smoothing, bilateral filtering and mean shift," Image
and Vision Computing, vol. 22, no. 1, pp. 73-81, 2004.
[6] T. Pham and L. van Vliet, "Separable Bilateral Filtering for Fast Video
Preprocessing," Multimedia and Expo, 2005. ICME 2005. IEEE International
Conference on, pp. 454-457, 2005.
[7] F. Durand and J. Dorsey, "Fast bilateral filtering for the display of highdynamic-
range images," Proceedings of the 29th annual conference on
Computer graphics and interactive techniques, pp. 257-266, 2002.
[8] S. Paris and F. Durand, "A fast approximation of the bilateral filter using
a signal processing approach," Proc. of Eur. Conf. on Comp. Vision, 2006.
[9] S. Fleishman, I. Drori, and D. Cohen-Or, "Bilateral mesh denoising," Int.
Conf. on Comp. Graphics and Interactive Techniques, pp. 950-953, 2003.