Effective Image and Video Error Concealment using RST-Invariant Partial Patch Matching Model and Exemplar-based Inpainting

An effective visual error concealment method has been presented by employing a robust rotation, scale, and translation (RST) invariant partial patch matching model (RSTI-PPMM) and exemplar-based inpainting. While the proposed robust and inherently feature-enhanced texture synthesis approach ensures the generation of excellent and perceptually plausible visual error concealment results, the outlier pruning property guarantees the significant quality improvements, both quantitatively and qualitatively. No intermediate user-interaction is required for the pre-segmented media and the presented method follows a bootstrapping approach for an automatic visual loss recovery and the image and video error concealment.

Authors:

• Shiraz Ahmad
• Zhe-Ming Lu

Keywords:

• Exemplar-based image and video inpainting
• outlierpruning
• RST-invariant partial patch matching model (RSTI-PPMM)
• visual error concealment.

References:

[1] S. Lin, D. J. Costello, and M. J. Miller, "Automatic repeat request error control schemes," IEEE Communication Magazine, vol. 22, no. 12, pp. 5-17, 1984.
[2] B. Girod and N. Farber, "Feedback-based error control for mobile video
transmission," Proc. IEEE, vol. 87, no. 10, pp. 1707-1717, 1999.
[3] J. Hagenauer and T. Stockhammer, "Channel coding and transmission
aspects for wireless multimedia," Proc. IEEE, vol. 87, no. 10, pp. 1764-
1777, 1999.
[4] S. B. Wicker, Error control systems for digital communication and
storage, Upper Saddle River, NJ: Prentice-Hall, 1995, ch. 15.
[5] V. K. Goyal, "Multiple description coding: compression meets the network," IEEE Signal Processing Magazine, vol. 18, no. 5, pp.74-93, Sept.2001.
[6] B.W. Wah, X. Su, and D. Lin, "A survey of error-concealment schemes for
real-time audio and video transmission over the internet," in Proc. IEEE
Int. Symp. Microelectronic Systems Education, Taipei, Taiwan, 2000, pp.
17-24.
[7] P. Cuenca, L. Orozco-Barbosa, A. Garrido, F. Quiles, and T. Olivares, "A
survey of error concealment schemes for MPEG-2 video communications
over ATM Network," in Proc. IEEE Canadian Conf. Electrical and
Computer Engineering, St John-s, NF, Canada, 1997, vol. 1, pp. 118-121.
[8] M. Bystrom, V. Parthasarathy, and J. W. Modestino, "Hybrid error concealment
schemes for broadcast video transmission over ATM networks,"
IEEE Trans. Circuits, Syst. and Video Tech., vol. 9, no. 6, pp. 868-881,
Sept. 1999.
[9] A. A. Efros and T. K. Leung, "Texture synthesis by non-parametric
sampling," in Proc. 7th Int. Conf. Computer Vision, Kerkyra, Corfu,
Greece, 1999, pp. 1033-1038.
[10] A. Criminisi, P. Perez, and K. Toyama, "Region filling and object
removal by exemplar-based inpainting," IEEE Trans. Image Processing,
vol. 13, no. 9, pp. 1200-1212, Sept. 2004.
[11] OV: The open video project - a shared digital video collection. Available:
http://www.open-video.org