ETRI Journal

Electronics and Telecommunications Research Institute (한국전자통신연구원)
권호 표지

Frame Error Concealment Using Pixel Correlation in Overlapped Motion Compensation Regions

  • Duong, Dinh Trieu (Department of Electronic Engineering, Korea University) ;
  • Choi, Byeong-Doo (Fraunhofer Institute for Telecommunications, Heinrich-Hertz-Institut (HHI)) ;
  • Hwang, Min-Cheol (Department of Electronic Engineering, Korea University) ;
  • Ko, Sung-Jea (Department of Electronic Engineering, Korea University)
  • Received : 2008.06.09
  • Accepted : 2008.12.11
  • Published : 2009.02.28
Download PDF
⟨ Previous Next ⟩

Abstract

In low bit-rate video transmission, the payload of a single packet can often contain a whole coded frame due to the high compression ratio in both spatial and temporal domains of most modern video coders. Thus, the loss of a single packet not only causes the loss of a whole frame, but also produces error propagation into subsequent frames. In this paper, we propose a novel whole frame error concealment algorithm which reconstructs the first of the subsequent frames instead of the current lost frame to suppress the effects of error propagation. In the proposed algorithm, we impose a constraint which uses side match distortion (SMD) and overlapped region difference (ORD) to estimate motion vectors between the target reconstructed frame and its reference frame. SMD measures the spatial smoothness connection between a block and its neighboring blocks. ORD is defined as the difference between the correlated pixels which are predicted from one reference pixel. Experimental results show that the proposed algorithm effectively suppresses error propagation and significantly outperforms other conventional techniques in terms of both peak signal-to-noise ratio performance and subjective visual quality.

Keywords

References

  1. J. Huang et al., "Performance of a Mixed-Traffic CDMA2000 Wireless Network with Scalable Streaming Video," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 10, Oct. 2003, pp. 973-981. https://doi.org/10.1109/TCSVT.2003.816516
  2. M. Naghshineh and M. Willebeek-LeMair, "End-to-End QoS Provisioning in Multimedia Wireless/Mobile Networks Using an Adaptive Framework," IEEE Commun. Mag., vol. 35, no. 11, Nov. 1997, pp. 72-81.
  3. Y. Wang, J. Ostermann, and Y.Q. Zhang, Video Processing and Communication., Signal Processing Series, NJ: Prentice Hall, 2002.
  4. Y. Wang and Q.-F. Zhu, "Error Control and Concealment for Video Communication: A Review," Proc. IEEE, vol. 86, no. 5, May 1998, pp. 974-997. https://doi.org/10.1109/5.664283
  5. W.-Y. Kung, C.-S. Kim, and C.-C.J. Kuo, "Spatial and Temporal Error Concealment Techniques for Video Transmission over Noisy Channels," IEEE Trans. Circuits Syst. Video Technol., vol. 16, no. 7, July 2006, pp. 789-802. https://doi.org/10.1109/TCSVT.2006.877391
  6. W. Zeng and B. Liu, "Geometric-Structure-Based Error Concealment with Novel Applications in Block-Based Low-Bit-Rate Coding," IEEE Trans. Circuits Syst. Video Technol., vol. 9, no. 4, June 1999, pp. 648-665. https://doi.org/10.1109/76.767129
  7. J. Park et al., "Content-Based Adaptive Spatio-Temporal Methods for MPEG-Repair," IEEE Trans. Image Process., vol. 13, no. 8, Aug. 2004, pp. 1066-1077. https://doi.org/10.1109/TIP.2003.822615
  8. S.-H. Lee, D.-H. Choi, and C.-S. Hwang, "Error Concealment Using Affine Transform for H.263 Coded Video Transmissions," Electron. Lett., vol. 37, no. 4, Feb. 2001, pp. 218-220. https://doi.org/10.1049/el:20010147
  9. M. Friebe and A. Kaup, "Fading Techniques for Error Concealment in Block-Based Video Decoding Systems," IEEE Trans. Broadcast., vol. 53, no. 1, Mar. 2007, pp. 286-296. https://doi.org/10.1109/TBC.2006.889688
  10. L. Tang, "Combined and Iterative Form of Spatial and Temporal Error Concealment for Video Signals," IEEE Trans. Broadcast., vol. 52, no. 2, Sept. 2006, pp. 356-361. https://doi.org/10.1109/TBC.2006.880323
  11. J. Lu, "Signal Processing for Internet Video Streaming: A Review," Proc. of SPIE Image Video Comm. Process., vol. 3974, Jan. 2000, pp. 246-259.
  12. S.K. Bandyopadhyay et al., "Frame Loss Error Concealment for H.264/AVC," 73rd MPEG Meeting and 16th JVT Meeting, Joint Video Team of ISO/IEC MPEG and ITU-T VCEG, JVT-P072, July 2005.
  13. P. Baccichet et al., "Frame Concealment for H.264/AVC Decoders," IEEE Trans. Consumer Electron., vol. 51, no. 1, Feb. 2005, pp. 227-233. https://doi.org/10.1109/TCE.2005.1405724
  14. Y. Wang, Q.-F. Zhu, and L. Shaw, "Maximally Smooth Image Recovery in Transform Coding," IEEE Trans. Commun., vol. 41, no. 10, Oct. 1993, pp. 1544-1551. https://doi.org/10.1109/26.237889
  15. K. Suhring, Ed., JM 12. 2 Reference Software. [Online] Available: http://iphome.hhi.de/suehring/tml/download/
  16. M. Wien, "Variable Block-Size Transforms for H.264/AVC," IEEE Trans. Circuits Syst. Video Technol., vol. 13, no. 7, July 2003, pp. 604-613. https://doi.org/10.1109/TCSVT.2003.815380
  17. Z. He, J. Cai, and C.W. Chen, "Joint Source Channel Rate-Distortion Analysis for Adaptive Mode Selection and Rate Control in Wireless Video Coding," IEEE Trans. Circuits Syst. Video Technol., vol. 12, no. 6, June 2002, pp. 511-523. https://doi.org/10.1109/TCSVT.2002.800313
  18. S. Belfiore et al., "Concealment of Whole-Frame Losses for Wireless Low Bit-Rate Video Based on Multiframe Optical Flow Estimation," IEEE Trans. Multimedia, vol. 7, no. 2, Apr. 2005, pp. 316-329. https://doi.org/10.1109/TMM.2005.843347