Abstract
In this paper, we proposed a video error concealment algorithm using Motion Vector (MV) recovery for parallelogram partitions in the lost area. Error concealment is inevitable when some video packets are lost during transmission and correction or retransmission is not feasible. In conventional methods, MVs are recovered for the square shaped blocks which are then used for motion compensated temporal replacement. But in our proposed method, by parallelogram partitioning of the lost area, the MVs are found for more general shaped blocks. The parallelograms with various sizes and angles are examined, and then the best combination (size and angle) is selected with the assist of a border matching algorithm and a blind quality assessment method. Experimental results show that our method outperforms the other error concealment algorithms, both subjectively and objectively.
Similar content being viewed by others
References
[Online]. Available: https://hevc.hhi.fraunhofer.de/trac/hevc/browser
Akbari A, Trocan M, Granado B (2017) Sparse recovery-based error concealment. IEEE Trans Multimed 19(6):1339–1350
Available: http://live.ece.utexas.edu/research/Quality/noreference.htm.
Bellman R (1954) The theory of dynamic programming. Bull Am Math Soc
Byongsu H, Jonghyon J, Cholsu R (2017) An improved multi-directional interpolation for spatial error concealment. Multimed Tools Appl 76(1):397–413
Carreira JFM, Assunção PA, de-Faria SM, Ekmekcioglu E, Kondoz A (2018) Error concealment-aware encoding for robust video transmission. IEEE Trans Broadcast 65(2):282–293
Chang YL, Reznick YA, Chen Z, Cosman PC (2013) Motion compensated error concealment for HEVC based on block-merging and residual energy. In: International packet video workshop (PV)
Choe G, Nam C, Chu C (2018) An effective temporal error concealment in H.264 video sequences based on scene change detection-PCA model. Springer Multimed Tools Appl 77(24):31953–31967
Chung B, Yim C (2019) Bi-sequential video error concealment method using adaptive homography-based registration. IEEE Trans Circ Syst Video Technol. https://doi.org/10.1109/TCSVT.2019.2909564
Dufaux F, Moscheni F (1995) Motion estimation techniques for digital TV: a review and a new contribution. Proc IEEE 83:858–876
Huang Z, Cai Q (2018) A video data recovery algorithm in wireless communication networks. In: IEEE 18th international conference on Communication Technology
Hwang MC, Kim JH, Duong DT, Ko SJ (2008) Hybrid temporal error concealment methods for block-based compressed video transmission. IEEE Trans Broadcast 54(2):198–207
Lam WM. Reibman AR, Liu B (1993) Recovery of lost or erroneously received motion vectors. In: Proceedings of IEEE international conference on Acoust. Speech Signal Process, pp 417–420
Li Y, Chen R (2017) Motion vector recovery for video error concealment based on the plane fitting. Springer Multimed Tools Appl 76(13):14993–15006
Lie WN, Lee CM, Yeh CH, Gao ZW (2014) Motion vector recovery for video error concealment by using iterative dynamic-programming optimization. IEEE Trans Mulimed 16(1):216–227
Lin TL, Ding TL, Yang NC, Wu PY, Tung KH, Lai CK, Chang TE (2016) Video motion vector recovery method using decoding partition information. J Disp Technol 12(11):1451–1463
Lin TL, Ding TL, Fan CY, Chen WC (2017) Error concealment algorithm based on sparse optimization. Multimed Tools Appl 76(1):397–413
Liu L, Liu B, Huang H, Bovik AC (2014) No-reference image quality assessment based on spatial and spectral entropies. Signal Process Image Commun 29(8):856–863
Liu X, Zhai D, Zhou J, Wang S, Zhao D, Guo H (2016) Sparsitybased image error concealment via adaptive dual dictionary learning and regularization. IEEE Trans Image Process 26(2):782–796
Moorthy AK, Bovik AC (2010) A two-step framework for constructing blind image quality indices. IEEE Signal Process Lett 17(5):513–516
Oztas B, Pourazad MT, Nasiopoulos P, and Leung VCM (2012) A study on the HEVC performance over Lossy Networks. In: Proceedings of 19th IEEE international conference on Electron. Circuits Syst. (ICECS), pp 785–788
Qian X, Liu G, Wang H (2009) Recovering connected error region based on adaptive error concealment order determination. IEEE Trans Multimed 11(4):683–695
Radmehr A, Ghasemi A (2016) Error concealment via particle filter by Gaussian mixture modeling of motion vectors for H.264/AVC. Springer Sig Image Video Process 10(2):311–318
Saad MA, Bovik AC (2012) Blind image quality assessment: a natural scene statistics approach in the DCT domain. IEEE Trans Image Process 28(39):3339–3352
Sankisa A, Punjabi A, Katsaggelos AK (2018) Video error concealment using deep neural networks. In: Proceedings of the IEEE international conference on Image Processing, Athens, Greece, pp 380–384
Shih HC, Wang CT, Huang CL (2018) Spiral-like pixel reconstruction algorithm for spatiotemporal video error concealment. IEEE Access 16:6370–6381
Soundararajan R, Bovik AC (2013) Video quality assessment by reduced reference Spatio-temporal entropic differencing. IEEE Trans Circ Syst Video Technol 23(4):684–694
Suh JW, Ho YS (2002) Error concealment techniques for digital TV. IEEE Trans Broadcast 48(4):299–306
Sullivan GJ, Ohm JR, Han WJ, Wiegand T (2012) Overview of the High Efficiency Video Coding (HEVC) standard. IEEE Trans Circ Syst Video Technol 22(12):1648–1667
Usman M., He X, Xu M and Lam KM (2015) Survey of error concealment techniques: research directions and open issues. In: Picture coding symposium (PCS), Cairns, QLD, Australia
Wang Y, Zhu QF (1998) Error control and concealment for video communication: a review. Proc IEEE 86(5):974–999
Xiang C, Xu J, Yan C, Peng Q, (2019) Generative adversarial networks based error concealment for low resolution video. In: IEEE international conference on Acoustics, Speech And Signal Processing (ICASSP)
Yang SH, Chang CW, Chan CC (2015) An object-based error concealment technique for H.264 coded video. Multimed Tools Appl 74(23):10785–10800
Zhang J, Arnold JF, Frater MR (2000) A cell-loss concealment technique for MPEG-2 coded video. IEEE Trans Circ Syst Video Technol 10(4):659–665
Zhang Y, Xiang X, Zhao D, Ma S, Gao W (2011) Packet video error concealment with auto regressive model. IEEE Trans Circ Syst Video Technol 22(1):12–27
Zhou Z, Dai M, Zhao R, Li B, Zhong H, Wen Y (2016) Video error concealment scheme based on tensor model. Springer Multimed Tools Appl 76(14):16045–16061
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Hojati, S., Kazemi, M. & Moallem, P. Error concealment with parallelogram partitioning of the lost area. Multimed Tools Appl 79, 7449–7469 (2020). https://doi.org/10.1007/s11042-019-08538-5
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-019-08538-5