Abstract
With the increasing growth of multimedia applications over the networking in recent years, users have put forward much higher requirements for multimedia quality of experience (QoE) than before. One of the representative requirements is the image quality. Therefore, the image quality assessment ranging from two-dimension (2D) image to three-dimension (3D) image has been getting much attention. In this paper, an efficient objective image quality assessment metric in block-based discrete cosine transform (DCT) coding is proposed. The metric incorporates properties of human visual system (HVS) to improve its validity and reliability in evaluating the quality of stereoscopic image. This is fulfilled by calculating the local pixel-based distortions in frequency domain, combining the simplified models of local visibility properties embodied in frequency domain, which consist of region of interest (ROI) mechanism (visual sensitivity), contrast sensitivity function (CSF) and contrast masking effect. The performance of the proposed metric is compared with other currently state-of-the-art objective image quality assessment metrics. The experimental results have demonstrated that the proposed metric is highly consistent with the subjective test scores. Moreover, the performance of the metric is also confirmed with the popular IRCCyN/IVC database. Therefore, the proposed metric is promising in term of the practical efficiency and reliability for real-life multimedia applications.








Similar content being viewed by others
References
Akhter R, Sazzad ZMP, Horita Y, Baltes J (2010) No-reference stereoscopic image quality assessment. Proc SPIE 7524, stereoscopic displays and applications XXI, San Jose, California
Arican Z, Yea S, Sullivan A, Vetro A (2009) Intermediate view generation for perceived depth adjustment of stereo video. SPIE Applications of Digital Image Processing XXXII, San Diego, 7443(1), CA, USA. doi:10.1117/12.829381
Boev A, Gotchev A, Egiazarian K, Aksay A, Akar GB (2006) Towards compound stereo-video quality metric: a specific encoder-based framework. Proceeding of IEEE Southwest Symposium on Image Analysis and Interpretation, Denver, Colorado, USA, pp 218–222
Brandão T, Queluz MP (2008) No-reference image quality assessment based on DCT domain statistics. J Signal Process 88(4):822–833. doi:10.1016/j.sigpro.2007.09.017
Callet PL, Autrusseau F (2005) Subjective quality assessment IRCCyN/IVC database, available: http://www.irccyn.ec-nantes.fr/ivcdb/
Chen W, Fournier J, Barkowsky M, Callet P-Le (2010) New requirements of subjective video quality assessment methodologies for 3DTV. Proceeding of International Workshop Video Processing Quality Metrics, Scottsdale, USA
Dabov K, Foi R, Katkovnik V, Egiazarian K (2008) Image restoration by sparse 3D transform –domain collaborative filtering. Proc. SPIE Electronic Imaging, no. 6812–07, San Jose, USA
Egiazarian K, Astola J, Ponomarenko N, Lukin V, Battisti F, Carli M (2006) A new full-reference quality metrics based on HVS. International Workshop on Video Processing and Quality Metrics, Scottsdale, USA
Ha K, Kim M (2011) A perceptual quality assessment metric using temporal complexity and disparity information for stereoscopic video. Proceeding of ICIP, Brussel, Belguim, pp 2525–2528
Hewage CTER, Martini MG (2010) Reduced-reference quality metric for 3D depth map transmission. IEEE Int Conf Image Processing, Hong Kong, China
ITU-R BT. 500-11 (2002), Methodology for the subjective assessment of the quality of television pictures, International Telecommunication Union (ITU) Radio Communication Sector, Geneva, Switzerland
Jin L, Boev A, Gotchev A, Egiazarian K (2011) 3D-DCT based perceptual quality assessment of stereo video. 18th IEEE International Conference on Image Processing (ICIP2011), Brussels, pp 2521–2524
Joveluro P, Malekmohamadi H, Fernando WAC, Kondoz AM (2010) Perceptual video quality metric for 3D video quality assessment. 3DTV-Conference: the true vision –capture, transmission and display of 3D video (3DTV-CON), pp 1–4
Kim D, Min D, Oh J, Jeon S, Sohn K (2009) Depth map quality metric for three-dimensional video. Stereoscopic Displays and Applications XX, vol 7237, San Jose, CA. doi:10.1117/12.806898
Kim DHH, Ryu S, Sohn KHW (2012) Depth perception and motion cue based 3D video Quality assessment. IEEE Int. Symposium on Broadband on Multimedia Systems and Broadcasting (BMSM), Seoul, South Korea, pp 1–4
Ma L, Li S, Ngan KN (2012) Reduced-reference image quality assessment in reorganized DCT domain. Signal Process Image Commun, in press. doi:10.1016/j.image.2012.08.001
Mannos JL, Sakrison DJ (1974) The effects of a visual fidelity criterion on the encoding of images. IEEE Trans Inf Theory 20(4):525–536
Moorthy AK, Su CC, Mittal A, Bovik AC (2012) Subjective evaluation of stereoscopic image quality. Signal Process Image Commun 28(8):870–883. doi:10.1016/j.image.2012.08.004
Park PK, Oh KJ, Ho YS (2008) Efficient view-temporal prediction structures for multi-view video coding. Electron Lett 44(2):102–103. doi:10.1049/el:20082082
Pinson MH, Wolf S (2004) A new standardized method for objectively measuring video quality. IEEE Trans Broadcast 50(3):312–322. doi:10.1109/TBC.2004.834028
Ponomarenko N, Silvestri F, Egiazarian K, Carli M, Astola J, Lukin V (2007) On between-coefficient contrast masking of DCT basis functions, Int. Workshop on Video Processing and Quality Metrics, USA
Sazzad ZMP, Yamanaka S, Kawayoke Y, Horita Y (2009) Stereoscopic image quality prediction. Proc IEEE QoMEX, San Diego, USA, pp 180–185
Seo J, Liu X, Kim D, Sohn K (2012) An objective video quality metric for compressed stereoscopic video. Circ Syst Signal Proc (Springer J) 31(3):1089–1107. doi:10.1007/s00034-011-9369-7
Sheikh HR, Bovik AC (2006) Image information and visual quality. IEEE Trans Image Process 15(2):430–444. doi:10.1109/TIP.2005.859378
Smolic A, Mueller K, Stefanoski N, Ostermann J et al (2007) Coding algorithms for 3DTV – a survey. IEEE Trans Circ Syst Video Technol 17(11):1606–1621. doi:10.1109/TCSVT.2007.909972
Smolic A, Muller K, Merkle P, Käuff P, Wiegand T (2009) An overview of available and emerging 3D video formats and depth enhanced stereo as efficient generic solution. Proc Picture Coding Symposium (PCS), Chicago, USA, pp 1–4
Solomon JA, Watson AB, Ahumada AJ (1994) Visibility of DCT basis functions: effects of contrast masking. Proceeding of Data Compression Conference, Snowbird, Utah, pp 361–370
Tsung PK, Ding LF, Chen WY, Chuang TD, Chen YH, Hsuao PH, Chien SY, Chen LG (2010) Video encoder design for high-definition 3D video communication systems. IEEE Commun Mag 48(4):76–86. doi:10.1109/MCOM.2010.5439080
Wang Z, Bovik A (2002) A universal image quality index. IEEE Trans Sig Process Lett 9:81–84. doi:10.1109/97.995823
Wang Z, Bovik AC, Sheikh HR, Simoncelli EP (2004) Image quality assessment: from error visibility to structural similarity. IEEE Trans Image Process 13(4):600–612. doi:10.1109/TIP.2003.819861
Wang Z, Simoncelli EP, Bovik AC (2003) Multiscale structural similarity for image quality assessment. IEEE Asilomar Conf Signals Syst Comput 2:1398–1402. doi:10.1109/ACSSC.2003.1292216
Winkler S (1892) Visual model and quality metrics for image processing applications, PH.D Thesis 2000J, A treatise on electronic and magnetism, 3rd edn, vol 2. Clarendon, Oxford, pp 68–73
Wu HR, Rao KR (2006) Digital video image quality and perceptive coding. CRC Press Taylor & Francis Group Boca Raton, London
Xing L, You J, Ebrahimi T, Perkis A (2010) An objective metric for assessing quality of experience on stereoscopic images. Proceeding of MMSP, Saint-Malo, USA, pp 373–378
Yang J, Hou C, Zhou Y, Zhang Z, Guo J (2009) Objective quality assessment method of stereo images, 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D video, pp 1–4
Zhu Z, Wang Y (2009) Perceptual distortion metric for stereo video quality evaluation. WSEAS Trans Signal Process 5(7):241–250
Acknowledgments
The work was supported by Fundamental Research Funds for the Central Universities on the grant ZYGX2012J028, and also supported by the China Postdoctoral Science Foundation funded Project on the grant 2013M530396.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liu, X., Sun, C. & Yang, L.T. DCT-based objective quality assessment metric of 2D/3D image. Multimed Tools Appl 74, 2803–2820 (2015). https://doi.org/10.1007/s11042-013-1698-z
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-013-1698-z