Abstract
Image quality is an important metric for measuring multimedia services; thus, analysing image quality accurately has high practicability. The existing image quality assessment (IQA) methods mainly focus on grey information, which underutilize the colour information. In this paper, a new IQA method is proposed to make full use of colour information. The method calculates the colour information fluctuation (CF) around each pixel in different detection directions, and obtain CF maps (CFMs). Meanwhile, the greyscale fluctuations (GFs) are analysed to extract GF maps (GFMs). Based on CFMs and GFMS, the direction information is calculated to form CF direction map (CFD) and GF direction map (GFD). After that, the histogram-based features are extracted from CFMs, GFMs, CFDs and GFDs. Finally, different features are combined to measure quality variations comprehensively. The performance comparisons demonstrate the proposed method is competitive with prevalent methods, and is suitable for both natural image and screen content image.
Similar content being viewed by others
References
Weihua, L., Quan, B., Minjie, Z., et al.: Automated influence maintenance in social networks: an agent-based approach. IEEE Trans. Knowl. Data Eng. 31(10), 1884–1897 (2019)
Cong, R., Lei, J., Fu, H., et al.: Review of visual saliency detection with comprehensive information. IEEE Trans. Circuits Syst. Video Technol. 29(10), 2941–2959 (2019)
Cai, C., Chen, L., Zhang, X., et al.: End-to-end optimized ROI image compression. IEEE Trans. Image Process. 29, 3442–3457 (2020)
Niu, Y., Zhong, Y., Guo, W., et al.: 2D and 3D image quality assessment: a survey of metrics and challenges. IEEE Access 7, 782–801 (2019)
Chen, D., Wang, Y., Gao, W.: No-reference image quality assessment: an attention driven approach. IEEE Trans. Image Process. 29, 6496–6506 (2020)
Yue, G., Hou, C., Zhou, T., et al.: Effective and efficient blind quality evaluator for contrast distorted images. IEEE Trans. Instrum. Meas. 68(8), 2733–2741 (2019)
Mittal, A., Moorthy, A.K., Bovik, A.C.: No-reference image quality assessment in the spatial domain. IEEE Trans. Image Process. 21(12), 4695–4708 (2012)
Wang, H., Fu, J., Lin, W., et al.: Image quality assessment based on local linear information and distortion-specific compensation. IEEE Trans. Image Process. 26(2), 915–926 (2017)
Deng, C., Wang, S., Bovik, A.C., et al.: Blind noisy image quality assessment using sub-band kurtosis. IEEE Trans. Cybern. 50(3), 1146–1156 (2020)
Liu, Y., Gu, K., et al.: Blind quality assessment of camera images based on low-level and high-level statistical features. IEEE Trans. Multimed. 21(1), 135–146 (2019)
Zhang, Y., Mou, X., Chandler, D.M., et al.: Learning no-reference quality assessment of multiply and singly distorted images with big data. IEEE Trans. Image Process. 29, 2676–2691 (2020)
Zhang, Y., Chandler, D.M.: Opinion-unaware blind quality assessment of multiply and singly distorted images via distortion parameter estimation. IEEE Trans. Image Process. 27(11), 5433–5448 (2018)
Yan, B., Bare, B., Tan, W., et al.: Naturalness-aware deep no-reference image quality assessment. IEEE Trans. Multimed. 21(10), 2603–2615 (2019)
Mittal, A., Soundararajan, R., Bovik, A.C., et al.: Making a “completely blind” image quality analyzer. IEEE Signal Process. Lett. 20(3), 209–212 (2013)
Zhang, L., Zhang, L., Bovik, A.C., et al.: A feature-enriched completely blind image quality evaluator. IEEE Trans. Image Process. 24(8), 2579–2591 (2015)
Liu, Y., Gu, K., Zhang, Y., et al.: Unsupervised blind image quality evaluation via statistical measurements of structure, naturalness and perception. IEEE Trans. Circuits Syst. Video Technol. 30(4), 929–943 (2020)
Kuang, W., Chan, Y., Tsang, S., et al.: Machine learning based fast intra mode decision for HEVC screen content coding via decision trees. IEEE Trans. Circuits Syst. Video Technol. 30(5), 1481–1496 (2020)
Kuang, W., Chan, Y., Tsang, S., et al.: Online-learning-based bayesian decision rule for fast intra mode and CU partitioning algorithm in HEVC screen content coding. IEEE Trans. Image Process. 29, 170–185 (2020)
Jiang, X., Shen, L., Yu, L., et al.: No-reference screen content image quality assessment based on multi-region features. Neurocomputing 386, 30–41 (2019)
Bai, Y., Yu, M., Jiang, Q., et al.: Learning content-specific codebooks for blind quality assessment of screen content images. Signal Process. 161, 248–258 (2019)
Wu, J., Xia, Z., Zhang, H., et al.: Blind quality assessment for screen content images by combining local and global features. Digit. Signal Process. 91, 31–40 (2019)
Fang, Y., Yan, J., Li, L., et al.: No reference quality assessment for screen content images with both local and global feature representation. IEEE Trans. Image Process. 27(4), 1600–1610 (2018)
Gu, K., Wang, S., Yang, H., et al.: Saliency-guided quality assessment of screen content images. IEEE Trans. Multimedia 18(6), 1098–1110 (2016)
Gu, K., Zhai, G., Lin, W., et al.: Learning a blind quality evaluation engine of screen content images. Neurocomputing 196, 140–149 (2016)
Liu, X., Fang, Y., Du, R., et al.: Blind quality assessment for tone-mapped images based on local and global features. Inf. Sci. 528, 46–57 (2020)
Gu, K., Qiao, J., Min, X., et al.: Evaluating quality of screen content images via structural variation analysis. IEEE Trans. Visual Comput. Graphics 24(10), 2689–2701 (2018)
Gu, K., Zhou, J., Qiao, J.F., et al.: No-reference quality assessment of screen content pictures. IEEE Trans. Image Process. 26(8), 4005–4018 (2017)
Huang, Y., Li, L., Zhu, H., et al.: Blind quality index of depth images based on structural statistics for view synthesis. IEEE Signal Process. Lett. 27, 685–689 (2020)
Yue, G., Hou, C., Gu, K., et al.: Analysis of structural characteristics for quality assessment of multiply distorted images. IEEE Trans. Multimed. 20(10), 2722–2732 (2018)
Mansouri, A., Mahmoudiaznaveh, A.: SSVD: structural SVD-based image quality assessment. Signal Process.-Image Commun. 74, 54–63 (2019)
Yang, X., Sun, Q., Wang, T.: Completely blind image quality assessment based on gray-scale fluctuations. In: International Conference on Digital Image Processing, vol. 915916 (2014)
Yang, X., Sun, Q., Wang, T., et al.: Image quality assessment via spatial structural analysis. Comput. Electr. Eng. 70, 349–365 (2018)
Yang, X., Sun, Q., Wang, T., et al.: No-reference image quality assessment based on sparse representation. Neural Comput. Appl. 31(10), 6643–6658 (2019)
Yang, X., Wang, T., Ji, G., et al.: No-reference image quality assessment via structural information fluctuation. IET Image Proc. 14(2), 384–396 (2020)
Chang, ChihChung, Lin, ChihJen: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. 2(3), 1–27 (2011)
Sheikh, H.R., Sabir, M.F., Bovik, A.C.: A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Trans. Image Process. 15(11), 3440–3451 (2006)
Larson, E.C., Chandler, D.M.: Most apparent distortion: full-reference image quality assessment and the role of strategy. J. Electron. Imaging 19(1), 011006 (2010)
Ponomarenko, N., Jin, L., Ieremeiev, O., et al.: Image database TID2013: Peculiarities, results and perspectives. Signal Processing Image Communication 30, 57–77 (2015)
Ji, H., Liu, C.: Motion blur identification from image gradients computer vision and pattern recognition, 2008. CVPR 2008. In IEEE Conference on. IEEE, pp. 1–8 (2008)
Ghadiyaram, D., Bovik, A.C.: Massive online crowdsourced study of subjective and objective picture quality. IEEE Trans. Image Process. 25(1), 372–387 (2015)
Yang, H., Fang, Y., Lin, W.: Perceptual quality assessment of screen content images. IEEE Trans. Image Process. 24(11), 4408–4421 (2015)
Wang, S., Gu, K., Zhang, X., et al.: Subjective and objective quality assessment of compressed screen content images. IEEE J. Emerg. Sel. Top. Circuits Syst. 6(4), 532–543 (2016)
VQEG, Final report from the video quality experts group on the validation of objective models of video quality assessment, March 2000 (http://www.vqeg.org/)
Wang, Z., Bovik, A.C., Sheikh, H.R., et al.: Image quality assessment: from error visibility to structural similarity. IEEE Trans. Image Process. 13(4), 600–612 (2004)
Zhang, L., Zhang, L., Mou, X., et al.: FSIM: a feature similarity index for image quality assessment. IEEE Trans. Image Process. 20(8), 2378–2386 (2011)
Acknowledgements
This paper is supported by the National Natural Science Foundation of China (Grant No. 62101268), the National Natural Science Foundation of China (Grant No. 41971343), the Natural Science Foundation of the Jiangsu Higher Education Institutions of China (Grant No. 20KJB510021), the Natural Science Foundation of Jiangsu Province (Grant No. BK20210696) and the Future Network Scientific Research Fund Project (Grant No. FNSRFP-2021-ZD-24).
Author information
Authors and Affiliations
Contributions
XY conceived and designed the experiments. XY performed the experiments. XY analysed the data. XY, GJ and TW wrote and reviewed the paper. XY, GJ and TW approved the final version of the paper.
Corresponding author
Ethics declarations
Conflict of interest
The authors have declared that there are no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Yang, X., Wang, T. & Ji, G. Image quality assessment via colour information fluctuation. SIViP 17, 1161–1171 (2023). https://doi.org/10.1007/s11760-022-02323-y
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11760-022-02323-y