[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

DFC-dehaze: an improved cycle-consistent generative adversarial network for unpaired image dehazing

  • Original article
  • Published:
The Visual Computer Aims and scope Submit manuscript

Abstract

Recently, cycle-consistent adversarial network (CycleGAN) has been utilized in image dehazing tasks due to train without paired images. However, the quality of generated dehazed images is low. To enhance the dehazed images, this paper presents an improved CycleGAN model, called DFC-dehaze, in which the convolutional neural network (CNN)-based generator is replaced by the Dehazeformer-t model. To reduce the haze residuals in the recovered images, the local–global discriminator is used to handle locally varying haze. When the generated images are blurred or have unrealistic colors, the discriminator gives them the low scores by the negative sample punishment mechanism. Another, the structural similarity index measurement (SSIM) loss is combined with the cyclic consistent loss to improve the visual quality of the dehazed images. The experimental results demonstrate that the proposed methods outperform other unsupervised methods and yield visual outcomes that are comparable to those produced by supervised methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Data availability

Data will be available on reasonable request.

References

  1. McCartney, E.J.: Optics of the atmosphere: scattering by molecules and particles. New York (1976)

  2. Nayar, S.K., Narasimhan, S.G.: Vision in bad weather. In Proceedings of the 7th IEEE International Conference on Computer Vision, vol. 2, pp. 820–827. IEEE (1999)

  3. Narasimhan, S.G., Nayar, S.K.: Vision and the atmosphere. Int. J. Comput. Vis. 48(3), 233–254 (2002)

    Article  Google Scholar 

  4. He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. IEEE Trans. Pattern Anal. Mach. Intell. 33(12), 2341–2353 (2010)

    Google Scholar 

  5. Fattal, R.: Dehazing using color-lines. ACM Trans. Graph. (TOG) 34(1), 1–14 (2014)

    Article  Google Scholar 

  6. Zhu, Q., Mai, J., Shao, L.: A fast single image haze removal algorithm using color attenuation prior. IEEE Trans. Image Process. 24(11), 3522–3533 (2015)

    Article  MathSciNet  Google Scholar 

  7. Berman, D., Avidan, S. et al.: Non-local image dehazing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1674–1682 (2016)

  8. Cai, B., Xiangmin, X., Jia, K., Qing, C., Tao, D.: Dehazenet: an end-to-end system for single image haze removal. IEEE Trans. Image Process. 25(11), 5187–5198 (2016)

    Article  MathSciNet  Google Scholar 

  9. Ren, W., Liu, S., Zhang, H., Pan, J., Cao, X., Yang, M.-H.: Single image dehazing via multi-scale convolutional neural networks. In: European Conference on Computer Vision, pp. 154–169. Springer (2016)

  10. Zhang, H., Patel, V.M.: Densely connected pyramid dehazing network. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3194–3203 (2018)

  11. Liu, X., Ma, Y., Shi, Z., Chen, J.G.: Attention-based multi-scale network for image dehazing. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 7314–7323 (2019)

  12. Chen, D., He, M., Fan, Q., Liao, J., Zhang, L., Hou, D., Yuan, L., Hua, G.: Gated context aggregation network for image dehazing and deraining. In: 2019 IEEE Winter Conference on Applications of Computer Vision (WACV), pp. 1375–1383. IEEE (2019)

  13. Dong, J., Pan, J.: Physics-based feature dehazing networks. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, August 23–28, 2020, Proceedings, Part XXX 16, pp. 188–204. Springer (2020)

  14. Deng, Q., Huang, Z., Tsai, C.-C., Lin, C.-W.: Hardgan: a haze-aware representation distillation gan for single image dehazing. In: European Conference on Computer Vision, pp. 722–738. Springer (2020)

  15. Dong, H., Pan, J., Xiang, L., Hu, Z., Zhang, X., Wang, F., Yang, M.-H.: Multi-scale boosted dehazing network with dense feature fusion. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 2157–2167 (2020)

  16. Qin, X., Wang, Z., Bai, Y., Xie, X., Jia, H.: Ffa-net: feature fusion attention network for single image dehazing. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 11908–11915 (2020)

  17. Wu, H., Qu, Y., Lin, S., Zhou, J., Qiao, R., Zhang, Z., Xie, Y., Ma, L.: Contrastive learning for compact single image dehazing. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 10551–10560 (2021)

  18. Bashir, U., Abbas, M., Ali, J.M.: The g2 and c2 rational quadratic trigonometric bézier curve with two shape parameters with applications. Appl. Math. Comput. 219(20), 10183–10197 (2013)

    MathSciNet  Google Scholar 

  19. BiBi, S., Muhammad Abbas, Md., Misro, Y., Gang, H.: A novel approach of hybrid trigonometric bézier curve to the modeling of symmetric revolutionary curves and symmetric rotation surfaces. IEEE Access 7, 165779–165792 (2019)

    Article  Google Scholar 

  20. Usman, M., Abbas, M., Miura, K.T.: Some engineering applications of new trigonometric cubic bézier-like curves to free-form complex curve modeling. J. Adv. Mech. Design Syst. Manuf. 14(4), JAMDSM0048–JAMDSM0048 (2020)

  21. Maqsood, S., Abbas, M., Hu, G., Ramli, A.L.A., Miura, K.T.: A novel generalization of trigonometric bézier curve and surface with shape parameters and its applications. Math. Probl. Eng. 2020, 1–25 (2020)

    Article  Google Scholar 

  22. Li, F., Gang, H., Abbas, M., Miura, K.T.: The generalized h-bézier model: geometric continuity conditions and applications to curve and surface modeling. Mathematics 8(6), 924 (2020)

    Article  Google Scholar 

  23. Chen, Y., Xia, R., Yang, K., Zou, K.: Mffn: image super-resolution via multi-level features fusion network. Vis. Comput. 1–16 (2023)

  24. Isola, P., Zhu, J.-Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)

  25. Zhu, J.-Y., Park, T., Isola, P., Efros, A.A.: Unpaired image-to-image translation using cycle-consistent adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2223–2232 (2017)

  26. Song, Y., He, Z., Qian, H., Du, X.: Vision transformers for single image dehazing. arXiv preprint arXiv:2204.03883 (2022)

  27. Li, B., Peng, X., Wang, Z., Xu, J., Feng, D.: Aod-net: all-in-one dehazing network. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 4770–4778 (2017)

  28. Ancuti, C.O., Ancuti, C., Timofte, R.: Nh-haze: an image dehazing benchmark with non-homogeneous hazy and haze-free images. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, pp. 444–445 (2020)

  29. Ancuti, C., Ancuti, C.O, Timofte, R., De Vleeschouwer, C.: I-haze: a dehazing benchmark with real hazy and haze-free indoor images. In: International Conference on Advanced Concepts for Intelligent Vision Systems, pp. 620–631. Springer (2018)

  30. Ancuti, C.O., Ancuti, C., Sbert, M., Timofte, R.: Dense-haze: a benchmark for image dehazing with dense-haze and haze-free images. In: 2019 IEEE International Conference on Image Processing (ICIP), pp. 1014–1018. IEEE (2019)

  31. Ancuti, C., Ancuti, C.O., De Vleeschouwer, C.: D-hazy: a dataset to evaluate quantitatively dehazing algorithms. In: 2016 IEEE International Conference on Image Processing (ICIP), pp. 2226–2230. IEEE (2016)

  32. Zhang, Y., Ding, L., Sharma, G.: Hazerd: an outdoor scene dataset and benchmark for single image dehazing. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3205–3209. IEEE (2017)

  33. Li, B., Ren, W., Dengpan, F., Tao, D., Feng, D., Zeng, W., Wang, Z.: Benchmarking single-image dehazing and beyond. IEEE Trans. Image Process. 28(1), 492–505 (2018)

    Article  MathSciNet  Google Scholar 

  34. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Bing, X., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial networks. Commun. ACM 63(11), 139–144 (2020)

    Article  MathSciNet  Google Scholar 

  35. Engin, D., Genç, A., Ekenel, H.K.: Cycle-dehaze: enhanced cyclegan for single image dehazing. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 825–833 (2018)

  36. Park, J., Han, D.K., Ko, H.: Fusion of heterogeneous adversarial networks for single image dehazing. IEEE Trans. Image Process. 29, 4721–4732 (2020)

    Article  Google Scholar 

  37. Arnab, A., Dehghani, M., Heigold, G., Sun, C., Lučić, M., Schmid, C.: Vivit: a video vision transformer. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 6836–6846 (2021)

  38. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., Guo, B.: Swin transformer: hierarchical vision transformer using shifted windows. In: Proceedings of the IEEE/CVF International Conference on Computer Vision, pp. 10012–10022 (2021)

  39. Mao, X., Li, Q., Xie, H., Lau, R.Y.K., Wang, Z., Smolley, S.P.: Least squares generative adversarial networks. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2794–2802 (2017)

  40. Silberman, N., Hoiem, D., Kohli, P., Fergus, R.: Indoor segmentation and support inference from RGBD images. ECCV 5(7576), 746–760 (2012)

    Google Scholar 

  41. Scharstein, D., Szeliski, R.: High-accuracy stereo depth maps using structured light. In: 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings., vol. 1, pp. I–I. IEEE (2003)

  42. Loshchilov, I., Hutter, F.: Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 (2017)

  43. Meng, G., Wang, Y., Duan, J., Xiang, S., Pan, C.: Efficient image dehazing with boundary constraint and contextual regularization. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 617–624 (2013)

  44. Golts, A., Freedman, D., Elad, M.: Unsupervised single image dehazing using dark channel prior loss. IEEE Trans. Image Process. 29, 2692–2701 (2019)

    Article  Google Scholar 

  45. Li, B., Gou, Y., Liu, J.Z., Zhu, H., Zhou, J.T., Peng, X.: Zero-shot image dehazing. IEEE Trans. Image Process. 29, 8457–8466 (2020)

    Article  Google Scholar 

  46. Li, B., Gou, Y., Shuhang, G., Liu, J.Z., Zhou, J.T., Peng, X.: You only look yourself: unsupervised and untrained single image dehazing neural network. Int. J. Comput. Vis. 129, 1754–1767 (2021)

    Article  Google Scholar 

  47. Li, J., Li, Y., Zhuo, L., Kuang, L., Yu, T.: Usid-net: unsupervised single image dehazing network via disentangled representations. IEEE Trans. Multimedia (2022)

Download references

Acknowledgements

This work was supported by the scientific and technological project in Henan Province in 2022 (Grant No. 222102210187), the National Natural Science Foundation of China (Grant No. 62072160).

Author information

Authors and Affiliations

  1. School of Computer and Information Engineering, Henan Normal University, No. 46, Construction Road, Xinxiang, 453007, China

    Shibin Wang, Xueshu Mei, Pengshuai Kang, Yan Li & Dong Liu

  2. Key Laboratory of Artificial Intelligence and Personalized Learning in Education of Henan Province, Xinxiang, China

    Shibin Wang & Dong Liu

Authors
  1. Shibin Wang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Xueshu Mei
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Pengshuai Kang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yan Li
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Dong Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Shibin Wang.

Ethics declarations

Conflict of interest

We declare that we have no competing financial interests or personal relationships that could have appeared to influence our work.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Wang, S., Mei, X., Kang, P. et al. DFC-dehaze: an improved cycle-consistent generative adversarial network for unpaired image dehazing. Vis Comput 40, 2807–2818 (2024). https://doi.org/10.1007/s00371-023-02987-8

Download citation

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00371-023-02987-8

Keywords

Search

Navigation