SSL: A Self-similarity Loss for Improving Generative Image Super-resolution
Pages 3189 - 3198
Abstract
Generative adversarial networks (GAN) and generative diffusion models (DM) have been widely used in real-world image super-resolution (Real-ISR) to enhance the image perceptual quality. However, these generative models are prone to generating visual artifacts and false image structures, resulting in unnatural Real-ISR results. Based on the fact that natural images exhibit high self-similarities, i.e., a local patch can have many similar patches to it in the whole image, in this work we propose a simple yet effective self-similarity loss (SSL) to improve the performance of generative Real-ISR models, enhancing the hallucination of structural and textural details while reducing the unpleasant visual artifacts. Specifically, we compute a self-similarity graph (SSG) of the ground-truth image, and enforce the SSG of Real-ISR output to be close to it. To reduce the training cost and focus on edge areas, we generate an edge mask from the ground-truth image, and compute the SSG only on the masked pixels. The proposed SSL serves as a general plug-and-play penalty, which could be easily applied to the off-the-shelf Real-ISR models. Our experiments demonstrate that, by coupling with SSL, the performance of many state-of-the-art Real-ISR models, including those GAN and DM based ones, can be largely improved, reproducing more perceptually realistic image details and eliminating many false reconstructions and visual artifacts. Codes and supplementary material are available at https://github.com/ChrisDud0257/SSL
References
[1]
Eirikur Agustsson and Radu Timofte. 2017. NTIRE 2017 Challenge on Single Image Super-resolution: Dataset and study. In IEEE Conference on Computer Vision and Pattern Recognition Workshop. IEEE, 126--135.
[2]
Marco Bevilacqua, Aline Roumy, Christine Guillemot, and Marie Line Alberi-Morel. 2012. Low-complexity Single-image Super-resolution Based on Nonnega-tive Neighbor Embedding. In British Machine Vision Conference. 135.1-135.10.
[3]
Antoni Buades, Bartomeu Coll, and Jean-Michel Morel. 2011. Non-local means denoising. Image Processing On Line 1 (2011), 208--212.
[4]
Jianrui Cai, Hui Zeng, Hongwei Yong, Zisheng Cao, and Lei Zhang. 2019. Toward Real-world Single Image Super-resolution: A New Benchmark and a New Model. In International Conference on Computer Vision. IEEE, 3086--3095.
[5]
Chang Chen, Zhiwei Xiong, Xinmei Tian, Zheng-Jun Zha, and Feng Wu. 2019. Camera Lens Super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 1652--1660.
[6]
Du Chen, Jie Liang, Xindong Zhang, Ming Liu, Hui Zeng, and Lei Zhang. 2023. Human guided ground-truth generation for realistic image super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 14082--14091.
[7]
Hao-Wei Chen, Yu-Syuan Xu, Min-Fong Hong, Yi-Min Tsai, Hsien-Kai Kuo, and Chun-Yi Lee. 2023. Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolution. In IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 18257--18267.
[8]
Xiangyu Chen, Xintao Wang, Jiantao Zhou, Yu Qiao, and Chao Dong. 2023. Activating more pixels in image super-resolution transformer. In IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 22367--22377.
[9]
Haram Choi, Jeongmin Lee, and Jihoon Yang. 2023. N-gram in swin transformers for efficient lightweight image super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. IEEE, 2071--2081.
[10]
Victor Cornillere, Abdelaziz Djelouah, Wang Yifan, Olga Sorkine-Hornung, and Christopher Schroers. 2019. Blind Image Super-resolution with Spatially Variant Degradations. ACM Transactions on Graphics 38, 6 (2019), 1--13.
[11]
Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. 2007. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on Image Processing 16, 8 (2007), 2080--2095.
[12]
Keyan Ding, Kede Ma, Shiqi Wang, and Eero P Simoncelli. 2020. Image Quality Assessment: Unifying Structure and Texture Similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence 44, 5 (2020), 2567--2581.
[13]
Chao Dong, Chen Change Loy, Kaiming He, and Xiaoou Tang. 2014. Learning a Deep Convolutional Network for Image Super-resolution. In European Conference on Computer Vision. Springer, 184--199.
[14]
Chao Dong, Chen Change Loy, and Xiaoou Tang. 2016. Accelerating the Super- resolution Convolutional Neural Network. In European Conference on Computer Vision. Springer, 391--407.
[15]
Weisheng Dong, Lei Zhang, Guangming Shi, and Xin Li. 2012. Nonlocally centralized sparse representation for image restoration. IEEE transactions on Image Processing 22 (2012), 1620--1630.
[16]
Chen Du, He Zewei, Sun Anshun, Yang Jiangxin, Cao Yanlong, Cao Yanpeng, Tang Siliang, and Michael Ying Yang. 2019. Orientation-aware deep neural network for real image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. 0--0.
[17]
Garas Gendy, Nabil Sabor, Jingchao Hou, and Guanghui He. 2023. A Simple Transformer-Style Network for Lightweight Image Super-Resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 1484--1494.
[18]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2020. Generative Adversarial Networks. Commun. ACM 63, 11 (2020), 139--144.
[19]
Jinjin Gu, Hannan Lu, Wangmeng Zuo, and Chao Dong. 2019. Blind Super-resolution with Iterative Kernel Correction. In IEEE Conference on Computer Vision and Pattern Recognition. 1604--1613.
[20]
Shuhang Gu, Andreas Lugmayr, Martin Danelljan, Manuel Fritsche, Julien Lamour, and Radu Timofte. 2019. Div8k: Diverse 8k resolution image dataset. In 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW). IEEE, 3512--3516.
[21]
Shuhang Gu, Lei Zhang, Wangmeng Zuo, and Xiangchu Feng. 2014. Weighted nuclear norm minimization with application to image denoising. In IEEE Conference on Computer Vision and Pattern Recognition. 2862--2869.
[22]
Xiangyu He, Zitao Mo, Peisong Wang, Yang Liu, Mingyuan Yang, and Jian Cheng. 2019. Ode-inspired Network Design for Single Image super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 1732--1741.
[23]
Zewei He, Du Chen, Yanpeng Cao, Jiangxin Yang, Yanlong Cao, Xin Li, Siliang Tang, Yueting Zhuang, and Zheming Lu. 2022. Single Image Super-Resolution Based on Progressive Fusion of Orientation-aware Features. Pattern Recognition (2022), 109038.
[24]
Martin Heusel, Hubert Ramsauer, Thomas Unterthiner, Bernhard Nessler, and Sepp Hochreiter. 2017. Gans Trained by a Two Time-scale Update Rule Converge to a Local Nash Equilibrium. Advances in Neural Information Processing Systems 30 (2017).
[25]
Jonathan Ho, Ajay Jain, and Pieter Abbeel. 2020. Denoising diffusion probabilistic models. Advances in Neural Information Processing Systems 33 (2020), 6840--6851.
[26]
Jia-Bin Huang, Abhishek Singh, and Narendra Ahuja. 2015. Single Image super- resolution from Transformed Self-exemplars. In IEEE Conference on Computer Vision and Pattern Recognition. 5197--5206.
[27]
Yawen Huang, Ling Shao, and Alejandro F Frangi. 2017. Simultaneous super- resolution and cross-modality synthesis of 3D medical images using weakly-supervised joint convolutional sparse coding. In IEEE Conference on Computer Vision and Pattern Recognition. 6070--6079.
[28]
Andrey Ignatov, Nikolay Kobyshev, Radu Timofte, Kenneth Vanhoey, and Luc Van Gool. [n. d.]. DSLR-quality Photos on Mobile Devices with Deep Convolutional Networks. In Proc. IEEE.
[29]
Tero Karras, Samuli Laine, and Timo Aila. 2019. A style-based generator ar- chitecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 4401--4410.
[30]
Junjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar, and Feng Yang. 2021. Musiq: Multi-scale image quality transformer. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 5148--5157.
[31]
Jiwon Kim, Jung Kwon Lee, and Kyoung Mu Lee. 2016. Accurate Image Super-resolution Using Very Deep Convolutional Networks. In IEEE Conference on Computer Vision and Pattern Recognition. 1646--1654.
[32]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[33]
Christian Ledig, Lucas Theis, Ferenc Huszár, Jose Caballero, Andrew Cunningham, Alejandro Acosta, Andrew Aitken, Alykhan Tejani, Johannes Totz, Zehan Wang, et al. 2017. Photo-realistic Single Image Super-resolution Using a Generative Adversarial Network. In IEEE Conference on Computer Vision and Pattern-Recognition. 4681--4690.
[34]
Sen Lei, Zhenwei Shi, and Zhengxia Zou. 2017. Super-resolution for remote sensing images via local-global combined network. IEEE Geoscience and Remote Sensing Letters 14, 8 (2017), 1243--1247.
[35]
Wenbo Li, Kun Zhou, Lu Qi, Liying Lu, and Jiangbo Lu. 2022. Best-buddy gans for highly detailed image super-resolution. In Proceedings of the AAAI Conference on Artificial Intelligence. 1412--1420.
[36]
Xiaoming Li, Chaofeng Chen, Xianhui Lin, Wangmeng Zuo, and Lei Zhang. 2022. From face to natural image: Learning real degradation for blind image super-resolution. In European Conference on Computer Vision. Springer, 376--392.
[37]
Xiaoming Li, Shiguang Zhang, Shangchen Zhou, Lei Zhang, and Wangmeng Zuo. 2022. Learning Dual Memory Dictionaries for Blind Face Restoration. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 5 (2022), 5904--5917.
[38]
Xiaoming Li, Wangmeng Zuo, and Chen Change Loy. 2023. Learning Generative Structure Prior for Blind Text Image Super-Resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10103--10113.
[39]
Zhen Li, Jinglei Yang, Zheng Liu, Xiaomin Yang, Gwanggil Jeon, and Wei Wu. 2019. Feedback network for image super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 3867--3876.
[40]
Jingyun Liang, Jiezhang Cao, Guolei Sun, Kai Zhang, Luc Van Gool, and Radu Timofte. 2021. SwinIR: Image Restoration Using Swin Transformer. In Proceedings of the IEEE/CVF International Conference on Computer Vision Workshop. 1833--1844.
[41]
Jie Liang, Hui Zeng, and Lei Zhang. 2022. Details or Artifacts: A Locally Dis- criminative Learning Approach to Realistic Image Super-Resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 5657--5666.
[42]
Bee Lim, Sanghyun Son, Heewon Kim, Seungjun Nah, and Kyoung Mu Lee. 2017. Enhanced Deep Residual Networks for Single Image Super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition Workshop. 136--144.
[43]
Xinqi Lin, Jingwen He, Ziyan Chen, Zhaoyang Lyu, Ben Fei, Bo Dai, Wanli Ouyang, Yu Qiao, and Chao Dong. 2023. DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior. arXiv preprint arXiv:2308.15070 (2023).
[44]
Ze Liu, Yutong Lin, Yue Cao, Han Hu, Yixuan Wei, Zheng Zhang, Stephen Lin, and Baining Guo. 2021. Swin transformer: Hierarchical vision transformer using shifted windows. In Proceedings of the IEEE/CVF international conference on computer vision. 10012--10022.
[45]
Zhengxiong Luo, Yan Huang, Shang Li, Liang Wang, and Tieniu Tan. 2022. Learn- ing the degradation distribution for blind image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 6063--6072.
[46]
Cheng Ma, Yongming Rao, Yean Cheng, Ce Chen, Jiwen Lu, and Jie Zhou. 2020. Structure-preserving super resolution with gradient guidance. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 7769--7778.
[47]
David Martin, Charless Fowlkes, Doron Tal, and Jitendra Malik. [n. d.]. A Data- base of Human Segmented Natural Images and its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics. In Proc. IEEE.
[48]
Yusuke Matsui, Kota Ito, Yuji Aramaki, Azuma Fujimoto, Toru Ogawa, Toshihiko Yamasaki, and Kiyoharu Aizawa. 2017. Sketch-based Manga Eetrieval Using Manga109 Dataset. Multimedia Tools and Applications 76, 20 (2017), 21811--21838.
[49]
Yiqun Mei, Yuchen Fan, and Yuqian Zhou. 2021. Image super-resolution with non-local sparse attention. In IEEE Conference on Computer Vision and Pattern Recognition. 3517--3526.
[50]
Anish Mittal, Rajiv Soundararajan, and Alan C Bovik. 2012. Making a 'Completely Blind' Image Quality Analyzer. IEEE Signal Processing Letters 20, 3 (2012), 209--212.
[51]
Ben Niu, Weilei Wen, Wenqi Ren, Xiangde Zhang, Lianping Yang, Shuzhen Wang, Kaihao Zhang, Xiaochun Cao, and Haifeng Shen. 2020. Single Image Super-resolution via a Holistic Attention Network. In European Conference on Computer Vision. Springer, 191--207.
[52]
JoonKyu Park, Sanghyun Son, and Kyoung Mu Lee. 2023. Content-Aware Local GAN for Photo-Realistic Super-Resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 10585--10594.
[53]
Seobin Park, Dongjin Kim, Sungyong Baik, and Tae Hyun Kim. 2023. Learning Controllable Degradation for Real-World Super-Resolution via Constrained Flows. Proceedings of the International Conference on Machine Learning (2023).
[54]
Mohammad Saeed Rad, Behzad Bozorgtabar, Urs-Viktor Marti, Max Basler, Hazim Kemal Ekenel, and Jean-Philippe Thiran. 2019. Srobb: Targeted Perceptual Loss for Single Image Super-resolution. In International Conference on Computer Vision. 2710--2719.
[55]
Robin Rombach, Andreas Blattmann, Dominik Lorenz, Patrick Esser, and Björn Ommer. 2022. High-resolution image synthesis with latent diffusion models. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 10684--10695.
[56]
Chitwan Saharia, Jonathan Ho, William Chan, Tim Salimans, David J Fleet, and Mohammad Norouzi. 2022. Image Super-resolution via Iterative Refinement. IEEE Transactions on Pattern Analysis and Machine Intelligence 45, 4 (2022), 4713--4726.
[57]
Christoph Schuhmann, Romain Beaumont, Richard Vencu, Cade Gordon, Ross Wightman, Mehdi Cherti, Theo Coombes, Aarush Katta, Clayton Mullis, Mitchell Wortsman, et al. 2022. LAION-5B: An Open Large-scale Dataset for Training Next Generation Image-text Models. Advances in Neural Information Processing Systems 35 (2022), 25278--25294.
[58]
Karen Simonyan and Andrew Zisserman. 2014. Very Deep Convolutional Networks for Large-scale Image Recognition. arXiv preprint arXiv:1409.1556 (2014).
[59]
Jiaming Song, Chenlin Meng, and Stefano Ermon. 2020. Denoising Diffusion Implicit Models. In International Conference on Learning Representations.
[60]
Radu Timofte, Eirikur Agustsson, Luc Van Gool, Ming-Hsuan Yang, and Lei Zhang. 2017. NTIRE 2017 Challenge on Single Image Super-resolution: Methods and Results. In IEEE Conference on Computer Vision and Pattern Recognition Workshop. 114--125.
[61]
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Lukasz Kaiser, and Illia Polosukhin. 2017. Attention is All You Need. Conference and Workshop on Neural Information Processing Systems 30 (2017).
[62]
Jianyi Wang, Kelvin CK Chan, and Chen Change Loy. 2023. Exploring clip for assessing the look and feel of images. In Proceedings of the AAAI Conference on Artificial Intelligence. 2555--2563.
[63]
Jianyi Wang, Zongsheng Yue, Shangchen Zhou, Kelvin CK Chan, and Chen Change Loy. 2023. Exploiting Diffusion Prior for Real-World Image Super-Resolution. arXiv preprint arXiv:2305.07015 (2023).
[64]
Longguang Wang, Yingqian Wang, Xiaoyu Dong, Qingyu Xu, Jungang Yang, Wei An, and Yulan Guo. 2021. Unsupervised Degradation Representation Learning for Blind Super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 10581--10590.
[65]
Xintao Wang, Liangbin Xie, Chao Dong, and Ying Shan. [n. d.]. Real-ESRGAN: Training Real-world Blind Super-resolution with Pure Synthetic Data. In Proc. IEEE.
[66]
Xintao Wang, Ke Yu, Chao Dong, and Chen Change Loy. 2018. Recovering Realistic Texture in Image Super-resolution by Deep Spatial Feature Transform. In IEEE Conference on Computer Vision and Pattern Recognition. 606--615.
[67]
Xintao Wang, Ke Yu, Shixiang Wu, Jinjin Gu, Yihao Liu, Chao Dong, Yu Qiao, and Chen Change Loy. 2018. ESRGAN: Enhanced Super-resolution Generative Adversarial Networks. In European Conference on Computer Vision Workshop. 0--0.
[68]
Zhou Wang, Alan C Bovik, Hamid R Sheikh, and Eero P Simoncelli. 2004. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing 13, 4 (2004), 600--612.
[69]
Pengxu Wei, Yujing Sun, Xingbei Guo, Chang Liu, Guanbin Li, Jie Chen, Xiangyang Ji, and Liang Lin. 2023. Towards Real-World Burst Image Super-Resolution: Benchmark and Method. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 13233--13242.
[70]
Pengxu Wei, Ziwei Xie, Hannan Lu, Zongyuan Zhan, Qixiang Ye, Wangmeng Zuo, and Liang Lin. 2020. Component Divide-and-conquer for Real-world Image Super-resolution. In European Conference on Computer Vision. Springer, 101--117.
[71]
Yunxuan Wei, Shuhang Gu, Yawei Li, Radu Timofte, Longcun Jin, and Hengjie Song. 2021. Unsupervised real-world image super resolution via domain-distance aware training. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13385--13394.
[72]
Bin Xia, Yulun Zhang, Shiyin Wang, Yitong Wang, Xinglong Wu, Yapeng Tian, Wenming Yang, and Luc Van Gool. 2023. Diffir: Efficient Diffusion Model for Image Restoration. Proceedings of the IEEE/CVF International Conference on Computer Vision (2023).
[73]
Liangbin Xie, Xintao Wang, Xiangyu Chen, Gen Li, Ying Shan, Jiantao Zhou, and Chao Dong. 2023. DeSRA: Detect and Delete the Artifacts of GAN-based Real-World Super-Resolution Models. Proceedings of the International Conference on Machine Learning (2023).
[74]
Ruikang Xu, Mingde Yao, and Zhiwei Xiong. 2023. Zero-Shot Dual-Lens Super- Resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 9130--9139.
[75]
Xiaoqian Xu, Pengxu Wei, Weikai Chen, Yang Liu, Mingzhi Mao, Liang Lin, and Guanbin Li. 2022. Dual adversarial adaptation for cross-device real-world image super-resolution. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 5667--5676.
[76]
Tao Yang, Peiran Ren, Xuansong Xie, and Lei Zhang. 2023. Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization. arXiv preprint arXiv:2308.14469 (2023).
[77]
Zuo.Zhicun Yin, Ming Liu, Xiaoming Li, Hui Yang, Longan Xiao, and Wangmeng 2023. MetaF2N: Blind Image Super-Resolution by Learning Efficient Model Adaptation from Faces. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 13033--13044.
[78]
Jinsu Yoo, Taehoon Kim, Sihaeng Lee, Seung Hwan Kim, Honglak Lee, and Tae Hyun Kim. 2023. Enriched cnn-transformer feature aggregation networks for super-resolution. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 4956--4965.
[79]
Zongsheng Yue, Jianyi Wang, and Chen Change Loy. 2023. Resshift: Efficient diffusion model for image super-resolution by residual shifting. Proceedings of the Advances in Neural Information Processing Systems (2023).
[80]
Zongsheng Yue, Qian Zhao, Jianwen Xie, Lei Zhang, Deyu Meng, and Kwan-Yee K Wong. 2022. Blind Image Super-resolution with Elaborate Degradation Modeling on Noise and Kernel. In IEEE Conference on Computer Vision and Pattern Recognition. 2128--2138.
[81]
Roman Zeyde, Michael Elad, and Matan Protter. 2010. On Single Image Scale-up Using Sparse-representations. In International Conference on Curves and Surfaces. Springer, 711--730.
[82]
Kai Zhang, Luc Van Gool, and Radu Timofte. 2020. Deep Unfolding Network for Image Super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 3217--3226.
[83]
Kaihao Zhang, Dongxu Li, Wenhan Luo, Wenqi Ren, Björn Stenger, Wei Liu, Hongdong Li, and Ming-Hsuan Yang. 2021. Benchmarking ultra-high-definition image super-resolution. In Proceedings of the IEEE/CVF international conference on computer vision. 14769--14778.
[84]
Kai Zhang, Jingyun Liang, Luc Van Gool, and Radu Timofte. [n. d.]. Designing a Practical Degradation Model for Deep Blind Image Super-resolution. In Proc. IEEE.
[85]
Kai Zhang, Wangmeng Zuo, and Lei Zhang. 2018. Learning a Single Convolutional Super-resolution Network for Multiple Degradations. In IEEE Conference on Computer Vision and Pattern Recognition. 3262--3271.
[86]
Richard Zhang, Phillip Isola, Alexei A Efros, Eli Shechtman, and Oliver Wang. 2018. The Unreasonable Effectiveness of Deep Features as a Perceptual Metric. In IEEE Conference on Computer Vision and Pattern Recognition. 586--595.
[87]
Wenlong Zhang, Yihao Liu, Chao Dong, and Yu Qiao. 2019. Ranksrgan: Generative adversarial networks with ranker for image super-resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 3096--3105.
[88]
Xuaner Zhang, Qifeng Chen, Ren Ng, and Vladlen Koltun. 2019. Zoom to learn, learn to zoom. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 3762-3770.
[89]
Xindong Zhang, Hui Zeng, Shi Guo, and Lei Zhang. 2022. Efficient Long-range At- tention Network for Image Super-resolution. In European Conference on Computer Vision. Springer, 649--667.
[90]
Yulun Zhang, Kunpeng Li, Kai Li, Lichen Wang, Bineng Zhong, and Yun Fu. 2018. Image Super-resolution Using Very Deep Residual Channel Attention Networks. In European Conference on Computer Vision. 286--301.
[91]
Yulun Zhang, Yapeng Tian, Yu Kong, Bineng Zhong, and Yun Fu. 2018. Residual dense network for image super-resolution. In IEEE Conference on Computer Vision and Pattern Recognition. 2472--2481.
[92]
Yulun Zhang, Donglai Wei, Can Qin, Huan Wang, Hanspeter Pfister, and Yun Fu. 2021. Context reasoning attention network for image super-resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 4278--4287.
[93]
Hongyang Zhou, Xiaobin Zhu, Jianqing Zhu, Zheng Han, Shi-Xue Zhang, Jingyan Qin, and Xu-Cheng Yin. 2023. Learning Correction Filter via Degradation-Adaptive Regression for Blind Single Image Super-Resolution. In Proceedings of the IEEE/CVF International Conference on Computer Vision. 12365--12375.
Index Terms
- SSL: A Self-similarity Loss for Improving Generative Image Super-resolution
Recommendations
Boundary equilibrium SR: effective loss functions for single image super-resolution
AbstractRecently, single image super-resolution (SISR) has made great progress due to the rapid development of deep convolutional neural networks (CNN), and the application of Generative Adversarial Networks (GAN ) has made super-resolution networks even ...
Image super-resolution using only low-resolution images
AbstractCurrently, most image super-resolution methods use the paired training dataset which is difficult to collect. So bicubic mode is often used to generate paired low-resolution and high-resolution images, but this does not match the actual ...
Curvature preserving image super-resolution with gradient-consistency-anisotropic-regularization prior
Single image super-resolution (SR) often suffers from annoying interpolation artifacts such as blur, jagged edges, and ringing. In this paper, we aim to achieve artifact-free SR reconstruction from an input low resolution (LR) image using adaptive de-...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
October 2024
11719 pages
ISBN:9798400706868
DOI:10.1145/3664647
- General Chairs:
- Jianfei Cai,
- Mohan Kankanhalli,
- Balakrishnan Prabhakaran,
- Susanne Boll,
- Program Chairs:
- Ramanathan Subramanian,
- Liang Zheng,
- Vivek K. Singh,
- Pablo Cesar,
- Lexing Xie,
- Dong Xu
Copyright © 2024 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 28 October 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MM '24
Sponsor:
MM '24: The 32nd ACM International Conference on Multimedia
October 28 - November 1, 2024
Melbourne VIC, Australia
Acceptance Rates
MM '24 Paper Acceptance Rate 1,150 of 4,385 submissions, 26%;
Overall Acceptance Rate 2,145 of 8,556 submissions, 25%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 122Total Downloads
- Downloads (Last 12 months)122
- Downloads (Last 6 weeks)114
Reflects downloads up to 13 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in