A Novel Clustering-Based Image Inpainting Model Using the Loermgan Algorithm
Authors: 
Ishan Sharma, Yongwei NieAuthors Info & Claims
Article No.: 15, Pages 1 - 8
Abstract
The process of recovering the damaged or missing areas from an image utilizing information as of known portions is termed Image Inpainting. To refurbish the damaged image into a new one alike an actual image, numerous sophisticated methodologies have been established to date. Nevertheless, in the case of images with a larger missing region, these models are not effective in addressing the problem. Likewise, these methodologies are ineffective towards the edge. Therefore, by utilizing the Log of Exponent Rule Generative Adversarial Network algorithm, a novel clustering-centric image inpainting system has been proposed here. Initially, two significant steps, namely (i) noise removal, and (ii) Contrast Enhancement (CE), are performed to pre-process the input images. After that, by utilizing the Adaptive Max One-Sided Box Filter (AMOSBF) algorithm, the pre-processed images’ edges are well-preserved. Then, the most needed features are extracted as of the edge preserved images. Next, by employing Supremum Distance Fast Density Peaks Clustering Algorithm (SDFDPCA), the features being extracted are clustered. Next, the proposed model, termed Log of Exponent Rule Mish Generative Adversarial Network (LOERMGAN), which reconstructs the actual images effectively, is fed with the clustered features and also the masked image and the mask itself. In this research, the openly accessible datasets termed ADE20k, Paris, and Places2 are utilized. Subsequently, the outcomes obtained are analogized with the prevailing methodologies. The experiential outcomes displayed that the proposed model outshines the other prevailing methodologies by effectively reconstructing images.
References
[1]
Alan Anwer Abdulla and Mariwan Wahid Ahmed. 2021. An improved image quality algorithm for exemplar-based image inpainting. Multimedia Tools and Applications 80, 9 (2021), 13143–13156.
[2]
Yıldız Aydin and Bekir Dizdaroğlu. 2018. Image inpainting with local feature extraction. In 2018 26th Signal Processing And Communications Applications Conference (SIU). IEEE, 1–4.
[3]
Weiwei Cai and Zhanguo Wei. 2020. PiiGAN: generative adversarial networks for pluralistic image inpainting. IEEE Access 8(2020), 48451–48463.
[4]
Yewang Chen, Xiaoliang Hu, Wentao Fan, Lianlian Shen, Zheng Zhang, Xin Liu, Jixiang Du, Haibo Li, Yi Chen, and Hailin Li. 2020. Fast density peak clustering for large scale data based on kNN. Knowledge-Based Systems 187 (2020), 104824.
[5]
Yi-Hao Chung and Yen-Lin Chen. 2022. Three-Dimensional Image Inpainting System Using 3D-ED-GAN for Efficient Vision-Based Detection for Rotor Dynamic Balance System. IEEE Access (2022).
[6]
Ding Ding, Sundaresh Ram, and Jeffrey J Rodríguez. 2018. Image inpainting using nonlocal texture matching and nonlinear filtering. IEEE Transactions on Image Processing 28, 4 (2018), 1705–1719.
[7]
Mrinmoy Ghorai, Soumitra Samanta, Sekhar Mandal, and Bhabatosh Chanda. 2019. Multiple pyramids based image inpainting using local patch statistics and steering kernel feature. IEEE Transactions on Image Processing 28, 11 (2019), 5495–5509.
[8]
Qiang Guo, Shanshan Gao, Xiaofeng Zhang, Yilong Yin, and Caiming Zhang. 2017. Patch-based image inpainting via two-stage low rank approximation. IEEE transactions on visualization and computer graphics 24, 6(2017), 2023–2036.
[9]
Chong Han and Junli Wang. 2021. Face Image Inpainting With Evolutionary Generators. IEEE Signal Processing Letters 28 (2021), 190–193. https://doi.org/10.1109/LSP.2020.3048608
[10]
Xingchen He, Xudong Cui, and Qilong Li. 2020. Image inpainting based on inside–outside attention and wavelet decomposition. IEEE Access 8(2020), 62343–62355.
[11]
Nobuyuki Hirahara, Motoharu Sonogashira, and Masaaki Iiyama. 2021. Cloud-Free Sea-Surface-Temperature Image Reconstruction From Anomaly Inpainting Network. IEEE Transactions on Geoscience and Remote Sensing 60 (2021), 1–11.
[12]
Mariko Isogawa, Dan Mikami, Daisuke Iwai, Hideaki Kimata, and Kosuke Sato. 2018. Mask optimization for image inpainting. IEEE Access 6(2018), 69728–69741.
[13]
Phillip Isola, Jun-Yan Zhu, Tinghui Zhou, and Alexei A Efros. 2017. Image-to-image translation with conditional adversarial networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1125–1134.
[14]
Bin Jiang, Wei Huang, Yun Huang, Chao Yang, and Fangqiang Xu. 2020a. Deep Fusion Local-Content and Global-Semantic for Image Inpainting. IEEE Access 8(2020), 156828–156838.
[15]
Yi Jiang, Jiajie Xu, Baoqing Yang, Jing Xu, and Junwu Zhu. 2020b. Image inpainting based on generative adversarial networks. IEEE Access 8(2020), 22884–22892.
[16]
Avisek Lahiri, Sourav Bairagya, Sutanu Bera, Siddhant Haldar, and Prabir Kumar Biswas. 2020. Lightweight modules for efficient deep learning based image restoration. IEEE Transactions on Circuits and Systems for Video Technology 31, 4(2020), 1395–1410.
[17]
Zhidan Li, Jiawei Liu, and Jixiang Cheng. 2019. Exploiting multi-direction features in MRF-based image inpainting approaches. IEEE Access 7(2019), 179905–179917.
[18]
Jiaying Liu, Shuai Yang, Yuming Fang, and Zongming Guo. 2018. Structure-guided image inpainting using homography transformation. IEEE Transactions on Multimedia 20, 12 (2018), 3252–3265.
[19]
Takuro Matsui and Masaaki Ikehara. 2019. Single-image fence removal using deep convolutional neural network. IEEE Access 8(2019), 38846–38854.
[20]
Yongwei Nie, Zhensong Zhang, Hanqiu Sun, Tan Su, and Guiqing Li. 2016. Homography propagation and optimization for wide-baseline street image interpolation. IEEE transactions on visualization and computer graphics 23, 10(2016), 2328–2341.
[21]
Mengjie Qin, Zhuorong Li, Shengyong Chen, Qiu Guan, and Jianwei Zheng. 2020. Low-rank tensor completion and total variation minimization for color image inpainting. IEEE Access 8(2020), 53049–53061.
[22]
Irawati Nurmala Sari, Emiko Horikawa, and Weiwei Du. 2021. Interactive Image Inpainting of Large-Scale Missing Region. IEEE Access 9(2021), 56430–56442.
[23]
Yuhang Song, Chao Yang, Zhe Lin, Xiaofeng Liu, Qin Huang, Hao Li, and C-C Jay Kuo. 2018. Contextual-based image inpainting: Infer, match, and translate. In Proceedings of the European Conference on Computer Vision (ECCV). 3–19.
[24]
Tan Su, Yongwei Nie, Zhensong Zhang, Hanqiu Sun, and Guiqing Li. 2016. Video stitching for handheld inputs via combined video stabilization. In SIGGRAPH ASIA 2016 Technical Briefs. 1–4.
[25]
Jing Wang, Yan-Hong Zhou, Hai-Feng Sima, Zhan-Qiang Huo, and Ai-Zhong Mi. 2021b. Image Inpainting Based on Structural Tensor Edge Intensity Model. International Journal of Automation and Computing 18, 2 (2021), 256–265.
[26]
Ning Wang, Yipeng Zhang, and Lefei Zhang. 2021a. Dynamic selection network for image inpainting. IEEE Transactions on Image Processing 30 (2021), 1784–1798.
[27]
Xinyi Wang, He Wang, and Shaozhang Niu. 2019. An image forensic method for AI inpainting using faster R-CNN. In International Conference on Artificial Intelligence and Security. Springer, 476–487.
[28]
Yi Wang, Xin Tao, Xiaojuan Qi, Xiaoyong Shen, and Jiaya Jia. 2018. Image inpainting via generative multi-column convolutional neural networks. Advances in neural information processing systems 31 (2018).
[29]
Jinsheng Wei, Guanming Lu, Huaming Liu, and Jingjie Yan. 2019. Facial image inpainting with deep generative model and patch search using region weight. IEEE Access 7(2019), 67456–67468.
[30]
Chunxia Xiao, Yongwei Nie, Wei Hua, and Wenting Zheng. 2010. Fast multi-scale joint bilateral texture upsampling. The Visual Computer 26, 4 (2010), 263–275.
[31]
Liming Xu, Xianhua Zeng, Weisheng Li, and Zhiwei Huang. 2020b. Multi-granularity generative adversarial nets with reconstructive sampling for image inpainting. Neurocomputing 402(2020), 220–234.
[32]
Rui Xu, Minghao Guo, Jiaqi Wang, Xiaoxiao Li, Bolei Zhou, and Chen Change Loy. 2021. Texture memory-augmented deep patch-based image inpainting. IEEE Transactions on Image Processing 30 (2021), 9112–9124.
[33]
Shunxin Xu, Dong Liu, and Zhiwei Xiong. 2020a. E2I: Generative inpainting from edge to image. IEEE Transactions on Circuits and Systems for Video Technology 31, 4(2020), 1308–1322.
[34]
Tao Yang, Xiaofei Chang, Hang Su, Nathan Crombez, Yassine Ruichek, Tomas Krajnik, and Zhi Yan. 2020. Raindrop removal with light field image using image inpainting. IEEE Access 8(2020), 58416–58426.
[35]
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, and Thomas S Huang. 2018. Generative image inpainting with contextual attention. In Proceedings of the IEEE conference on computer vision and pattern recognition. 5505–5514.
[36]
Jiahui Yu, Zhe Lin, Jimei Yang, Xiaohui Shen, Xin Lu, and Thomas S Huang. 2019. Free-form image inpainting with gated convolution. In Proceedings of the IEEE/CVF international conference on computer vision. 4471–4480.
[37]
Jiaqi Yu, Yongwei Nie, Chengjiang Long, Wenjun Xu, Qing Zhang, and Guiqing Li. 2021. Monte Carlo denoising via auxiliary feature guided self-attention.ACM Trans. Graph. 40, 6 (2021), 273–1.
[38]
Liuchun Yuan, Congcong Ruan, Haifeng Hu, and Dihu Chen. 2019b. Image inpainting based on patch-GANs. IEEE Access 7(2019), 46411–46421.
[39]
Zefeng Yuan, Hengyu Li, Jingyi Liu, and Jun Luo. 2019a. Multiview scene image inpainting based on conditional generative adversarial networks. IEEE Transactions on Intelligent Vehicles 5, 2 (2019), 314–323.
[40]
Zhensong Zhang, Yongwei Nie, Hanqiu Sun, Qing Zhang, Qiuxia Lai, Guiqing Li, and Mingyu Xiao. 2019. Multi-view video synopsis via simultaneous object-shifting and view-switching optimization. IEEE Transactions on Image Processing 29 (2019), 971–985.
Index Terms
- A Novel Clustering-Based Image Inpainting Model Using the Loermgan Algorithm
Recommendations
Edge-Guided Image Inpainting with Transformer
Advances in Visual ComputingAbstractImage inpainting aims to complete missing regions by extracting the features of the image through the information of the known region. Traditional image inpainting approaches like patch-based and diffusion-based methods are robust for simple ...
Image Retrieval Using Digital Image Inpainting Techniques
Image retrieval is an inverse problem in digital image processing. In this paper, the authors deal with restoration of image using digitally image inpainting methods. In this inpainting technique, one can extract a missing an important part or can ...
An Improved Algorithm Based on Exemplar Based Image Inpainting
AIAM 2019: Proceedings of the 2019 International Conference on Artificial Intelligence and Advanced ManufacturingImage restoration technology is an important image processing technology. In image restoration, it not only can reconstruct the loss part of impaired image caused by external factors, but also can remove unwanted parts from the specified image. ...
Comments
Please enable JavaScript to view thecomments powered by Disqus.Information & Contributors
Information
Published In
December 2022
284 pages
ISBN:9798400700316
DOI:10.1145/3574131
Copyright © 2022 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 13 January 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Conference
VRCAI '22
Sponsor:
VRCAI '22: The 18th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry
December 27 - 29, 2022
Guangzhou, China
Acceptance Rates
Overall Acceptance Rate 51 of 107 submissions, 48%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 65Total Downloads
- Downloads (Last 12 months)13
- Downloads (Last 6 weeks)2
Reflects downloads up to 11 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format