[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3627377.3627440acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicbdtConference Proceedingsconference-collections
research-article

Self-Attention based Deep Hash Learning Method for Efficient Image Retrieval

Published: 04 December 2023 Publication History

Abstract

Hash method with efficient retrieval efficiency and lower storage space, in the most recent has been widely used in image retrieval task. For complex image retrieval task, the manually extracted features often has limitations, and the deep convolution neural network can extract better features. However, traditional convolution neural networks usually focus on local features, while ignoring the ability to learn global features. In addition, traditional hash methods require constructing sample pairs to learn distance metrics, resulting in high computational costs. To address the above problem, in this paper a new self-attention based deep hash (SADH) learning method is proposed, which introduces a labeled hashing center and trains the network using self-attention mechanism. The method aims to fit the image hash codes to the relevant hashing center. The distance between the hashing center and the image hash codes is calculated using a loss function, resulting in generated hash code with strong discriminative power. Experimental evaluations on standard datasets demonstrate that this method outperforms the state-of-the-art retrieval methods in terms of retrieval accuracy.

References

[1]
Zhangjie Cao, Mingsheng Long, Jianmin Wang, and Philip S Yu. 2017. Hashnet: Deep learning to hash by continuation. In Proceedings of the IEEE international conference on computer vision. 5608–5617.
[2]
Mayur Datar, Nicole Immorlica, Piotr Indyk, and Vahab S Mirrokni. 2004. Locality-sensitive hashing scheme based on p-stable distributions. In Proceedings of the twentieth annual symposium on Computational geometry. 253–262.
[3]
Yunchao Gong, Svetlana Lazebnik, Albert Gordo, and Florent Perronnin. 2012. Iterative quantization: A procrustean approach to learning binary codes for large-scale image retrieval. IEEE transactions on pattern analysis and machine intelligence 35, 12 (2012), 2916–2929.
[4]
Hanjiang Lai, Yan Pan, Ye Liu, and Shuicheng Yan. 2015. Simultaneous feature learning and hash coding with deep neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 3270–3278.
[5]
Wu-Jun Li, Sheng Wang, and Wang-Cheng Kang. 2015. Feature learning based deep supervised hashing with pairwise labels. arXiv preprint arXiv:1511.03855 (2015).
[6]
Xue Li, Jiong Yu, Yongqiang Wang, Jia-Ying Chen, Peng-Xiao Chang, and Ziyang Li. 2021. DAHP: Deep attention-guided hashing with pairwise labels. IEEE Transactions on Circuits and Systems for Video Technology 32, 3 (2021), 933–946.
[7]
Haomiao Liu, Ruiping Wang, Shiguang Shan, and Xilin Chen. 2016. Deep supervised hashing for fast image retrieval. In Proceedings of the IEEE conference on computer vision and pattern recognition. 2064–2072.
[8]
Haomiao Liu, Ruiping Wang, Shiguang Shan, and Xilin Chen. 2017. Learning multifunctional binary codes for both category and attribute oriented retrieval tasks. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3901–3910.
[9]
David G Lowe. 2004. Distinctive image features from scale-invariant keypoints. International journal of computer vision 60 (2004), 91–110.
[10]
Huimin Lu, Ming Zhang, Xing Xu, Yujie Li, and Heng Tao Shen. 2020. Deep fuzzy hashing network for efficient image retrieval. IEEE transactions on fuzzy systems 29, 1 (2020), 166–176.
[11]
Xuchao Lu, Li Song, Rong Xie, Xiaokang Yang, and Wenjun Zhang. 2017. Deep hash learning for efficient image retrieval. In 2017 IEEE International Conference on Multimedia & Expo Workshops (ICMEW). IEEE, 579–584.
[12]
Aude Oliva and Antonio Torralba. 2001. Modeling the shape of the scene: A holistic representation of the spatial envelope. International journal of computer vision 42 (2001), 145–175.
[13]
Shishi Qiao, Ruiping Wang, Shiguang Shan, and Xilin Chen. 2021. Deep video code for efficient face video retrieval. Pattern Recognition 113 (2021), 107754.
[14]
Ruikui Wang, Ruiping Wang, Shishi Qiao, Shiguang Shan, and Xilin Chen. 2020. Deep position-aware hashing for semantic continuous image retrieval. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2493–2502.
[15]
Xiaolong Wang, Ross Girshick, Abhinav Gupta, and Kaiming He. 2018. Non-local neural networks. In Proceedings of the IEEE conference on computer vision and pattern recognition. 7794–7803.
[16]
Yingxin Wang, Xiushan Nie, Yang Shi, Xin Zhou, and Yilong Yin. 2019. Attention-based video hashing for large-scale video retrieval. IEEE Transactions on Cognitive and Developmental Systems 13, 3 (2019), 491–502.
[17]
Yair Weiss, Antonio Torralba, and Rob Fergus. 2008. Spectral hashing. Advances in neural information processing systems 21 (2008).
[18]
Kaixing Wu and Li Xu. 2023. Deep Hybrid Neural Network with Attention Mechanism for Video Hash Retrieval Method. IEEE Access (2023).
[19]
Rongkai Xia, Yan Pan, Hanjiang Lai, Cong Liu, and Shuicheng Yan. 2014. Supervised hashing for image retrieval via image representation learning. In Proceedings of the AAAI conference on artificial intelligence, Vol. 28.
[20]
Li Yuan, Tao Wang, Xiaopeng Zhang, Francis EH Tay, Zequn Jie, Wei Liu, and Jiashi Feng. 2020. Central similarity quantization for efficient image and video retrieval. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 3083–3092.
[21]
Ruimao Zhang, Liang Lin, Rui Zhang, Wangmeng Zuo, and Lei Zhang. 2015. Bit-scalable deep hashing with regularized similarity learning for image retrieval and person re-identification. IEEE Transactions on Image Processing 24, 12 (2015), 4766–4779.
[22]
Fang Zhao, Yongzhen Huang, Liang Wang, and Tieniu Tan. 2015. Deep semantic ranking based hashing for multi-label image retrieval. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1556–1564.
[23]
Han Zhu, Mingsheng Long, Jianmin Wang, and Yue Cao. 2016. Deep hashing network for efficient similarity retrieval. In Proceedings of the AAAI conference on Artificial Intelligence, Vol. 30.

Index Terms

  1. Self-Attention based Deep Hash Learning Method for Efficient Image Retrieval

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    ICBDT '23: Proceedings of the 2023 6th International Conference on Big Data Technologies
    September 2023
    441 pages
    ISBN:9798400707667
    DOI:10.1145/3627377
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 December 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Attention mechanisms
    2. Deep learning
    3. Hash center

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICBDT 2023

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 25
      Total Downloads
    • Downloads (Last 12 months)20
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 09 Jan 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media