More Web Proxy on the site http://driver.im/

research-article

Feature Fusion: Graph Attention Network and CNN Combing for Hyperspectral Image Classification

Authors:

Cao GuoAuthors Info & Claims

ICCCV '22: Proceedings of the 5th International Conference on Control and Computer Vision

Pages 171 - 178

https://doi.org/10.1145/3561613.3561640

Published: 09 November 2022 Publication History

Abstract

Graph convolutional networks (GCNs) have attracted increasing attention in hyperspectral image classification. However, most of the available GCN-based HSI classification methods treat superpixels as graph nodes, ignoring pixel-level spectral spatial features. In this paper, we propose a novel Feature Fusion Network (FFGCN), which is composed of two different convolutional networks, namely Graph Attention Network (GAT) and Convolutional Neural Network (CNN). Among them, superpixel-based GAT can deal with the problem of labeled deficiency and extract spatial features from HSI. Attention-based multi-scale CNN can extract multi-scale pixel local features for HSI classification. Finally, the features of the two neural network models are fused and used for classification. Rigorous experiments on two real HSI datasets show that FFGCN achieves better experimental results and is competitive with other state-of-the-art methods.

References

[1]

Dong Y, Liu Q, Du B, Weighted feature fusion of convolutional neural network and graph attention network for hyperspectral image classification[J]. IEEE Transactions on Image Processing, 2022, 31: 1559-1572.

Digital Library

[2]

Wambugu N, Chen Y, Xiao Z, Hyperspectral image classification on insufficient-sample and feature learning using deep neural networks: A review[J]. International Journal of Applied Earth Observation and Geoinformation, 2021, 105: 102603.

[3]

Ding Y, Zhang Z, Zhao X, Multi-feature Fusion: Graph Neural Network and CNN Combining for Hyperspectral Image Classification[J]. Neurocomputing, 2022.

[4]

Li S, Song W, Fang L, Deep learning for hyperspectral image classification: An overview[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 57(9): 6690-6709.

[5]

Dong Y, Liu Q, Du B, Weighted feature fusion of convolutional neural network and graph attention network for hyperspectral image classification[J]. IEEE Transactions on Image Processing, 2022, 31: 1559-1572.

Digital Library

[6]

Hong-hai Y, Xiao-peng Y, Shao-kun L, Radar emitter multi-label recognition based on residual network[J]. Defence Technology, 2021.

[7]

Bai J, Yuan A, Xiao Z, Class incremental learning with few-shots based on linear programming for hyperspectral image classification[J]. IEEE Transactions on Cybernetics, 2020.

[8]

Tao R, Zhao X, Li W, Hyperspectral anomaly detection by fractional Fourier entropy[J]. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2019, 12(12): 4920-4929.

[9]

He Z, Shen Y, Zhang M, Spectral-spatial hyperspectral image classification via SVM and superpixel segmentation[C]//2014 IEEE International Instrumentation and Measurement Technology Conference (I2MTC) Proceedings. IEEE, 2014: 422-427.

[10]

Zhang Y, Cao G, Li X, Active semi-supervised random forest for hyperspectral image classification[J]. Remote Sensing, 2019, 11(24): 2974.

[11]

Velásquez L, Cruz-Tirado J P, Siche R, An application based on the decision tree to classify the marbling of beef by hyperspectral imaging[J]. Meat Science, 2017, 133: 43-50.

[12]

Li Z, Huang H, Zhang Z, Manifold-Based Multi-Deep Belief Network for Feature Extraction of Hyperspectral Image[J]. Remote Sensing, 2022, 14(6): 1484.

[13]

Liu Q, Zhou F, Hang R, Bidirectional-convolutional LSTM based spectral-spatial feature learning for hyperspectral image classification[J]. Remote Sensing, 2017, 9(12): 1330.

[14]

Chen Y, Lin Z, Zhao X, Deep learning-based classification of hyperspectral data[J]. IEEE Journal of Selected topics in applied earth observations and remote sensing, 2014, 7(6): 2094-2107.

[15]

Hu W, Huang Y, Wei L, Deep convolutional neural networks for hyperspectral image classification[J]. Journal of Sensors, 2015, 2015.

[16]

Yang J, Zhao Y, Chan J C W, Hyperspectral image classification using two-channel deep convolutional neural network[C]//2016 IEEE international geoscience and remote sensing symposium (IGARSS). IEEE, 2016: 5079-5082.

[17]

Xu S, Liu S, Wang H, A hyperspectral image classification approach based on feature fusion and multi-layered gradient boosting decision trees[J]. Entropy, 2020, 23(1): 20.

[18]

Ding G, Guo Y, Chen K, DECODE: Deep confidence network for robust image classification[J]. IEEE Transactions on Image Processing, 2019, 28(8): 3752-3765.

[19]

Kipf T N, Welling M. Semi-supervised classification with graph convolutional networks[J]. arXiv preprint arXiv:1609.02907, 2016.

[20]

Qin A, Shang Z, Tian J, Spectral–spatial graph convolutional networks for semisupervised hyperspectral image classification[J]. IEEE Geoscience and Remote Sensing Letters, 2018, 16(2): 241-245.

[21]

Wan S, Gong C, Zhong P, Multiscale dynamic graph convolutional network for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2019, 58(5): 3162-3177.

[22]

Liu Q, Xiao L, Yang J, CNN-enhanced graph convolutional network with pixel-and superpixel-level feature fusion for hyperspectral image classification[J]. IEEE Transactions on Geoscience and Remote Sensing, 2020, 59(10): 8657-8671.

[23]

Velickovic P, Cucurull G, Casanova A, Graph attention networks[J]. stat, 2017, 1050: 20.

[24]

Hou Q, Zhou D, Feng J. Coordinate attention for efficient mobile network design[C]//Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 2021: 13713-13722.

[25]

Bukhtoyarov V, Zyryanov D, Tynchenko V, Research of Data Analysis Techniques for Vibration Monitoring of Technological Equipment[C]//Proceedings of the Computational Methods in Systems and Software. Springer, Cham, 2020: 598-605.

[26]

Kim K S, Zhang D, Kang M C, Improved simple linear iterative clustering superpixels[C]//2013 IEEE International Symposium on Consumer Electronics (ISCE). IEEE, 2013: 259-260.

[27]

Hu W, Huang Y, Wei L, Deep convolutional neural networks for hyperspectral image classification[J]. Journal of Sensors, 2015, 2015.

[28]

Li L, Yin J, Jia X, Joint spatial–spectral attention network for hyperspectral image classification[J]. IEEE geoscience and remote sensing letters, 2020, 18(10): 1816-1820.

[29]

Roy S K, Krishna G, Dubey S R, HybridSN: Exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification[J]. IEEE Geoscience and Remote Sensing Letters, 2019, 17(2): 277-281.

Cited By

Mu CLiu YYan XAli ALiu Y(2024)Few-Shot Open-Set Hyperspectral Image Classification With Adaptive Threshold Using Self-Supervised Multitask LearningIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2024.344161762(1-18)Online publication date: 2024
https://doi.org/10.1109/TGRS.2024.3441617
Jamshidi MKalhor AVahabie A(2024)Active Data Fusion in Deep Neural Networks via Separation Index2024 32nd International Conference on Electrical Engineering (ICEE)10.1109/ICEE63041.2024.10668072(1-7)Online publication date: 14-May-2024
https://doi.org/10.1109/ICEE63041.2024.10668072
Geetha TRao CChellaswamy CUmamaheswari K(2024)Enhancing remote target classification in hyperspectral imaging using graph attention neural networkJournal of Earth System Science10.1007/s12040-024-02294-3133:2Online publication date: 11-May-2024
https://doi.org/10.1007/s12040-024-02294-3

Recommendations

ImageNet classification with deep convolutional neural networks

We trained a large, deep convolutional neural network to classify the 1.2 million high-resolution images in the ImageNet LSVRC-2010 contest into the 1000 different classes. On the test data, we achieved top-1 and top-5 error rates of 37.5% and 17.0%, ...
Transformers in Vision: A Survey
Astounding results from Transformer models on natural language tasks have intrigued the vision community to study their application to computer vision problems. Among their salient benefits, Transformers enable modeling long dependencies between input ...
Multi-feature fusion: Graph neural network and CNN combining for hyperspectral image classification
Abstract
Due to its impressive representation power, the graph convolutional network (GCN) has attracted increasing attention in the hyperspectral image (HSI) classification. However, the most of available GCN-based methods for HSI ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

ICCCV '22: Proceedings of the 5th International Conference on Control and Computer Vision

August 2022

241 pages

ISBN:9781450397315

DOI:10.1145/3561613

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 November 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICCCV 2022

ICCCV 2022: 2022 The 5th International Conference on Control and Computer Vision

August 19 - 21, 2022

Xiamen, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
101
Total Downloads

Downloads (Last 12 months)26
Downloads (Last 6 weeks)0

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Mu CLiu YYan XAli ALiu Y(2024)Few-Shot Open-Set Hyperspectral Image Classification With Adaptive Threshold Using Self-Supervised Multitask LearningIEEE Transactions on Geoscience and Remote Sensing10.1109/TGRS.2024.344161762(1-18)Online publication date: 2024
https://doi.org/10.1109/TGRS.2024.3441617
Jamshidi MKalhor AVahabie A(2024)Active Data Fusion in Deep Neural Networks via Separation Index2024 32nd International Conference on Electrical Engineering (ICEE)10.1109/ICEE63041.2024.10668072(1-7)Online publication date: 14-May-2024
https://doi.org/10.1109/ICEE63041.2024.10668072
Geetha TRao CChellaswamy CUmamaheswari K(2024)Enhancing remote target classification in hyperspectral imaging using graph attention neural networkJournal of Earth System Science10.1007/s12040-024-02294-3133:2Online publication date: 11-May-2024
https://doi.org/10.1007/s12040-024-02294-3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten