[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content
Springer Nature Link
Log in

A real-time SC2S-based open-set recognition in remote sensing imagery

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Accuracy and computational time are two crucial parameters influencing the efficacy of classification algorithms for remote sensing applications. Machine learning algorithms are known for achieving notable success for several classification problems in various domains, including remote sensing. However, they are well-recognized and considered accurate and efficient for closed-set recognition (CSR) but may provide suboptimal and erroneous results for open-set recognition (OSR) tasks. Many practical image-driven and computer vision applications have open-set and dynamic scenarios with unknown data where classification algorithms have not yet achieved significant prediction performance. This paper presents a group of class-aware (CA) classification algorithms based on a supervised cascaded classifier system (SC2S), called CA-SC2S, which is accurate for OSR and CSR tasks. We evaluate the prediction accuracy of the proposed methods against the state-of-the-art methods in a multiclass setting using multiple image classification scenarios of OSR and CSR. The test case scenarios use six multispectral and hyperspectral datasets from different sensing platforms. And to assess the computational performance of the methods, we designed various field-programmable gate array (FPGA) architectures of the proposed methods. We evaluated their real-time performance on a low-cost, low-power Artix-7 35 T FPGA.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Scheirer, W.J., Jain, L.P., Boult, T.E.: Probability models for open set recognition. IEEE Trans. Pattern Anal. Mach. Intell. 36(11), 2317–2324 (2014). https://doi.org/10.1109/TPAMI.2014.2321392

    Article  Google Scholar 

  2. Ghamisi, P., Plaza, J., Chen, Y., Li, J., Plaza, A.J.: Advanced spectral classifiers for hyperspectral images: a review. IEEE Geosci. Remote Sens. Mag. 5(1), 8–32 (2017). https://doi.org/10.1109/MGRS.2016.2616418

    Article  Google Scholar 

  3. Khan, M.J., Khan, H.S., Yousaf, A., Khurshid, K., Abbas, A.: modern trends in hyperspectral image analysis: a review. IEEE Access 6, 14118–14129 (2018). https://doi.org/10.1109/ACCESS.2018.2812999

    Article  Google Scholar 

  4. Gyaneshwar, D., Nidamanuri, R.R.: Low-complexity reconfigurable computing based online one-class classification using high-resolution hyperspectral imagery. In: 2021 IEEE International India Geoscience and Remote Sensing Symposium (InGARSS), pp. 33–36. IEEE

  5. Gyaneshwar, D., Nidamanuri, R.R.: A novel supervised cascaded classifier system (SC2S) for robust remote sensing image classification. IEEE Geosci. Remote Sens. Lett. 18(3), 421–425 (2021). https://doi.org/10.1109/LGRS.2020.2980186

    Article  Google Scholar 

  6. Tessier, R., Pocek, K., DeHon, A.: Reconfigurable computing architectures. Proc. IEEE 103(3), 332–354 (2015)

    Article  Google Scholar 

  7. Gyaneshwar, D., Nidamanuri, R.R.: A real-time FPGA accelerated stream processing for hyperspectral image classification. Geocarto Int. 37(1), 52–69 (2022). https://doi.org/10.1080/10106049.2020.1713231

    Article  Google Scholar 

  8. Júnior, P.R.M., et al.: Nearest neighbors distance ratio open-set classifier. Mach. Learn. 106(3), 359–386 (2017)

    Article  MathSciNet  Google Scholar 

  9. Farfan-Escobedo, J.D., Enciso-Rodas, L., Vargas-Muñoz, J.E.: Towards accurate building recognition using convolutional neural networks. In: 2017 IEEE XXIV International Conference on Electronics, Electrical Engineering and Computing (INTERCON), Cusco, Peru, pp. 1–4 (2017)

  10. Homenda, W., Jastrzebska, A.: Global, local and embedded architectures for multiclass classification with foreign elements rejection: An overview. In: 2015 7th International Conference of Soft Computing and Pattern Recognition (SoCPaR), pp. 89–94. https://doi.org/10.1109/SOCPAR.2015.7492789. (2015)

  11. Schölkopf, B., Williamson, R.C., Smola, A.J., Shawe-Taylor, J., Platt, J.C.: Support vector method for novelty detection. In: Thirteenth Annual Neural Information Processing Systems Conference (NIPS 1999), pp. 582–588. MIT Press

  12. Hu, W., Huang, Y., Wei, L., Zhang, F., Li, H.: Deep convolutional neural networks for hyperspectral image classification. J. Sens. (2015). https://doi.org/10.1155/2015/258619

    Article  Google Scholar 

  13. Xilinx User Guide: Vivado Design Suite User Guide: Model-Based DSP Design using System Generator, UG897, v2016.1 ed. (2016)

  14. Zhang, L.: System generator model-based FPGA design optimization and hardware co-simulation for Lorenz chaotic generator. In: 2017 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), Wuhan, China, pp. 170–174 (2017)

  15. SpaceNet on Amazon Web Services (AWS). "Datasets," The SpaceNet Catalog. https://spacenet.ai/datasets/. Accessed 18 Aug. 2020

  16. Kemker, R., Salvaggio, C., Kanan, C.: Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning. ISPRS J. Photogramm. Remote. Sens. 145, 60–77 (2018)

    Article  Google Scholar 

  17. Yokoya, N., Iwasaki, A.: Airborne hyperspectral data over Chikusei. Space Appl. Lab., Univ. Tokyo, Tokyo, Japan, Tech. Rep. SAL-2016–05–27 (2016)

  18. Chang, C.-C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)

    Google Scholar 

Download references

Acknowledgements

The authors would like to thank Prof. Paolo Gamba, SpaceNet of DigitalGlobe, Rochester Institute of Technology, and Space Application Laboratory (Department of Advanced Interdisciplinary studies, the University of Tokyo) for providing the PC, WV3, R18, and CHK datasets, respectively.

Author information

Authors and Affiliations

  1. Indian Institute of Space Science and Technology, Thiruvananthapuram, 695547, India

    Dubacharla Gyaneshwar & Rama Rao Nidamanuri

Authors
  1. Dubacharla Gyaneshwar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Rama Rao Nidamanuri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Dubacharla Gyaneshwar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gyaneshwar, D., Nidamanuri, R.R. A real-time SC2S-based open-set recognition in remote sensing imagery. J Real-Time Image Proc 19, 867–880 (2022). https://doi.org/10.1007/s11554-022-01226-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-022-01226-y

Keywords

Search

Navigation