[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ Skip to main content

Advertisement

Springer Nature Link
Log in

Real-time prediction of spatial raster time series: a context-aware autonomous learning model

  • Special Issue Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Real-time prediction of spatial raster time series, such as those derived from satellite remote sensing imagery, is important for making emergency decisions on various geo-spatial processes/events. However, because of the scalability issue and large training time requirement, the neural network (NN)-based models often fail to perform real-time prediction, in spite of their tremendous potential. In this paper, we propose ContRast, a variant of recurrent NN-based context-aware raster time series prediction model that attempts to resolve these issues by: (1) eliminating the need for offline adjustment of network structure by employing self-evolving autonomous learning of recurrent neural network, (2) saving training time by adopting single-pass parameter learning mechanism, and (3) reducing redundant learning by skipping sub-regional data associated with similar spatio-temporal context and reusing already learned parameters to predict for the same. Experimental evaluations with respect to predicting normalized difference vegetation index (NDVI)-raster derived from MODIS Terra satellite remote sensing imagery show that ContRast is highly effective for real-time prediction of spatial raster time series, and it significantly outperforms the existing models. In addition, the theoretical analyses of model complexity and computational cost further justify our empirical observations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (United Kingdom)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Baeza-Yates, R., Liaghat, Z.: Quality-efficiency trade-offs in machine learning for text processing. In: 2017 IEEE International Conference on Big Data, pp. 897–904. IEEE (2017)

  2. Belhi, A., Al-Ali, A.K., Bouras, A., Foufou, S., Yu, X., Zhang, H.: Investigating low-delay deep learning-based cultural image reconstruction. J. Real-Time Image Process. 17, 1911–1926 (2020)

    Article  Google Scholar 

  3. Chen, B., Huang, B., Chen, L., Xu, B.: Spatially and temporally weighted regression: a novel method to produce continuous cloud-free landsat imagery. IEEE Trans. Geosci. Remote Sens. 55(1), 27–37 (2017)

    Article  Google Scholar 

  4. Chen, C., Li, W., Gao, L., Li, H., Plaza, J.: Special issue on advances in real-time image processing for remote sensing. J. Real-Time Image Process. 15(3), 435–438 (2018)

    Article  Google Scholar 

  5. Chen, Y., Li, J., Xiao, H., Jin, X., Yan, S., Feng, J.: Dual path networks. In: Advances in Neural Information Processing Systems, pp. 4467–4475 (2017)

  6. Cheng, Q., Shen, H., Zhang, L., Yuan, Q., Zeng, C.: Cloud removal for remotely sensed images by similar pixel replacement guided with a spatio-temporal mrf model. ISPRS J. Photogramm. Remote Sens. 92, 54–68 (2014)

    Article  Google Scholar 

  7. Crespo, J.L., Zorrilla, M., Bernardos, P., Mora, E.: A new image prediction model based on spatio-temporal techniques. Vis. Comput. 23(6), 419–431 (2007)

    Article  Google Scholar 

  8. Das, M.: Online prediction of derived remote sensing image time series: an autonomous machine learning approach. In: 2020 IEEE International Geoscience and Remote Sensing Symposium (IGARSS). pp. 1496–1499. IEEE (2020)

  9. Das, M., Ghosh, S.K.: Deep-STEP: a deep learning approach for spatiotemporal prediction of remote sensing data. IEEE Geosci. Remote Sens. Lett. 13(12), 1984–1988 (2016)

    Article  Google Scholar 

  10. Das, M., Ghosh, S.K.: A deep-learning-based forecasting ensemble to predict missing data for remote sensing analysis. IEEE J. Sel. Top. Appl. Earth Observ. Remote Sens. 10(12), 5228–5236 (2017)

    Article  Google Scholar 

  11. Das, M., Ghosh, S.K.: Spatio-temporal autocorrelation analysis for regional land-cover change detection from remote sensing data. In: Proceedings of the Fourth ACM IKDD Conferences on Data Sciences, pp. 1–10 (2017)

  12. Das, M., Ghosh, S.K.: Space-time prediction of high resolution raster data: an approach based on spatio-temporal Bayesian network (stbn). In: Proceedings of the ACM India Joint International Conference on Data Science and Management of Data, pp. 129–135. ACM (2019)

  13. Das, M., Pratama, M., Ghosh, S.K.: SARDINE: a self-adaptive recurrent deep incremental network model for spatio-temporal prediction of remote sensing data. ACM Trans. Spat. Algorithms Syst. (TSAS) 6(3), 1–26 (2020)

    Article  Google Scholar 

  14. Deng, L., Yu, D.: Deep learning: methods and applications. Found. Trends Signal Process. 7(3–4), 197–387 (2014)

    Article  MathSciNet  Google Scholar 

  15. Dong, C., Loy, C.C., He, K., Tang, X.: Image super-resolution using deep convolutional networks. IEEE Trans. Pattern Anal. Mach. Intell. 38(2), 295–307 (2016)

    Article  Google Scholar 

  16. Eldawy, A., Niu, L., Haynes, D., Su, Z.: Large scale analytics of vector + raster big spatial data. In: Proceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems, pp. 1–4 (2017)

  17. Ha, V.K., Ren, J., Xu, X., Liao, W., Zhao, S., Ren, J., Yan, G.: Optimized highway deep learning network for fast single image super-resolution reconstruction. J. Real-Time Image Process. 17(6), 1961–1970 (2020)

    Article  Google Scholar 

  18. Han, L., Sun, J., Zhang, W., Xiu, Y., Feng, H., Lin, Y.: A machine learning nowcasting method based on real-time reanalysis data. J. Geophys. Res. Atmos. 122(7), 4038–4051 (2017)

    Article  Google Scholar 

  19. Jean, N., Burke, M., Xie, M., Davis, W.M., Lobell, D.B., Ermon, S.: Combining satellite imagery and machine learning to predict poverty. Science 353(6301), 790–794 (2016)

    Article  Google Scholar 

  20. Ji, C.: Haze reduction from the visible bands of landsat tm and etm+ images over a shallow water reef environment. Remote Sens. Environ. 112(4), 1773–1783 (2008)

    Article  Google Scholar 

  21. Krishnaraj, N., Elhoseny, M., Thenmozhi, M., Selim, M.M., Shankar, K.: Deep learning model for real-time image compression in internet of underwater things (iout). J. Real-Time Image Process. 17(6), 2097–2111 (2020)

    Article  Google Scholar 

  22. Kuwata, K., Shibasaki, R.: Estimating crop yields with deep learning and remotely sensed data. In: 2015 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), pp. 858–861. IEEE (2015)

  23. Marzano, F.S., Rivolta, G., Coppola, E., Tomassetti, B., Verdecchia, M.: Rainfall nowcasting from multisatellite passive-sensor images using a recurrent neural network. IEEE Trans. Geosci. Remote Sens. 45(11), 3800–3812 (2007)

    Article  Google Scholar 

  24. Sedano, F., Kempeneers, P., Hurtt, G.: A Kalman filter-based method to generate continuous time series of medium-resolution ndvi images. Remote Sens. 6(12), 12381–12408 (2014)

    Article  Google Scholar 

  25. USGS-EarthExplorer.: Land Processes Distributed Active Archive Center (2019). https://lpdaac.usgs.gov/data_access/usgs_earthexplorer

  26. Wang, L., Ma, Y., Yan, J., Chang, V., Zomaya, A.Y.: pipscloud: high performance cloud computing for remote sensing big data management and processing. Future Gener. Comput. Syst. 78, 353–368 (2018)

    Article  Google Scholar 

  27. Yang, Y., Dong, J., Sun, X., Lima, E., Mu, Q., Wang, X.: A cfcc-lstm model for sea surface temperature prediction. IEEE Geosci. Remote Sens. Lett. 15(2), 207–211 (2017)

    Article  Google Scholar 

  28. Zhang, Q., Wang, H., Dong, J., Zhong, G., Sun, X.: Prediction of sea surface temperature using long short-term memory. IEEE Geosci. Remote Sens. Lett. 14(10), 1745–1749 (2017)

    Article  Google Scholar 

  29. Zhao, L., Chen, Y., Sheng, V.S.: A real-time typhoon eye detection method based on deep learning for meteorological information forensics. J. Real-Time Image Process. 17(1), 95–102 (2020)

    Article  Google Scholar 

Download references

Acknowledgement

This research is supported by the DST-INSPIRE Faculty Fellowship in the year 2019–2020, as received by the author, under the discipline of Engineering sciences.

Author information

Authors and Affiliations

  1. Machine Intelligence Unit (MIU), Centre for Artificial Intelligence and Machine Learning (CAIML), Indian Statistical Institute (ISI), Kolkata, 700108, India

    Monidipa Das

Authors
  1. Monidipa Das
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Monidipa Das.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 1278 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Das, M. Real-time prediction of spatial raster time series: a context-aware autonomous learning model. J Real-Time Image Proc 18, 1591–1605 (2021). https://doi.org/10.1007/s11554-021-01099-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-021-01099-7

Keywords