Abstract
There are substantial problems in the photogrammetric image matching especially in the images taken by UAVs in the regions where grassland, waterfront, forest, buildings, bridges, high-voltage lines etc. in the urban and rural areas. The main reason of these problems are color, tone, texture, contrast and scale changes cannot be successfully detected in between sequential images. To solve these problems, radial basis functions can be used. The thin plate spline (TPS) that has a natural representation in terms of radial basis functions is used as a non-rigid transformation model in image matching. In other words, TPS is strong interpolation method for coordinate transformations modeling. In this study, the Istanbul Technical University Campus was selected as the study area and the study focused on using the integration of SURF and TPS, called as automatic TPS (A-TPS), for photogrammetric matching of UAV images obtained for the campus. Three different test areas that have different surface characteristics were selected and the implementation of A-TPS realized using control points on these test areas. The A-TPS algorithm was compared with SURF and VisualSFM software that uses the SIFTGPU method. Also, the images were rotated 45 degrees and the same operations were repeated. RANSAC algorithm was applied to determine the inliers from the point matches obtained from all methods. The A-TPS algorithm performs better than the other two methods, especially for images with the homogenous texture of forestry areas.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Ai M, Hu Q, Li J, Wang M, Yuan H, Wang S (2015) A robust photogrammetric processing method of low-altitude UAV images. Remote Sens 7:2302–2333. https://doi.org/10.3390/rs70302302
Akcay O, Erenoglu RC, Avsar EO (2017) The effect of JPEG compression in close range photogrammetry. International Journal of Engineering and Geosciences 2(1):35–40
Barrodale I, Kuwahara R, Poeckert R, Skea D (1993) Side-scan sonar image processing using thin plate splines and control point matching. Numerical Algorithms 5:85–98. https://doi.org/10.1007/BF02212041
Bay H, Tuytelaars T, Van Gool L (2006) SURF: speeded up robust features computer vision – ECCV 2006. In: Computer Vision – ECCV 2006. https://doi.org/10.1007/11744023_32
Buhmann MD (2003) Radial basis functions: theory and implementations. Radial Basis Functions, 12. https://doi.org/10.1017/CBO9780511543241
Calonder M, Lepetit V, Strecha C, Fua P (2010) BRIEF: binary robust independent elementary features. In: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-642-15561-1_56
Du Q, Raksuntorn N, Orduyilmaz A, Bruce LM (2008) Automatic registration and mosaicking for airborne multispectral image sequences. Photogrammetric Engineering and Remote Sensing. https://doi.org/10.14358/PERS.74.2.169
Duran Z, Aydar U (2012) Digital modeling of world's first known length reference unit: the Nippur cubit rod. J Cult Herit 13(3):352–356
Eisenbeiss H (2009) UAV photogrammetry. ETH Zürich. https://doi.org/10.3929/ethz-a-005939264
Fogel DN, Tinney LR (1996) Image registration using multiquadric functions, the finite element method, bivariate mapping polynomials and thin plate spline (96–1)
Gan H, Lee WS, Alchanatis V (2018) A photogrammetry-based image registration method for multi-camera systems – with applications in images of a tree crop. Biosyst Eng 174:89–106. https://doi.org/10.1016/j.biosystemseng.2018.06.013
Guo H, Hou Y, Zhao Y (2016) An image matching algorithm using thin plate splines (Tps) transformation model. International Journal of Simulation -- Systems, Science & Technology 17:13.1–13.5. https://doi.org/10.5013/IJSSST.a.17.08.13
Hassaballah M, Abdelmgeid AA, Alshazly HA (2016) Image features detection, description and matching. Studies in computational intelligence. https://doi.org/10.1007/978-3-319-28854-3_2
Hou W, Wu Z, Ding M (2010) Densely stereo image matching using SURF and TPS 38:91–94
Incekara AH, Delen A, Seker DZ, Goksel C (2019) Investigating the utility potential of low-cost unmanned aerial vehicles in the temporal monitoring of a landfill. ISPRS Int J Geo Inf 8(1):22
Jiang S, Jiang W (2018) Hierarchical motion consistency constraint for efficient geometrical verification in UAV stereo image matching. ISPRS J Photogramm Remote Sens 142:222–242. https://doi.org/10.1016/j.isprsjprs.2018.06.009
Kivilcim CO, Duran Z (2016) A semi-automated point cloud processing methodology for 3D cultural heritage documentation. International archives of the photogrammetry, remote sensing and spatial information sciences 5
Krishna S, Varghese A (2015) Feature based automatic multiview image registration. Int J Comput Sci Softw Eng 4:308–314
Leutenegger S, Chli M, Siegwart RY (2011) BRISK: binary robust invariant scalable keypoints. In: Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2011.6126542
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
Moreels P, Perona P (2007) Evaluation of features detectors and descriptors based on 3D objects. Int J Comput Vis 73:263–284. https://doi.org/10.1007/s11263-006-9967-1
Ren X, Sun M, Zhang X, Liu L (2017) A simplified method for UAV multispectral images mosaicking. Remote Sens 9. https://doi.org/10.3390/rs9090962
Rosten E, Drummond T (2005) Fusing points and lines for high performance tracking. In: Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2005.104
Rublee E, Rabaud V, Konolige K, Bradski G (2011) ORB: an efficient alternative to SIFT or SURF. In Proceedings of the IEEE International Conference on Computer Vision. https://doi.org/10.1109/ICCV.2011.6126544
Sasi A, Yakar M (2018) Photogrammetric modelling of Hasbey Dar'Ülhuffaz (masjid) using an unmanned aerial vehicle. International Journal of Engineering and Geosciences 3(1):6–11
Sun Y, Zhao L, Huang S, Yan L, Dissanayake G (2014) L2-SIFT: SIFT feature extraction and matching for large images in large-scale aerial photogrammetry. ISPRS J Photogramm Remote Sens 91:1–16. https://doi.org/10.1016/j.isprsjprs.2014.02.001
Tsai CH, Lin YC (2017) An accelerated image matching technique for UAV orthoimage registration. ISPRS J Photogramm Remote Sens 128:130–145. https://doi.org/10.1016/j.isprsjprs.2017.03.017
Yemenicioglu C, Kaya S, Seker DZ (2016) Accuracy of 3D (three-dimensional) terrain models in simulations. International Journal of Engineering and Geosciences 1(1):30–33
Acknowledgments
The study was supported by Istanbul Technical University Scientific Research Office (BAP) with the project number of MGA-2017-40789.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Additional information
Communicated by: H. Babaie
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Atik, M.E., Ozturk, O., Duran, Z. et al. An automatic image matching algorithm based on thin plate splines. Earth Sci Inform 13, 869–882 (2020). https://doi.org/10.1007/s12145-020-00476-3
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12145-020-00476-3