Abstract
Three-dimensional (3D) urban reconstruction becomes increasingly crucial in many application areas, such as entertainment, urban planning, digital mapping. To achieve photorealistic 3D urban reconstruction, the detailed reconstruction of building facades is the key. Light Detection and Ranging (LiDAR) point clouds and images are the two most important data types for 3D urban reconstruction, which are complementary regarding data characteristic. LiDAR scans are sparse and noisy but contain the precise depth data, whereas images can offer the color and high-resolution data but no depth information. In recent years, an increasing number of studies show that the fusion of LiDAR point clouds and images can attain better 3D reconstruction results than a single data type. In this paper, we aim to provide a systematic review of the research in the area of the 3D facade reconstruction based on the fusion of LiDAR and images. The reviewed studies are classified by the different usage of images in the reconstruction process. We hope that this research could help future researchers have a more clear understanding of how existing studies leverage the data in LiDAR scans and images and promote more innovations in this area.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Becker, S., Haala, N.: Refinement of building fassades by integrated processing of LIDAR and image data. Int. Arch. Photogrammetry Remote Sens. Spat. Inf. Sci. 36, 7–12 (2007)
Biljecki, F., Stoter, J., Ledoux, H., Zlatanova, S., Çöltekin, A.: Applications of 3D city models: state of the art review. ISPRS Int. J. Geo-Inf. 4(4), 2842–2889 (2015). https://doi.org/10.3390/ijgi4042842
Brenner, C.: Building reconstruction from images and laser scanning. Int. J. Appl. Earth Obs. Geoinf. 6(3), 187–198 (2005). https://doi.org/10.1016/j.jag.2004.10.006
Campbell, J.B., Wynne, R.H.: Introduction to Remote Sensing. Guilford Press, New York (2011)
Edum-Fotwe, K., Shepherd, P., Brown, M., Harper, D., Dinnis, R.: Fast, accurate and sparse, automatic facade reconstruction from unstructured ground laser-scans. In: ACM SIGGRAPH 2016 Posters, SIGGRAPH 2016, pp. 45:1–45:2. ACM, New York (2016). https://doi.org/10.1145/2945078.2945123
Fruh, C., Zakhor, A.: 3D model generation for cities using aerial photographs and ground level laser scans. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 2, p. II, December 2001. https://doi.org/10.1109/CVPR.2001.990921
Haala, N., Kada, M.: An update on automatic 3D building reconstruction. ISPRS J. Photogrammetry Remote Sens. 65(6), 570–580 (2010). https://doi.org/10.1016/j.isprsjprs.2010.09.006
Hohmann, B., Krispel, U., Havemann, S., Fellner, D.: Cityfit-high-quality urban reconstructions by fitting shape grammars to images and derived textured point clouds. In: Proceedings of the 3rd ISPRS International Workshop 3D-ARCH, vol. 2009, p. 3D (2009)
Li, Y., Zheng, Q., Sharf, A., Cohen-Or, D., Chen, B., Mitra, N.J.: 2D–3D fusion for layer decomposition of urban facades. In: 2011 International Conference on Computer Vision, pp. 882–889, November 2011. https://doi.org/10.1109/ICCV.2011.6126329
Liu, L., Stamos, I.: Automatic 3D to 2D registration for the photorealistic rendering of urban scenes. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 2, pp. 137–143, June 2005. https://doi.org/10.1109/CVPR.2005.80
Liu, L., Stamos, I.: A systematic approach for 2D-image to 3D-range registration in urban environments. In: 2007 IEEE 11th International Conference on Computer Vision, pp. 1–8, October 2007. https://doi.org/10.1109/ICCV.2007.4409215
Müller, P., Zeng, G., Wonka, P., Van Gool, L.: Image-based procedural modeling of facades. In: ACM SIGGRAPH 2007 Papers, SIGGRAPH 2007. ACM, New York (2007). https://doi.org/10.1145/1275808.1276484
Musialski, P., Wonka, P., Aliaga, D.G., Wimmer, M., Gool, L., Purgathofer, W.: A survey of urban reconstruction. Comput. Graph. Forum 32(6), 146–177 (2013). https://doi.org/10.1111/cgf.12077
Pu, S., Vosselman, G.: Building facade reconstruction by fusing terrestrial laser points and images. Sensors 9(6), 4525–4542 (2009). https://doi.org/10.3390/s90604525
Sadeghi, F., Arefi, H., Fallah, A., Hahn, M.: 3D building Façade reconstruction using handheld laser scanning data. Int. Arch. Photogrammetry Remote Sens. Spat. Inf. Sci. 40 (2015). https://doi.org/10.5194/isprsarchives-XL-1-W5-625-2015
Stamos, I., Allen, P.K.: 3-D model construction using range and image data. In: CVPR, p. 1531. IEEE (2000). https://doi.org/10.1109/CVPR.2000.855865
Stamos, I., Allen, P.K.: Automatic registration of 2-D with 3-D imagery in urban environments. In: Proceedings Eighth IEEE International Conference on Computer Vision, ICCV 2001, vol. 2, pp. 731–736, July 2001. https://doi.org/10.1109/ICCV.2001.937699
Wang, J., et al.: Automatic modeling of urban facades from raw lidar point data. Comput. Graph. Forum 35(7), 269–278 (2016). https://doi.org/10.1111/cgf.13024
Wang, R., Peethambaran, J., Chen, D.: Lidar point clouds to 3-D urban models: a review. IEEE J. Sel. Top. Appl. Earth Obs. Remote Sens. 11(2), 606–627 (2018). https://doi.org/10.1109/JSTARS.2017.2781132
Wang, R.: 3D building modeling using images and lidar: a review. Int. J. Image Data Fusion 4(4), 273–292 (2013). https://doi.org/10.1080/19479832.2013.811124
Wang, R., Bach, J., Ferrie, F.P.: Window detection from mobile LIDAR data. In: 2011 IEEE Workshop on Applications of Computer Vision (WACV), pp. 58–65. IEEE (2011)
Xiao, J., Fang, T., Tan, P., Zhao, P., Ofek, E., Quan, L.: Image-based Façade modeling. ACM Trans. Graph. 27(5), 161:1–161:10 (2008). https://doi.org/10.1145/1457515.1409114
Xiao, J., Fang, T., Zhao, P., Lhuillier, M., Quan, L.: Image-based street-side city modeling. ACM Trans. Graph. 28(5), 114:1–114:12 (2009). https://doi.org/10.1145/1661412.1618460
Yang, L., Sheng, Y., Wang, B.: 3D reconstruction of building facade with fused data of terrestrial LIDAR data and optical image. Optik - Int. J. Light Electron Opt. 127(4), 2165–2168 (2016). https://doi.org/10.1016/j.ijleo.2015.11.147
Zhang, J., Lin, X.: Advances in fusion of optical imagery and LiDAR point cloud applied to photogrammetry and remote sensing. Int. J. Image Data Fusion 8(1), 1–31 (2017). https://doi.org/10.1080/19479832.2016.1160960
Zhao, H., Shibasaki, R.: Reconstructing a textured cad model of an urban environment using vehicle-borne laser range scanners and line cameras. Mach. Vis. Appl. 14(1), 35–41 (2003). https://doi.org/10.1007/s00138-002-0099-5
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Xu, H., Chen, CY. (2019). 3D Facade Reconstruction Using the Fusion of Images and LiDAR: A Review. In: Chang, CY., Lin, CC., Lin, HH. (eds) New Trends in Computer Technologies and Applications. ICS 2018. Communications in Computer and Information Science, vol 1013. Springer, Singapore. https://doi.org/10.1007/978-981-13-9190-3_18
Download citation
DOI: https://doi.org/10.1007/978-981-13-9190-3_18
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-13-9189-7
Online ISBN: 978-981-13-9190-3
eBook Packages: Computer ScienceComputer Science (R0)