Detecting Three-Dimensional Straight Edges in Point Clouds Based on Normal Vectors †
<p>The basic steps of the methodology presented in this paper (more details in <a href="#sec3-heritage-08-00091" class="html-sec">Section 3</a>).</p> "> Figure 2
<p>Workflow of the proposed algorithm<a href="#fn001-heritage-08-00091" class="html-fn">1</a>.</p> "> Figure 3
<p>Illustration of the process used to ensure that the normal vectors n<sub>1</sub> and n<sub>2</sub> which belong to adjacent triangles are consistently oriented to point inwards or outwards relative to the mesh.</p> "> Figure 4
<p>Transformation of graph G to line graph L(G). The (blue) edges in the original graph G are converted into vertices (blue points) in the line graph L(G).</p> "> Figure 5
<p>Dense point cloud representing the temple of Demeter in Sangri, Naxos, Greece [<a href="#B37-heritage-08-00091" class="html-bibr">37</a>].</p> "> Figure 6
<p>Triangular mesh created from the dense point cloud of Demeter’s temple. (<b>a</b>) Area where gaps are formed in the mesh. (<b>b</b>) Area with a solid surface without gaps. (<b>c</b>) Area with gaps and other errors that create texture in the mesh.</p> "> Figure 7
<p>The density (<b>a</b>) and distribution (<b>b</b>) of the real data sparse point cloud.</p> "> Figure 8
<p>The density (<b>a</b>) and distribution (<b>b</b>) of the real data dense point cloud.</p> "> Figure 9
<p>Visualization of the finite edges on the triangular mesh surface of the Temple of Demeter’s facade. (<b>a</b>,<b>b</b>) Regions where the detected finite edges are densely concentrated in specific sections of the mesh. (<b>c</b>) Region exhibiting a high density of finite edges, primarily due to surface anomalies.</p> "> Figure 10
<p>Visualization of line segments in the dense point cloud of the Temple of Demeter’s facade. (<b>a</b>,<b>b</b>) Regions where the line segments are densely concentrated in sections of the mesh. (<b>c</b>) Region exhibiting many line segments, primarily due to surface anomalies.</p> "> Figure 11
<p>Visualization of the final 3D edges of Demeter’s temple. (<b>a</b>,<b>b</b>) Regions where the detected edges accurately represent the temple’s geometry, (<b>c</b>) Region with some wrong detected edges. The numbers indicate different sections on the temple: (1) horizontal geison, (2) architrave, (3a) upper section of the pillar, (3b) lower section of the pillar, (4) stylobate and (5) foundation.</p> "> Figure 12
<p>The final 3D edge is detected in segments before processing the triangular mesh.</p> "> Figure 13
<p>The final 3D edge is detected along its entire length after processing the triangular mesh.</p> ">
Abstract
:1. Introduction
2. Related Work
3. Methodology
3.1. Construction of the Triangle Mesh Surface
3.2. Computation of the Normal Vectors and Angle Estimation
3.3. Graph Generation
3.4. Concatenation of Finite Edges
3.5. RANSAC Variation
- The original RANSAC is designed to randomly select point samples from the data and find the model, i.e., usually a line or plane, that best fits the inliers. In contrast, the proposed variation of RANSAC connects almost parallel line segments that are close to each other.
- The original RANSAC checks whether a point is an inlier based on a threshold related to the distance from the model. However, in the proposed variation, the line segments must form an angle smaller than rad with each other to be considered inliers. Additionally, their endpoints must be within a distance smaller than a predefined value. This distance is typically set to 5 times the average point density of the given point cloud but may be changed by the user if needed. The chosen distance provides a large enough area to search for neighboring line segments without introducing delays in the algorithm’s execution time.
- The original RANSAC does not use any special structure for searching for inliers, while in the proposed variation of RANSAC a k-D tree structure is employed to find the nearest neighbors. This approach narrows the search, restricting it to a smaller area so that the algorithm remains efficient even with datasets consisting of a large number of points. Some examples of the algorithm’s running times are available in Table 2. All experiments in this research were conducted on a PC equipped with an Intel i7 processor, 8GB of DDR4 RAM, and an NVIDIA GTX 1050 GPU.
- The original RANSAC does not perform any searches for model extension based on neighboring points. However, in the proposed variation, an extension strategy is used by connecting neighboring line segments, which were found using the k-D tree structure. This extension is performed using depth-first search (DFS) algorithm, which joins the neighboring line segments that satisfy the distance and slope conditions of the model, thus forming the final edges.
4. Experimental Results
4.1. Synthetic Data
4.1.1. Noise-Free Synthetic Data
4.1.2. Noisy Synthetic Data
4.2. Real-World Data
5. Discussion and Future Work
6. Conclusions
Author Contributions
Funding
Data Availability Statement
Conflicts of Interest
1 | The process should be executed in a sequential and linear manner, with each step carefully followed to ensure the desired results are achieved. |
2 | The percentage of correctly detected edges is determined by comparing the automatically detected edges with the ground truth edges of the synthetic data. |
References
- Abdellali, H.; Frohlich, R.; Vilagos, V.; Kato, Z. L2D2: Learnable line detector and descriptor. In Proceedings of the 2021 International Conference on 3D Vision (3DV), London, UK, 1–3 December 2021. [Google Scholar]
- Zhang, H.; Luo, Y.; Qin, F.; He, Y.; Liu, X. Elsd: Efficient line segment detector and descriptor. In Proceedings of the International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 10–17 October 2021. [Google Scholar]
- Bode, L.; Weinmann, M.; Klein, R. BoundED: Neural boundary and edge detection in 3D point clouds via local neighborhood statistics. ISPRS J. Photogramm. Remote Sens. 2023, 205, 334–351. [Google Scholar] [CrossRef]
- Ye, Y.; Yi, R.; Gao, Z.; Cai, Z.; Xu, K. Delving Into Crispness: Guided Label Refinement for Crisp Edge Detection. IEEE Trans. Image Process. A Publ. IEEE Signal Process. Soc. 2023, 32, 4199–4211. [Google Scholar] [CrossRef] [PubMed]
- Ahmed, M.; Tan, Y.Z.h.i.; Chew, C.; Al-Mamun, A.; Wong, F. Edge and Corner Detection for Unorganized 3D Point Clouds with Application to Robotic Welding. In Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain, 1–5 October 2018; pp. 7350–7355. [Google Scholar] [CrossRef]
- Pateraki, M.; Baltsavias, E. Surface discontinuity modelling by LSM through patch adaptation and Use of edges. In Proceedings of the ISPRS Congress, IAPRS, Istanbul, Turkey, 12–23 July 2004; Volume 35, Part B3. pp. 522–527. [Google Scholar]
- Cosgrove, C.; Yuille, A.L. Adversarial Examples for Edge Detection: They Exist, and They Transfer. In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), Snowmass, CO, USA, 1–5 March 2020; pp. 1059–1068. [Google Scholar] [CrossRef]
- Krizhevsky, A.; Sutskever, I.; Hinton, G.E. Imagenet classification with deep convolutional neural networks. In Proceedings of the 26th Intl. Conf. on Neural Information Processing Systems (NIPS’12), Curran Associates Inc., Lake Tahoe, NV, USA, 3-6 December 2012; pp. 1097–1105. [Google Scholar]
- Agrafiotis, P.; Talaveros, G.; Georgopoulos, A. Orthoimage-to-2D Architectural Drawing with Conditional Adversarial Networks. In ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences; Copernicus Publications: Göttingen, Germany, 2023; pp. 11–18. [Google Scholar] [CrossRef]
- Betsas, T.; Georgopoulos, A.; Doulamis, A. INCAD: 2D Vector Drawings Creation using Instance Segmentation. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2024, 48, 65–72. [Google Scholar] [CrossRef]
- Sobel, I.; Feldman, G. A 3x3 isotropic gradient operator for image processing. A Talk Stanf. Artif. Proj. 1968, 1968, 271–272. [Google Scholar]
- Prewitt, J.; Mendelsohn, M.L.; Melville, J.R. The Prewitt operator for detecting edges. IEEE Trans. Comput. 1970, C-19, 313–319. [Google Scholar]
- Canny, J.F. Finding Edges and Lines in Images; Technical Report; Massachusetts Inst of Tech Cambridge Artificial Intelligence Lab: Cambridge MA, USA, 1983. [Google Scholar]
- Canny, J.F. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 1986, PAMI-8, 679–698. [Google Scholar] [CrossRef]
- Grompone Von Gioi, R.; Jakubowicz, J.; Morel, J.M.; Randall, G. LSD: A fast line segment detector with a false detection control. IEEE Trans. Pattern Anal. Mach. Intell. (PAMI) 2008, 32, 722–732. [Google Scholar] [CrossRef]
- Akinlar, C.; Topal, C. EDLines: A real-time line segment detector with a false detection control. Pattern Recognit. Lett. 2011, 32, 1633–1642. [Google Scholar] [CrossRef]
- Suarez, F.; Smith, J.; Zhang, L. ELSED Algorithm: An Enhanced Edge Detection Technique for Image Processing. J. Image Process. Comput. Vis. 2022, 15, 123–134. [Google Scholar]
- Xie, Y.; Tian, J.; Zhu, X.X. Linking points with labels in 3D: A review of point cloud semantic segmentation. IEEE Geosci. Remote Sens. Mag. 2020, 8, 38–59. [Google Scholar] [CrossRef]
- Poma, X.S.; Riba, E.; Sappa, A. Dense extreme inception network: Towards a robust CNN model for edge detection. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Snowmass Village, CO, USA, 1–5 March 2020; pp. 1923–1932. [Google Scholar]
- Su, Z.; Liu, W.; Yu, Z.; Hu, D.; Liao, Q.; Tian, Q.; Pietikainen, M.; Liu, L. Pixel difference networks for efficient edge detection. In Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada, 11–17 October 2021; pp. 5117–5127. [Google Scholar]
- Dhankhar, P.; Sahu, N. A Review and Research of Edge Detection Techniques for Image Segmentation. Int. J. Comput. Sci. Mob. Comput. 2013, 2, 86–92. [Google Scholar]
- Lu, X.; Liu, Y.; Li, K. Fast 3D Line Segment Detection from Unorganized Point Cloud. arXiv 2019, arXiv:abs/1901.02532. [Google Scholar]
- Rodríguez Miranda, Á.; Valle Melón, J.M.; Martínez Montiel, J.M. 3D Line Drawing from Point Clouds using Chromatic Stereo and Shading. Digital Heritage. In Proceedings of the 14th International Conference on Virtual Systems and Multimedia VSMM, Limassol, Cyprus, 20–25 October 2008; pp. 77–84, ISBN 978-963-8046-99-4. [Google Scholar]
- Canciani, M.; Falcolini, C.; Saccone, M.; Spadafora, G. From Point Clouds to Architectural Models: Algorithms for Shape Reconstruction. In Proceedings of the International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, Volume XL-5/W1, 20133D-ARCH 2013—3D Virtual Reconstruction and Visualization of Complex Architectures, Trento, Italy, 25–26 February 2013. [Google Scholar]
- Briese, C.; Pfeifer, N. Towards automatic feature line modelling from terrestrial laser scanner data. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2008, 37, 463–468. [Google Scholar]
- Nguatem, W.; Drauschke, M.; Mayer, H. Localization of Windows and Doors in 3d Point Clouds of Facades. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2014, 2, 87–94. [Google Scholar] [CrossRef]
- Mitropoulou, A.; Georgopoulos, A. An Automated Process to Detect Edges in Unorganized Point Clouds. ISPRS Ann. Photogramm. Remote Sens. Spat. Inf. Sci. 2019, 4, 99–105. [Google Scholar] [CrossRef]
- Liakopoulou, A.M. Development of a Plane Intersection Algorithm for 3D Edge Determination. Diploma Thesis, Lab of Photogrammetry, NTUA (in Greek). 2022. Available online: https://dspace.lib.ntua.gr/xmlui/handle/123456789/56782 (accessed on 5 May 2024).
- Bazazian, D.; Casas, J.R.; Ruiz-Hidalgo, J. Fast and Robust Edge Extraction in Unorganized Point Clouds. In Proceedings of the International Conference on Digital Image Computing: Techniques and Applications (DICTA), Adelaide, SA, Australia, 23–25 November 2015; pp. 1–8. [Google Scholar] [CrossRef]
- Dolapsaki, M.M.; Georgopoulos, A. Edge Detection in 3D Point Clouds Using Digital Images. ISPRS Int. J. Geo-Inf. 2021, 10, 229. [Google Scholar] [CrossRef]
- Bao, T.; Zhao, J.; Xu, M. Step edge detection method for 3D point clouds based on 2D range images. Optik 2015, 126, 2706–2710. [Google Scholar] [CrossRef]
- Betsas, T.; Georgopoulos, A. 3D Edge Detection and Comparison using Four-Channel ImagesS. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2022, 48, 9–15. [Google Scholar] [CrossRef]
- Makka, A.; Pateraki, M.; Betsas, T.; Georgopoulos, A. 3D edge detection based on normal vectors. Int. Arch. Photogramm. Remote Sens. Spat. Inf. Sci. 2024, 48, 295–300. [Google Scholar] [CrossRef]
- Aggarwal, A.; Stolkin, R.; Marturi, N. Unsupervised learning-based approach for detecting 3D edges in depth maps. Sci. Rep. 2024, 14, 796. [Google Scholar] [CrossRef] [PubMed]
- Xin, X.; Huang, W.; Zhong, S.; Zhang, M.; Liu, Z.; Xie, Z. Accurate and complete line segment extraction for large-scale point clouds. Int. J. Appl. Earth Obs. Geoinf. 2024, 128, 103728. [Google Scholar] [CrossRef]
- Bernardini, F.; Mittleman, J.; Rushmeier, H.; Silva, C.; Taubin, G. The ball-pivoting algorithm for surface reconstruction. IEEE Trans. Vis. Comput. Graph. 1999, 5, 349–359. [Google Scholar] [CrossRef]
- Betsas, T. Automated Detection of Edges in Point Clouds Using Semantic Information. Diploma Thesis, Laboratory of Photogrammetry, NTUA. Available online: https://dspace.lib.ntua.gr/xmlui/handle/123456789/53090 (accessed on 8 February 2024).
- Balta, H.; Velagic, J.; Bosschaerts, W.; De Cubber, G.; Siciliano, B. Fast Statistical Outlier Removal Based Method for Large 3D Point Clouds of Outdoor Environments. IFAC-Pap. 2018, 51, 348–353. [Google Scholar] [CrossRef]
- Wang, L.; Chen, Y.; Song, W.; Xu, H. Point Cloud Denoising and Feature Preservation: An Adaptive Kernel Approach Based on Local Density and Global Statistics. Sensors 2024, 24, 1718. [Google Scholar] [CrossRef]
2D-3D Vectorization (Requiring Straight Edge Detection) | ||
---|---|---|
2D Line—Edge Detection | 3D Line—Edge Detection | 2D Automated Vectorization |
Pixel-based processing: [11,12,13,14,15,16,17,21] | Manual detection: [23,24,25] | Machine Learning/deep learning: [9,10] |
Machine learning/deep learning: [18,19,20] | Semi-automated detection: |
Use of K-D Tree | Number of Points | Execution Time |
---|---|---|
NO | 32,000 | >3 h (180 min) |
YES | 32,000 | 2 min |
YES | 385,000 | 24 min |
Number of Points | Triangular Mesh | Edges Detected |
---|---|---|
8 | ||
5 | ||
20 |
Number of Points | Triangular Mesh | Edges Detected | Percentage of Correctly Detected Edges2 |
30 | 42% | ||
100 | 58% | ||
500 | 83% | ||
50,000 | 92% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Makka, A.; Pateraki, M.; Betsas, T.; Georgopoulos, A. Detecting Three-Dimensional Straight Edges in Point Clouds Based on Normal Vectors. Heritage 2025, 8, 91. https://doi.org/10.3390/heritage8030091
Makka A, Pateraki M, Betsas T, Georgopoulos A. Detecting Three-Dimensional Straight Edges in Point Clouds Based on Normal Vectors. Heritage. 2025; 8(3):91. https://doi.org/10.3390/heritage8030091
Chicago/Turabian StyleMakka, Antonia, Maria Pateraki, Thodoris Betsas, and Andreas Georgopoulos. 2025. "Detecting Three-Dimensional Straight Edges in Point Clouds Based on Normal Vectors" Heritage 8, no. 3: 91. https://doi.org/10.3390/heritage8030091
APA StyleMakka, A., Pateraki, M., Betsas, T., & Georgopoulos, A. (2025). Detecting Three-Dimensional Straight Edges in Point Clouds Based on Normal Vectors. Heritage, 8(3), 91. https://doi.org/10.3390/heritage8030091