Overview of Image Datasets for Deep Learning Applications in Diagnostics of Power Infrastructure
<p>Overview of processes related to power line maintenance that are supported by algorithms trained on dedicated datasets.</p> "> Figure 2
<p>The related research metrics investigation. Figures were prepared using data from the <span class="html-italic">dimensions.ai</span> web service of Digital Science & Research Solutions, Inc., London, United Kingdom (accessed on 3 January 2023).</p> "> Figure 3
<p>The summary statistics for the reviewed data collections. The objects of the specific classes have been aggregated into more general categories.</p> "> Figure 4
<p>Collection of images of an insulator taken outdoors in varying lighting conditions with additional laser spots—research scenes.</p> "> Figure 5
<p>The setup that was used to develop the commented dataset, which was aimed at the acquisition of high-resolution images in varying lighting conditions with additional laser spots—samples with illuminance variation on the insulator surface are presented in this figure.</p> "> Figure 6
<p>Example of the power line insulator detection attempt that was based on the analysis of local features.</p> ">
Abstract
:1. Introduction
- Comprehensiveness assessment: To evaluate the comprehensiveness of existing datasets available in the field of power line maintenance. This objective aims to identify any gaps or limitations in the current datasets and highlight areas where additional data collection may be needed.
- Data comparison: To compare multiple datasets from different sources or studies, aiming to identify similarities, differences, and potential inconsistencies. This objective can help researchers to understand the strengths and weaknesses of different datasets and choose the most appropriate one for their analysis.
- Data accessibility and open data evaluation: To assess the availability and accessibility of datasets for the research community. This objective is relevant for promoting open data practices and making datasets easily accessible to other researchers.
- High-quality evaluation: To assess the quality and reliability of datasets by examining their data sources, collection methods, and data processing techniques. This objective helps ensure that the datasets used in research are of high quality and suitable for analysis.
- Data fusion and integration: Researching methods to combine data from multiple sensors and sources to create more informative datasets. Integrating data from different types of sensors, such as visual cameras, thermal imaging, and acoustic sensors, can provide a more comprehensive understanding of power line conditions,
- Real-time analysis and decision making: Advancing real-time data analytics to enable proactive decision making and predictive maintenance for power line assets. This includes developing algorithms that can quickly process large amounts of data to identify potential problems and optimize grid performance,
- Automated data collection: Developing advanced techniques for automated data collection from power line assets using drones, satellites, LiDAR, or other remote sensing technologies. Automation can reduce human intervention, improve data coverage, and enable more frequent data updates.
2. Power Line Elements Datasets Review
2.1. The Review of Datasets Consisting of Images of Various Power Line Equipment
Research Name | Research Results |
---|---|
Power Infrastructure Monitoring and Damage Detection Using Drone-Captured Images [46] | F-score of 75% for multi-class classification and 88% for pylon identification. |
Detection and Monitoring of Power Line Corridor From Satellite Imagery Using RetinaNet and K-Mean Clustering [27] | mAP of 72.45% for an IoU threshold of 0.5 and 85.21% for IoU threshold of 0.3; discrimination of high- and low-density vegetation regions within the power line corridor area. |
A Monocular Vision-Based Perception Approach for Unmanned Aerial Vehicle Close Proximity Transmission Tower Inspection [41] | Reported results: SSD300 network has the fastest runtime with 6 FPS, and YOLOv2 has a speed of 5.6 FPS, but their APs were relatively low—87.5 for SSD300 and 86.8 for YOLOv2. The highest AP (89.8) was obtained by Faster R-CNN (VGG16) and Tower R-CNN with 0.8 and 5 FPS, respectively. |
Wire Detection using Synthetic Data and Dilated Convolutional Networks for Unmanned Aerial Vehicles [12] | Evaluation of a few deep neural networks (FCNs, SegNet, and E-Net) on a publicly available USF dataset. Obtained results: AP = 0.729, F-Score = 0.688 for wire detection using dilated convnets to facilitate autonomous UAVs. |
Time Series Analysis of Separation for Vegetation Management Around Power Lines Using UAV Photogrammetry [43] | Separation distance between the power line and the vegetation at any position. |
Detecting Power Lines in UAV Images with Convolutional Features and Structured Constraints [26] | Evaluation using two datasets (PLDU and PLDM) for power line detection using UAVs. Obtained F1-scores: ODS (optimal dataset scale threshold) = 0.914 (PLDU dataset) and 0.888 (PLDM dataset). |
TTPLA: An Aerial-Image Dataset for Detection and Segmentation of Transmission Towers and Power Lines [22] | The best average scores for the bounding box and mask are 22.96% and 15.72%, respectively. |
Insulator Visual Non-Conformity Detection in Overhead Power Distribution Lines Using Deep Learning [16] | Accuracy of 92% for material classification, and 85% for defect detection; F1-score of 0.75. |
Power Distribution Insulators Classification Using Image Hybrid Deep Learning [47] | Overall accuracy of 95% for the identification of non-conforming component classes. |
Real-time Power Line Detection Network Using Visible Light and Infrared Images [38] | mIoU of 37.68% with processing speed 24 fps on UAV. |
Detection of Power Line Insulators on Digital Images with the use of Laser Spots [45] | The method enables positive classification of insulators based on profile fragments. It reports the prediction quality measures for insulator detection accuracy of 0.961 and precision of 0.989. |
Autonomous Aerial Delivery Vehicles, a Survey of Techniques on how Aerial Package Delivery is Achieved [48] | A comprehensive review of various power line domain applications. |
Object Detection-Based Inspection of Power Line Insulators: Incipient Fault Detection in the Low Data-Regime [49] | The best result was obtained for insulator detection (mAP up to 0.90), while the mAP was relatively lower for other objects (disks, dumpers, or nests). |
Automatic Power Line Inspection Using UAV Images [40] | RMSE for the point cloud of 0.233 m, and RMSE for the power line of 0.205 m. |
Deep Learning-Based Framework for Vegetation Hazard Monitoring Near Powerlines [44] | The performance of powerline detection using aerial images, with precision and recall values of 0.821 and 0.762 (both for [email protected]), and 0.798 and 0.563 ([email protected]:0.95). |
Deep Learning-Based Detection for Transmission Towers Using UAV Images [42] | mAP for transmission tower detection achieved using the Faster R-CNN model reached 90% using Inception V2 and 94% using ResNet50; and for the SSD model reached 84% and 92% with Inception V2 and ResNet50, respectively. |
High-Accuracy Insulator Defect Detection for Overhead Transmission Lines Based on Improved YOLOv5 [50] | Average accuracy of the algorithm of 97.4% for insulator detection. |
Robust Powerline Equipment Inspection System Based on a Convolutional Neural Network [36] | Real-time equipment detection with 93% recall and 92% precision, and defect analysis with up to 98% accuracy. |
ICARUS: Automatic Autonomous Power Infrastructure Inspection with UAVs [51] | Multiple sensors integration; autonomous detection, tracking, and identification of infrastructure components automation. |
The Implementation of a Convolutional Neural Network for the Detection of the Transmission Towers Using Satellite Imagery [39] | The final dataset consists of 4944 labeled satellite images; the highest performance obtained using the test set was an accuracy of 0.9676, a precision of 0.9522, and a recall of 0.9361. |
Evaluation of Power Insulator Detection Efficiency with the Use of Limited Training Dataset [2] | AP at the level of 0.8 for 60 training frames. The main contribution of the work is the evidence that a limited training set, in this case just 60 training frames, could be used for object detection, assuming an outdoor scenario with well-defined conditions. |
- auxiliary equipment of overhead power lines:
- –
- clamps for attaching wires and auxiliary lines;
- –
- accessories intended for connecting clamps with insulators;
- –
- accessories for suspending insulator chains on poles and connecting multi-row chains;
- –
- protective equipment fixed at both ends of the insulator chains, designed to spread the electric field strength;
- –
- power line spacers used to fix bundle wires and ensure a constant distance between them;
- –
- tuned mass dampers (Stockbridge dampers);
- –
- protective marking (aviation obstruction signs, bird flight diverters);
- –
- de-icing and anti-icing equipment;
- detection of objects colliding with high-voltage lines:
- –
- branches and trees (problem of transmission corridors);
- –
- stork nests on poles.
- Size: the collection should provide enough data to allow accurate power line diagnostics. The more data, the better the chance of detecting damage. However, for the mentioned set ([21]), its size is not at the top of the list, suggesting that following the size criteria alone could be ambiguous. Its size is relatively small compared to others, but it is currently the most numerous in terms of found and labeled damage.
- Diversity: The collection should include a variety of data, different power line conditions, and address realistic scenes. In this way, it should be possible to identify problems in a variety of conditions, which is crucial for effective power line monitoring. In the mentioned set we have emphasized different groups of insulators and their damage have been collected (including two classes of damage: broken insulator shell, and flashover damaged insulator shell).
- Data quality: The image material in the selected set should provide the highest possible resolution in its recording, which later will help the precise marking process. This is one of the most important aspects of a well-prepared collection, while incorrect or inaccurate annotations can be misleading.
- Generic nature: The method of registration partially disqualifies the usefulness of some sets for applications in diagnostic solutions based on air flights. In the promoted set, the acquisition was performed from the air, which refers to similar recordings during a scheduled diagnostic flight.
2.2. The Collection of Images of an Insulator Taken Outdoors in Varying Lighting Conditions with Additional Laser Spots
- methods of detection and location of insulators in images;
- preparation of classifiers of technical facilities;
- methods of laser spot detection on digital images made outside in variable lighting conditions;
- methods of assessing the condition of the insulator’s surface, or other deep learning algorithms, in particular, convolutional neural networks, generative adversarial networks, or deep belief networks.
3. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
AP | Average precision |
COCO | Common Objects in Context, a dataset for object detection |
CPLID | Chinese Power Line Insulator Dataset |
CNN | Convolutional neural network |
DNN | Deep neural network |
EXIF | Exchangeable image file format; image metadata standard |
fps | Frames per second; indicates frame rate |
GPS | Global positioning system |
IDID | Insulator Defect Image Dataset |
IoU | Intersection over union metric |
IR | Infrared |
LiDAR | Light detection and ranging |
mAP | Mean average precision |
mIoU | Averaged IoU metric |
MV | Medium voltage |
NIR | Near infrared |
nm | Nanometer; 1 nm = m |
OPDL | Overhead Power Distribution Lines Insulators dataset |
PLAD | Power Line Assets Detection Dataset |
PLDU | Power line dataset of urban scene |
PLDM | Power line dataset of mountain scene |
R-CNN | Region-based convolutional neural networks |
ResNet50 | 50-layer residual convolutional neural network |
RMSE | Root mean square error |
TTPLA | Transmission Towers and Power Lines dataset |
UAV | Unmanned aerial vehicle |
UV | Ultraviolet |
VOC | The PASCAL Visual Object Classes 2012 dataset |
VL | Visible light |
YOLOv5 | 5th version of you only look once object detection network |
References
- Ruszczak, B.; Boguszewska-Mańkowska, D. Deep potato—The Hyperspectral Imagery of Potato Cultivation with Reference Agronomic Measurements Dataset: Towards Potato Physiological Features Modeling. Data Brief 2022, 42, 108087. [Google Scholar] [CrossRef] [PubMed]
- Tomaszewski, M.; Michalski, P.; Osuchowski, J. Evaluation of Power Insulator Detection Efficiency with the Use of Limited Training Dataset. Appl. Sci. 2020, 10, 2104. [Google Scholar] [CrossRef] [Green Version]
- Li, H.; Yang, Z.; Han, J.; Lai, S.; Zhang, Q.; Zhang, C.; Fang, Q.; Hu, G. TL-Net: A Novel Network for Transmission Line Scenes Classification. Energies 2020, 13, 3910. [Google Scholar] [CrossRef]
- Liu, C.; Wu, Y.; Liu, J.; Han, J. MTI-YOLO: A Light-Weight and Real-Time Deep Neural Network for Insulator Detection in Complex Aerial Images. Energies 2021, 14, 1426. [Google Scholar] [CrossRef]
- Zhao, Z.; Zhen, Z.; Zhang, L.; Qi, Y.; Kong, Y.; Zhang, K. Insulator Detection Method in Inspection Image Based on Improved Faster R-CNN. Energies 2019, 12, 1204. [Google Scholar] [CrossRef] [Green Version]
- Luo, Y.; Yu, X.; Yang, D.; Zhou, B. A survey of intelligent transmission line inspection based on unmanned aerial vehicle. Artif. Intell. Rev. 2022, 56, 173–201. [Google Scholar] [CrossRef]
- Xu, B.; Zhao, Y.; Wang, T.; Chen, Q. Development of power transmission line detection technology based on unmanned aerial vehicle image vision. SN Appl. Sci. 2023, 5, 72. [Google Scholar] [CrossRef]
- Liu, J.; Liu, C.; Wu, Y.; Xu, H.; Sun, Z. An Improved Method Based on Deep Learning for Insulator Fault Detection in Diverse Aerial Images. Energies 2021, 14, 4365. [Google Scholar] [CrossRef]
- Han, J.; Yang, Z.; Xu, H.; Hu, G.; Zhang, C.; Li, H.; Lai, S.; Zeng, H. Search Like an Eagle: A Cascaded Model for Insulator Missing Faults Detection in Aerial Images. Energies 2020, 13, 713. [Google Scholar] [CrossRef] [Green Version]
- Liu, J.; Hu, M.; Dong, J.; Lu, X. Summary of insulator defect detection based on deep learning. Electr. Power Syst. Res. 2023, 224, 109688. [Google Scholar] [CrossRef]
- Wang, L.; Wan, H.; Huang, D.; Liu, J.; Tang, X.; Gan, L. Sustainable Analysis of Insulator Fault Detection Based on Fine-Grained Visual Optimization. Sustainability 2023, 15, 3456. [Google Scholar] [CrossRef]
- Madaan, R.; Maturana, D.; Scherer, S. Wire detection using synthetic data and dilated convolutional networks for unmanned aerial vehicles. In Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, 24–28 September 2017; pp. 3487–3494. [Google Scholar] [CrossRef]
- Diwakar, T.; Power Lines Detection. Detect the Images Containing the Power Lines from Set of Given Visible and Infrared Images. Available online: https://kaggle.com/competitions/recognizance-2 (accessed on 3 January 2023).
- Savva, A.; Makrigiorgis, R.; Kolios, P.; Kyrkou, C. Aerial Power Infrastructure Detection Dataset. 2022. Available online: https://zenodo.org/record/7148922 (accessed on 25 June 2023).
- Yetgin, Ö.E.; Gerek, Ö.N. Powerline Image Dataset (Infrared-IR and Visible Light-VL). 2017. Available online: https://data.mendeley.com/datasets/n6wrv4ry6v/8 (accessed on 25 June 2023).
- Prates, R.M.; Cruz, R.; Marotta, A.P.; Ramos, R.P.; Simas Filho, E.F.; Cardoso, J.S. Insulator visual non-conformity detection in overhead power distribution lines using deep learning. Comput. Electr. Eng. 2019, 78, 343–355. [Google Scholar] [CrossRef]
- Combine Pole Dataset. Available online: https://universe.roboflow.com/dy-cfoxw/combine_pole (accessed on 15 December 2022).
- Tomaszewski, M.; Ruszczak, B.; Michalski, P. The collection of images of an insulator taken outdoors in varying lighting conditions with additional laser spots. Data Brief 2018, 18, 765–768. [Google Scholar] [CrossRef]
- Power Towers Dataset. Available online: https://universe.roboflow.com/main-enht2/power-towers (accessed on 15 December 2022).
- Reyes, A. Electrical Substation Dataset. Available online: https://universe.roboflow.com/andres-reyes-xv9l4/electrical_substation (accessed on 15 December 2022).
- Kulkarni, D.L.P. Insulator Defect Detection. 2021. Available online: https://ieee-dataport.org/competitions/insulator-defect-detection (accessed on 15 December 2022).
- Abdelfattah, R.; Wang, X.; Wang, S. TTPLA: An Aerial-Image Dataset for Detection and Segmentation of Transmission Towers and Power Lines. arXiv 2020, arXiv:2010.10032. [Google Scholar] [CrossRef]
- MNV0L TT Dataset. Available online: https://universe.roboflow.com/wx-rycls/tt-mnv0l (accessed on 15 December 2022).
- Tao, X.; Zhang, D.; Wang, Z.; Liu, X.; Zhang, H.; Xu, D. Detection of Power Line Insulator Defects Using Aerial Images Analyzed With Convolutional Neural Networks. IEEE Trans. Syst. Man Cybern. Syst. 2018, 50, 1486–1498. [Google Scholar] [CrossRef]
- Yetgin, Ö.E.; Gerek, Ö.N. Ground Truth of Powerline Dataset (Infrared-IR and Visible Light-VL). 2019. Available online: https://data.mendeley.com/datasets/twxp8xccsw/9 (accessed on 25 June 2023).
- Zhang, H.; Yang, W.; Yu, H.; Zhang, H.; Xia, G.S. Detecting Power Lines in UAV Images with Convolutional Features and Structured Constraints. Remote Sens. 2019, 11, 1342. [Google Scholar] [CrossRef] [Green Version]
- Haroun, F.M.E.; Deros, S.N.M.; Din, N.M. Detection and Monitoring of Power Line Corridor From Satellite Imagery Using RetinaNet and K-Mean Clustering. IEEE Access 2021, 9, 116720–116730. [Google Scholar] [CrossRef]
- Insulator Final Dataset. Available online: https://universe.roboflow.com/khosro/p_insulator_final (accessed on 15 December 2022).
- SEAI-C4 Dataset. Available online: https://universe.roboflow.com/insulators/seai-c4 (accessed on 15 December 2022).
- CEPS Dataset. Available online: https://universe.roboflow.com/ceps/ceps (accessed on 15 December 2022).
- Ježek, R. Dataset 1: Power Lines UAV Images. Available online: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/ZFJCET (accessed on 15 December 2022).
- Vieira-e-Silva, A.L.B.; de Castro Felix, H.; de Menezes Chaves, T.; Simões, F.P.M.; Teichrieb, V.; dos Santos, M.M.; da Cunha Santiago, H.; Sgotti, V.A.C.; Neto, H.B.D.T.L. STN PLAD: A Dataset for Multi-Size Power Line Assets Detection in High-Resolution UAV Images. In Proceedings of the 2021 34th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Gramado, Rio Grande do Sul, Brazil, 18–22 October 2021; pp. 215–222. [Google Scholar] [CrossRef]
- Broken Glass Insulator Dataset. Available online: https://universe.roboflow.com/deep-learning-wpmkc/broken-glass-insulator (accessed on 15 December 2022).
- Electrical Line Dataset. Available online: https://universe.roboflow.com/neec/electrical-line (accessed on 15 December 2022).
- Dataset Insulators Neering Dataset. Available online: https://universe.roboflow.com/pierouc-gmail-com/dataset-insulators-neering (accessed on 15 December 2022).
- Siddiqui, Z.A.; Park, U.; Lee, S.W.; Jung, N.J.; Choi, M.; Lim, C.; Seo, J.H. Robust Powerline Equipment Inspection System Based on a Convolutional Neural Network. Sensors 2018, 18, 3837. [Google Scholar] [CrossRef] [Green Version]
- Zhao, L.; Song, W.Z. Distributed Power-Line Outage Detection Based on Wide Area Measurement System. Sensors 2014, 14, 13114–13133. [Google Scholar] [CrossRef] [Green Version]
- Choi, H.; Koo, G.; Kim, B.J.; Woo Kim, S. Real-time Power Line Detection Network using Visible Light and Infrared Images. In Proceedings of the 2019 International Conference on Image and Vision Computing New Zealand (IVCNZ), Dunedin, New Zealand, 2–4 December 2019; pp. 1–6. [Google Scholar] [CrossRef]
- Michalski, P.; Ruszczak, B.; Lorente, P.J.N. The Implementation of a Convolutional Neural Network for the Detection of the Transmission Towers Using Satellite Imagery. In Information Systems Architecture and Technology: Proceedings of the 40th Anniversary International Conference on Information Systems Architecture and Technology—ISAT 2019, Wrocław, Poland, 15–17 September 2019; Świątek, J., Borzemski, L., Wilimowska, Z., Eds.; Springer International Publishing: Cham, Switzerland, 2020; pp. 287–299. [Google Scholar] [CrossRef]
- Zhang, Y.; Yuan, X.; Li, W.; Chen, S. Automatic Power Line Inspection Using UAV Images. Remote Sens. 2017, 9, 824. [Google Scholar] [CrossRef] [Green Version]
- Bian, J.; Hui, X.; Zhao, X.; Tan, M. A monocular vision–based perception approach for unmanned aerial vehicle close proximity transmission tower inspection. Int. J. Adv. Robot. Syst. 2019, 16, 1729881418820227. [Google Scholar] [CrossRef]
- Wu, H.; Sun, R.; Ling, X.; Zhong, X.; Gao, X. Deep Learning-Based Detection for Transmission Towers Using UAV Images. In Proceedings of the IGARSS 2022—2022 IEEE International Geoscience and Remote Sensing Symposium, Kuala Lumpur, Malaysia, 17–22 July 2022; pp. 3740–3743. [Google Scholar] [CrossRef]
- Arai, T.; Kageyama, Y.; Ishizawa, C.; Shirai, H.; Ishii, M.; Suehiro, K.; Takahashi, N.; Kobayashi, T.; Yaguchi, S.; Sato, T.; et al. Time series analysis of separation for vegetation management around power lines using UAV photogrammetry. IEEJ Trans. Electr. Electron. Eng. 2020, 15, 1801–1810. [Google Scholar] [CrossRef]
- Sey, N.E.N.; Amo-Boateng, M.; Domfeh, M.K.; Kabo-Bah, A.; Antwi-Agyei, P. Deep Learning-Based Framework for Vegetation Hazard Monitoring Near Powerlines. 2022. Available online: https://www.researchsquare.com/article/rs-1991473/v1 (accessed on 25 June 2023).
- Tomaszewski, M.; Michalski, P.; Ruszczak, B.; Zator, S. Detection of power line insulators on digital images with the use of laser spots. IET Image Process. 2019, 13, 2358–2366. [Google Scholar] [CrossRef]
- Varghese, A.; Gubbi, J.; Sharma, H.; Balamuralidhar, P. Power infrastructure monitoring and damage detection using drone captured images. In Proceedings of the 2017 International Joint Conference on Neural Networks (IJCNN), Anchorage, AK, USA, 14–19 May 2017; pp. 1681–1687. [Google Scholar] [CrossRef]
- Filho, E.F.S.; Prates, R.M.; Ramos, R.P.; Cardoso, J.S. Power Distribution Insulators Classification Using Image Hybrid Deep Learning. In Proceedings of the 2019 27th European Signal Processing Conference (EUSIPCO), A Coruna, Spain, 2–6 September 2019; pp. 1–5. [Google Scholar] [CrossRef]
- Saunders, J.; Saeedi, S.; Li, W. Autonomous Aerial Delivery Vehicles, a Survey of Techniques on how Aerial Package Delivery is Achieved. arXiv 2021, arXiv:2110.02429. [Google Scholar] [CrossRef]
- Das, L.; Saadat, M.H.; Gjorgiev, B.; Auger, E.; Sansavini, G. Object detection-based inspection of power line insulators: Incipient fault detection in the low data-regime. arXiv 2022, arXiv:2212.11017. [Google Scholar] [CrossRef]
- Huang, Y.; Jiang, L.; Han, T.; Xu, S.; Liu, Y.; Fu, J. High-Accuracy Insulator Defect Detection for Overhead Transmission Lines Based on Improved YOLOv5. Appl. Sci. 2022, 12, 12682. [Google Scholar] [CrossRef]
- Savva, A.; Zacharia, A.; Makrigiorgis, R.; Anastasiou, A.; Kyrkou, C.; Kolios, P.; Panayiotou, C.; Theocharides, T. ICARUS: Automatic Autonomous Power Infrastructure Inspection with UAVs. In Proceedings of the 2021 International Conference on Unmanned Aircraft Systems (ICUAS), Athens, Greece, 15–18 June 2021; pp. 918–926. [Google Scholar] [CrossRef]
- Sun, J.; Gao, H.; Wang, X.; Yu, J. Scale Enhancement Pyramid Network for Small Object Detection from UAV Images. Entropy 2022, 24, 1699. [Google Scholar] [CrossRef]
- Tomaszewski, M.; Osuchowski, J.; Debita, Ł. Effect of Spatial Filtering on Object Detection with the SURF Algorithm. In BCI 2018: Biomedical Engineering and Neuroscience, Proceedings of the 3rd International Scientific Conference on Brain-Computer Interfaces, Opole, Poland, 13–14 March 2018; Hunek, W.P., Paszkiel, S., Eds.; Springer International Publishing: Cham, Switzerland, 2018; pp. 121–140. [Google Scholar]
- Urtasun, A.G.L.S. Vision meets Robotics: The KITTI Dataset. Int. J. Robot. Res. (IJRR) 2013, 32, 1231–1237. [Google Scholar]
- Caesar, H.; Bankiti, V.; Lang, A.H.; Vora, S.; Liong, V.E.; Xu, Q.; Krishnan, A.; Pan, Y.; Baldan, G.; Beijbom, O. nuScenes: A multimodal dataset for autonomous driving. In Proceedings of the CVPR, Seattle, WA, USA, 13–19 June 2020. [Google Scholar]
Name and Reference | Classes | MT | NoI | Details |
---|---|---|---|---|
Wire detection dataset [12] | Conductor | D | 67,000 | The set contains synthetic images. Top models were run at more than 3 Hz on the NVIDIA Jetson TX2 with an input resolution of 480 × 640, with an average precision score of 0.73. |
Power Lines Detection (Recognizance-2) [13] | Power line | C | 16,078 | Contains images of power lines from a set of given visible and infrared images. |
Aerial Power Infrastructure Detection Dataset [14] | Tower | D | 12,943 | The dataset consists of top-view images of MV poles from various locations across Cyprus. Images were captured across different seasons to account for a variety of background conditions, such as grass or ground, as well as at different heights to account for variations in the UAV’s height during the inspection. Additionally, all annotations were converted into VOC and COCO formats for training in numerous frameworks. |
Powerline Image Dataset (Infrared-IR and Visible Light-VL) [15] | Conductor, No conductor | D | 8000 | The set contains IR and VL images that were acquired and scaled to a size of 128 × 128. Conductors and towers are present in images. |
Overhead Power Distribution Lines Insulators dataset (OPDL Dataset) [16] | Insulator, Conductor | D | 4960 | In this database, 4 types of distribution insulators were selected that operate at a voltage of 15 kV, namely: ceramic pin insulator (CPI), ceramic bicolor insulator (CBI), polymeric grey insulator (PGI), and glass green insulator (GGI), taken inside and outside the studio. |
Combine Pole Computer Vision Project [17] | Tower | C, D | 3761 | The dataset shows the upper element of the power pole in most cases, together with the insulators. Images were taken in different lighting conditions. There are also samples recorded at night. |
Electrical insulators dataset [18] | Insulators | D | 2630 | Images of a long rod electrical insulator under varying lighting conditions and against different backgrounds: crops, forest, and grass. Images contain additional laser spots that could be exploited to boost object detection. Longer description in Section 2.2. |
Power Towers Computer Vision Project [19] | Tower, Insulator, Conductor | C, D | 2121 | The set contains photos from many different sources. The labels describe mainly the supporting structures of high-voltage lines. |
Electrical Substation Computer Vision Project [20] | Tower, Insulator | C, D | 1991 | A large part of the photo collection shows the power infrastructure in winter scenery, some with elements of overhead lines covered with ice or snow. The labels describe columns and supporting structures. |
The Insulator Defect Image Dataset (IDID) [21] | Insulator, Flashover damage insulator shell, Brokeninsulatorshell, Unbrokeninsulator shell | C, D | 1596 | The images present the insulator as the primary subject and a parent class; each image is assigned to one of 3 sub-classes: flashover damage insulator shell, broken insulator shell, or good insulator shell. In addition, a text document is included with an overview of the dataset characteristics, file structure, and labeling format. |
Transmission Tower Dataset in VOC format [22] | Tower, Conductor | D | 1300 | Collected from internet and inspection videos. Various types of towers and backgrounds. |
TTPLA: An Aerial-Image Dataset for Detection and Segmentation of Transmission Towers and Power Lines [22] | Insulator, Conductor, Tower | S, D | 1234 | Images with a resolution of 3840 × 2160 pixels and manually labeled; a total of 8987 instances of transmission towers and power lines. |
MNV0L Dataset [23] | Insulator, Broken insulator | C, D | 931 | Different types of insulators and their damage are included. There are no labels attached to this collection. |
Insulator Dataset—Chinese Power Line Insulator Dataset (CPLID) [24] | Insulator, Broken insulator | C | 848 | The number of non-broken insulator images is 600. The number of defective insulator images is 248. Real-world images with labeled insulators are supplemented with synthetic images with defects labeled (i.e., missing cap). |
Ground Truth of Powerline Dataset (Infrared-IR and Visible Light-VL) [25] | Conductor, Noconductor | D | 800 | The set contains 400 IR and 400 VL images that are acquired and scaled to a size of 512 × 512. The IR folder contains IR images with power lines, ground truths, and overlay images of these images. The VL folder contains VL images with power lines, ground truths, and overlay images of these images. Conductors and towers present on images. |
Power line dataset of urban scene (PLDU) [26] | Conductor | S, D | 573 | The images in this dataset were captured with UAVs hovering above the power lines within ten meters. Images have pixel-wise annotations |
Electric transmission and distribution infrastructure imagery dataset [27] | Power line, Tower | D | 511 | Dataset built of annotated electric transmission and distribution infrastructure for approximately 321 km2 of high-resolution satellite and aerial imagery, spanning 14 cities and 6 countries across 5 continents. This dataset was designed for training machine learning algorithms to identify electricity infrastructure in satellite imagery automatically; for those working on identifying the best pathways to electrification in low- and middle-income countries, and for researchers investigating domain adaptation for computer vision. |
Insulator Final Computer Vision Project [28] | Insulator | C, D | 498 | The collection contains images of pin insulators from various manufacturers. The images show the insulators on very different scales (resolutions). |
SEAI-C4 Computer Vision Project [29] | Insulator, Broken insulator | C, D | 469 | Dataset with various types of insulators, mostly made of glass and ceramic. The photos have noise added at the post-processing stage. |
Power line dataset of a mountain scene (PLDM) [26] | Conductor | S, D | 287 | Dataset elements were captured at a distance of more than thirty meters of power lines in mountain scenery. |
CEPS Computer Vision Project [30] | Insulator | C, D | 257 | Images of different types of insulators are depicted on very diverse backgrounds. |
Power line vegetation management using UAV images [31] | Conductor, Tower | S, D | 187 | An example dataset containing UAV images for power line vegetation encroachment detection. The images contain GPS positions in their EXIF metadata. |
PLAD: A Dataset for Multi-Size Power Line Assets Detection in High-Resolution UAV Images [32] | Transmission tower, Insulator, Spacer, Tower plate, Stockbridge damper | C, D | 133 | Image size: 5472 × 3078 or 5472 × 3648. It has 2409 annotated objects divided into five classes, which vary in size (resolution), orientation, illumination, angulation, and background. |
Broken glass insulator Computer Vision Project [33] | Insulator, Broken insulator | C, D, S | 125 | Images depicting glass insulators. Most of the labels are rectangular in shape, and part of them indicate the exact outline of the insulator and are suitable for segmentation. |
Electrical Line Computer Vision Project [34] | Conductor | C, D | 120 | Insulated and non-insulated wires are labeled separately, although the markings are not very precise. |
Dataset Insulators Neering Computer Vision Project [35] | Insulator, Broken insulator | C, D | 104 | The dataset contains labels of faults located on the surface of insulators. |
Element | Data Format | Description |
---|---|---|
Digital images of power line insulators | JPG | Images of the insulator on a different background. |
Digital images of power line insulators with laser points | JPG | Images of insulator on a different background along with visible points of a green laser generated by a device emitting light with a wavelength of 532 nm. |
ROI | CSV | Information on the position of the insulator in the ROI picture (x, y, width, height). |
Illuminance | CSV | Information on the lighting level in lux (lx) at the moment of taking a given image. |
Position of laser points on images | CSV | For images on which laser spots are located, information about their number and the coordinates of the spots in the image. |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2023 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Ruszczak, B.; Michalski, P.; Tomaszewski, M. Overview of Image Datasets for Deep Learning Applications in Diagnostics of Power Infrastructure. Sensors 2023, 23, 7171. https://doi.org/10.3390/s23167171
Ruszczak B, Michalski P, Tomaszewski M. Overview of Image Datasets for Deep Learning Applications in Diagnostics of Power Infrastructure. Sensors. 2023; 23(16):7171. https://doi.org/10.3390/s23167171
Chicago/Turabian StyleRuszczak, Bogdan, Paweł Michalski, and Michał Tomaszewski. 2023. "Overview of Image Datasets for Deep Learning Applications in Diagnostics of Power Infrastructure" Sensors 23, no. 16: 7171. https://doi.org/10.3390/s23167171
APA StyleRuszczak, B., Michalski, P., & Tomaszewski, M. (2023). Overview of Image Datasets for Deep Learning Applications in Diagnostics of Power Infrastructure. Sensors, 23(16), 7171. https://doi.org/10.3390/s23167171