CN116070523A - A simulation construction method of image samples for substation defect detection - Google Patents

Abstract

The invention discloses a simulation construction method of a transformer substation defect detection image sample, which relates to the technical field of simulation construction of transformer substation image samples, and aims to solve the problems that on-site shooting is limited by objective factors such as time, environment, field and the like, equipment fault scenes under the influence of various possible factors cannot be covered, a large amount of time and manpower resources are consumed, the physical simulation cost is high, and the design difficulty is high, and the method has the technical scheme that the method comprises the following processing steps: s1: and (3) data collection: performing field investigation on the environment of the transformer substation, and modeling the virtual transformer substation by using three-dimensional modeling software; s2: modeling a transformer substation; s3: and (3) fault analysis: classifying and sorting common fault data of the substation equipment; s4: and (3) fault simulation: including static faults and dynamic faults; s5: substation operation simulation: and the overhaul and the record of different faults are convenient. S6: and automatically generating and labeling the sample. The effects of conveniently constructing samples, performing targeted simulation and conveniently performing simulation training are achieved.

Description

A simulation construction method of image samples for substation defect detection

technical field

The invention relates to the technical field of substation image sample simulation construction, in particular to a substation defect detection image sample simulation construction method.

Background technique

The development of the national economy is closely related to the stable operation of the power system. The substation is an important part of the power system. Ensuring the normal operation of the substation is very important to the national economy and people's lives. The looseness and wear of power equipment or transmission line components It will lead to the destruction of the stable operation of the substation, so it is necessary to operate and maintain the substation equipment. The inspection robot has been able to realize functions such as defect detection, fault identification, instrument reading, switch knife and air switch status judgment, but the type and quantity of image training samples affect the accuracy and generalization of intelligent algorithms. Moreover, there is a serious shortage of defect sample image datasets in the current substation environment. On the one hand, the number of samples in the dataset is small, which cannot cover the possible defects of various power equipment; on the other hand, the defect data is very unbalanced, and the insulators explode The number of samples related to defects such as missing pins and missing pins is relatively large, while the number of samples related to defects such as broken cables, loose strands, and corroded hardware is relatively small; in addition, some equipment locations are difficult to photograph, such as equipment fixed on utility poles, It is difficult to take images of defects from multiple angles.

At present, the ways to obtain image training samples for fault recognition algorithms are: (1) On-site shooting: use drones or robots to collect relevant images at industrial sites, use the collected images as training samples, and manually mark each image (2) virtual simulation: design simulation software, simulate various fault simulation software that may occur in power equipment, and obtain visible light optical images that meet the requirements through sensors in the simulation software, (3) physical simulation : Design a physical object that can simulate the state of equipment when various faults occur, and manually collect images, (4) Intelligent algorithm: simulation sample generation method based on long short-term memory network, defect sample generation method based on generative confrontation network, etc.

The above-mentioned existing technical solutions have the following defects: (1) On-site shooting is limited by objective factors such as time, environment, and venue, and cannot cover equipment failure scenarios under the influence of various possible factors, and consumes a lot of time and human resources; (2) ) The cost of physical simulation is high and the design is difficult.

Contents of the invention

The purpose of the present invention is to provide a simulation construction method of substation defect detection image samples for collecting information to model substations and simulating substation faults.

To achieve the above object, the present invention provides the following technical solutions:

A simulation construction method for substation defect detection image samples, the construction steps are as follows:

S1: Data collection: Conduct on-the-spot investigations on the substation environment, collect the graphics, dimensions, and models of each equipment, determine the prototype of the substation, and then collect a large number of relevant pictures and drawings of each equipment, and conduct substation and electrical equipment based on this Modeling, using 3D modeling software to model the virtual substation;

S2: Substation modeling: select the appropriate modeling basic body according to the approximate shape of the modeling object, and then convert the basic body into an editable body according to the equipment drawings obtained from field investigation and collection, and adjust the polygonal shape according to the size and shape of the equipment Points, lines, and surfaces to get a complete device model:

S3: Fault analysis: Classify and organize the common fault data of substation equipment, so as to obtain the data after fault analysis, and set the corresponding maintenance mode according to the data after fault analysis, and input the data of the maintenance mode, so as to obtain the fault database;

S4: Fault simulation: The fault phenomenon simulation module is responsible for simulating various faults that may occur in the substation environment according to the fault database, including static faults and dynamic faults, and importing the repair methods of corresponding faults into the corresponding fault database through documents or video links , extracted together with the fault data, which is convenient for fault repair and simulation learning repair process;

S5: Substation operation simulation: establish a three-dimensional simulation environment for substations based on virtual reality technology, and set up corresponding editing programs. When in use, use virtual reality technology to simulate various typical equipment faults in real time, and analyze the faults during the simulation. Obtain fault conditions and fault repair information, and use virtual reality technology to display online, simulate fault repairs based on fault repair information, and can enter new fault information for recording, which is convenient for repairing and recording different faults.

S6: Automatic sample generation and labeling: In the virtual substation scene, the camera imaging model is modeled according to the camera's spatial position, direction, and forward vector. During the imaging process, high-fidelity images are generated based on Render-To-Texture technology. At the same time, according to the type of imaging equipment, fault type, geometric information, etc. in the substation 3D simulation scene, the bounding box coordinates, equipment and fault type annotation information are generated to meet the needs of algorithm training and semantic annotation information.

Further, in the S1, three-dimensional modeling software is used to model the virtual substation with iconic icons, and the iconic icons are marked and saved, so as to facilitate subsequent extraction of iconic buildings for model building.

Further, in the substation modeling in S2, for objects with complex geometric structures, the method of segmentation and reorganization is used to model them. After the three parts of the model are completed, they are integrated into a whole by means of splicing and reorganization, basically After modeling the complete model of the substation equipment, use textures to improve the details of the model. After all the parts are modeled, different types of equipment are constructed by splicing and reorganizing, and the splicing and reorganization icons can be saved to form common icons , used to combine with icon extraction.

Further, the faults in S3 and S4 include static faults and dynamic faults, and static faults refer to the situation that the isolation switch is not completely closed and the insulation coil is broken, and dynamic faults refer to the process of transformer explosion and reactor smoke.

Further, after analyzing the situation of faults in the substation operation simulation process, they are classified, and the whole is set to a real-time storage mode to record different types of faults, and at the same time, it is convenient for subsequent timely recording and analysis of new faults.

Further, after the classification and recording of faults in the operation simulation process of the substation, the maintenance method of the corresponding type of fault is called, and the fault maintenance method is set to the real-time recording mode, which can continuously optimize and repair different faults Mode, which is convenient for simulating repair and learning about repair knowledge.

In summary, the beneficial technical effects of the present invention are:

1. This substation defect detection image sample simulation construction method uses 3D modeling software to model the virtual substation. First, before modeling, we conduct on-the-spot inspections of the substation environment and collect the graphics, dimensions, and models of each equipment. Determine the prototype of the substation, and then collect a large number of relevant pictures and drawings of each equipment, and model the substation and electrical equipment based on this. It does not need to be modeled entirely by shooting, reducing the overall difficulty of modeling. Achieved the effect of conveniently constructing samples;

2. The simulation construction method of the substation defect detection image sample uses virtual reality technology to realize the development of the fault phenomenon simulation module. First, a large amount of fault conditions existing in the substation environment are understood, and then, the static and dynamic faults classified by us are targeted for simulation. , and extract the corresponding solutions at the same time, which is convenient for solving and learning, and achieves the effect of targeted simulation.

3. The substation defect detection image sample simulation construction method generates a separate rendering image file containing fault-related information such as faulty equipment and fault phenomena to mark the fault location or fault type in the image, thereby realizing the image The automatic acquisition of training samples to mark fault points and fault types achieves the effect of facilitating simulation training.

Description of drawings

Figure 1 is a schematic diagram of the workflow of the present invention.

Detailed ways

The method of the present invention will be described in further detail below in conjunction with the accompanying drawings.

With reference to accompanying drawing 1, a kind of substation defect detection image sample simulation construction method is characterized in that, its construction steps are as follows:

S1: Data collection: Conduct on-the-spot investigations on the substation environment, collect the graphics, dimensions, and models of each equipment, determine the prototype of the substation, and then collect a large number of relevant pictures and drawings of each equipment, and conduct substation and electrical equipment based on this Modeling, use 3D modeling software to model the virtual substation, use 3D modeling software to model the virtual substation with iconic icons in the modeling process, and mark and save the iconic icons to facilitate subsequent extraction of iconic The construction of the model of the building, the 3D modeling software is a combination of two-dimensional plane photos to form software similar to the shooting site, which is an existing and well-known technical common sense. This design is mainly for the simulation of substation faults, and the selection of modeling software And use is not the focus of this design, so I won't describe it more;

S2: Substation modeling: select the appropriate modeling basic body according to the approximate shape of the modeling object, and then convert the basic body into an editable body according to the equipment drawings obtained from field investigation and collection, and adjust the polygonal shape according to the size and shape of the equipment Points, lines, and surfaces to obtain a complete equipment model. Substation modeling For objects with complex geometric structures, use the method of segmentation and reorganization to model them. They become a whole. After basically modeling the complete model of the substation equipment, the textures are used to improve the details of the model. After all the parts are modeled, different types of equipment are constructed by splicing and reorganizing, and the splicing and reorganization icons can Save and form commonly used icons, which are used to extract and combine with iconic icons. Commonly used icons are general equipment in substations, that is, common equipment in most substations. They are represented and named by the same icon to facilitate subsequent extraction. Iconic icons refer to For special equipment that is different from general equipment, there may be larger or special equipment depending on the type of work in the substation, which requires special modeling and different data settings to better adapt to the internal conditions of the substation and ensure the accuracy of the simulation sex;

S3: Fault analysis: Classify and organize the common fault data of substation equipment, so as to obtain the data after fault analysis, and set the corresponding maintenance mode according to the data after fault analysis, and input the data of the maintenance mode, so as to obtain the fault The database and the fault database can be used for data entry and extraction, so that the possible faults can be extracted according to the possibility of substation simulation, so as to facilitate maintenance according to the actual situation;

S4: Fault simulation: The fault phenomenon simulation module is responsible for simulating various faults that may occur in the substation environment according to the fault database, including static faults and dynamic faults, and importing the repair methods of corresponding faults into the corresponding fault database through documents or video links , which is extracted together with the fault data, which is convenient for fault maintenance and simulated learning and repair process. Faults include static faults and dynamic faults, and static faults refer to the situation that the isolating switch is not completely closed and the insulation coil is broken. Dynamic faults refer to the transformer In the process of explosion and reactor smoke, static faults and dynamic faults are set in different databases. When a fault occurs in a substation, the fault type is first searched to reduce the range of retrieval and increase the speed of retrieval;

S5: Substation operation simulation: establish a three-dimensional simulation environment for substations based on virtual reality technology, and set up corresponding editing programs. When in use, use virtual reality technology to simulate various typical equipment faults in real time, and analyze the faults during the simulation. Obtain fault conditions and fault repair information, and use virtual reality technology to display online, simulate fault repairs based on fault repair information, and record new fault information, which is convenient for repairing and recording different faults. The substation After the situation analysis of the faults in the operation simulation process, it is classified, the whole is set to the real-time saving mode, and different types of faults are recorded, and at the same time, it is convenient for subsequent timely recording and analysis of new faults. The faults in the operation simulation process of the substation After the generated situation is classified and recorded, the maintenance method of the corresponding type of failure is called, and the maintenance method of the failure is set to the real-time recording mode, which can continuously optimize the repair mode for different failures, which is convenient for simulated repair and repair knowledge learning.

S6: Automatic sample generation and labeling: In the virtual substation scene, the camera imaging model is modeled according to the camera's spatial position, direction, and forward vector. During the imaging process, high-fidelity images are generated based on Render-To-Texture technology. At the same time, according to the type of imaging equipment, fault type, geometric information, etc. in the substation 3D simulation scene, the bounding box coordinates, equipment and fault type annotation information are generated to meet the needs of algorithm training and semantic annotation information;

The faults in the substation operation simulation process are analyzed and classified, and the whole is set to a real-time storage mode to record different types of faults, and at the same time, it is convenient for subsequent timely recording and analysis of new faults.

The embodiments of this specific implementation mode are all preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention, so: all equivalent changes made according to the structure, shape and principle of the present invention should be covered by within the protection scope of the present invention.

Claims (6)

1. A substation defect detection image sample simulation construction method is characterized in that its construction steps are as follows: S1: Data collection: Conduct on-the-spot investigations on the substation environment, collect the graphics, dimensions, and models of each equipment, determine the prototype of the substation, and then collect a large number of relevant pictures and drawings of each equipment, and conduct substation and electrical equipment based on this Modeling, using 3D modeling software to model the virtual substation; S2: Substation modeling: select the appropriate modeling basic body according to the approximate shape of the modeling object, and then convert the basic body into an editable body according to the equipment drawings obtained from field investigation and collection, and adjust the polygonal shape according to the size and shape of the equipment Points, lines, and surfaces to get a complete device model: S3: Fault analysis: Classify and organize the common fault data of substation equipment, so as to obtain the data after fault analysis, and set the corresponding maintenance mode according to the data after fault analysis, and input the data of the maintenance mode, so as to obtain the fault database; S4: Fault simulation: The fault phenomenon simulation module is responsible for simulating various faults that may occur in the substation environment according to the fault database, including static faults and dynamic faults, and importing the repair methods of corresponding faults into the corresponding fault database through documents or video links , extracted together with the fault data, which is convenient for fault repair and simulation learning repair process; S5: Substation operation simulation: establish a three-dimensional simulation environment for substations based on virtual reality technology, and set up corresponding editing programs. When in use, use virtual reality technology to simulate various typical equipment faults in real time, and analyze the faults during the simulation. Obtain fault conditions and fault repair information, and use virtual reality technology to display online, simulate fault repairs based on fault repair information, and can enter new fault information for recording, which is convenient for repairing and recording different faults. S6: Automatic sample generation and labeling: In the virtual substation scene, the camera imaging model is modeled according to the camera's spatial position, direction, and forward vector. During the imaging process, high-fidelity images are generated based on Render-To-Texture technology. At the same time, according to the type of imaging equipment, fault type, geometric information, etc. in the substation 3D simulation scene, the bounding box coordinates, equipment and fault type annotation information are generated to meet the needs of algorithm training and semantic annotation information. 2. A kind of substation defect detection image sample simulation construction method according to claim 1, it is characterized in that: use three-dimensional modeling software in the described S1 to adopt iconic icon to carry out modeling in the virtual substation modeling process, and to The iconic icons are marked and saved, which is convenient for subsequent extraction of iconic buildings for model building. 3. The method for constructing a substation defect detection image sample simulation according to claim 2, characterized in that: the substation modeling in the S2 uses segmentation and reorganization to model objects with complex geometric structures, After completing the model making of the three parts, they are made into a whole by splicing and reorganizing. After basically modeling the complete model of the substation equipment, the texture is used to improve the details of the model. After all the parts are modeled, through Splicing and reorganizing to build different types of equipment, and splicing and reorganizing icons can be saved to form common icons, which are used to extract and combine with iconic icons. 4. A kind of substation defect detection image sample simulation construction method according to claim 1, is characterized in that: the fault in described S3 and S4 comprises static fault and dynamic fault, and static fault refers to disconnector not fully closed, In the case of broken insulating coils, dynamic faults refer to the process of transformer explosion and reactor smoking. 5. a kind of substation defect detection image sample simulation construction method according to claim 1, it is characterized in that: classify after the situation analysis of the fault generation in the operation simulation process of the substation, the whole is set to the real-time preservation mode, for Different fault types are recorded, and at the same time, it is convenient for subsequent timely record and analysis of new faults. 6. A substation defect detection image sample simulation construction method according to claim 5, characterized in that: after the faults in the substation operation simulation process are classified and recorded, the maintenance method of the corresponding category of faults is called , and the fault maintenance method is set to the real-time recording mode, which can continuously optimize the repair mode for different faults, which is convenient for simulated repair and repair knowledge learning.

Images