RU2617972C1 - Simulator for operational and maintenance staff on the basis of virtual reality models of transformer substation - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: simulator includes a PC with a machine-readable medium containing a logic part of the simulator and a graphical three-dimensional shell, peripheral devices connected to the PC for navigation in a virtual environment which comprise of a virtual reality headset, infrared camera, joystick, fine movement trackers and an omni-directional treadmill. Wherein, the logic part of the simulator includes a switching module, protection module, mode calculating module and evaluation module interconnected via a local software transport interface. The training method consists in visualization of the virtual reality headset on the screen, the graphic three-dimensional shell of the virtual substation, in receipt of the form for operational switching from the logical part of the simulator, implementation of operative switching of control elements in a virtual environment by means of peripheral control devices connected to a PC in accordance with the received form for operative switching, in monitoring changes of operator body positions by means of infrared cameras, in tracking changes of hand positions by means of fine movement trackers, transmission of information on changes in the position of the body, hands and on operative switching from the position trackers and the infrared camera to the logical part of the simulator through interfacing protocols, recalculation of the electrical mode of the substation circuit by means of a built-in mathematical algorithm in the logical part of the simulator (data on the position of switching devices and instrument readings are transferred to the graphic shell of the simulator and displayed on the screen of the virtual reality headset) and in evaluation of correctness of the operator's actions.

EFFECT: improved quality of staff training by providing maximum approach to real operational switching and conditions at a power plant.

2 cl, 4 dwg

Description

The invention relates to the field of information technology and computer technology, namely, to virtual simulators for personnel based on the simulation of substations in three-dimensional virtual space with the interactive interaction of the operational and operational personnel of customer substations in order to teach him methods for safe work, including in emergency situations and training methods using these virtual simulators.

The closest analogue of the proposed solution is a simulation system of an electrical substation for training operators (Chinese patent No. 203165263, 08/28/2013), which includes a control system, a dynamic motion capture system and a display system. The control system includes a control computer that can receive and transmit signals and can perform dynamic motion simulation in accordance with the received signals. The display system includes a helmet used to display virtual scenes. The dynamic motion capture system and the display system are connected to the control system. The control computer can perform dynamic motion simulation in accordance with the signals received from the dynamic motion capture system and display virtual scenes on the screen in front of operators in real time.

The disadvantage of the closest analogue is the simplified logical part of the simulator, which does not represent the possibility of mathematical modeling of an energy object available in the patented system. In particular, the analog does not present the possibility of modeling relay protection and automation of an energy facility, modeling and calculation of the electrical mode.

The task to which the proposed solution is directed is to create a tool for training and training the skills of operational and repair personnel in order to reduce accidents and prevent injuries when working in electrical installations using modern technologies for creating virtual reality.

The technical result of the invention is to improve the quality of staff training by ensuring maximum approximation to real operational switching and conditions at the power facility. The proposed simulator allows you to simulate real equipment, conduct training on models of existing electrical substations, training related to checking the workplace, examining the condition of the equipment (for example, visual inspection of insulators for chips and cracks), as well as training that reflects the real time cost of moving along substations and switching, due to the presence of a navigation system and analysis of user actions in a virtual environment.

The claimed technical result is achieved due to the proposed method for training the operational and operational personnel of the transformer substation based on virtual reality models downloaded to a PC in the form of a core with the logical part of the simulator and a graphic three-dimensional shell of the simulator containing a virtual model of the transformer substation, visualized on the helmet screen of virtual reality, connected to a PC, a graphical three-dimensional shell of a virtual substation loaded into a PC is received from of the part of the simulator loaded into the PC, the form of the training instruction displayed on the helmet display, carry out operational switching of controls in a virtual environment by means of control devices connected to the PC, in accordance with the instructions received, monitor the position of the operator’s body by means of IR cameras, information on changes in body position and on operational switching is transmitted through interaction protocols to the logical part of the simulator, after recalculation of the mode, data on the position of comm utilization apparatuses and instrument readings are transmitted to the simulator's graphic shell and displayed on the helmet screen of virtual reality.

The proposed training method is carried out by means of a training station, including a PC with a computer-readable medium containing the logical part of the simulator and a graphic three-dimensional shell, keyboard, mouse, joystick, virtual reality helmet, as well as peripheral devices for user navigation in a virtual environment connected to a PC, consisting of infrared cameras, trekkers fine motor hand and omnidirectional treadmill.

Thanks to the user navigation system in the virtual environment, the user is provided with the opportunity to create visual effects in the virtual environment, such as highlighting the controls in the virtual environment when the user hovers over it, as well as simulating a fire or an electric arc that occurs during some erroneous operations staff. This feature allows you to conduct visual training of personnel as close as possible to real operational switching at the power facility, which improves the quality of training for operational and operational personnel of the transformer substation.

Further, the solution is illustrated by reference to the drawings, which show the following:

FIG. 1 is a schematic diagram of the interaction of system units and a user.

FIG. 2 is a block diagram of a training station.

FIG. 3 is a flowchart of a training algorithm.

FIG. 4 is a general view of a training station.

In FIG. Figure 1 shows the general scheme of interaction between the subsystems: the logical part of the simulator (LST) and the 3-D shell. Due to the fact that the created system is an integration of two subsystems: LST and 3-D shells, the human actions performed in the latter (which is the interface for the user) are transferred for execution to the LST and their subsequent fixation in it. Information exchange between the subsystems will be carried out through the local software transport interface (COM COM API) and is based on a transactional model. All elements presented in the visualization and available for management will have their own unique identification number (ID). Such elements will include equipment controls in the primary circuit, secondary control keys, measuring devices, personal protective equipment, etc. Each element will be assigned a specific set of available actions that the user can perform during the training. A transaction is the exchange of data packets between subsystems. The exchange algorithm is depicted in FIG. 3.

In accordance with FIG. 3, the sequence of information flows during the functioning of the system is as follows.

Block 1. The user, in order to start working in the multi-user mode, launches the “Simulator” application, selects the appropriate mode and the training scenario to be worked out.

Block 2. After the above actions of the user, the training scene (virtual substation) and the laid-out training scenario are used as the output from the BLT and, accordingly, the input for the graphic 3-D shell at this stage.

Next, blocks 3 and 4 correspond to the passage of the first transaction between LBT and the 3-D shell in order to start the simulation for this user. This action is always performed when the system starts on the training platform and is an integral stage for starting work.

Block 3. After unloading the training scene and the embedded script into the graphical 3-D shell of the BLT, using the UDP network interface, it polls parallel training platforms to determine if they have already been simulated. If the simulations are already running, then their execution is temporarily blocked for the period of full load (next Block 4) on this training platform. Blocking the flow of execution is provided in order to correctly upload data to the running simulation about the current state of the equipment available for control, and thus ensure synchronization of data on parallel simulations, some of which could be started earlier. If the simulation started on several platforms at the same time, then the first transactions are executed in turn.

Block 4. After blocking the execution flow (if it takes place), the 3-D shell receives from the BLTIN all the elements involved in the running simulation and available for control, and data on the initial state of the elements. After completing this action, the training platform is ready for work and training.

Next, the training process begins directly. The algorithm that is implemented when any action is performed by the user is described by blocks 5, 6, 7, 8. Since training is a set of sequential actions, the information exchange between subsystems during it is completely described by these blocks.

Block 5. The user performs an action in the graphical interface, for example, turns the control key of the linear circuit breaker to trip.

Block 6. From the 3-D shell in LBT, a transaction is passed with information about the type of action on an element with IN N (control key).

Block 7. The response of LRT to the perfect effect: a change is made to the switching model of the electrical part of the substation, changes are recorded in the secondary circuits (signaling, control, etc.), and the electrical mode that has changed after changing the state of the system is recalculated.

Block 8. A reverse transaction is carried out from LST to 3-D Shell: transmission of visualization data by element N (for example, after the circuit breaker is turned off, it is necessary to change the alarm on the control room boards, the readings of measuring instruments, position, etc.).

Block 9. Conditionally displays the whole set of actions performed by the user during the training, which are also described in blocks 5-8.

Block 10. After completion of the training, the user completes the simulation. At the same time, LST determines the number of correct and incorrect actions when completing a training session and evaluates them in points with corresponding weighting factors. If the threshold number of points is reached, then the training was successful, otherwise - unsuccessfully.

During emergency training, when during operational switching a failure occurs or an accident occurs for reasons beyond the control of the user (the moment of failure or accident is determined in advance and incorporated into the training algorithm), it is proposed to implement the following algorithm. Since the visualization of this event implies an appropriate transaction from the LRT to the 3-D shell, and the generation of transactions from the LBT is not provided, with a certain discreteness, the 3-D shell will simultaneously send requests to the LBT regarding the occurrence of an emergency event.

In FIG. 4 shows a general view of a training substation and the following elements are indicated:

11. The helmet of virtual reality.

12. Tracker position of the hands.

13. IR camera.

14. Omni-directional treadmill.

15. The system unit of the workstation.

16. Monitor workstation simulator.

The training station is a personal computer with a machine-readable medium containing software, divided into two functional cores: the logical part of the simulator (BLT) and a 3D graphic shell. Also, the necessary programs are installed on the computer to communicate peripheral equipment into a single complex. An integral part of the simulator is a virtual reality helmet, which is a means of displaying virtual reality. To track the local movements of the trained personnel, an IR camera is used.

A set of peripherals includes:

- The keyboard is used to navigate the training station;

- mouse - serves to navigate the training station;

- virtual reality helmet - is used to display the 3D shell;

- infrared camera - serves to track the position of the body and the movements of the trainee and transfer information to the 3D shell;

- the joystick is used to navigate the user in a virtual environment;

- omnidirectional treadmill.

The switching module is a subsystem of the logical part of the simulator and is responsible for storing information about the topology of the electrical circuit of the power facility, the current state of the circuit elements, their design characteristics. The switching module also analyzes the circuit from the point of view of the correctness of the topology during its construction and debugging.

The protection module is a subsystem of the logical part of the simulator and performs circuit analysis from the point of view of the possibility of localizing a malfunction that occurs in a node or zone. The analysis is performed automatically when the circuit diagram of the network opens in the application "Schema Animator". This creates lists of protection zones, circuit nodes and deadlocks that are available for viewing by the user. Entering information about the damage to the element leads to the disconnection of the network section, which can also be used to verify the scheme.

The mode calculation system is an algorithm built into the logic part of the simulator, designed to calculate the steady-state electric mode of the AC network of the simulated object.

Before starting a workout, you need to download the logical part of the simulator and the graphic shell (using the keyboard and mouse), configure the work of the virtual reality helmet. These functions can be performed by an instructor or system administrator. The trainee does not have to have the skills to prepare the system for work. Wearing a virtual reality helmet, the user begins training on a virtual model of a transformer substation. In the preloaded logical part of the simulator, a reference sequence of actions corresponding to the training, called the training scenario, is recorded. The script contains the correct sequence of actions that the user must perform during the training. The main training venue is:

- Substation control room containing control panels;

- open switchgear;

- indoor switchgear;

- other production facilities of the power facility involved in the switching process.

During training, the user interacts with the controls in a virtual environment. Information about the changes is transmitted through the interaction protocols to the logical part of the simulator, and, after recalculating the mode, data on the position of the switching devices, instrument readings are transmitted back to the graphic shell of the simulator.

To make the switch, the user needs to approach the control unit at a distance in virtual reality, no more than equivalent to the distance of an outstretched arm in reality. Before the eyes of the user in the center of the image there is always a red square (sight) used to interact with elements of the graphic shell. To interact with an element of the graphical shell, the user needs to look at him with a glance. When aiming at the controls, their backlight turns on, helping the user with the choice of equipment. The backlight is the appearance of a red line along the contour of the selected element, thereby achieving its selection against the background of textures. If the element is selected correctly, then the user presses the joystick key, and this affects the element.

Starting the system is to download the necessary software and configure peripheral devices. After starting the system and setting up, training begins. The virtual environment is displayed through the virtual reality helmet. The training process consists in the user performing actions in accordance with the training scenario. The training scenario is compiled in accordance with regulatory documents for operational switching (forms for operational switching). During the training, the user needs to move around the substation model, act on the controls, use personal protective equipment, hang up prohibition posters, etc. To move and influence the elements, the user uses a joystick, omnidirectional treadmill, virtual reality helmet, fine hand motor trackers and an infrared camera. These tools are the main means of navigation. The user himself visually determines his position in the virtual space. There are four types of motor activity of the user:

1. Hand movements (fine motor skills)

Here, for recognition, trackers of fine motor skills of hands are used (gesture control devices that recognize hand movements in the user's field of vision are fixed on the virtual reality helmet). Also, to implement interaction with the elements of the graphical shell, a joystick can be used, using the levers of which the user is moved in space, and with the help of buttons, interaction with the selected virtual object is performed.

2. Large body movements (body movement)

This type of movement is tracked by an IR camera synchronized with a virtual reality helmet. The IR camera is calibrated and fixes the initial position of the virtual reality helmet in space. Further, during training, the IR camera monitors the deviation of the position of the helmet in space from the initial one.

3. Space moves in steps

To implement this movement in virtual reality, an omnidirectional treadmill is used. The joystick can be used to move (imitation of steps when pressing the button on the joystick) in the absence of an omnidirectional treadmill or in addition to it.

At any time during training, the user can open the switching form to understand the sequence of actions using the button on the joystick reserved for this function. The form appears before the eyes of the user in the graphical shell. The switching form is an operational document that indicates which switching is performed and provides a list of actions required to perform during the switching. During training, the program evaluates the correctness of the actions performed and, after the training is completed, issues a report on the operations performed. Evaluation is carried out in the evaluation module specially created for this in the logical part of the simulator. A reference sequence of training activities (its scenario) is programmed into it. During the training, the information exchange described above between the BLT and the graphic part occurs. LST transmits information about the actions performed by the user to the evaluation module and compares the resulting sequence with the reference one. If the actual and reference actions coincide, points are awarded to the user. Their number depends on the importance of the performed action: the corresponding weighting factors are assigned to various actions. As a result, a report of the user's actual actions and his score in points are generated. Analysis of the report allows you to determine the readiness of the trainee to work on a real object and the mistakes and shortcomings made.

The main advantage of the simulator under development is the presence of a visual component - a graphical 3D shell and BLT, working together. Training conducted on the simulator under development will be visual and as close as possible to real operational switching at a power facility. The presence of a 3D graphic shell and the use of virtual reality technology allows you to:

- simulate real equipment, conduct training on models of existing electrical substations;

- conduct training related to checking the workplace, examining the condition of the equipment (for example, visual inspection of insulators for chips and cracks), which is impossible on existing simulators for operational switching;

- conduct training that reflects the real time costs of moving around the substation and making switches;

- create visual effects such as a fire or an electric arc arising from erroneous actions of operational personnel.

The simulator is intended for use in training centers for personnel of electric grid companies and large consumers of electric energy. The simulator can be used both for training on-duty substation electricians and for testing operational personnel. Trained personnel are notified in advance about the scenario and goals of the training (for example, training on the conclusion of the transformer for repair). Having started training, the staff opens the switching form in the virtual environment and begins to sequentially perform the actions indicated in the form. The training is monitored by supervisory personnel, who, if necessary, give advice on how to interact with the simulator. After training, the program creates a protocol indicating errors (violation of the sequence of actions, failure to perform an action, performing an extra action or an incorrect action) committed during the work.

Areas of use of the system: training of new personnel and certification, advanced training of working personnel, conducting emergency training.

Claims (15)

1. The simulator of the operational and operational personnel of the transformer substation based on virtual reality models, including a PC with a machine-readable medium containing the logic part of the simulator and a graphic three-dimensional shell, peripheral devices for navigating in a virtual environment connected to a PC, including a virtual reality helmet, infrared camera, joystick , fine motor trackers and an omnidirectional treadmill, while the logical part of the simulator includes interconnected by means of locally go software transport interface a switching module configured to store information about the topology of the electrical circuit of the power facility, the current state of the circuit elements, their design characteristics, analysis of the circuit in terms of the correctness of the topology during its construction and debugging, a protection module configured to analyze a network circuit for faults, a mode calculation module configured to calculate a steady state AC network of a simulated object, an evaluation module, configured to evaluate the comparison of actions performed by the user with the sequence of actions contained in the form for operational switching. 2. The method of training the operational and operational personnel of the transformer substation, carried out using the simulator according to claim 1, characterized in that it includes the stages at which visualize on the screen of a virtual reality helmet connected to a PC, a three-dimensional graphic shell of a virtual substation loaded into a PC, receive from the logical part of the simulator downloaded to the PC, and display on the helmet screen a form for operational switching, carry out operational switching of controls in a virtual environment through peripheral control devices connected to a PC, in accordance with the received form for operational switching, monitor by means of IR cameras a change in the position of the body of the operator, track the movements of the hands by means of fine motor trackers, information on changes in the position of the body, hands and on operational switching from the position trackers and the IR camera is transmitted through the interaction protocols to the logical part of the simulator, recalculate the electrical mode of the substation circuit by means of the mathematical algorithm built into the logic part of the simulator, after recalculation of the mode, the data on the position of the switching devices and the readings of the devices are transmitted to the simulator’s graphic shell and displayed on the screen of the virtual reality helmet, track the correct and incorrect actions when completing a workout and evaluate them in points with the corresponding weighting factors through the logical part of the simulator.

Images