RU2766391C1 - Method for analysing behaviour of person being tested to identify his/her psychological characteristics by means of virtual reality technologies - Google Patents

Abstract

FIELD: medicine.

SUBSTANCE: invention relates to medicine, namely to a method for analysing the behaviour of a person being tested for identifying psychological characteristics by means of virtual reality technologies. Person being tested is put on sensors for monitoring physiological parameters, as well as a virtual reality device and headphones, to which interactive audiovisual content simulating a stress situation is transmitted. Simultaneously, data on the reaction of the person being tested and data from the sensors are transmitted to the imaging device. In the process of diagnostics, the content of the audiovisual content is dynamically changed by creating new interactive elements, thereby modifying the conditions of the stress situation depending on the results of measuring the sensors for controlling physiological parameters and the response of the person being tested. To this end, a database of applications is used to simulate various situations for diagnosing personal qualities, which is an interactive environment configured to interact with virtual elements and accompany interactions with audiovisual effects. Application with database of interactive elements is made with possibility to embed any element into launched application for simulation of various situations, as well as with the possibility of creating interactive elements and subsequent integration into the launched application for simulating various situations. At any moment in time, specialized specialists are provided with access to the entire set of interactive elements from an application with a database of interactive elements regardless of the initially launched application which modulates the stress situation. Data from sensors is automatically analysed in the control device in real time. Based on the analysis, the specialized specialists are given recommendations on correcting the conditions of the stress situation.

EFFECT: enabling increase in the accuracy of diagnosing personal qualities by removing the limitations of the specialized specialist by selecting one of the pre-determined versions of the audiovisual content taking into account dynamically changing conditions, which are set by profile specialists, with possibility of correcting conditions of stress situation.

3 cl, 1 dwg, 1 ex

Description

DESCRIPTION OF THE INVENTION

The invention relates to methods for evaluating behavior and diagnosing personal qualities of a person in stressful situations simulated by means of virtual reality technologies [A61B5/00, G06Q10/10].

The prior art known SYSTEM AND METHOD FOR TESTING THE COGNITIVE ABILITIES OF THE PATIENT ON THE BASIS OF VR [CN110459314, publ. November 15, 2019]. The invention discloses a system and method for testing a patient's cognitive abilities based on VR. The system and method are applied to wearable equipment. The method comprises the steps of displaying terms from a group of testing terms sequentially on a virtual reality device in a predetermined period of time; the patient is shown the terms presented on the virtual reality device; at the end of the presentation of terms, the patient is asked to answer the memorized terms; the results of responses to the learned terms are collected, voice recognition processing is performed, and thereby, a processed group of terms with responses is obtained; the terms to which the user could not give an answer are counted. With the VR-based patient cognitive testing system and method, the patient's cognitive abilities can be tested repeatedly, the human resources cost is reduced, and the interactivity and entertainment of the test are improved.

The disadvantage of analogue are:

- low interactivity, due to the fact that the patient does not have the opportunity to interact with virtual interactive objects that are analogues of physical objects from the real world;

- low testing accuracy due to the fact that test results depend on the quality of voice recognition algorithms, which in non-standard situations (for example, with non-standard patient diction) have low efficiency.

Also known from the prior art is a PSYCHOLOGICAL SELECTION DEVICE FOR AIR FORCE RECRUITMENT BASED ON VIRTUAL REALITY TECHNOLOGY [CN111920428, publ.: 11/13/2020]. The psychological selection device for air force recruitment based on virtual reality technology includes a virtual reality helmet, a personal computer, a control element, a gaze tracking device, and a memory element. The VR helmet consists of a helmet body and a display screen assembly. The display screen assembly includes an outer shell, a lens, an image display device, and the display screen itself. The control element is in control communication with the personal computer; and the tracker contains a capture lens, a camera, and a driver. The display screen assembly matches the position of the user's eyes; the display screen is facing inside the helmet shell; the capture lens and the camera are sequentially located on the lower surface of the first cavity; the lens and the image display device are sequentially located in the second cavity; the personal computer controls and is connected to an image display device, a driver, and a memory element. VR technology is used to create an immersive situation and subsequent testing based on readings from hardware sensors. During testing, eye-hand coordination, reaction speed and information processing ability can be improved. The device allows to increase the efficiency of the recruitment of professional personnel for the air force.

The disadvantages of analog are:

- low testing accuracy due to the fact that the analogue does not provide the ability to dynamically change the test conditions to create non-standard and unique situations.

The closest in technical essence is the SYSTEM AND METHOD FOR ASSESSING MENTAL STRESS ON THE BASIS OF VR EQUIPMENT [CN108968986, publ. 11.12.2018]. The system includes a module for collecting external physiological parameters, a test program module, a visual output module, an audio output module, and input equipment. The module for collecting external physiological parameters is used to obtain various physiological parameters of a person in the process of assessing the psychological response to stress; the test program module is used to store three test programs used to assess the psychological response to stress; the visual output module is used to clearly display content and content changes in the test program; the audio output module is used to reproduce the content of test programs, as well as to assess mental stress and guide the test subjects; input equipment is used to select content in the mental stress assessment process.

The main technical problem of the prototype is the low accuracy of diagnosing personal qualities due to the fact that the choice of situations in the process of assessing mental stress is significantly limited by the content of one of the three test programs. Thus, at the beginning of testing, the specialist can choose a finite set of interactive situations only within the framework of the launched test, which leads to the impossibility of adapting the test to the unique psychological characteristics of each test subject. The inability to reveal all the essential features of the psyche, due to the limitation on the number of situations within one test program, leads to a decrease in the accuracy of diagnosis.

The objective of the invention is to eliminate the disadvantages of the prototype.

The technical result of the invention is to improve the accuracy of diagnosing personal qualities.

The specified technical result is achieved due to the fact that the method of analyzing the behavior of the subject to identify his psychological characteristics using virtual reality technologies is characterized by the fact that initially the subject is put on sensors for monitoring physiological parameters, as well as a device for virtual reality and headphones, on which, from the control device , by means of control commands, electrical signals are transmitted containing interactive audiovisual content that simulates a stressful situation, at the same time, data on the reaction of the subject and data from sensors are transmitted in the form of electrical signals to the visualization device, then, in the process of diagnostics, the content of the audiovisual content is dynamically changed, by creating new interactive elements containing audiovisual content, with their subsequent transformation in the form of an electrical signal and transmission by means of control commands from the control element through the control device to the device for virtual reality and headphones, thereby modifying the conditions of a stressful situation depending on the results of measurements of sensors for monitoring physiological parameters and the reaction of the subject by using a database of applications for modeling various situations for diagnosing personal qualities, which is an interactive environment made with the possibility of interaction with virtual elements and accompanying interactions with audiovisual effects, an application with a database of interactive elements, made with the ability to embed any element into a running application to simulate various situations, with the ability to create interactive elements and then integrate into a running application to simulate various situations, providing in any point in time for profile specialists to access the entire set of interactive elements from the application with a database of interactive elements, regardless of the initial a running application that modulates a stressful situation, and automatic real-time analysis of data from sensors in the control device, as well as on the basis of an analysis of the issuance of recommendations to specialized specialists on correcting the conditions of a stressful situation.

In particular, the electrical signals of the control commands are transmitted via a cable

In particular, electrical control command signals are transmitted via a wireless communication network.

one.

Brief description of the drawings

In FIG. 1 shows a schematic view of a device for analyzing the behavior of a test subject to identify his psychological characteristics using virtual reality technologies.

In FIG. shown: 1 - virtual reality device; 2 - headphones; 3 - control device; 4 - visualization device; 5 - control element; 6 - sensor.

Implementation of the invention.

A device for analyzing the behavior of the subject to identify his psychological characteristics through virtual reality technologies includes a virtual reality device, 1 which can be virtual reality glasses or a virtual reality helmet; closed-type headphones 2 and control device 3. At the same time, control device 3 is configured to exchange data with virtual reality device 1 and headphones 2. In embodiments, data exchange can be implemented via cable or via wireless technologies (for example, wi-fi). As a control device 3, a personal or specialized computer with pre-installed software can be used, including:

- a database of applications for modeling various situations for diagnosing personal qualities, which is an interactive environment made with the possibility of interacting with virtual elements and accompanying interactions with audiovisual effects;

- an application with a database of interactive elements, made with the possibility of embedding any element into a running application for simulating various situations, as well as with the ability to create interactive elements, also for subsequent integration into a running application for simulating various situations;

- a peripheral program for synchronizing the operation of the control device 3, virtual reality device 1 and headphones 2;

- visualization device 4 to display information transmitted to the virtual reality device 1;

- a control element 5, configured to make audiovisual changes during the operation of the application with a database for diagnosing personal qualities.

Additionally, a device for diagnosing personal qualities using virtual reality technologies includes a set of various sensors for measuring the spatial position of body parts and physiological parameters of a person (for example, sensors for measuring pulse and heartbeat, motion sensors for legs, arms, etc.), which are connected to the device. control 3 and are configured to display the measurement parameters of the sensors through the visualization device 4 in real time.

A method for analyzing the behavior of the subject to identify his psychological characteristics using virtual reality technologies, characterized in that the subject is put on a virtual reality device 1, headphones 2 and a set of sensors 6 is attached to it. Next, an application from the application database is launched on the control device 3 to simulate various situations for diagnosing personal qualities, then through the peripheral program, using control commands in the form of electrical signals, synchronized interactive audiovisual content is transmitted to the virtual reality device 1 and headphones 2. Thus, the subject perceives the audiovisual content through the virtual reality device 1 in the form of three-dimensional graphics, its animation and sound accompaniment. Further, depending on which application from the database for modeling various situations for diagnosing personal qualities, a certain stressful situation is simulated. Further, through the control device 3, the subject is given a command to start responding to a stressful situation. In embodiments, this command may be given automatically and programmed into a personality diagnostic application. Further, the subject, at his own discretion, makes decisions and performs actions with interactive virtual objects, depending on the simulated stressful situation. At the same time, the visualization device 4 displays information transmitted to the virtual reality device 1. At the same time, the sensors 6 in real time capture the spatial position of the body parts and the physiological parameters of the subject and also display on the visualization device 4. Analysis of the displayed information and indicators of sensors 6 in real time are carried out by specialized specialists, and its results depend on the specific decisions and actions of the subject. Further, specialized specialists, based on the analysis of real-time information received from the visualization device 4, correct or clarify the current conditions of the stress situation through the control element 5 or create new conditions of the stress situation by creating a unique interactive object. Further, information about the correction of the stressful situation from the control element 5 through the control device 3 is transmitted, by transmitting control commands in the form of electrical signals, to the virtual reality device 1 and headphones 2, where, according to the predefined algorithms of the application for diagnosing personal qualities, the interactive audiovisual content changes. Also, through the control element 5, specialized specialists can stop the diagnosis of the personal qualities of the subject at any time. In the embodiment, a specialized subroutine in the control device 3 automatically, in real time, analyzes the data received from the sensors 6 and, based on the analysis, issues recommendations to specialized specialists on correcting the conditions of the stressful situation. Thus, the process of diagnosing personal qualities includes an analysis of the behavior of the subject in a simulated stressful situation, taking into account dynamically changing conditions that are set by specialized specialists.

The technical result of the invention is an increase in the accuracy of diagnosing personal qualities is achieved due to the fact that in the course of diagnosing personal qualities, profile specialists dynamically change the content of audiovisual content by creating new interactive elements, followed by their transformation in the form of an electrical signal and transmission by means of control commands from the control element 5 through control device 3 to virtual reality device 1 and headphones 2. Thus, the choice of situations in the diagnostic process is not limited by the built-in algorithms of a particular test (the application in which it is launched), since a specialized specialist can independently create a virtual interactive element and introduce it into the process diagnostics of personal qualities. Thus, the restriction on the number of unique simulated situations within one test is removed, which helps to identify all the essential features of the subject's psyche and leads to an increase in the accuracy of diagnostics.

The applicant implemented the claimed method in 2021. During the implementation of the claimed method, the technical result of the invention was confirmed. Diagnostic accuracy increased by 40%.

An example of the implementation of the claimed method.

The subject arrives at the diagnostics of personal qualities to determine the possibility of getting a job, including the frequent occurrence of stressful situations (for example, a firefighter). Initially, the subject undergoes an initial fitness assessment and signs a voluntary agreement for diagnostics. Next, the subject puts on the virtual reality device 1 and headphones 2, and the command “Act as you see fit, according to the situation” is given from specialized specialists through the control device 3. After that, an application from the database of applications for diagnosing personal qualities is launched on the control device 3, and the subject begins to receive interactive audiovisual content. Interactive audiovisual content simulates a situation when an outsider is in a closed room and an explosion suddenly occurs (1st situation), in which case, having seen a virtual object in the form of a table, the subject hid under it, covering not only himself, but also the outsider . The profile specialists, having seen and analyzed the actions of the subject, through the control element 5, through the application with a database of interactive elements, change the conditions of the stressful situation and remove the virtual object "table", while simulating a fire situation in a room with an abandoned small child in the corner of the room (2 th situation). In this case, the subject attempted to get out of the room through the door. The profile specialists, having seen and analyzed the actions of the subject, again change the conditions of the stressful situation, and by means of an application with a database of interactive elements create an interactive “blockage” object in the user interface that blocks the path to the exit around the turn of the door, then add the “blockage” object to the simulated situation (3rd situation). In this case, the subject returns to the room and tries to get out of the window, while forgetting about the left small child. Profile specialists, after analyzing the readings of sensors 6, decide to stop the diagnostics. Next, specialists perform the process of identifying a person's primary instantaneous reaction to an external stimulus / critical situation, according to the following classification:

1) Physical (the subject saves his life first of all);

2) Emotional (the subject falls into hysterics, shows violent emotions, calls for help);

3) Volitional (the subject takes responsibility for others, shows leadership qualities, distributes roles to others, dictates his decision to others, acts to eliminate the threat);

4) Logical (the subject is inactive in a stupor, gives out a logical thought, passively analyzes the situation).

The analysis, according to the above classification, revealed the following: in the first situation, the subject showed a volitional instantaneous reaction (covered himself and an outsider with a table), the second and third situations, the subject showed a physical primary instantaneous reaction. At the same time, according to the results of the first and second situations, the specialized specialists could not make a final conclusion and they decided to create an additional interactive “blockage” element in the form of a dead end around the corner through the user interface in real time.

Based on the analysis, a decision is made to refuse employment of the subject as a fireman and offer him a vacancy as a clerk.

In the absence of dynamically changing conditions, the subject would show only a volitional instantaneous reaction (situation 1) and, with a high degree of probability, would be hired as a firefighter. Simulation of situations 2 and 3 showed that, despite the results of the reaction to the first situation, in most stressful situations, the subject still tends to show a physical instantaneous reaction, which is incompatible with the position of a fireman. Thus, thanks to the implementation of the claimed method, the accuracy of diagnosing the personal qualities of the subject was increased.

Claims (3)

1. A method for analyzing the behavior of a subject to identify his psychological characteristics using virtual reality technologies, characterized in that initially the subject is put on sensors for monitoring physiological parameters, as well as a device for virtual reality and headphones, to which electrical signals are transmitted from the control device by means of control commands, containing interactive audiovisual content that simulates a stressful situation, at the same time, data on the reaction of the subject and data from sensors are transmitted in the form of electrical signals to the visualization device, then, in the diagnostic process, the content of the audiovisual content is dynamically changed by creating new interactive elements containing audiovisual content, followed by converting them into an electrical signal and transmitting them by means of control commands from the control element through the control device to the virtual reality device and headphones, modifying thereby initiating the conditions of a stressful situation depending on the results of measurements of sensors for monitoring physiological parameters and the reaction of the subject by using a database of applications to simulate various situations for diagnosing personal qualities, which is an interactive environment made with the ability to interact with virtual elements and accompany interactions with audiovisual effects of the application with a database of interactive elements, made with the possibility of embedding any element into a running application for modeling various situations, with the possibility of creating interactive elements and subsequent integration into a running application for modeling various situations, providing access to the entire set of interactive elements to specialized specialists at any time from an application with a database of interactive elements, regardless of the initially launched application that modulates a stressful situation, and automatically automatic analysis in the control device in real time of data from sensors, as well as on the basis of the analysis of the issuance of recommendations to specialized specialists on correcting the conditions of a stressful situation. 2. The method according to claim 1, characterized in that the electrical signals of the control commands are transmitted via a cable. 3. The method according to claim. 1, characterized in that the electrical signals of the control commands are transmitted via a wireless communication network.

Images