RU2678300C1 - Multi-functional hardware and software device of automated assessing human psycho-emotional state - Google Patents

Abstract

FIELD: medicine.SUBSTANCE: invention relates to medical equipment. Multifunctional hardware-software device for automated assessment of a person’s psycho-emotional state contains a control unit for hardware-software device (1), the fixing platform of the first information retrieval device (2), the response panel of second information retrieval device (3), a separate third sensor for recording motor activity (4), a digital video camera with audio recording function (5) fixed on tripod (6), headphones of subject (7), operator’s headphones (11), monitor of person being examined (12), operator’s personal computer (8). Coordinator device of operator (10) and network power adapter (9) are connected to the inputs of the personal computer. Locking platform of the first information retrieval device contains two sensors for recording electrical activity parameters of the skin, two sensors for photoplethysmogram displayed on its surface, the first sensor for recording motor activity, a sensor for measuring body temperature, and an elastic belt attached to the platform with hook-and-loop fasteners for fixing the palm of the subject. Response panel of the second device for information retrieval contains the second sensor of motor activity and two feedback buttons "YES" and "NO" displayed on the surface.EFFECT: increase in the reliability and authenticity of the survey is achieved by automating the process and eliminating the human factor, integrated assessment of parameters with psycho-physiological indicators, reducing the stress level of the testing process, reducing the likelihood of exposure to the examined person of external sound stimuli that are not related to the presented stimulus.1 cl, 3 dwg

Description

The invention relates to the field of measuring equipment and instrumentation, in particular, to devices for medical and biological purposes for the diagnosis of the psychoemotional state of a person. The invention can be used in medicine, psychology, pedagogy, including when conducting research, in the activities of law enforcement agencies, special services, as well as in working with personnel, including in order to identify information that a person is hiding.

A device for conducting psychophysiological studies is known from the prior art (RF patent for utility model No. 14824, IPC АВВ 5/16, G06F 17/60, published September 10, 2000), which contains, in particular, a software unit - a computer microprocessor, a separate motor registration sensor activity, operator’s personal computer, information retrieval device. The information retrieval device comprises a skin-galvanic reaction sensor, a photoplethysmographic heart rate sensor, a motor activity recording sensor. In this case, the response panel of the information pickup device contains a voice response sensor - a microphone.

A disadvantage of the known device is the need for the subject to give an answer to the stimulus with his voice, which increases the likelihood of distortion of psychophysiological parameters and at the same time reduces the reliability and reliability of the survey results.

A lie detector is known from the prior art (RF patent for utility model No. 105819, IPC АВВ 5/16, А61М 21/00, published June 27, 2011) aimed at psychosounding and assessing the professional suitability of specialists based on test assessments of "sincerity-insincerity" with using an electronic computer (computer), as well as for special services. The known detector contains, in particular, a psychostimulation unit with a psychostimulation control panel, an analyzer of responses to psychostimulation, headphones of the subject, a computer, a monitor of the subject, a duplicate operator’s monitor, and a microphone for feedback.

A disadvantage of the known device is the presentation of a stimulus to the examined person with the participation of the operator, due to which the influence of the human factor associated with the peculiarities of the phonetic perception of the examined person, as well as with the possible emotional involvement of the operator, which can lead to a decrease in the reliability of the examination results, cannot be ruled out.

The prior art device for assessing the psycho-emotional state of a person (RF patent for utility model No. 107482, IPC A61M 21/00, published 08/20/2011), designed to diagnose the condition of a living organism by the electrical conductivity of the skin and providing an assessment of the psycho-emotional state of a person. In the known device, registration and assessment of the electrical conductivity of the skin is carried out.

A disadvantage of the known device is that it is not possible to register and evaluate other indicators of the psycho-emotional state of a person, which significantly reduces the reliability of the results.

The prior art device for monitoring and evaluating physiological processes (RF patent for the invention No. 2378984, IPC A61B 5/0205, A61B 5/16, A61B 5/0432, G06F 19/00, published January 20, 2010). The known device is intended for registration and evaluation of fast-flowing physiological reactions that occur in response to the presented stimuli. The device registers and evaluates the parameters of electrical activity of the skin, chest breathing, abdominal breathing, blood pressure, cardiovascular activity, motor activity of a person, including facial expressions. The facial expression sensor is designed to record indicators of the motor activity of the muscles of the face of a person (there is movement or not movement, but nothing more).

A disadvantage of the known device is that it does not provide for the possibility of recording and evaluating the sensorimotor reaction, as well as characteristic changes on the person’s face, depending on the emotions experienced by him, which reduces the effectiveness of its use in order to identify information hidden by a person.

The closest analogue adopted for the prototype is a device for psychological and psychophysiological analysis (RF patent for the invention No. 77149, IPC AB 5/16, published on 10/20/2008). The purpose of the known device is to automate experimental research using psychological analysis based on projective techniques and questionnaire tests, a psychophysiological analysis with synchronous registration of physiological signals when a person is identified, in particular, information that is hidden by him during the selection and verification of a hired or working staff or during the investigation of offenses. The known device contains, in particular, a microcontroller, a block of sensors and electrodes, a touch monitor tablet (as a device for the automated input of information of a test person), a personal computer with a video monitor of the operator and an input / output port, a portable video monitor of the examined person. In this case, the device comprises a skin-galvanic reaction sensor in the form of two electrodes and a photoplethysmogram sensor.

A disadvantage of the known device is the need to place sensors and electrodes that record physiological parameters on different parts of the body of the subject, which to some extent increases the level of discomfort and stressfulness of the testing process, as a result of which the reliability of the examination results can be reduced.

The claimed invention is directed to the diagnosis of the psychoemotional state of a person with automated synchronous presentation of visual and auditory stimuli to him, by recording the parameters of the electrical activity of the skin, changes in cardiovascular activity, respiratory system, psychomotor and motor activity of a person, followed by automated analysis and evaluation of the results.

The technical result of the claimed invention is a significant increase in the reliability and reliability of the examination due to:

- automation of the process and elimination of the human factor,

- a comprehensive assessment of parameters with psychophysiological indicators,

- reduce the stress of the testing process,

- use in the testing process of the headphones of the subject, which reduces the likelihood of exposure to the subject of external sound stimuli that are not related to the presented stimulus.

The essence of the claimed invention lies in the fact that the multifunctional hardware-software device for automated assessment of the psycho-emotional state of a person contains a control unit for a hardware-software device, to the inputs of which the connecting platform of the first information pickup device, the response panel of the second information pickup device, are connected with their outputs separate sensor for recording motor activity, digital video camera with audio recording function, fixation Mounted on a desktop tripod, the headphone of the person being examined is connected to the output of the control unit of the hardware-software device, and the operator’s personal computer is connected with the possibility of two-way communication, and the operator’s personal computer, to the inputs of which the operator’s coordinator device and network power adapter are connected , and the operator’s headphones and a portable monitor of the examined person are connected to the outputs with their inputs, and the device’s fixing platform with The information acquisition contains two sensors for recording skin electrical activity parameters, two photoplethysmogram sensors, a sensor for detecting motor activity, a sensor for measuring body temperature, and an elastic strap with Velcro fasteners attached to the fixing platform of the information acquisition device for fixing the palm of the person being examined and the response panel of the information pickup device contains a motor activity sensor and two feedback buttons “YES” and “NO” displayed on the surface.

The invention is illustrated by the following graphic materials.

In FIG. 1 shows the functional connections of the control unit of the hardware and software device BU APU, where 1 is the control unit of the hardware and software device BU APU, 2 is the first information retrieval device at SI No. 1, 3 is the second information retrieval device USI No. 2, 4 is a separate third motor activity detection sensor DDA No. 3, 5 - a digital video camera VK with audio recording function, 6 - a desktop tripod ШТ, 7 - headphones of an examined person Н No. 2, 8 - personal computer of a PC operator, 9 - network power adapter CA, 10 - coordinating device opera KU, 11 - headphone operator N No. 1, 12 - portable monitor of the examined person PM.

In FIG. Figure 2 shows the first data pickup device for ASI No. 1 with sensors brought to the surface of its fixing platform, where 13 is the first sensor for recording electrical skin activity parameters EAK No. 1, 14 is the second sensor for recording electrical skin activity parameters for EAK No. 2, 15 is the first photoplethysmogram sensor FPG No. 1, 16 - the second sensor of the photoplethysmogram FPG No. 2, 17 - the first sensor of registration of motor activity DDA No. 1, 18 - the sensor for measuring body temperature DIT, 19 - elastic belt.

In FIG. Figure 3 shows the second data pickup device of the ASI No. 2 with sensors displayed on its response panel, where 20 is the second motor activity sensor ДДА No. 2, 21 is the feedback button "YES", 22 is the feedback button "NO".

The invention consists of a control unit for a hardware-software device BU APU 1, a first information retrieval device USI No. 1-2, a second information retrieval device USI No. 2-3, a separate third sensor for recording motor activity DCA No. 3-4, a digital video camera VK 5 s audio recording function, ShT 6 desktop tripod, subject headphone Н No. 2-7, personal computer of PC 8 operator, power adapter CA 9, coordinator device of KU 10 operator for cursor control and issuing various commands personally The computer operator pc 8 ( "computer mouse"), the operator H headphone №1-11 and portable monitor of the subject 12 PM.

The first information retrieval device 2 (ASI No. 1) has a fixing platform with sensors for detecting skin electrical activity parameters in the amount of two pieces 13 and 14 (EAA No. 1 and EAA No. 2), photoplethysmogram sensors in the amount of two pieces 15 and 16 (FPG No. 1 and FIG No. 2), the first sensor for detecting motor activity 17 (DDA No. 1), a temperature measuring sensor 18 (DIT), and also an elastic belt 19 with Velcro fasteners attached to the platform.

The second information retrieval device 3 (ASI No. 2) has a response panel with two feedback buttons 21 and 22 displayed on its surface, and a second motor activity sensor 20 (DDA No. 2).

Using the connecting cable, the fixing platform of the first information pickup device 2 (USI No. 1) is connected to the control unit of the hardware-software device 1 (ACU APU), the response panel of the second information pickup device 3 (USI No. 2) is connected using the connecting cable connecting cable a separate sensor for detecting motor activity 4 (DDA No. 3) is connected, using a connecting cable, a digital video camera 5 (VK) fixed on a table stand 6 (SHT) with an audio recording function is connected, with and connecting cable are connected headphones the subject 7 (H №2), via a connecting cable to connect a personal computer operator 8 (PC).

In this case, information is transmitted unilaterally:

- from the first information retrieval device 2 (USI No. 1) to the control unit of the hardware-software device 1 (BU APU),

- from the second information retrieval device 3 (USI No. 2) to the control unit of the hardware-software device 1 (BU APU),

- from a separate sensor of registration of motor activity 4 (DDA No. 3) to the control unit of the hardware-software device 1 (BU APU),

- from a digital video camera 5 (VK) to the control unit of the hardware-software device 1 (BU APU),

- from the control unit of the hardware-software device 1 (BU APU) to the headphones of the subject 7 (N No. 2).

Information is transmitted between the operator’s personal computer 8 (PC) and the control unit of the hardware-software device 1 (ACU control unit) in a two-way manner.

To the operator’s personal computer 8 (PC) with the help of connecting cables, a portable monitor of the examined person 12 (PM), earphones of the operator 11 (H No. 1), coordinator device 10 (KU) and the power supply adapter 9 (CA) are connected.

In this case, information is transmitted unilaterally:

- from the personal computer of the operator 8 (PC) to the portable monitor of the subject 12 (PM),

- from the personal computer of the operator 8 (PC) to the headphones of the operator 11 (H No. 1),

- from the coordinator device 10 (KU) to the personal computer of the operator 8 (PC).

The power is transmitted unilaterally from the mains via the power adapter 9 (CA) to the personal computer of the operator 8 (PC).

Operator’s personal computer 8 (PC) provides the operator with the input of the hardware and software device for the necessary information, including stimulus material for the subject, provides visual online monitoring by the operator of the testing process, which makes it possible for the operator to examine the data obtained during testing.

The coordinator device 10 (KU), in particular, the "computer mouse", increases the convenience of the operator with a personal computer 8 (PC).

The operator’s headphone 11 (H # 1) allows the operator to hear stimulus material that is presented to the person being examined.

The power adapter 9 (CA) converts alternating current into direct current and thereby provides power to both the personal computer of operator 8 (PC) and the entire hardware-software device as a whole.

The portable monitor of the subject 12 (PM) provides the necessary information and visual stimuli presented to the subject on the screen during testing.

The headphones of the examined person 7 (N No. 2) provide the opportunity to hear the audible stimuli presented to the examined person.

The fixing platform of the first data pickup device 2 (USI No. 1) with dimensions of 300 mm × 230 mm × 30 mm (length × width × height) is a horizontal surface with ergonomic recesses under the left palm, with sensors for detecting skin electrical activity parameters displayed on its surface in the amount of two pieces: the first sensor for recording parameters of the electrical activity of the skin 13 (EAA No. 1) and the second sensor for recording the parameters of electrical activity of the skin 14 (EAA No. 2), photoplethysmogram sensors in the amount of two pieces : the first photoplethysmogram sensor 15 (FPG No. 1) and the second photoplethysmogram sensor 16 (FPG No. 2), the body temperature measuring sensor 18 (DIT), the first motor activity recording sensor 17 (DDA No. 1), and the elastic strap 19 attached to the platform with Velcro fasteners designed to properly secure the subject’s palm. The first information retrieval device 2 (USI No. 1) provides registration during the testing of parameters of the electrical activity of the skin, changes in cardiovascular activity, respiratory system, temperature and motor activity of the subject.

The response panel of the second information pickup device 3 (USI No. 2) with dimensions of 100 mm × 70 mm × 30 mm (length × width × height) represents a coordinate device resembling a “computer mouse” with two buttons on the surface of the subject’s index and middle fingers - feedback button "YES" 21 and feedback button "NO" 22, respectively.

The second sensor of registration of motor activity 20 (DDA No. 2) with dimensions of 300 mm × 300 × 10 mm (length × width × height) is a horizontal surface that allows you to record the parameters of the motor activity of the subject during testing.

A digital video camera 5 with an audio recording function fixed on a desktop tripod provides video and audio recording of the testing process.

The control unit for the hardware-software device 1 (APU control unit) is a technical device that provides synchronous operation of the hardware-software device, processes incoming information in a special way, after which it is displayed on the screen of a personal computer (PC).

Operator or specialist - a person making a diagnosis.

The test person or subject is a person whose psycho-emotional state is diagnosed.

A multifunctional hardware-software device for automated assessment of the psycho-emotional state of a person works as follows.

Before testing, the operator, using the keyboard of a personal computer 8 (PC) and the coordinator device 10, in particular, a “computer mouse”, forms a testing program by using ready-made templates or entering questions (incentives) for the person being examined. With the help of a special program, these textual questions are also converted into speech, which the test person will hear in the headphones 7 (Н No. 2) during testing.

The examined person is located on a chair, on the seat of which there is a third motor activity sensor 4 (DDA No. 3).

The examined person puts on headphones 7 (N No. 2).

The portable monitor of the subject 12 (PM) is located on the table in front of the subject, and behind him on the table tripod 6, which is higher in height than the height of the portable monitor of the subject 12, is a digital video camera 5.

The operator helps the subject to correctly position the palm of his left hand on the fixing platform of the first information pick-up device 2 (USI No. 1), which is located to the left of the portable monitor of the subject 12, and then fixes it with an elastic strap 19 with a Velcro fastener.

The examined person has the right hand on the response panel of the second information pickup device 3 (ASI No. 2) located to the right of the portable monitor of the examined person 12.

All the instructions about the necessary actions in the process of testing, the subject sees on the screen of a portable monitor of the subject 12 and synchronously hears through the headphones of the subject 7 (N No. 2). At the same time, he is not required to give verbal answers to the questions (incentives) presented during the testing process, but rather, in response, press the buttons on the answer panel with the index and middle fingers of the right hand. Pressing the feedback button 21 with the index finger implies the answer “YES”, the feedback button 22 with the middle finger - the answer “NO”.

In the online testing process, the data received from the sensors 13, 14, 15, 16, 17, 18 and the digital video camera 5, after processing in the control unit of the hardware-software device 1, are displayed as an integral indicator on the screen of the operator’s personal computer 8 (PC ) The integral indicator is displayed in the dynamics of its changes, consists of green, yellow and red colors. The color of the integral indicator changes depending on changes in the psychoemotional state of the subject. Green color characterizes the individual relative stabilization in the channels of information retrieval from the subject as a background. Yellow color characterizes the fixation of changes in the psycho-emotional state of the examined person as different from the background. Red color characterizes the fixation of changes in the psychoemotional state of the subject as significantly different from the background. Each subsequent stimulus is presented according to a sequence predefined by the operator, but at the same time, the moment of the beginning of presentation of each subsequent stimulus is determined automatically, without the participation of the operator, and only at that moment when the psychoemotional state of the person being examined is relatively stabilized and assessed as background. During testing, the operator has the opportunity to see on the screen of a personal computer 8 (PC) a video image of the subject being examined, the presented stimuli in text form, as well as each data acquisition channel in a graphical display. If the operator wears headphones 11 (H # 1), then he can also hear the presented stimuli.

After testing, the operator has the opportunity to see the final conclusions of the automated calculation of the psycho-emotional state of the person being examined upon presentation of each stimulus on the personal computer of operator 8 (PC) in tabular form and print these data.

Advantages of the invention:

1. In the testing process, each stimulus is presented automatically, without the participation of the operator, at the moment when the psycho-emotional state of the person being examined is relatively stabilized and assessed as background. This completely eliminates the possible mistake of a specialist related to untimely presentation of the stimulus. Thus, the reliability of the survey results increases significantly.

2. During the testing process, visual and auditory stimuli are presented to the person being examined synchronously, while the auditory stimulus is presented by an emotionally impersonal voice modeled by the software of the hardware-software device. This completely eliminates the “human factor” associated with the characteristics of the phonetic perception of the subject, as well as with the possible emotional involvement of the operator upon presentation of the stimulus, which may be reflected in the temporal unevenness of his speech, semantic and acoustic emphasis. Thus, the reliability of the survey results increases significantly.

3. Along with the removal of psychophysiological indicators, a hardware-software device provides for synchronous registration of the psychomotor response of the examined person in response to the presented stimuli. The latent time, duration and strength of pressing by the subject of the buttons on the answer block is recorded and evaluated. Mimic non-verbal changes in the face of the examined person are recorded and evaluated in response to the presented stimulus. Given a comprehensive assessment of these parameters with psychophysiological indicators, the reliability of the survey results will increase significantly.

4. There is no need for the subject to give an answer to the stimulus by voice, which reduces the likelihood of distortion of psychophysiological indicators and at the same time increases reliability and increases the reliability of the survey results.

5. The location of a number of psychophysiological sensors on the fixing platform of the first information retrieval device (ASI No. 1) reduces the possibility of distortion of psychophysiological indicators as a result of the motor activity of the person being examined, which accordingly also increases reliability and increases the reliability of the examination results.

6. The absence of sensors on the body and head of the subject to a certain extent reduces the level of discomfort and stressfulness of the testing process, which will positively affect the reliability and quality of the test results.

7. The use of headphones of the examined person during testing reduces the likelihood of exposure to the examined person of external sound stimuli that are not related to the presented stimulus, which significantly increases the reliability of the examination results.

Thus, the invention provides a significant increase in the reliability and reliability of the examination due to the automation of the process and the elimination of the human factor, a comprehensive assessment of parameters with psychophysiological parameters, reducing the stress of the testing process, reducing the likelihood of exposure to the examined person of external sound stimuli that are not related to the presented stimulus.

The present invention can be industrially implemented using standard technical means.

Claims (4)

A multifunctional hardware-software device for automated assessment of the psycho-emotional state of a person, containing a control unit for a hardware-software device, to the inputs of which the connecting platform of the first information retrieval device, the response panel of the second information retrieval device, a separate third motor activity registration sensor are connected with their outputs digital video camera with audio recording function, fixed on a table tripod, to the output of the unit the board with a hardware-software device connected to the input of the headphone of the subject, and also with the possibility of two-way communication connected to the personal computer of the operator, and the operator’s personal computer, to the inputs of which the coordinator device of the operator and the network power adapter are connected with their outputs, and the headphones of the operator and a portable monitor of the person being examined are connected to the outputs by their inputs, moreover, the fixing platform of the first information pickup device contains two sensors for detecting skin electrical activity parameters, two photoplethysmogram sensors, a first sensor for detecting motor activity, a body temperature measuring sensor and an elastic strap with Velcro fasteners attached to the fixing platform of the information pickup device for fixing the palm of the person being examined, and the response panel of the second information pickup device contains a second motor activity sensor and two feedback buttons “YES” and “NO” displayed on the surface.

Images