JP6888789B2 - EEG measurement system, EEG measurement method, program, and non-temporary recording medium - Google Patents

Description

The present disclosure generally relates to electroencephalogram measurement systems, electroencephalogram measurement methods, programs, and non-temporary recording media. More specifically, an electroencephalogram measurement system, an electroencephalogram measurement method, a program, and a non-temporary electroencephalogram measurement system that acquires electroencephalogram information representing an electroencephalogram collected at an electrode portion arranged at a measurement point that is a part of the subject's head. Regarding recording media.

Conventionally, a technique for utilizing the brain wave information of a subject has been proposed.

As an example, Patent Document 1 discloses a technique for estimating the listening experience of a musical piece based on an electroencephalogram measured at the time of listening to the musical piece by a subject (subject). In the technique described in Patent Document 1, the brain wave of a subject listening to a music whose listening experience is unknown is measured to acquire brain wave information (subject brain wave data), and the first feature obtained from the brain wave information is obtained. Using the results of collation with the model EEG pattern, it is estimated whether or not the music has been listened to.

In Patent Document 1, the parameters (model brain wave pattern) used for analyzing the brain wave information are the average power calculated from the brain wave of the subject when listening to the known music and the average calculated from the brain wave of the subject when listening to the unknown music. Determined based on the difference from power.

However, in Patent Document 1, when any of the brain wave information used for determining the parameter contains, for example, an artifact (noise), a relatively large error occurs in the parameter, resulting in a result. Therefore, the measurement accuracy of brain waves may decrease.

Japanese Unexamined Patent Publication No. 2017-42562

The present disclosure has been made in view of the above reasons, and an object of the present invention is to provide an electroencephalogram measurement system, an electroencephalogram measurement method, a program, and a non-temporary recording medium capable of suppressing a decrease in accuracy of electroencephalogram measurement.

The electroencephalogram measurement system according to one aspect of the present disclosure includes an acquisition unit, a storage unit, an input unit, and a processing unit. The acquisition unit acquires electroencephalogram information representing an electroencephalogram collected at an electrode unit arranged at a measurement point that is a part of the subject's head. The storage unit stores a plurality of the electroencephalogram information acquired by the acquisition unit. The input unit receives from the operation unit a designated signal that specifies one or more electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit. The processing unit executes a calibration process for determining parameters used for analysis of the electroencephalogram information based on the one or more electroencephalogram information designated by the designated signal. The input unit executes a redesignation process for receiving the designated signal after the processing unit executes the calibration process. The processing unit re-executes the calibration process based on one or more electroencephalogram information designated by the designated signal received by the input unit in the redesignation process.

The electroencephalogram measuring method according to one aspect of the present disclosure acquires brain wave information representing an electroencephalogram collected at an electrode portion arranged at a measurement point which is a part of a subject's head, and has a plurality of electroencephalogram information in a storage portion. Memorize brain wave information. Further, in this electroencephalogram measuring method, a designated signal for designating one or more electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit is received from the operation unit. Further, in this electroencephalogram measurement method, a calibration process for determining parameters used for analysis of the electroencephalogram information is executed based on the one or more electroencephalogram information designated by the designated signal. In this electroencephalogram measurement method, after executing the calibration process, a redesignation process for receiving the designated signal is executed, and based on one or more brain wave information designated by the designated signal in the redesignation process, the electroencephalogram is measured. The calibration process is executed again.

The program according to one aspect of the present disclosure is a program for causing a computer system to execute the above-mentioned electroencephalogram measurement method.

The non-temporary recording medium according to one aspect of the present disclosure is a non-temporary recording medium readable by a computer system in which a program for causing the computer system to execute the electroencephalogram measurement method is recorded.

The electroencephalogram measurement system according to one aspect of the present disclosure includes a display control unit, an input unit, and a processing unit. The display control unit causes the display unit to display a plurality of brain wave information. The input unit receives from the operation unit a designated signal that specifies one or more electroencephalogram information from the plurality of electroencephalogram information. The processing unit executes a calibration process for determining parameters used for analysis of the electroencephalogram information based on the one or more electroencephalogram information designated by the designated signal. The input unit executes a redesignation process for receiving the designated signal after the processing unit executes the calibration process. The processing unit re-executes the calibration process based on the one or more electroencephalogram information designated by the designated signal received by the input unit in the redesignation process.

FIG. 1 is a schematic view showing a usage state of the electroencephalogram measurement system according to the first embodiment and the rehabilitation support system provided with the electroencephalogram measurement system. FIG. 2 is a schematic front view showing a usage state of the headset of the above-mentioned electroencephalogram measurement system. FIG. 3 is a block diagram showing the configurations of the above-mentioned electroencephalogram measurement system and rehabilitation support system. FIG. 4 is an explanatory diagram showing an example of a training screen of the above-mentioned electroencephalogram measurement system. FIG. 5 is an explanatory diagram showing an example of the setting screen of the above-mentioned electroencephalogram measurement system. FIG. 6 is a graph for explaining a method of determining a threshold value for the activation level of the above-mentioned electroencephalogram measurement system. FIG. 7 is an explanatory diagram showing an example of the calibration screen of the above-mentioned electroencephalogram measurement system. FIG. 8 is an explanatory diagram showing an example of the selection screen of the above-mentioned electroencephalogram measurement system. FIG. 9 is an explanatory diagram showing an example of the calibration result screen of the above-mentioned electroencephalogram measurement system. FIG. 10 is a flowchart showing the calibration process of the above-mentioned electroencephalogram measurement system.

(Embodiment 1)
(1) Outline An outline of the electroencephalogram measurement system 10 according to the present embodiment will be described with reference to FIGS. 1 and 2.

The electroencephalogram measurement system 10 according to the present embodiment is a system for measuring the electroencephalogram of the subject 5, and is an electrode portion 11 arranged at a measurement point 51 which is a part of the head 52 of the subject 5. Acquires electroencephalogram information representing the collected electroencephalogram. The "electroencephalogram" (EEG) referred to in the present disclosure means a waveform obtained by deriving an electrical signal (action potential) emitted by a nerve cell (group) of the cerebrum to the outside of the body and recording it. In the present disclosure, unless otherwise specified, the overall action potentials of a large number of neurons (nerve network) in the cerebral cortex are targeted and recorded using an electrode portion 11 attached to the body surface. Is called "brain wave".

The electroencephalogram measurement system 10 includes a headset 1 having an electrode portion 11 and an information processing device 2. The headset 1 is attached to the head 52 of the subject 5 in a state where the electrode portion 11 is in contact with the surface (scalp) of the head 52 of the subject 5. In the present disclosure, the electrode portion 11 comes into contact with the surface of the head 52 by being placed on a paste (electrode glue) applied to the surface of the head 52. At this time, the electrode portion 11 comes into contact with the surface of the head 52 without passing through the hair by scraping the hair. Of course, the electrode portion 11 may come into direct contact with the surface of the head portion 52 without applying the paste. That is, in the present disclosure, "contacting the electrode portion 11 with the surface of the head 52" means that the electrode portion 11 is brought into direct contact with the surface of the head 52, and the electrode portion 11 is brought into contact with the surface of the head 52 via an intermediate. It also includes indirect contact with the surface of the head 52. The intermediate is not limited to the paste, and may be, for example, a conductive gel.

The headset 1 measures the electroencephalogram of the subject 5 by measuring the action potential of the brain of the subject 5 at the electrode unit 11, and generates electroencephalogram information representing the electroencephalogram. The headset 1 transmits brain wave information to the information processing device 2 by, for example, wireless communication. The information processing device 2 performs various processes on the electroencephalogram information acquired from the headset 1 and displays the electroencephalogram information.

In the present embodiment, the case where the electroencephalogram measurement system 10 is used in the rehabilitation support system 100 for supporting the rehabilitation of the subject 5 will be described. That is, the rehabilitation support system 100 includes the electroencephalogram measurement system 10 according to the present embodiment. The rehabilitation support system 100 further includes an exercise assist device 3 and a control device 4. The exercise assisting device 3 is a device that assists the exercise of the subject 5 by adding at least one of a mechanical stimulus and an electrical stimulus to the subject 5. The control device 4 controls the exercise assist device 3 based on the electroencephalogram information acquired by the electroencephalogram measurement system 10.

The rehabilitation support system 100 supports rehabilitation by exercise therapy, for example, for a person who has motor paralysis or a decrease in motor function in a part of the body due to a brain disease such as a stroke or an accident. In such a subject 5, the voluntary movement, which is an exercise performed by the subject 5 based on his / her own intention or intention, may not be satisfactory due to inability or deterioration of its function. The "exercise therapy" referred to in the present disclosure refers to a disorder caused by exercising a part of the body of the subject 5 in which such voluntary movement is impossible or a function is deteriorated (hereinafter referred to as "disordered part"). It means a method of recovering the function of voluntary movement for a part.

In this embodiment, a case where the rehabilitation support system 100 is used for rehabilitation of the left finger 53 (left finger) of the subject 5 is illustrated. That is, in the subject 5 in this case, the left finger is the disordered part. However, not limited to this example, the rehabilitation support system 100 may be used for rehabilitation of the right finger of the subject 5, for example.

In the rehabilitation support system 100, when the subject 5 performs a voluntary movement with the left finger 53, the exercise assist device 3 attached to the subject 5's left hand provides mechanical stimulation and electricity to the subject 5's left hand. Assist voluntary movements by adding at least one of the stimuli. As a result, for example, in the same manner as when a medical staff such as a physical therapist or an occupational therapist assists the voluntary movement of the subject 5 by holding the fingers 53 of the subject 5, the voluntary movement is performed by the rehabilitation support system 100. Assistance becomes possible. Therefore, according to the rehabilitation support system 100, it is possible to realize rehabilitation by exercise therapy, which is more effective than the case where the subject 5 performs voluntary exercise alone, as in the case where the medical staff assists.

By the way, in order to support the rehabilitation as described above, the rehabilitation support system 100 may assist the voluntary movement of the subject 5 with the exercise assist device 3 when the subject 5 intends to perform the voluntary movement. desirable. The rehabilitation support system 100 interlocks the exercise assisting device 3 with the brain waves (brain wave information) of the subject 5 measured by the brain wave measuring system 10, so that the subject 5 assists the exercise when he / she intends to perform a voluntary movement. The assistance of the voluntary movement in the device 3 is realized. In other words, the rehabilitation support system 100 uses the brain-machine interface (BMI) technology to operate the machine (exercise assist device 3) using brain activity (brain waves). Achieve therapeutic rehabilitation.

When the subject 5 performs a voluntary movement (that is, in the process of the subject 5 performing the voluntary movement), a characteristic change in the brain wave may occur. That is, when the subject 5 intends (remembers) to perform the voluntary movement, activation of the brain region corresponding to the target portion of the voluntary movement may occur. An example of such a brain region is the somatosensory motor cortex. More effective rehabilitation can be expected by assisting the voluntary movement of the subject 5 with the exercise assisting device 3 at the timing when such activation of the brain region occurs. Such activation of brain regions can be detected as a characteristic change in EEG. Therefore, the rehabilitation support system 100 assists the voluntary movement of the subject 5 with the exercise assisting device 3 at the timing when this characteristic change occurs in the brain wave of the subject 5. Such characteristic changes in EEG can occur when the subject 5 images the voluntary movement (that is, during an exercise attempt) even if the voluntary movement is not actually performed. In other words, such characteristic changes in EEG can be seen if the corresponding brain region is activated by the intention (remembering) of the subject 5 to perform the voluntary movement even if the voluntary movement is not actually performed. Can occur. Therefore, the rehabilitation support system 100 can assist the voluntary movement even for the subject 5 who cannot perform the voluntary movement.

According to the rehabilitation support system 100 having such a configuration, it is possible to realize effective rehabilitation by exercise therapy in the subject 5 while reducing the burden on the medical staff. Further, according to the rehabilitation support system 100, for example, the timing of assisting the voluntary movement does not vary due to human factors such as the skill level of the medical staff who assists the voluntary movement of the subject 5, and the effect of the rehabilitation varies. Is reduced. In particular, in the rehabilitation support system 100, it is possible to assist the voluntary movement of the subject 5 at the timing when the characteristic change in the brain wave occurs (that is, the timing when the brain region is actually activated). As described above, in the rehabilitation support system 100, since training can be performed in accordance with the timing of brain activity, it can be expected to contribute to learning and establishment of correct brain activity. In particular, it is difficult for the subject 5 and the medical staff alone to determine whether or not a characteristic change has occurred in the brain wave. Therefore, by using the rehabilitation support system 100, effective rehabilitation that is difficult to realize only by the subject 5 or the medical staff becomes possible.

In the present embodiment, when the subject 5 uses the rehabilitation support system 100, a medical staff such as a physical therapist or an occupational therapist accompanies the subject 5, and the medical staff performs the operation of the rehabilitation support system 100 and the like. Suppose that. However, it is not essential for the medical staff to accompany the target person 5 who uses the rehabilitation support system 100. For example, the target person 5 or the target person 5's family may operate the rehabilitation support system 100.

By the way, the electroencephalogram measurement system 10 according to the present embodiment may occur when the subject 5 performs a voluntary movement in the above-mentioned rehabilitation support system 100 (that is, when the subject 5 intends to perform a voluntary movement). ) Used to detect brain waves containing characteristic changes. The details will be explained in the column of "(2) Rehabilitation support system", but the electroencephalogram measurement system 10 changes the intensity of a specific frequency band generated in the electroencephalogram due to the occurrence of event-related desynchronization (ERD). , Detected as a characteristic change. The "event-related desynchronization" referred to in the present disclosure means a phenomenon in which the power of a specific frequency band decreases in an electroencephalogram measured near the motor field during voluntary movement (including recall of voluntary movement). The term "at the time of voluntary movement" as used in the present disclosure means the process from the time when the subject 5 intends (remembers) the voluntary movement to the success or failure of the voluntary movement. "Event-related desynchronization" can occur during this voluntary movement, triggered by the intention (recollection) of the voluntary movement. The frequency bands in which the power is reduced due to event-related desynchronization are mainly α waves (for example, frequency bands of 8 Hz or more and less than 13 Hz) and β waves (for example, frequency bands of 13 Hz or more and less than 30 Hz).

However, the frequency band in which the power is reduced due to event-related desynchronization, the amount of power reduction, etc. are not uniform. For example, the attributes (age, gender, etc.) of the subject 5, the location of the disorder, the state of the disorder, and individual differences. It varies depending on the factors. Therefore, the electroencephalograms to be detected by the electroencephalogram measurement system 10 (electroencephalograms including characteristic changes that may occur when the subject 5 intends to perform a voluntary movement) are not uniformly determined, and vary depending on the subject 5. It can take the form. Therefore, the electroencephalogram measurement system 10 is configured to perform an electroencephalogram information analysis, that is, a calibration process for determining various parameters used for detecting an electroencephalogram to be detected.

Here, if the brain wave information includes an artifact, the measurement accuracy of the brain wave may decrease. The "artifact" referred to in the present disclosure means a phenomenon other than the electroencephalogram mixed in the electroencephalogram information acquired by the electroencephalogram measurement system 10, and is a noise component for the electroencephalogram. Examples of artifacts mixed in the electroencephalogram information include components caused by eye movements such as blinking, and components caused by body movements and facial muscle movements such as tooth biting or neck movement. When the calibration process is executed using the brain wave information mixed with this kind of artifact, the calibration process is performed with the measurement accuracy of the brain wave lowered due to the artifact, and the accuracy of the parameter is lowered. To do. Therefore, in order to accurately determine the parameters, it is preferable that the electroencephalogram measurement system 10 executes the calibration process using the electroencephalogram information that does not include the artifact.

The electroencephalogram measurement system 10 according to the present embodiment has a function of determining the presence or absence of an artifact based on the electroencephalogram information acquired from the electrode unit 11 and outputting the determination result. Examples of the output mode of the determination result include display, audio output, printout (printing), writing to a non-temporary recording medium, transmission to an information terminal, and the like. Therefore, since the presence or absence of an artifact can be determined from the output determination result, for example, by excluding the electroencephalogram information mixed with the artifact, it is possible to suppress a decrease in the accuracy of the electroencephalogram measurement due to the artifact. As described above, in the electroencephalogram measurement system 10, the determination result of the presence or absence of the artifact is output, so that the calibration process using only the electroencephalogram information that does not include the artifact becomes possible. As a result, in the electroencephalogram measurement system 10, the processing load of the processing unit 215 that executes the calibration process can be reduced.

(2) Rehabilitation Support System The rehabilitation support system 100 according to the present embodiment will be described in more detail below.

As shown in FIG. 1, the rehabilitation support system 100 includes an electroencephalogram measurement system 10, an exercise assist device 3, and a control device 4.

As described above, in the present embodiment, the electroencephalogram measurement system 10 includes a headset 1 and an information processing device 2.

As shown in FIG. 2, the headset 1 is attached to the head 52 of the subject 5. The headset 1 has an electrode portion 11. The electrode portion 11 is arranged at the measurement point 51, which is a part of the head 52 of the subject 5. Specifically, in the headset 1, the subject is in contact with the electrode portion 11 at the measurement point 51 set on a part of the surface (scalp) of the head 52 of the subject 5. The brain waves of 5 are measured, and brain wave information representing the brain waves is generated.

The information processing device 2 mainly includes a computer system such as a personal computer. The information processing device 2 receives the electroencephalogram information from the headset 1 by, for example, wireless communication, and executes various processes on the electroencephalogram information. In the present embodiment, the information processing apparatus 2 performs detection of brain waves including characteristic changes that may occur when the subject 5 intends (remembers) to perform a voluntary movement, calibration processing, and the like.

When the subject 5 intends (remembers) to perform a voluntary movement, an electroencephalogram including a characteristic change is usually generated in the motor cortex corresponding to the part of the body in which the voluntary movement is performed. Therefore, the electroencephalogram measurement system 10 measures the electroencephalogram collected from the vicinity of the motor cortex corresponding to the injured site which is the target of rehabilitation. Here, the motor cortex corresponding to the left finger is on the right side of the brain, and the motor cortex corresponding to the right finger is on the left side of the brain. Therefore, when the left finger 53 of the subject 5 is targeted for rehabilitation as in the present embodiment, the brain wave acquired by the electrode portion 11 brought into contact with the right side of the head 52 of the subject 5 is generated. It is a measurement target in the electroencephalogram measurement system 10. That is, as shown in FIG. 2, the electrode portion 11 is arranged on the measurement point 51 formed of a part of the right surface of the head 52 of the subject 5. As an example, the electrode portion 11 is arranged at the position represented by the electrode symbol “C4” in the International 10-20 Law. When the right finger of the subject 5 is to be rehabilitated, the measurement point consisting of a part of the left surface of the head 52 of the subject 5, for example, the electrode symbol "C3" in the International 10-20 Law. The electrode portion 11 is arranged at the represented position.

When the electroencephalogram measurement system 10 detects an electroencephalogram including a characteristic change that may occur when the subject 5 intends to perform a voluntary movement, the brain wave measurement system 10 outputs a control signal for controlling the exercise assist device 3. That is, in the rehabilitation support system 100, the exercise assist device 3 is triggered by the brain wave measurement system 10 detecting a brain wave including a characteristic change that may occur when the subject 5 intends to perform a voluntary movement. A control signal for control is generated. As a result, in the rehabilitation support system 100, it is possible to assist the voluntary movement of the subject 5 with the exercise assist device 3 in accordance with the voluntary movement of the subject 5. The electroencephalogram measurement system 10 will be described in detail in the column of "(3) EEG measurement system".

The exercise assisting device 3 is a device that assists the exercise of the subject 5 by adding at least one of a mechanical stimulus and an electrical stimulus to the subject 5. In the present embodiment, since the rehabilitation support system 100 is used for the rehabilitation of the left hand finger of the subject 5, the exercise assist device 3 is attached to the left hand of the subject 5 as shown in FIG.

In this embodiment, a case where the rehabilitation support system 100 is used for rehabilitation of the gripping motion and the extension motion of the subject 5 with the left finger is illustrated. The "grasping operation" referred to in the present disclosure means an operation of grasping an object. That is, in the subject 5, the left finger is the impaired part, and the rehabilitation support system 100 is used for rehabilitation for voluntary movements such as gripping motion and extension motion by the left finger. However, in reality, the rehabilitation support system 100 does not directly assist the gripping motion of the subject 5, but indirectly rehabilitates the gripping motion by assisting the extension motion of the fingers of the subject 5. Do. The "extension movement" referred to in the present disclosure is a state in which the hands are opened by the extension of four fingers 53 (second to fifth fingers) excluding the first finger (thumb), that is, the hands are grasped by the gripping movement. It means the action of releasing "things".

Therefore, in the rehabilitation support system 100, when the subject 5 performs an extension movement as a voluntary movement, the exercise assist device 3 attached to the left hand of the subject 5 mechanically stimulates the left finger 53 of the subject 5. And at least one of electrical stimuli to assist voluntary movements. Specifically, as shown in FIG. 3, the exercise assisting device 3 includes a finger driving device 31 and an electrical stimulation generator 32.

The finger driving device 31 holds four fingers 53 (second to fifth fingers) excluding the first finger (thumb), and applies a mechanical stimulus (external force) to these four fingers 53. It is a device that moves four fingers 53. The finger driving device 31 includes, for example, a power source such as a motor or a solenoid, and moves the four fingers 53 by transmitting the force generated by the power source to the four fingers 53. In the finger driving device 31, the held four fingers 53 are moved in a direction away from the first finger (that is, an extension operation) and a movement in a direction closer to the first finger (that is, a gripping operation). Two types of operations, "closing operation" and "closing operation", are possible. The opening operation of the finger driving device 31 assists the extension operation of the subject 5, and the closing operation of the finger driving device 31 assists the gripping operation of the subject 5.

The electrical stimulus generator 32 is a device that gives an electrical stimulus to a portion for moving the finger 53 of the subject 5. Here, the part for moving the finger 53 of the subject 5 includes a part corresponding to at least one of the muscle and the nerve of the finger 53 of the subject 5. For example, the part for moving the finger 53 of the subject 5 is a part of the arm of the subject 5. The electrical stimulation generator 32 includes, for example, a pad attached to the body (for example, an arm) of the subject 5. The electric stimulus generator 32 gives a stimulus to a part for moving the finger 53 by applying an electric stimulus (current) to the body of the subject 5 from the pad.

The control device 4 controls the exercise assist device 3 based on the electroencephalogram information acquired by the electroencephalogram measurement system 10. In the present embodiment, the control device 4 is electrically connected to the information processing device 2 and the exercise assist device 3 of the electroencephalogram measurement system 10. The control device 4 is connected to the exercise assist device 3 and the power cable for supplying the operating power of the control device 4. The control device 4 includes a drive circuit for driving the finger drive device 31 of the exercise assist device 3 and an oscillation circuit for driving the electrical stimulation generator 32. The control device 4 receives a control signal from the information processing device 2 by, for example, wire communication.

When the control device 4 receives the first control signal from the information processing device 2, the control device 4 drives the finger drive device 31 of the exercise assist device 3 by the drive circuit, and the finger drive device 31 performs the "open operation". Controls the exercise assist device 3. Further, when the control device 4 receives the second control signal from the information processing device 2, the drive circuit drives the finger drive device 31 of the exercise assist device 3, and the finger drive device 31 performs a "closing operation". The exercise assist device 3 is controlled so as to be processed. Further, when the control device 4 receives the third control signal from the information processing device 2, the control device 4 drives the electrical stimulation generator 32 of the motion assisting device 3 by the oscillation circuit, and the body of the subject 5 is electrically stimulated. The exercise assist device 3 is controlled so as to be given.

In this way, the control device 4 controls the exercise assist device 3 based on the control signal output from the electroencephalogram measurement system 10, and the exercise assist device 4 is based on the electroencephalogram information acquired by the electroencephalogram measurement system 10. It is possible to control 3. Further, the control device 4 controls the exercise assist device 3 so that the finger drive device 31 performs the “open operation” and the “close operation” in response to the operation of the operation switch provided in the control device 4. You can also.

Next, how to use the rehabilitation support system 100 will be described. In the present embodiment, the rehabilitation support system 100 performs a voluntary movement (extension movement) when the subject 5 releases the peg 101 by the extension movement of the fingers 53 from the posture in which the peg 101 (see FIG. 1) is grasped by the left finger. The case of assisting will be described in.

First, as a preparatory process, the subject 5 attaches the headset 1 to the head 52 and the exercise assist device 3 to the left hand. At this time, the headset 1 is attached to the head 52 of the subject 5 so that at least the electrode portion 11 is brought into contact with a part of the right surface of the head 52 of the subject 5 which is the measurement point 51. The exercise assist device 3 holds at least four fingers 53 (second to fifth fingers) excluding the first finger (thumb) of the left hand of the subject 5, and the pad is attached to the arm of the subject 5. In this state, it is attached to the subject 5. The headset 1 and the exercise assist device 3 are appropriately fixed so as not to shift or come off during rehabilitation. In the preparation process, the four fingers 53 of the subject 5 are held by the finger drive device 31 of the exercise assist device 3, so that the subject 5 maintains the posture of grasping the peg 101 with his left finger. .. The work of attaching the headset 1 and the exercise assist device 3 to the subject 5 may be performed by the subject 5 himself or by the medical staff.

When the preparation is completed and the headset 1 and the information processing device 2 can communicate with each other, the electroencephalogram information generated by the headset 1 can be acquired by the information processing device 2. That is, the electroencephalogram measurement system 10 acquires the electroencephalogram information representing the electroencephalogram collected by the electrode unit 11 arranged at the measurement point 51, which is a part of the head 52 of the subject 5, by the information processing device 2. be able to. Details will be described in the column of "(3) EEG measurement system", but the information processing device 2 stores (stores) the acquired EEG information in the memory 22 (see FIG. 3) in chronological order. Further, the information processing apparatus 2 generates a power spectrum of an electroencephalogram by, for example, performing a time frequency analysis on the stored electroencephalogram information. The brain wave measurement system 10 can detect brain waves including characteristic changes that may occur when the subject 5 tries to perform a voluntary movement by constantly monitoring the power spectrum data with the information processing device 2. Become.

Here, before the subject 5 starts the rehabilitation, the electroencephalogram measurement system 10 executes a calibration process for determining various parameters used for detecting the electroencephalogram to be detected. As a result, the electroencephalogram measurement system 10 improves the detection accuracy of the electroencephalogram to be detected by taking into consideration the frequency band in which the power is reduced due to the event-related desynchronization and the variation in the amount of power reduction for each subject 5. Can be planned. The calibration process will be described in detail in the column of "(3) EEG measurement system".

After the completion of the preparatory process including the calibration process, the rehabilitation support system 100 starts a training process to support the rehabilitation of the subject 5. In the training process, the rehabilitation of the subject 5 is supported based on the brain waves measured by the brain wave measuring system 10 during the training time. Specifically, the training time is divided into a rest period and an exercise period, and the subject 5 carries out rehabilitation according to the instructions of the rehabilitation support system 100 in each of the rest period and the exercise period. In this embodiment, as an example, it is assumed that the training time is "10 seconds", and when the training time is divided into two equal parts, the first half "5 seconds" is the rest period and the latter half "5 seconds" is the exercise period. To do.

During the rest period, the subject 5 keeps his / her body in a resting state, that is, does not intend (remember) to perform voluntary movements, and maintains a relaxed state. At this time, the electroencephalogram measurement system 10 does not detect an electroencephalogram including a characteristic change due to event-related desynchronization that may occur when the subject 5 intends to perform a voluntary movement.

On the other hand, during the exercise period, the subject 5 intends (remembers) to perform the extension movement of the fingers 53, that is, the voluntary movement. At this time, the electroencephalogram measurement system 10 can detect an electroencephalogram including a characteristic change due to event-related desynchronization that may occur when the subject 5 intends to perform a voluntary movement. In the present embodiment, characteristic changes in EEG are detected by comparing the activation level with the threshold value and checking whether the activation level exceeds the threshold value. The "activation level" referred to in the present disclosure is a value representing a decrease in power (power spectrum) in a specific frequency band. Since the activation level exceeds the threshold value due to the occurrence of event-related desynchronization and the decrease in power in a specific frequency band, the electroencephalogram measurement system 10 has a characteristic change in the electroencephalogram when the activation level exceeds the threshold value. Is detected.

In the electroencephalogram measurement system 10, a control signal for controlling the exercise assist device 3 is generated by detecting an electroencephalogram including such a characteristic change as a trigger. Therefore, in the rehabilitation support system 100, when the subject 5 intends to perform the voluntary movement, the exercise assisting device is adjusted to the timing when the activation of the brain region corresponding to the target part of the voluntary movement actually occurs. It is possible to assist the voluntary movement of the subject 5 in 3.

The operation of the electroencephalogram measurement system 10 in the training process will be described in detail in the column of "(3) EEG measurement system".

(3) Electroencephalogram Measurement System (3.1) Configuration Hereinafter, the electroencephalogram measurement system 10 according to the present embodiment will be described in more detail.

As shown in FIG. 3, the electroencephalogram measuring system 10 includes a headset 1 worn on the head 52 of the subject 5, and an information processing device 2 mainly composed of a computer system such as a personal computer. ..

The headset 1 includes an electrode unit 11, a signal processing unit 12, and a first communication unit 13. The headset 1 is, for example, battery-powered, and the operating power of the signal processing unit 12, the first communication unit 13, and the like is supplied from the battery.

The electrode portion 11 is an electrode for collecting an electroencephalogram (electroencephalogram signal) of the subject 5, and is, for example, a silver-silver chloride electrode. The electrode portion 11 may be gold, silver, platinum or the like. The electrode portion 11 has a first electrode 111 and a second electrode 112. In the present embodiment, as shown in FIG. 2, the measurement point 51 set on the surface of the head 52 of the subject 5 includes the first measurement point 511 and the second measurement point 512. The first electrode 111 is an electrode corresponding to the first measurement point 511 and is arranged on the first measurement point 511. The second electrode 112 is an electrode corresponding to the second measurement point 512 and is arranged on the second measurement point 512. Specifically, the first measurement point 511 and the second measurement point 512 are the first measurement points 511 and the second measurement points 511 and the second measurement points 511 from the midline center side (upper side) on the line connecting the midline center portion of the head 52 and the right ear. The measurement points 512 are arranged side by side in this order.

Further, in the present embodiment, the headset 1 further includes a reference electrode 113 and a ground electrode 114. The reference electrode 113 is an electrode for measuring the reference potential of the electroencephalogram signal measured at each of the first electrode 111 and the second electrode 112. The reference electrode 113 is located at the posterior position of either the right or left ear on the head 52. Specifically, the reference electrode 113 is arranged at the rear position of the ear on the side of the head 52 where the first electrode 111 and the second electrode 112 are arranged. In the present embodiment, the first electrode 111 and the second electrode 112 are arranged on the right surface of the head 52, so that the reference electrode 113 is arranged at the posterior position of the right ear. The ground electrode 114 is arranged at the posterior position of the right ear or the left ear of the head 52 where the reference electrode 113 is not arranged. In the present embodiment, the reference electrode 113 is arranged at the posterior position of the right ear, so that the ground electrode 114 is arranged at the posterior position of the left ear. Each of the reference electrode 113 and the ground electrode 114 is electrically connected to the main body 15 of the headset 1 by an electric wire 16 (see FIG. 2), and is attached to the surface (scalp) of the head 52. The position where the reference electrode 113 and the ground electrode 114 are arranged may be the earlobe instead of the position behind the ear as described above. The posterior position of the ear and the earlobe are locations on the head that are less susceptible to biopotentials derived from brain activity. That is, it is preferable that the reference electrode 113 and the ground electrode 114 are arranged in a place on the head that is not easily affected by the bioelectric potential derived from brain activity.

The signal processing unit 12 is electrically connected to the electrode unit 11, the reference electrode 113, and the ground electrode 114, executes signal processing on the electroencephalogram signal (electrical signal) input from the electrode unit 11, and performs electroencephalogram information. To generate. That is, the headset 1 measures the electroencephalogram of the subject 5 by measuring the action potential of the brain of the subject 5 at the electrode unit 11, and generates the electroencephalogram information representing the electroencephalogram at the signal processing unit 12. The signal processing unit 12 includes at least an amplifier that amplifies the brain wave signal and an A / D converter that performs A / D conversion, and outputs the amplified digital brain wave signal as brain wave information.

The first communication unit 13 has a communication function with the information processing device 2. The first communication unit 13 transmits at least the brain wave information generated by the signal processing unit 12 to the information processing device 2. In the present embodiment, the first communication unit 13 can communicate with the information processing device 2 in both directions. The communication method of the first communication unit 13 is, for example, wireless communication based on Bluetooth (registered trademark) or the like. From the first communication unit 13, brain wave information is transmitted to the information processing device 2 at any time.

The information processing device 2 mainly includes a computer system including a processor 21 and a memory 22. The information processing device 2 further includes a second communication unit 23, an operation unit 24, a third communication unit 25, and a display unit 26.

The second communication unit 23 has a communication function with the headset 1 (first communication unit 13). The second communication unit 23 receives at least brain wave information from the headset 1. In the present embodiment, the second communication unit 23 can communicate with the headset 1 in both directions. For example, the second communication unit 23 receives brain wave information sampled at a sampling frequency of about 200 Hz from the headset 1 at any time.

The third communication unit 25 has a communication function with the control device 4. The third communication unit 25 transmits at least a control signal to the control device 4. The communication method of the third communication unit 25 is, for example, wired communication compliant with USB (Universal Serial Bus).

In the present embodiment, the information processing device 2 is equipped with a touch panel display, and the touch panel display functions as an operation unit 24 and a display unit 26. Therefore, in the information processing device 2, the operation of an object such as a button (tap, swipe, drag, etc.) on each screen displayed on the display unit 26 is detected by the operation unit 24, so that the object such as a button is released. Judge that it has been operated. That is, the operation unit 24 and the display unit 26 function as a user interface that receives operation input from the target person 5 or the medical staff in addition to various displays. However, the operation unit 24 is not limited to the touch panel display, and may be, for example, a keyboard, a pointing device, a mechanical switch, or the like.

The processor 21 functions as an acquisition unit 211, an analysis unit 212, a detection unit 213, a determination unit 214, a processing unit 215, an input unit 216, an output unit 217, a display control unit 218, a selection unit 219, a presentation unit 220, and a deletion unit 221. have. When the processor 21 executes the program recorded in the memory 22, the acquisition unit 211, the analysis unit 212, the detection unit 213, the determination unit 214, the processing unit 215, the input unit 216, the output unit 217, and the display control unit 218 The function is realized. Similarly, when the processor 21 executes the program recorded in the memory 22, the functions of the selection unit 219, the presentation unit 220, and the deletion unit 221 are realized.

The acquisition unit 211 acquires electroencephalogram information representing the electroencephalogram collected by the electrode unit 11 arranged at the measurement point 51, which is a part of the head 52 of the subject 5. That is, the acquisition unit 211 acquires the electroencephalogram information representing the electroencephalogram collected by the electrode unit 11 of the headset 1 from the headset 1 via the second communication unit 23. Here, the acquisition unit 211 acquires the first brain wave information representing the brain wave collected by the first electrode 111 and the second brain wave information representing the brain wave collected by the second electrode 112, respectively. That is, in the present embodiment, since the electrode unit 11 includes the first electrode 111 and the second electrode 112, the acquisition unit 211 uses the electroencephalogram information collected by the first electrode 111 as the first electroencephalogram information and the second electrode. The electroencephalogram information collected in 112 is distinguished as the second electroencephalogram information. In the present embodiment, the acquisition unit 211 acquires digital-format electroencephalogram information and stores the acquired electroencephalogram information in the memory 22. At this time, the memory 22 stores the time-series data of the electroencephalogram information measured by the electroencephalogram measurement system 10 from the start to the end of the training time. The memory 22 can store a plurality of brain wave information. That is, the memory 22 functions as a storage unit that stores a plurality of brain wave information acquired by the acquisition unit 211.

The analysis unit 212 analyzes the brain wave information acquired by the acquisition unit 211. The analysis unit 212 performs frequency analysis of the electroencephalogram information stored in the memory 22 and generates spectral data indicating the signal strength for each frequency band. Specifically, the analysis unit 212 reads out the electroencephalogram information stored in the memory 22 for a predetermined time, and performs frequency analysis such as, for example, a short-time Fourier transform (STFT). As a result, the power for each frequency band is calculated for the electroencephalogram signal that changes with the passage of time. The "power" referred to in the present disclosure is an integrated value of the intensity (spectral intensity) for each frequency band.

The detection unit 213 detects brain waves including characteristic changes that may occur when the subject 5 intends to perform a voluntary movement based on the power of each frequency band analyzed by the analysis unit 212. Specifically, the detection unit 213 determines the presence or absence of an electroencephalogram including a characteristic change depending on whether the power in a specific frequency band is in the rest range or the motion range. The "rest range" referred to in the present disclosure is the brain wave of the subject 5 when the subject 5 keeps the body in a resting state, that is, does not intend (remember) to perform a voluntary movement and maintains a relaxed state. It means the range that the power of a specific frequency band can take. The "exercise range" as used in the present disclosure means a range in which the power of a specific frequency band of an electroencephalogram can be obtained when the subject 5 intends to perform voluntary movement. That is, the detection unit 213 generated an electroencephalogram including a characteristic change that may occur when the subject 5 intends to perform a voluntary movement due to the transition of the power in a specific frequency band from the rest range to the movement range. Judge.

More specifically, in the present embodiment, as an example, the detection unit 213 first calculates the activation level representing the amount of decrease in the power of a specific frequency band from the power of each frequency band analyzed by the analysis unit 212. Then, the detection unit 213 compares the calculated activation level with the threshold value stored in the memory 22, and determines that the characteristic change of the brain wave has occurred when the activation level exceeds the threshold value. That is, the threshold value for the activation level is a value corresponding to the boundary line (straight line Lth1) between the rest range A1 and the motion range A2 in the graph showing the power in a specific frequency band (see FIG. 6). Therefore, when event-related desynchronization occurs, the power in a specific frequency band decreases, and the power in the specific frequency band transitions from the rest range to the motion range, the activation level exceeds the threshold value. Details will be described in the column of "(3.3) Calibration process", but the threshold value is set in the calibration process.

The determination unit 214 determines the presence or absence of an artifact based on the electroencephalogram information acquired by the acquisition unit 211. Since the artifact becomes a noise component with respect to the brain wave as described above, when the determination unit 214 determines that the artifact is included, the measurement accuracy of the brain wave may decrease. The operation of the determination unit 214 will be described in detail in the column of "(3.3) Calibration processing".

The processing unit 215 executes a calibration process for determining the parameters used for the analysis of the electroencephalogram information. That is, the processing unit 215 executes a calibration process for determining various parameters including at least a threshold value for the activation level. The calibration process by the processing unit 215 is executed prior to the training process. The processing unit 215 stores various parameters determined in the calibration process in the memory 22.

The input unit 216 receives from the operation unit 24 a designated signal that specifies one or more electroencephalogram information used for the calibration process from the plurality of electroencephalogram information stored in the memory 22. That is, in the calibration process, one or more electroencephalogram information designated by the designated signal is used among the plurality of electroencephalogram information stored in the memory 22. In other words, the designated signal received by the input unit 216 from the operation unit 24 is a signal for designating one or more brain wave information used for the calibration process from the plurality of brain wave information stored in the memory 22. is there.

Further, the input unit 216 has a function of executing a redesignation process of receiving a designated signal after the processing unit 215 executes the calibration process. Then, the processing unit 215 has a function of re-executing the calibration process based on one or more brain wave information designated by the designated signal received by the input unit 216 in the redesignation process. That is, the processing unit 215 is configured to be able to repeat the calibration process a plurality of times. The input unit 216 is configured to be able to receive a designated signal by redesignation processing after the completion of the "N" th calibration process and before the start of the "N + 1" th calibration process (N is a natural number). .. The redesignation process will be described in detail in the column of "(3.4) Redesignation process".

Further, the acquisition unit 211 further acquires brain wave information and adds it to the memory 22 between the time when the processing unit 215 executes the calibration process and the time when the input unit 216 executes the redesignation process. It has a function to execute. That is, when the processing unit 215 repeatedly executes the calibration process a plurality of times, the acquisition unit 211 further acquires the brain wave information and adds it to the memory 22 before the input unit 216 executes the redesignation process. It is configured to be able to perform processing. Therefore, in the period after the completion of the "N" th calibration process and before the start of the "N + 1" th calibration process, the brain wave information is added to the memory 22 by the additional process of the acquisition unit 211, and then the input unit 216. The designated signal can be accepted by the redesignation process of. The additional processing will be described in detail in the column of "(3.3) Calibration processing".

The output unit 217 outputs the determination result of the determination unit 214. That is, when the determination unit 214 determines the presence or absence of an artifact, the determination result is output from the output unit 217. Examples of the output mode of the determination result by the output unit 217 include display, audio output, printout (printing), writing to a non-temporary recording medium, transmission to an information terminal, and the like. In the present embodiment, the output unit 217 outputs the determination result to the display control unit 218 so that the determination result is displayed on the display unit 26.

The display control unit 218 causes the display unit 26 to display a plurality of brain wave information stored in the memory 22. Further, the display control unit 218 causes the display unit 26 to display the determination result output by the output unit 217. The display control unit 218 has a function of controlling the display unit 26, and can display various contents on the display unit 26. The display control unit 218 causes the display unit 26 to display at least a plurality of brain wave information stored in the memory 22 and the determination result of the determination unit 214.

The selection unit 219 receives a selection signal from the operation unit 24 between the time when the processing unit 215 executes the calibration process and the time when the input unit 216 executes the redesignation process. The "selection signal" referred to in the present disclosure is a signal for selecting whether or not to execute additional processing by the acquisition unit 211. That is, the acquisition unit 211 does not always execute the additional processing before executing the redesignation processing, and whether or not the acquisition unit 211 executes the additional processing can be selected by the selection signal. Therefore, only when it is selected to execute the additional process in the selection process, the additional process by the acquisition unit 211 is executed before the execution of the redesignation process.

The presentation unit 220 presents the result of the calibration process. That is, when the calibration process is executed by the processing unit 215, the result is presented by the presentation unit 220. Modes of presentation by the presentation unit 220 include, for example, display, audio output, printout (printing), writing to a non-temporary recording medium, transmission to an information terminal, and the like. In the present embodiment, the presentation unit 220 outputs the result of the calibration process to the display control unit 218 so that the result of the calibration process is displayed on the display unit 26.

The deletion unit 221 deletes at least one electroencephalogram information from the plurality of electroencephalogram information stored in the memory 22. Specifically, the deletion unit 221 deletes (erases) at least one electroencephalogram information not specified by the designated signal received by the input unit 216 from the storage area of the electroencephalogram information in the memory 22.

(3.2) Training process Next, the operation of the electroencephalogram measurement system 10 in the training process will be described in detail.

In the training process, the operation mode of the rehabilitation support system 100 is the training mode. If the operation mode of the rehabilitation support system 100 is in the training mode, the display unit 26 of the information processing device 2 displays, for example, the training screen 200 as shown in FIG. In the example of FIG. 4, the alternate long and short dash line and the reference numeral indicating the region are shown only for the sake of explanation, and in reality, these alternate long and short dash line and the reference numeral are not displayed on the display unit 26.

The training screen 200 includes an activation level display area G1, an electroencephalogram display area G2, a training start button G3, an orthosis operation button G4, a number of times display area G5, a sensing state display area G6, a device state display area G7, a status display area G8, and an end. It has a button G9. Further, the training screen 200 further includes an operation guide area G10, a check box G11, a training information output button G12, a history button G13, and a setting button G14.

The activation level display area G1 is an area for displaying a graph of the activation level. The activation level graph displays a waveform representing the time change of the activation level, with the horizontal axis representing time (seconds) and the vertical axis representing the activation level. In the activation level display area G1, the straight line L1 represents a threshold value (set value). Further, during the period when the activation level exceeds the threshold value, a band-shaped determination mark M1 is displayed above the activation level graph. In addition, the background color of the activation level graph may differ between the rest period (period of 0 to 5 seconds) in the first half of the training time and the exercise period (period of 5 to 10 seconds) in the latter half of the training time. preferable.

The electroencephalogram display area G2 is an area for displaying the electroencephalogram measured by the headset 1. The electroencephalogram in the electroencephalogram display area G2 is displayed in real time according to the electroencephalogram information transmitted from the headset 1 to the information processing device 2. In the electroencephalogram graph, the horizontal axis is time (seconds) and the vertical axis is electric potential, and a waveform representing the time change of electroencephalogram is displayed.

The training start button G3 is a button for starting training. When the training start button G3 is tapped, the training by the rehabilitation support system 100 starts, and the electroencephalogram measurement by the electroencephalogram measurement system 10 starts.

The orthosis operation button G4 is a button for operating the exercise assist device 3. When the orthosis operation button G4 is tapped, a control signal is output from the electroencephalogram measurement system 10, and the exercise assist device 3 is closed or opened. Here, the orthosis operation button G4 displays text information such as "orthosis closed" or "orthosis open". When the orthosis operation button G4 is tapped while "orthosis closed" is displayed, the exercise assist device 3 is closed, and the orthosis operation button G4 is tapped while "orthosis open" is displayed. Then, the exercise assist device 3 is opened.

The number-of-times display area G5 is an area for displaying the number of successes and the number of trials. The "number of successes" referred to in the present disclosure refers to an electroencephalogram including a characteristic change due to an event-related desynchronization that may occur when the subject 5 intends to perform a voluntary movement by the electroencephalogram measurement system 10. It is the number of times detected in. The "number of trials" referred to in the present disclosure is the number of times training has been performed by the rehabilitation support system 100.

The sensing state display area G6 is an area for displaying the sensing state of the brain wave. In the present embodiment, the electroencephalogram measurement system 10 measures the impedance value between each of the first electrode 111 and the second electrode 112 with the body (scalp) of the subject 5, and according to the measured impedance value. The quality of the sensing state is judged. In the example of FIG. 4, in the sensing state display area G6, a text display of the impedance value (“80 or more” in FIG. 4) and a marker display indicating the quality of each sensing state of the first electrode 111 and the second electrode 112 are displayed. , Has been made. Specifically, for example, the color of the marker on the illustration imitating a human head changes depending on the quality of the sensing state of each of the first electrode 111 and the second electrode 112.

The device status display area G7 is an area for displaying the status of each device in the rehabilitation support system 100. In the device status display area G7, for example, the connection status of the information processing device 2 with the headset 1, the remaining battery level of the headset 1, and the like are displayed by icons such as "○" or "x".

The status display area G8 is an area for displaying the identification information (subject ID) and name of the subject 5, as well as the identification information (examiner ID) and name of the medical staff. Further, in the status display area G8, a "rehabilitation target", that is, a target icon G81 indicating whether the rehabilitation target is a "left hand" or a "right hand" is further displayed. In the example of FIG. 4, the target icon G81 indicates by text information that the target of rehabilitation is the “left hand”.

The end button G9 is a button for ending the training. When the end button G9 is tapped, the training by the rehabilitation support system 100 is completed, and the electroencephalogram measurement by the electroencephalogram measurement system 10 is completed.

The operation guide area G10 is an area for displaying text information that guides the operation of the rehabilitation support system 100. In the example of FIG. 4, the text information "Please press the [Training start] button to start the trial" is displayed in the operation guide area G10. The display content of the operation guide area G10 changes according to the operating state of the rehabilitation support system 100.

The check box G11 is an icon for switching whether or not to display an electroencephalogram in the electroencephalogram display area G2. By tapping the check box G11, the state in which the brain wave is displayed in the brain wave display area G2 and the state in which the brain wave is not displayed are alternately switched. When the display of the check box G11 is active, the electroencephalogram is displayed in the electroencephalogram display area G2.

The training information output button G12 is a button for outputting training information including the result of rehabilitation. By tapping the training information output button G12, the training information is output in a desired mode. Modes of output of training information include, for example, display, audio output, printout (printing), writing to a non-temporary recording medium, transmission to an information terminal, and the like.

The history button G13 is a button for referring to the history of training information including the result of rehabilitation. When the history button G13 is tapped, the screen displayed on the display unit 26 of the information processing device 2 transitions from the training screen 200 to the history reference screen. On the history reference screen, at least the result of the rehabilitation performed by the subject 5 in the past is displayed.

The setting button G14 is a button for shifting the operation mode of the rehabilitation support system 100 to a setting mode for making various settings related to the rehabilitation support system 100. When the setting button G14 is tapped, the screen displayed on the display unit 26 of the information processing device 2 transitions from the training screen 200 to the setting screen 201 (see FIG. 5) described later.

In the training process, the subject 5 performs rehabilitation while the training screen 200 as described above is displayed on the display unit 26 of the information processing device 2. That is, when the training start button G3 is tapped, the training by the rehabilitation support system 100 is started.

At the same time as the start of the training, the counting of the training time is started, and the brain wave measuring system 10 measures the brain wave of the subject 5. Then, during the rest period (period of 0 to 5 seconds) in the first half of the training time, the subject 5 puts the body in a rest state according to the display of the operation guide area G10 or the instruction of the medical staff. At this time, the activation level and the brain wave are displayed on the training screen 200 in real time. However, during the rest period, the EEG measurement system 10 does not compare the activation level with the threshold and does not detect EEG including characteristic changes due to event-related desynchronization.

On the other hand, during the exercise period (period of 5 to 10 seconds) in the latter half of the training time, the subject 5 performs an extension movement of the fingers 53, that is, a voluntary movement according to the display of the operation guide area G10 or the instruction of the medical staff. Make an attempt (recollection). At this time, the activation level and the brain wave are displayed on the training screen 200 in real time. Further, during the exercise period, the electroencephalogram measurement system 10 compares the activation level with the threshold value and detects an electroencephalogram including a characteristic change due to event-related desynchronization. Here, when the activation level exceeds the threshold value (see the straight line L1 in FIG. 4) due to the event-related desynchronization, a band-shaped determination mark M1 is displayed above the graph of the activation level on the training screen 200. ..

More specifically, the electroencephalogram measurement system 10 analyzes the electroencephalogram information acquired by the acquisition unit 211 at any time by the analysis unit 212. Further, the electroencephalogram measurement system 10 calculates the activation level in the detection unit 213 based on the power for each frequency band analyzed by the analysis unit 212, and compares the activation level with the threshold value. In the electroencephalogram measurement system 10, it is determined that the activation level exceeds the threshold value when the power of a specific frequency band decreases due to event-related desynchronization and the power of the specific frequency band shifts from the rest range to the motion range. Will be done.

Here, the specific frequency band may be a single frequency band (for example, an α wave band or a β wave band), or a plurality of frequency bands (for example, an α wave band and a β wave band). May be. When a specific frequency band is, for example, two frequency bands, the activation level exceeds the threshold when the coordinate value defined by the power of these two frequency bands transitions from the rest range to the motion range. ..

Further, in the present embodiment, the electroencephalogram measurement system 10 has a function of measuring the duration of the state in which the activation level exceeds the threshold value. In the training screen 200 illustrated in FIG. 4, the length of the determination mark M1 corresponds to the length of the duration. When the activation level rises (changes) from a value below the threshold value to a value exceeding the threshold value, the electroencephalogram measurement system 10 transmits a third control signal to the exercise assist device 3. Further, when the duration reaches a predetermined time (for example, "1 second"), the electroencephalogram measurement system 10 transmits a first control signal to the exercise assist device 3.

From the above, when the activation level exceeds the threshold value, the electrical stimulation generator 32 of the exercise assisting device 3 is driven, and the exercise assisting device 3 gives an electrical stimulation to the body of the subject 5. The voluntary movement (extension movement) of the subject 5 is assisted. Further, when the state in which the activation level exceeds the threshold value continues for a predetermined time, the finger drive device 31 of the exercise assist device 3 is driven, and the exercise assist device 3 performs an "opening operation" of the finger drive device 31. Therefore, the voluntary movement (extension movement) of the subject 5 is assisted.

As a result, when the subject 5 intends (remembers) to perform the voluntary movement, the exercise assist device 3 is set to the exercise assist device 3 at the timing when the activation of the brain region corresponding to the target part of the voluntary movement actually occurs. The voluntary movement of the subject 5 (extension movement of the left finger 53) is assisted. At this time, the muscles and sensory nerves of the subject 5 are activated, and the information is transmitted to the brain, so that the nerves are reconstructed and the effect of rehabilitation is obtained. Therefore, according to the rehabilitation support system 100, the exercise therapy is effective for the subject 5 in various states as compared with the case where the subject 5 performs voluntary exercise alone, as in the case where the medical staff assists. Rehabilitation can be realized.

By the way, if the operation mode of the rehabilitation support system 100 is in the setting mode, the setting screen 201 as shown in FIG. 5 is displayed on the display unit 26 of the information processing device 2. In the example of FIG. 5, the alternate long and short dash line and the reference numeral indicating the region are shown only for the sake of explanation, and in reality, these alternate long and short dash line and the reference numeral are not displayed on the display unit 26.

The setting screen 201 has the same sensing status display area G6, device status display area G7, status display area G8, and end button G9 as the training screen 200, as well as the first to fifth setting areas G21 to G25 and the update button G26. Includes.

In the first setting area G21, a slide bar for adjusting the intensity of electrical stimulation (neuromuscular stimulation level) by the electrical stimulation generator 32 is displayed. In the second setting area G22, a slide bar for adjusting the volume is displayed. In the third setting area G23, a slide bar for adjusting the threshold value for the activation level is displayed. In the fourth setting area G24, an upper slide bar G27 for adjusting the operating speed of the finger driving device 31 and a lower slide bar G28 for adjusting the movable range of the finger driving device 31 are displayed.

In the fifth setting area G25, a slide bar for setting a specified time is displayed. The "specified time" referred to in the present disclosure is a time for determining whether or not the extension operation of the subject 5 is assisted by the opening operation of the finger driving device 31, and as an example, the default time is 1.0 second. It is set. The electroencephalogram measurement system 10 outputs a first control signal to drive the finger driving device 31 when the state in which the activation level exceeds the threshold value continues for a predetermined time.

Here, with respect to the movable range of the finger drive device 31, an "open angle" that defines the end point of the open operation and a "closed angle" that defines the end point of the closed operation can be individually set. Specifically, the lower slide bar G28 includes a first slider G281 for adjusting the opening angle and a second slider G282 for adjusting the closing angle. Further, the display color (for example, light blue) is changed by the first slider G281, the illustration showing the action of the opening operation, and the text information indicating the opening angle so that the movable range of the finger driving device 31 can be intuitively adjusted. It is unified. Similarly, the display color (for example, red) is unified between the second slider G282, the illustration showing the action of the closing operation, and the text information indicating the closing angle.

The update button G26 is a button for shifting the operation mode of the rehabilitation support system 100 to the training mode. When the update button G26 is tapped, the screen displayed on the display unit 26 of the information processing device 2 transitions from the setting screen 201 to the training screen 200. At this time, various setting values set on the setting screen 201 are written to the memory 22, and the setting values are updated.

(3.3) Calibration processing Next, the operation of the electroencephalogram measurement system 10 during the calibration processing executed in the preparatory process prior to the training course will be described in detail.

(3.3.1) Outline of processing The calibration processing is performed when the operation mode of the rehabilitation support system 100 is the calibration mode. The calibration process is a process for determining various parameters including at least a threshold value for the activation level. That is, as described above, the frequency band in which the power is reduced due to the event-related desynchronization, the amount of power reduction, etc. are, for example, the attributes (age, gender, etc.) of the subject 5, the site of disability, the state of disability, and the individual. It varies due to differences. Therefore, in the electroencephalogram measurement system 10, in order to improve the detection accuracy of the electroencephalogram to be detected, various parameters used for the analysis of the electroencephalogram information are determined for each subject 5 in the calibration process.

The calibration process is a measurement process in which the electroencephalogram measurement system 10 actually measures the electroencephalogram of the subject 5 in the same procedure as the training course, and various types of calibration processes tailored to the subject 5 based on the measured electroencephalogram. Includes calculation processing in which parameters are determined.

In the measurement process, a calibration time divided into two is set for a rest period and an exercise period, as in the training time, and the electroencephalogram is measured by the electroencephalogram measuring system 10 at this calibration time. Subject 5 performs rehabilitation according to the instructions of the rehabilitation support system 100 during each of the rest period and the exercise period during the calibration time. In the present embodiment, as an example, the calibration time is "10 seconds", and when the calibration time is divided into two equal parts, the first half "5 seconds" is the rest period and the latter half "5 seconds" is the exercise period. Suppose.

That is, during the rest period, the subject 5 keeps his / her body in a resting state, that is, does not intend (remember) to perform voluntary movement, and maintains a relaxed state. On the other hand, during the exercise period, the subject 5 intends (remembers) to perform the extension movement of the fingers 53, that is, the voluntary movement. The electroencephalogram measurement system 10 measures the electroencephalogram of the subject 5 during both the rest period and the exercise period. The electroencephalogram measurement system 10 stores the electroencephalogram information measured during the calibration time (rest period and exercise period) in the memory 22 as a record. That is, the "record" referred to in the present disclosure is time-series data of the electroencephalogram information measured by the electroencephalogram measurement system 10 from the start to the end of the calibration time in the measurement process. However, in the calibration time of the measurement process, unlike the training course, the electroencephalogram measurement system 10 does not perform the process of detecting a characteristic change of the electroencephalogram.

Here, the electroencephalogram measurement system 10 can perform the above-mentioned measurement process a plurality of times in the calibration process. The memory 22 can store a plurality of records up to a predetermined number (“30” as an example). As a result, at the end of one or more measurement processes, the memory 22 stores one or more records representing the brain waves of the subject 5 during the rest period and the exercise period.

In the calculation process, various parameters according to the target person 5 are determined using one or more records stored in the memory 22 in the measurement process one or more times. Specifically, the electroencephalogram measurement system 10 analyzes the electroencephalogram information acquired by the acquisition unit 211 at any time by the analysis unit 212, and various parameters are based on the power of each frequency band analyzed by the analysis unit 212. To determine. The parameters determined at this time include at least the threshold value for the activation level, the frequency bands of the α wave and the β wave, and the like.

Here, it is not essential that all one or more records stored in the memory 22 are used to determine various parameters. For example, when five records are stored in the memory 22, at least one of these five records may be used for the calculation process for determining the parameter. Therefore, in the present embodiment, as described above, the input unit 216 sends a designated signal for designating one or more electroencephalogram information (records) from the plurality of electroencephalogram information stored in the memory 22 from the operation unit 24. Accept. Then, the processing unit 215 executes a calibration process for determining the parameters used for the analysis of the electroencephalogram information based on one or more electroencephalogram information (records) designated by the designated signal. As a result, which of the one or more records stored in the memory 22 is used for the calculation process is specified by the subject 5 or the medical staff.

The method of determining the threshold value for the activation level will be briefly described below with reference to FIG. FIG. 6 is a graph plotting the power for each of the rest period and the exercise period when focusing on the two frequency bands of the α wave and the β wave for a plurality of records (five here as an example). In FIG. 6, the horizontal axis represents the power of the α wave and the vertical axis represents the power of the β wave, and the representative value of the power during the rest period (for example, the average value) is indicated by an “◯” mark, and the representative value of the power during the exercise period ( For example, the average value) is indicated by an “x” mark. In FIG. 6, it is assumed that the frequency bands of the α wave and the β wave in the subject 5 have already been determined.

That is, in FIG. 6, for the two frequency bands of the α wave and the β wave, the range in which the “◯” mark exists corresponds to the rest range A1, and the range in which the “x” mark exists corresponds to the motion range A2. As described above, the electroencephalogram measurement system 10 includes an electroencephalogram including a characteristic change that may occur when the subject 5 tries to perform a voluntary movement due to the transition of the power in a specific frequency band from the rest range to the motion range. Is determined to have occurred. Therefore, the boundary line (straight line Lth1) between the rest range A1 and the motion range A2 in FIG. 6 corresponds to the threshold value for the activation level. Thus, the threshold for the activation level can be determined based on one or more records measured in the measurement process.

Various parameters determined in the calibration process are stored in the memory 22. In the subsequent training course, the rehabilitation support system 100 uses various parameters determined by the calibration process. Further, in the third setting area G23 of the setting screen 201 (see FIG. 5), the threshold value for the activation level can be adjusted with the slide bar as described above. However, on the setting screen 201, the threshold value determined in the calibration process is only adjusted to shift in the positive direction or the negative direction, and the reference threshold value is determined in the calibration process.

The method for determining the threshold value is not limited to the method described above, and various methods such as linear discriminant analysis (LDA) or support vector machine (SVM) can be applied.

(3.3.2) Description of Screen Next, regarding the screen displayed on the display unit 26 of the information processing device 2 during the calibration process, FIG. 7 shows the screen displayed on the display unit 26 of the information processing device 2. This description will be given with reference to FIG. In the examples of FIGS. 7 to 9, the alternate long and short dash line and the reference numeral indicating the region are shown only for the sake of explanation, and in reality, these alternate long and short dash line and the reference numeral are not displayed on the display unit 26.

That is, in the calibration process, first, during the measurement process, the calibration screen 202 as shown in FIG. 7, for example, is displayed on the display unit 26 of the information processing device 2. When the measurement process is completed, the display unit 26 of the information processing device 2 displays, for example, the selection screen 203 as shown in FIG. On the selection screen 203, the record used for the calculation process is selected. When the calculation process is completed, the calibration result screen 204 as shown in FIG. 9, for example, is displayed on the display unit 26 of the information processing device 2.

As shown in FIG. 7, the calibration screen 202 has an activation level display area G1, an electroencephalogram display area G2, a number of times display area G5, a sensing state display area G6, a device state display area G7, and a status display similar to the training screen 200. Includes region G8 and end button G9. Further, the calibration screen 202 includes a measurement start button G31, a transition button G32, and a back button G33, in addition to the operation guide area G10 and the check box G11 similar to the training screen 200. The activation level display area G1 of the calibration screen 202 is basically the same as the training screen 200, but differs from the training screen 200 in that graphs of α wave and β wave are displayed. Further, the number display area G5 of the calibration screen 202 is basically the same as the training screen 200, but is different from the training screen 200 in that the “success number” is not displayed.

In the activation level display area G1 of the calibration screen 202, a graph of the activation level for the α wave and a graph of the activation level for the β wave are displayed at the same time. However, the display mode (for example, the display color) is different between the α wave graph and the β wave graph so that the α wave graph and the β wave graph can be distinguished from each other. Further, in the calibration process, since the threshold value for the activation level is not set, the straight line L1 representing the threshold value (set value) is not displayed in the activation level display area G1 and is above the activation level graph. Judgment mark M1 is also not displayed. The background color of the activation level graph may differ between the rest period (0 to 5 seconds period) in the first half of the calibration time and the rest period (5 to 10 seconds period) in the second half of the calibration time. preferable.

The measurement start button G31 is a button for starting the measurement process. When the measurement start button G31 is tapped, the electroencephalogram measurement system 10 starts the electroencephalogram measurement.

The transition button G32 is a button for shifting to the calculation process. When the transition button G32 is tapped, the electroencephalogram measurement system 10 ends the measurement process, and the screen displayed on the display unit 26 of the information processing device 2 changes from the calibration screen 202 to the selection screen 203 (see FIG. 8). Transition.

The back button G33 is a button for returning the electroencephalogram measurement system 10 to the state before the start of the calibration process. When the back button G33 is tapped, the electroencephalogram measurement system 10 ends the calibration process and returns to the state before the start of the calibration process.

As shown in FIG. 8, the selection screen 203 includes a record display area G41, an operation guide area G42, a legend display area G43, a retry button G44, a selection number display area G45, and a calculation button G46.

The record display area G41 is an area for displaying an electroencephalogram stored in the memory 22 as a record. Here, the graph of the electroencephalogram in the record display area G41 displays a waveform representing a time change of the electroencephalogram, with the horizontal axis as time (seconds) and the vertical axis as potential, as in the electroencephalogram display area G2. In the example of FIG. 8, brain waves are displayed side by side in the vertical direction for a plurality of records (here, two) stored in the memory 22. Further, in the record display area G41, a check box G411 is displayed on the right side of the brain wave of each record in association with the record. The check box G411 is an icon for selecting a record to be used for the calculation process. By tapping the check box G411, the state in which the corresponding record is used for the calculation process and the state in which the corresponding record is not used are alternately switched. When the display of the check box G411 is active, the corresponding record is used for the calculation process.

Here, when the number of records displayed in the record display area G41 is large and the list cannot be displayed, the records displayed in the record display area G41 can be scrolled in the vertical direction. As a result, a large number of records can be displayed in the record display area G41, which exceeds the number that can be displayed in a list in the record display area G41.

By the way, below the brain wave of each record in the record display area G41, a band-shaped artifact mark M2 is displayed corresponding to each record. The artifact mark M2 is displayed only during the period when it is determined that the electroencephalogram information contains the artifact. As described above, since the electroencephalogram measurement system 10 according to the present embodiment has a function (determination unit 214) for determining whether or not the electroencephalogram information includes an artifact, the determination result by the determination unit 214 is an artifact mark. It will be reflected in M2.

That is, there is a high possibility that the EEG information contains an artifact during the period when the artifact mark M2 is displayed for a certain EEG information, and the EEG information contains the artifact during the period when the artifact mark M2 is not displayed. It is highly possible that it has not been done. In the electroencephalogram measurement system 10 according to the present embodiment, by displaying such an artifact mark M2 in the record display area G41, it is possible to easily select a record to be used for the calculation process from the records that do not include the artifact. Become. That is, when the subject 5 or the medical staff selects the record to be used for the calculation process in the check box G411, by selecting only the record in which the artifact mark M2 is not displayed, only the record containing no artifact is selected. You can choose. As a result, the parameters can be accurately determined by using the electroencephalogram information that does not include the artifact.

At this time, the input unit 216 receives a designated signal representing the record selected by the check box G411 from the operation unit 24 by the target person 5 or the medical staff. That is, the subject 5 or the medical staff selects the record to be used for the calculation process in the check box G411, and is used for the calibration process (calculation process) from the plurality of electroencephalogram information acquired by the acquisition unit 211. One or more electroencephalogram information is specified.

The operation guide area G42 is an area for displaying text information that guides the operation of the electroencephalogram measurement system 10. In the example shown in Fig. 8, "Please select the waveform to be used for analysis. Select two or more and press" Calculate "to display the calculation result here. You can redo the unselected waveform. If you want to start over, press "Retry". "The text information is displayed. The display content of the operation guide area G42 changes according to the operating state of the electroencephalogram measurement system 10.

The legend display area G43 is an area for displaying a description of the display mode of the artifact mark M2. The electroencephalogram measurement system 10 according to the present embodiment has a function of not only determining the presence or absence of an artifact but also determining the type of the artifact when it is determined that the artifact is present. The display mode of the artifact mark M2 differs depending on the type of the determined artifact. The types of artifacts include at least artifacts caused by eye movements (hereinafter, also referred to as "eyeball-derived artifacts") and artifacts caused by body movements and facial muscle movements (hereinafter, "body movement-derived artifacts"). There are two types. The display mode (for example, display color) of the artifact mark M2 is different between the eyeball-derived artifact and the body movement-derived artifact. Therefore, in the legend display area G43, these two types of display modes are displayed together with their respective explanations.

The retrial button G44 is a button for starting a retrial. The "retrial" referred to in the present disclosure is a process of adding a record by performing the measurement process again. That is, each time the additional trial is performed, the measurement process is performed again, and the acquisition unit 211 further executes an additional process of acquiring the electroencephalogram information and adding it to the memory 22. By tapping the follow-up button G44, the selection screen 203 transitions to the calibration screen 202.

The selected number display area G45 is an area for displaying the number of records (waveforms) selected on the selection screen 203. Specifically, the number of records displayed in the record display area G41 (that is, the number of records stored in the memory 22) is used as the denominator, and the number of records selected as the records used in the calculation process is used as the numerator. As, the number of records is displayed in fractional notation. For example, as shown in FIG. 8, when all of the two records displayed in the record display area G41 are selected (that is, the display of the check box G411 is active), the number of selections is displayed. "2/2" is displayed in the area G45.

The calculation button G46 is a button for starting the calculation process. When the calculation button G46 is tapped, the electroencephalogram measurement system 10 starts the calculation process using the record selected on the selection screen 203 at that time.

As shown in FIG. 9, the calibration result screen 204 includes a record display area G41, a legend display area G43, a follow-up button G44, a selection number display area G45, and a calculation button G46, which are the same as the selection screen 203. The calibration result screen 204 further includes a time frequency map G51, an information display area G52, an analysis result display area G53, and an end button G54.

The time frequency map G51 is a graph showing the tendency of the power change in a specific frequency band during the calibration time used in the calculation process. In the time frequency map G51, the power of each coordinate position is represented by "color" in a two-dimensional map having the horizontal axis as the time axis and the vertical axis as the frequency. That is, according to the time frequency map G51, the frequency band in which the power changes from the rest period to the exercise period is visually displayed. Further, in the time frequency map G51, straight lines G511 and G512 indicating the respective frequency bands of the α wave and the β wave calculated by the calculation process are displayed. The straight line G511 represents the lower limit value and the upper limit value of the frequency band (range) of the α wave, and the straight line G512 represents the lower limit value and the upper limit value of the frequency band (range) of the β wave.

The information display area G52 is an area for displaying information related to the measurement process. In the example of FIG. 9, text information indicating the number of times the measurement process is executed (the number of analysis trials), the time length of the rest period (relaxation section), and the time length of the exercise period (image section) is displayed in the information display area G52. It is displayed.

The analysis result display area G53 is an area for displaying the analysis result in the calculation process. In the example of FIG. 9, the frequency band of α wave (α wave frequency range), the frequency band of β wave (β wave frequency range), and the ratio of brain waves including characteristic changes due to event-related desynchronization (correct answer rate). The text information representing the above is displayed in the analysis result display area G53.

The end button G54 is a button for ending the calibration process. When the end button G54 is tapped, the electroencephalogram measurement system 10 ends the calibration process.

(3.3.3) Details of Processing Next, the details of the calibration processing will be described with reference to the flowchart shown in FIG.

First, the electroencephalogram measurement system 10 displays the calibration screen 202 (see FIG. 7) on the display unit 26 of the information processing device 2 (S1). When the measurement start button G31 is tapped on the calibration screen 202, the electroencephalogram measurement system 10 starts the electroencephalogram measurement, that is, the measurement process (S2). As a result, the electroencephalogram information in the acquisition unit 211 is acquired, and the acquired electroencephalogram information is stored in the memory 22 as a record (S3).

After that, the electroencephalogram measurement system 10 displays the selection screen 203 (see FIG. 8) on the display unit 26 of the information processing device 2 (S4). On the selection screen 203, a designated signal for designating one or more electroencephalogram information from a plurality of electroencephalogram information (records) stored in the memory 22 is accepted (S5). Specifically, as described above, the input unit 216 receives from the operation unit 24 a designated signal representing the record selected by the subject 5 or the medical staff in the check box G411 of the record display area G41.

After that, it is determined whether or not the calculation button G46 on the selection screen 203 is operated, that is, whether or not the calculation button G46 is tapped (S6). If it is determined that the calculation button G46 on the selection screen 203 has not been operated (S6: No), then whether or not the retry button G44 on the selection screen 203 has been operated, that is, whether or not the retry button G44 has been tapped. It is determined (S7). If it is determined that there is no operation of the follow-up button G44 on the selection screen 203 (S7: No), the electroencephalogram measurement system 10 returns to step S4 and continues the display of the selection screen 203.

On the other hand, if it is determined that the follow-up button G44 on the selection screen 203 is operated (S7: Yes), the electroencephalogram measurement system 10 returns to step S1. Therefore, the screen of the display unit 26 is switched from the selection screen 203 to the calibration screen 202. That is, on the selection screen 203, when the follow-up button G44 is tapped (S7: Yes), the measurement process (S2) is performed again, and the acquisition unit 211 further acquires brain wave information and adds it to the memory 22. Additional processing will be executed (S3). Here, the display control unit 218 causes the display unit 26 to display a plurality of electroencephalogram information stored in the memory 22, so that the display control unit 218 executes additional processing by adding the electroencephalogram information to the memory 22. Will be done. The additional processing performed by the display control unit 218 is a process of adding another electroencephalogram information to a plurality of electroencephalogram information to be displayed on the display unit 26.

Further, if it is determined that the calculation button G46 on the selection screen 203 is operated (S6: Yes), a calculation process for determining various parameters used for the analysis of the electroencephalogram information is executed (S8). In the calculation process, among the plurality of electroencephalogram information (records) stored in the memory 22, various parameters used for the analysis of the electroencephalogram information are determined using the electroencephalogram information designated by the designated signal in step S5. ..

After the calculation process is completed, the electroencephalogram measurement system 10 displays the calibration result screen 204 (see FIG. 9) on the display unit 26 of the information processing device 2 (S9). That is, on the calibration result screen 204, the presentation unit 220 presents (displays) the result of the calibration process. On the calibration result screen 204, the same record display area G41 as the selection screen 203 is displayed, and a designation for designating one or more electroencephalogram information from a plurality of electroencephalogram information (records) stored in the memory 22. The signal is accepted (S10). Specifically, as described above, the input unit 216 receives from the operation unit 24 a designated signal representing the record selected by the subject 5 or the medical staff in the check box G411 of the record display area G41.

After that, it is determined whether or not the calculation button G46 on the calibration result screen 204 is operated, that is, whether or not the calculation button G46 is tapped (S11). If it is determined that the calculation button G46 on the calibration result screen 204 is not operated (S11: No), then the presence or absence of the operation of the retry button G44 on the calibration result screen 204, that is, the retry button G44 is tapped. Whether or not it is determined (S12). If it is determined that there is no operation of the follow-up button G44 on the calibration result screen 204 (S12: No), the electroencephalogram measurement system 10 ends the calibration process. At this time, the electroencephalogram measurement system 10 actually ends the calibration process by tapping the end button G54 as described above.

On the other hand, if it is determined that the follow-up button G44 on the calibration result screen 204 is operated (S12: Yes), the electroencephalogram measurement system 10 returns to step S1. Therefore, the screen of the display unit 26 switches from the calibration result screen 204 to the calibration screen 202. That is, on the calibration result screen 204, when the follow-up button G44 is tapped (S12: Yes), the measurement process (S2) is performed again, and the acquisition unit 211 further acquires the brain wave information and the memory 22. The additional processing to be added to is executed (S3).

Further, if it is determined that the calculation button G46 on the calibration result screen 204 is operated (S11: Yes), the calculation process for determining various parameters used for the analysis of the electroencephalogram information is executed again (S8). .. In the calculation process, among the plurality of electroencephalogram information (records) stored in the memory 22, various parameters used for the analysis of the electroencephalogram information are determined using the electroencephalogram information designated by the designated signal in step S10. ..

Further, in the present embodiment, when it is determined that the follow-up button G44 is operated (S7: Yes or S12: Yes), the electroencephalogram information (record) not specified by the designated signal is deleted by the deletion unit 221. It is deleted from the memory 22. Specifically, when the retry button G44 is tapped, the display of the check box G411 is inactive, that is, the brain wave information (record) in which the check box G411 is unchecked is deleted. Therefore, after the follow-up trial button G44 is tapped and the additional processing is executed, the electroencephalogram information deleted from the memory 22 by the deletion unit 221 is excluded from the electroencephalogram information options specified by the designated signal. ..

As described above, in the present embodiment, the electroencephalogram information used for the calibration process can be designated by the designated signal on each of the selection screen 203 and the calibration result screen 204 (S5 or S10). Further, in step S10 or step S5 after passing through step S11 and step S12, after the processing unit 215 executes the calibration process, the redesignation process for receiving the designated signal is executed.

Here, whether or not the additional processing is executed between the calibration processing and the redesignation processing is determined by which of the calculation button G46 and the retry button G44 is operated on the calibration result screen 204. Determined by. In other words, the selection unit 219 receives a selection signal from the operation unit 24 indicating which of the calculation button G46 and the follow-up button G44 has been operated on the calibration result screen 204. That is, when the calculation button G46 on the calibration result screen 204 is tapped (S11: Yes), after the calculation process (S8), the redesignation process in step S10 is executed without executing the additional process. Will be done. On the other hand, when the retry button G44 on the calibration result screen 204 is tapped (S12: Yes), after the calculation process (S8), the additional process (S3) is executed, and then the redesignation in step S5 is performed. The process is executed.

(Modification example)
Embodiment 1 is just one of the various embodiments of the present disclosure. The first embodiment can be changed in various ways depending on the design and the like as long as the object of the present disclosure can be achieved. Further, the same function as the electroencephalogram measurement system 10 may be embodied by an electroencephalogram measurement method, a (computer) program, a non-temporary recording medium on which the program is recorded, or the like. In the electroencephalogram measuring method according to one aspect, the electroencephalogram information representing the electroencephalogram collected at the electrode portion 11 arranged at the measurement point 51 which is a part of the head 52 of the subject 5 is acquired, and the storage unit (memory). A plurality of electroencephalogram information is stored in 22). Further, in the electroencephalogram measuring method, the operation unit 24 receives a designated signal that specifies one or more electroencephalogram information from a plurality of electroencephalogram information stored in the storage unit (memory 22). Further, in the electroencephalogram measurement method, a calibration process for determining parameters used for analysis of electroencephalogram information is executed based on one or more electroencephalogram information designated by a designated signal. The (computer) program according to one aspect is a program for causing a computer system to execute the above-mentioned electroencephalogram measurement method.

Hereinafter, modifications of the first embodiment will be listed. The modifications described below can be applied in combination as appropriate.

The electroencephalogram measurement system 10 in the present disclosure includes a computer system. A computer system mainly consists of a processor and a memory as hardware. When the processor executes the program recorded in the memory of the computer system, the function as the brain wave measurement system 10 in the present disclosure is realized. The program may be pre-recorded in the memory of the computer system, may be provided through a telecommunications line, and may be recorded on a non-temporary recording medium such as a memory card, optical disk, hard disk drive, etc. that can be read by the computer system. May be provided. A processor in a computer system is composed of one or more electronic circuits including a semiconductor integrated circuit (IC) or a large scale integrated circuit (LSI). The integrated circuit such as IC or LSI referred to here has a different name depending on the degree of integration, and includes an integrated circuit called a system LSI, VLSI (Very Large Scale Integration), or ULSI (Ultra Large Scale Integration). Further, an FPGA (Field-Programmable Gate Array) programmed after the LSI is manufactured, or a logical device capable of reconfiguring the junction relationship inside the LSI or reconfiguring the circuit partition inside the LSI should also be adopted as a processor. Can be done. A plurality of electronic circuits may be integrated on one chip, or may be distributed on a plurality of chips. The plurality of chips may be integrated in one device, or may be distributed in a plurality of devices.

Further, for example, it is not essential for the electroencephalogram measurement system 10 that a plurality of components of the information processing device 2 are integrated in one housing, and a plurality of components of the information processing device 2 are present. It may be distributed in the housing. Even when a plurality of components are distributed in a plurality of housings, the brain wave measurement system 10 is realized in cooperation by connecting the plurality of components via a network such as the Internet. can do. Further, at least a part of the functions of the electroencephalogram measurement system 10 may be realized by, for example, a server or a cloud (cloud computing). On the contrary, a function distributed in a plurality of devices, such as a headset 1 and an information processing device 2, is combined with other components of the electroencephalogram measurement system 10 into one housing as a part of the electroencephalogram measurement system 10. It may be concentrated in the body.

Further, the electrode portion 11 is not limited to the configuration in which the electrode portion 11 is in contact with the surface (scalp) of the head 52 of the subject 5, for example, the electrode portion 11 is configured so as to be in contact with the surface of the brain (brain surface). May be done.

Further, the rehabilitation support system 100 is used not only for rehabilitation of the fingers of the subject 5, but also for rehabilitation of any part of the body of the subject 5, such as shoulders, elbows, upper arms, hips, lower limbs, or upper limbs. May be good. The characteristic changes in the brain waves that can occur when the subject 5 intends (remembers) to perform a voluntary movement may differ depending on the target site of rehabilitation, the content of the movement, and the like. For example, when event-related synchronization (ERS) occurs when the subject 5 intends to perform a voluntary movement, the brain wave measured near the motor field during the voluntary movement has a specific frequency band. Power increases. In this case, the electroencephalogram measurement system 10 detects a characteristic change in the electroencephalogram by increasing the power in a specific frequency band.

Further, the rehabilitation support system 100 is not limited to a configuration that gives an electrical or mechanical (mechanical) stimulus to the subject 5, for example, a configuration that gives a visual stimulus to the subject 5 by displaying an image. It may be. In this case, the rehabilitation support system 100, for example, when the subject 5 intends to perform the voluntary movement, the activation of the brain region corresponding to the target part of the voluntary movement actually occurs at the timing when the subject 5 intends to perform the voluntary movement. Show the subject 5 an image in which the impaired part is moving normally. Even in this way, the rehabilitation support system 100 can assist the voluntary movement of the subject 5.

Further, the exercise assist device 3 and the control device 4 are not limited to separate bodies, and for example, the exercise assist device 3 and the control device 4 may be housed and integrated in one housing.

Further, the communication method between the headset 1 and the information processing device 2 is wireless communication in the first embodiment, but the present invention is not limited to this example, and for example, wired communication may be used, or via a repeater or the like. Communication method may be used. The communication method between the control device 4 and the information processing device 2 is wired communication in the first embodiment, but is not limited to this example, and may be, for example, wireless communication, or communication via a repeater or the like. It may be a method.

Further, the headset 1 is not limited to the battery-powered type, and may be configured such that the operating power of the signal processing unit 12, the first communication unit 13, and the like is supplied from, for example, the information processing device 2.

Further, the information processing device 2 is not limited to the configuration in which the electroencephalogram information is acquired from the dedicated headset 1, and may be configured to acquire the electroencephalogram information from, for example, a general-purpose electroencephalograph.

Further, in the first embodiment, the case where the artifact determination result is used for the calibration process has been described, but the present invention is not limited to this example, and for example, the artifact determination result may be output in the training process. As a result, the subject 5 and the medical staff can easily confirm the state of the artifact in the training process.

Further, in the first embodiment, the subject 5 or the medical staff selects the electroencephalogram information to be used for the calibration process by referring to the determination result of the artifact, but the present invention is not limited to this example and is used for the calibration process. EEG information may be automatically selected. That is, when the output unit 217 outputs the artifact determination result to, for example, the processing unit 215, the processing unit 215 automatically selects the electroencephalogram information to be used for the calibration process based on the artifact determination result. May be good. In this case, it is preferable that the processing unit 215 selects only the electroencephalogram information determined not to contain the artifact, for example.

Further, the storage unit that stores a plurality of brain wave information acquired by the acquisition unit 211 is not limited to the memory 22 of the information processing device 2, for example, a non-temporary recording medium, a server, or a cloud that can be accessed by the information processing device 2. It may be realized by (cloud computing) or the like.

Further, when the input unit 216 receives the designated signal from the operation unit 24, the configuration in which the brain wave information stored in the memory 22 is displayed as a record in the record display area G41 is not an essential configuration for the brain wave measurement system 10. For example, the electroencephalogram information stored in the memory 22 is presented to the subject 5 or the medical staff in the form of voice output, printout (printing), writing to a non-temporary recording medium, transmission to an information terminal, or the like. May be done.

Further, the deletion unit 221 is not limited to the configuration in which the brain wave information not specified by the designated signal is deleted from the memory 22, and for example, the old brain wave information is automatically stored by leaving the latest predetermined number of records (brain wave information). It may be deleted from 22.

In addition, in the comparison between binary values such as activation level and threshold value, the place where "exceeds" does not include the case where the binary values are equal, but includes only the case where one of the binary values exceeds the other. However, the present invention is not limited to this, and "exceeding" here may be synonymous with "greater than or equal to" including both the case where the binary values are equal and the case where one of the binary values exceeds the other. That is, whether or not the case where the binary values are equal can be arbitrarily changed depending on the setting of the threshold value and the like, so there is no technical difference between "exceeding" and "greater than or equal to". Similarly, "less than or equal to" may be synonymous with "less than".

(Summary)
As described above, the electroencephalogram measurement system (10) according to the first aspect includes an acquisition unit (211), a storage unit (memory 22), an input unit (216), and a processing unit (215). Be prepared. The acquisition unit (211) acquires brain wave information. The electroencephalogram information is information representing the electroencephalogram collected at the electrode portion (11). The electrode portion (11) is arranged at a measurement point (51) which is a part of the head (52) of the subject (5). The storage unit stores a plurality of electroencephalogram information acquired by the acquisition unit (211). The input unit (216) receives from the operation unit (24) a designated signal that specifies one or more electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit. The processing unit (215) executes a calibration process for determining parameters used for analysis of the electroencephalogram information based on one or more electroencephalogram information designated by the designated signal.

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process from a plurality of electroencephalogram information stored in the storage unit (memory 22). Therefore, in the calibration process, for example, it is possible to accurately determine the parameters by using only the electroencephalogram information that is less affected by the artifact. As a result, the error that occurs in the parameter can be suppressed to a small value, and the decrease in the accuracy of the electroencephalogram measurement can be suppressed.

In the first aspect, the electroencephalogram measurement system (10) according to the second aspect is a display control unit (218) that displays a plurality of electroencephalogram information stored in the storage unit (memory 22) on the display unit (26). Further prepare.

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process by referring to the plurality of electroencephalogram information displayed on the display unit (26). Therefore, the work of designating (selecting) the electroencephalogram information used in the calibration process becomes relatively easy.

In the electroencephalogram measurement system (10) according to the third aspect, in the first or second aspect, the input unit (216) is redesignated to receive a designated signal after the processing unit (215) executes the calibration process. Execute the process. The processing unit (215) re-executes the calibration process based on one or more brain wave information designated by the designated signal received by the input unit (216) in the redesignation process.

According to this aspect, the calibration process can be executed again in a state where one or more electroencephalogram information used for the calibration process is redesignated by the redesignation process. Therefore, the time required for the calibration process can be shortened as compared with the case where the acquired electroencephalogram information is discarded and the acquisition unit (211) starts over from the acquisition of the electroencephalogram information. Etc. can be reduced.

In the electroencephalogram measurement system (10) according to the fourth aspect, in the third aspect, the acquisition unit (211) executes additional processing. In the additional processing, brain wave information is further acquired and stored in the storage unit (memory 22) between the time when the processing unit (215) executes the calibration process and the time when the input unit (216) executes the redesignation process. This is the process to add.

According to this aspect, when the options of the electroencephalogram information by the designated signal are not sufficient, the redesignation process can be executed with the options of the electroencephalogram information increased by the additional processing. Therefore, the time required for the calibration process can be shortened as compared with the case where the acquired electroencephalogram information is discarded and the acquisition unit (211) starts over from the acquisition of the electroencephalogram information. Etc. can be reduced.

The electroencephalogram measurement system (10) according to the fifth aspect further includes a selection unit (219) in the fourth aspect. The selection unit (219) executes additional processing by the acquisition unit (211) between the time when the processing unit (215) executes the calibration process and the time when the input unit (216) executes the redesignation process. A selection signal for selecting whether or not to use is received from the operation unit (24).

According to this aspect, for example, by executing the additional processing only when the selection of the electroencephalogram information by the designated signal is not sufficient, the time required for the recalibration processing can be shortened, and the subject (5) and the subject (5) and The burden on medical staff can be reduced.

The electroencephalogram measurement system (10) according to the sixth aspect further includes a presentation unit (220) that presents the result of the calibration process in any one of the first to fifth aspects.

According to this aspect, for example, the accuracy of the electroencephalogram measurement is further reduced by re-doing the calibration process so that the result of the calibration process presented by the presentation unit (220) satisfies a certain standard. It can be further suppressed.

The electroencephalogram measurement system (10) according to the seventh aspect deletes at least one electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit (memory 22) in any one of the first to sixth aspects. A deletion unit (221) is further provided.

According to this aspect, for example, the electroencephalogram information that is inappropriate as the electroencephalogram information used in the calibration process is designated from the electroencephalogram information options based on the designated signal, thereby designating the electroencephalogram information used in the calibration process. (Selection) work becomes relatively easy.

The rehabilitation support system (100) according to the eighth aspect includes an electroencephalogram measurement system (10), an exercise assist device (3), and a control device (4). The exercise assist device (3) applies at least one of mechanical stimulation and electrical stimulation to the subject (5). The control device (4) controls the exercise assist device (3) based on the brain wave information acquired by the acquisition unit (211).

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process from a plurality of electroencephalogram information stored in the storage unit (memory 22). Therefore, in the calibration process, for example, it is possible to accurately determine the parameters by using only the electroencephalogram information that is less affected by the artifact. As a result, the error that occurs in the parameter can be suppressed to a small value, and the decrease in the accuracy of the electroencephalogram measurement can be suppressed.

The electroencephalogram measuring method according to the ninth aspect is an electroencephalogram representing an electroencephalogram collected at an electrode portion (11) arranged at a measurement point (51) which is a part of the head (52) of the subject (5). The information is acquired, and a plurality of brain wave information is stored in the storage unit (memory 22). Further, in this electroencephalogram measuring method, a designated signal for designating one or more electroencephalogram information from a plurality of electroencephalogram information stored in the storage unit is received from the operation unit (24). Further, in this electroencephalogram measurement method, a calibration process for determining parameters used for analysis of electroencephalogram information is executed based on one or more electroencephalogram information designated by a designated signal.

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process from a plurality of electroencephalogram information stored in the storage unit (memory 22). Therefore, in the calibration process, for example, it is possible to accurately determine the parameters by using only the electroencephalogram information that is less affected by the artifact. As a result, the error that occurs in the parameter can be suppressed to a small value, and the decrease in the accuracy of the electroencephalogram measurement can be suppressed.

The program according to the tenth aspect is a program for causing a computer system to execute the electroencephalogram measurement method according to the ninth aspect.

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process from a plurality of electroencephalogram information stored in the storage unit (memory 22). Therefore, in the calibration process, for example, it is possible to accurately determine the parameters by using only the electroencephalogram information that is less affected by the artifact. As a result, the error that occurs in the parameter can be suppressed to a small value, and the decrease in the accuracy of the electroencephalogram measurement can be suppressed.

The non-temporary recording medium according to the eleventh aspect is a non-temporary recording medium readable by the computer system in which a program for causing the computer system to execute the electroencephalogram measurement method according to the ninth aspect is recorded.

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process from a plurality of electroencephalogram information stored in the storage unit (memory 22). Therefore, in the calibration process, for example, it is possible to accurately determine the parameters by using only the electroencephalogram information that is less affected by the artifact. As a result, the error that occurs in the parameter can be suppressed to a small value, and the decrease in the accuracy of the electroencephalogram measurement can be suppressed.

Not limited to the above aspects, various configurations (including modifications) of the electroencephalogram measurement system (10) according to the first embodiment may be performed by an electroencephalogram measurement method, a (computer) program, a non-temporary recording medium on which the program is recorded, or the like. It can be embodied.

The electroencephalogram measurement system (10) according to the twelfth aspect includes a display control unit (218), an input unit (216), and a processing unit (215). The display control unit (218) causes the display unit (26) to display a plurality of brain wave information. The input unit (216) receives a designated signal for designating one or more electroencephalogram information from the plurality of electroencephalogram information from the operation unit (24). The processing unit (215) executes a calibration process for determining parameters used for analysis of the electroencephalogram information based on one or more electroencephalogram information designated by the designated signal.

According to this aspect, it is possible to specify one or more electroencephalogram information used for the calibration process from a plurality of electroencephalogram information. Therefore, in the calibration process, for example, it is possible to accurately determine the parameters by using only the electroencephalogram information that is less affected by the artifact. As a result, the error that occurs in the parameter can be suppressed to a small value, and the decrease in the accuracy of the electroencephalogram measurement can be suppressed.

In the electroencephalogram measurement system (10) according to the thirteenth aspect, in the twelfth aspect, the input unit (216) performs a redesignation process of receiving a designated signal after the processing unit (215) executes the calibration process. Execute. The processing unit (215) re-executes the calibration process based on one or more brain wave information designated by the designated signal received by the input unit (216) in the redesignation process.

According to this aspect, the calibration process can be executed again in a state where one or more electroencephalogram information used for the calibration process is redesignated by the redesignation process. Therefore, compared to the case where the acquired electroencephalogram information is discarded and the acquisition of the electroencephalogram information is restarted, the time required for the calibration process can be shortened, and the burden on the subject (5) and the medical staff can be reduced. ..

In the electroencephalogram measurement system (10) according to the fourteenth aspect, in the thirteenth aspect, the display control unit (218) executes additional processing. The additional processing is divided into a plurality of brain wave information to be displayed on the display unit (26) between the time when the processing unit (215) executes the calibration processing and the time when the input unit (216) executes the redesignation processing. It is a process to add the brain wave information of.

According to this aspect, when the options of the electroencephalogram information by the designated signal are not sufficient, the redesignation process can be executed with the options of the electroencephalogram information increased by the additional processing. Therefore, compared to the case where the acquired electroencephalogram information is discarded and the acquisition of the electroencephalogram information is restarted, the time required for the calibration process can be shortened, and the burden on the subject (5) and the medical staff can be reduced. ..

The configurations according to the second to seventh, thirteen, and fourteenth aspects are not essential configurations for the electroencephalogram measurement system (10) and can be omitted as appropriate.

5 Target person 10 EEG measurement system 11 Electrode part 24 Operation part 26 Display part 51 Measurement point 52 Head 211 Acquisition part 215 Processing part 216 Input part 218 Display control part 219 Selection part 220 Presentation part 221 Delete part

Claims (11)

An acquisition unit that acquires brain wave information representing brain waves collected at an electrode unit located at a measurement point that is a part of the subject's head, and an acquisition unit.
A storage unit that stores a plurality of the electroencephalogram information acquired by the acquisition unit,
An input unit that receives from the operation unit a designated signal that specifies one or more electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit.
A processing unit that executes a calibration process for determining a parameter used for analyzing the brain wave information based on the one or more brain wave information designated by the designated signal is provided .
The input unit executes a redesignation process for receiving the designated signal after the processing unit executes the calibration process.
The processing unit is an electroencephalogram measuring system that re-executes the calibration process based on one or more brain wave information designated by the designated signal received by the input unit in the redesignation process. The electroencephalogram measurement system according to claim 1, further comprising a display control unit for displaying the plurality of electroencephalogram information stored in the storage unit on the display unit. The acquisition unit further acquires the electroencephalogram information and adds it to the storage unit between the time when the processing unit executes the calibration process and the time when the input unit executes the redesignation process. The electroencephalogram measuring system according to claim 1 or 2, wherein the processing is performed. A selection signal for selecting whether or not to execute the additional processing by the acquisition unit between the time when the processing unit executes the calibration process and the time when the input unit executes the redesignation process. The electroencephalogram measurement system according to claim 3, further comprising a selection unit that receives from the operation unit. The electroencephalogram measurement system according to any one of claims 1 to 4, further comprising a presentation unit for presenting the result of the calibration process. The electroencephalogram measurement system according to any one of claims 1 to 5, further comprising a deletion unit that deletes at least one electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit. The electroencephalogram information representing the electroencephalogram collected at the electrode part arranged at the measurement point which is a part of the subject's head is acquired, and a plurality of electroencephalogram information is stored in the storage part.
A designated signal for designating one or more electroencephalogram information from the plurality of electroencephalogram information stored in the storage unit is received from the operation unit, and the operation unit receives the designated signal.
Based on the one or more electroencephalogram information designated by the designated signal, a calibration process for determining the parameters used for the analysis of the electroencephalogram information is executed .
After executing the calibration process, the redesignation process for accepting the designated signal is executed.
A method for measuring an electroencephalogram in which the calibration process is executed again based on one or more electroencephalogram information designated by the designated signal in the redesignation process. For computer systems
A program for executing the electroencephalogram measuring method according to claim 7. For computer systems
A non-temporary recording medium readable by a computer system, which records a program for executing the electroencephalogram measurement method according to claim 7. A display control unit that displays multiple brain wave information on the display unit,
An input unit that receives a designated signal that specifies one or more electroencephalogram information from the plurality of electroencephalogram information from the operation unit, and an input unit.
A processing unit that executes a calibration process for determining a parameter used for analyzing the brain wave information based on the one or more brain wave information designated by the designated signal is provided .
The input unit executes a redesignation process for receiving the designated signal after the processing unit executes the calibration process.
The processing unit is an electroencephalogram measuring system that re-executes the calibration process based on the one or more electroencephalogram information designated by the designated signal received by the input unit in the redesignation process. The display control unit is different from the plurality of electroencephalogram information to be displayed on the display unit between the time when the processing unit executes the calibration process and the time when the input unit executes the redesignation process. The electroencephalogram measurement system according to claim 10 , wherein an additional process for adding electroencephalogram information is executed .

Images