JP3238360U - EEG video coding and playback system - Google Patents

Abstract

An electroencephalogram video coding and playback system is provided. A head-mounted device (10) further including a headband (11), an electroencephalogram detector (12), and a concentration and relaxation index calculator (15) for calculating an electroencephalogram concentration index and a relaxation index of a subject, and a head mount. A processor 20 for receiving and processing the electroencephalogram signal output from the device, the melody conversion mechanism for converting the electroencephalogram signal of a subject in any one time period into a corresponding musical melody based on changes in intensity. 30, a color conversion mechanism 50 for acquiring a plurality of colors corresponding to the electroencephalogram signals of the subject in any one time period based on the type of each electroencephalogram, and music acquired by the melody conversion mechanism. A music reproduction mechanism 40 for reproducing a melody and a screen display mechanism 60 for displaying each color acquired by the color conversion mechanism are provided. [Selection drawing] Fig. 1

Description

The present invention relates to an application of EEG detection, and more particularly to an EEG video coding and reproduction system.

The different brain waves of the human left and right brain delta waves, theta waves, high / low alpha waves, high / low beta waves and high / low gamma waves have different physical and physiological significance, i.e., different states of the subject. By measuring these different brain waves and calculating the numerical values, it is possible to know the degree to which the subject corresponds to the characteristics. The calculation method of related numerical values has already been studied fairly widely academically. In addition, after measuring the electroencephalogram by applying an electroencephalograph, it is academically very deeply sought to know the degree to which the subject corresponds to the characteristic by the algorithm in the chip.

In recent years, the science and technology industry has strongly promoted the "Metaverse", and the most important point is how to imitate the true humanity of human beings and blend into the virtual game world. To create an environment closer to the real world. By applying a non-invasive head-mounted electroencephalograph, it is possible to know the fluctuation of the real-time response of the electroencephalogram at any time. Human emotional reactions are actually expressed in brain waves, and the brain waves cause rhythmic fluctuations. Similarly, the emotions reflected in the brain waves have a correspondence similar to the emotions for human colors. When the emotions are low and sink, the brain waves correspond to dark colors.

The present inventor makes such rhythmic fluctuations of brain waves correspond to fluctuations in the melody and color of music, and expresses them in a music and video system. By broadcasting music and playing video, the message of brain waves is transmitted, and people around us resonate by listening to the music.

The present invention has been made by the intent of the present inventor in view of the above problems, and an object thereof is to provide an electroencephalogram video coding and reproduction system.

This invention, which solves the above-mentioned problems, is based on the relationship between the fluctuation of the brain wave and the rhythm and the lightness and darkness of the color of the human body based on the many years of research and understanding of the brain wave conducted by the inventor. It expresses the fluctuation of brain waves by making it correspond to the melody of music and the color of the image, integrating the conventional hardware and software technology, and applying the reproduction of music and the display of the image. The message of the brain wave is transmitted by broadcasting the music and displaying the image so that the surrounding people can resonate by listening to the music and seeing the image.

Since the present invention is configured as described above, it has the effects described below.

Other objectives, configurations and effects of the present invention will be clarified from the sections of the embodiments of the present invention below.

It is a block diagram which shows the combination structure of the main member of the electroencephalogram video coding and reproduction system which concerns on one Example of this invention. It is a schematic block diagram which shows the head mount device of this invention. It is a schematic block diagram which shows the system configuration of this invention.

Hereinafter, embodiments of the present invention will be specifically described, but the present invention is not limited thereto.

Next, the brain wave video coding and reproduction system according to the present invention will be described with reference to FIGS. 1 to 3.

The brain wave video coding and reproduction system of the present invention that solves the above problems mainly includes the following configurations.

<Head mount device 10>
It is used to detect the EEG signal of the subject. At the time of use, the head mount device 10 is erected on the head of the subject. As shown in FIGS. 1 and 2, the head mount device 10 is located in the head band 11, the brain wave detector 12 located in the head band 11 and used for detecting the brain wave, and the brain wave detector 12. The concentration and relaxation index calculator 15 and the brain wave detector 12 and the concentration and relaxation index which are connected and acquire the attention index and the relaxation index of the subject's brain waves based on the detection data of the brain waves. It is connected to the computer 15 and includes an electroencephalogram transmitter / receiver 14 for transmitting an electroencephalogram signal to the outside. Various algorithms for obtaining the Attention Index and Meditation Index from brain wave data have already had a great deal of research results in the prior art, and the Concentration and Relaxation Index Calculator 15 applies conventional software logic. These indexes are calculated, and the description thereof will be omitted here.

<Processor 20>
It is connected to the head mount device 10 and receives and processes an electroencephalogram signal of a sequence output from the head mount device 10. These EEG signals are the delta waves, theta waves, high / low alpha waves, high / low beta waves, high / low gamma waves, attention index and meditation of the left and right brains of the human body. Includes index and. As shown in FIGS. 1 and 3, the processor 20 mainly includes the following configurations.

<Processing end transceiver 21>
It is connected to the electroencephalogram transceiver 14 of the head mount device 10 and is used to receive a signal emitted from the electroencephalogram transceiver 14.

<Melody conversion mechanism 30>
It is connected to the processing end transceiver 21 and converts an electroencephalogram signal in any one time zone of a subject into a corresponding music melody based on a change in intensity. This method mainly involves changes in the intensity of the Attention and Meditation indexes, as well as left and right brain delta, theta, high / low alpha, high / low beta and high / low beta waves in the EEG waveform. It is based on changes in the intensity of high / low gamma waves.

<Color conversion mechanism 50>
It is connected to the processing end transceiver 21 and makes the electroencephalogram signal of any one time zone of the subject correspond to a different color for each type of electroencephalogram.

<Music playback mechanism 40>
It is connected to the melody conversion mechanism 30 and is used to reproduce the music melody acquired by the melody conversion mechanism 30.

<Screen display mechanism 60>
It is connected to the color conversion mechanism and is used to display each color acquired by the color conversion mechanism 50.

The processor 20 is installed in various different electronic information devices such as a personal computer, a mobile phone, or a tablet terminal.

The melody conversion mechanism 30 mainly includes the following configurations.

<Brain wave change calculator 31>
For each subject's EEG parameters, the difference in intensity between each of the two time points adjacent to the front and back is calculated. The brain wave parameters are selected from Att, Med, δ, θ, α ⁻ , α ⁺ , β ⁻ , β ⁺ , γ ⁻ , and γ ⁺ . Att indicates the concentration index, Med indicates the relaxation index, δ indicates the delta wave, θ indicates theta wave, α ⁻ indicates the low alpha wave, α ⁺ indicates the high alpha wave, and β ⁻ indicates the high alpha wave. Low beta wave, β ⁺ indicates high beta wave, γ ⁻ indicates low gamma wave, and γ ⁺ indicates high gamma wave.

<Encoder 32>
It is connected to the electroencephalogram change computer 31, and the change in the intensity difference corresponding to each electroencephalogram parameter is coded as a binary number value corresponding to each electroencephalogram parameter in a certain time zone.

<Sound range converter 33>
The corresponding range is coded based on the binary values of the concentration index and the relaxation index of each time zone connected to the encoder 32 and coded by the encoder 32. The binary value of each brain wave parameter coded by the encoder in each time zone is coded for the corresponding note and pitch in each range.

The range converter 33 further has a time signature calculation function for calculating each note in each range into a corresponding time signature.

<Melody creator 35>
Each note of each time zone connected to the range converter 33 and converted by the range converter 33 is arranged in a specific order to create a music melody of each time zone, and the music melody is transmitted to the music reproduction mechanism 40. Output and play.

The color conversion mechanism 50 corresponds the frequency band of each brain wave to a different color, the delta wave corresponds to white, theta wave corresponds to red, the low alpha wave corresponds to orange, and the high alpha wave corresponds to yellow. Low beta waves correspond to green, high beta waves correspond to blue, low gamma waves correspond to indigo, and high gamma waves correspond to purple. When the music reproduction mechanism 40 reproduces music, the music reproduction mechanism 40 transmits and displays the corresponding color to the screen display mechanism 60 based on the frequency band of the brain wave corresponding to each note.

The processor 20 is connected to the music reproduction mechanism 40 and the screen display mechanism 60, classifies the numerical values of each brain wave parameter at each time point into a plurality of types based on the magnitude of the amplitude, and each type has a different volume. It is further provided with a volume and color density selector 70 for controlling the magnitude of the volume of the music reproduction mechanism 40 and the color density displayed on the screen display mechanism 60, respectively.

The music reproduction mechanism 40 further includes a musical instrument selector 41 for receiving a musical instrument type designated by the subject and playing a musical melody using the timbre of the musical instrument. As a result, when there are a plurality of subjects, the melody played by different musical instruments is combined as a compound music melody.

The music reproduction mechanism 40 reproduces the melody of the melody conversion mechanism 30 in the MIDI format.

Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment and includes design changes and the like within a range not deviating from the gist of the present invention.

10 Head mount device 11 Headband 12 Brain wave detector 14 Brain wave transmitter / receiver 15 Concentration and relaxation index calculator 20 Processor 21 Processing end transmitter / receiver 30 Melody conversion mechanism 31 Brain wave change calculator 32 Encoder 33 Range converter 35 Melody creator 40 Music playback mechanism 41 Musical instrument selector 50 Color conversion mechanism 60 Screen display mechanism 70 Volume and color density selector

Claims (6)

A headband used to detect an electroencephalogram signal of a subject, an electroencephalogram detector located in the headband and used to detect an electroencephalogram, and an electroencephalogram detector connected to the electroencephalogram detector of the brain wave. An electroencephalogram signal connected to an electroencephalogram detector and an electroencephalogram detector and an electroencephalogram signal that acquires an electroencephalogram concentration index and a relaxation index based on detection data. With a head mount device, including a brain wave transmitter / receiver for transmitting to the outside,
It is connected to the head mount device, receives and processes the brain wave signals of the sequence output from the head mount device, and these brain wave signals include delta waves and theta waves of the left and right brains of the human body, and high / low. A processor comprising an alpha wave, a high / low beta wave, a high / low gamma wave, an Attention index and a / Meditation index.
A processing end transceiver connected to the electroencephalogram transmitter / receiver of the head mount device and for receiving a signal emitted from the electroencephalogram transmitter / receiver.
A melody conversion mechanism connected to the processing end transceiver and for converting an electroencephalogram signal in any one time zone of a subject into a corresponding music melody based on a change in intensity.
A processor connected to the processing end transceiver and provided with a color conversion mechanism for making an electroencephalogram signal of any one time zone of a subject correspond to a different color for each type of electroencephalogram.
A music reproduction mechanism connected to the melody conversion mechanism and for reproducing the music melody acquired by the melody conversion mechanism, and
An electroencephalogram video coding and reproduction system which is connected to the color conversion mechanism and includes a screen display mechanism for displaying each color acquired by the color conversion mechanism. The melody conversion mechanism is
It is an electroencephalogram change calculator that calculates the difference in intensity between two time points adjacent to each other for various electroencephalogram parameters of the subject, and the electroencephalogram parameters are Att, Med, δ, θ, α ⁻ , α ⁺ , β. Select from- ^, β ⁺ , γ- ^, and γ ⁺ , Att indicates concentration index, Med indicates relaxation index, δ indicates delta wave, θ indicates theta wave, ^and α- indicates low alpha wave. Α ⁺ indicates a high alpha wave, β ⁻ indicates a low beta wave, β ⁺ indicates a high beta wave, γ ⁻ indicates a low gamma wave, and γ ⁺ indicates an electroencephalogram change computer indicating a high gamma wave.
An encoder connected to the EEG change calculator and coding the change in the intensity difference corresponding to each EEG parameter to the corresponding binary value of each EEG parameter in a certain time zone.
A range converter connected to the encoder and coding the corresponding range based on the binary values of the concentration index and the relax index of each time zone coded by the encoder, in each time zone coded by the encoder. The binary values of each brain wave parameter are the range converters coded for the corresponding notes and pitches in each range.
Connected to the range converter, each note in each time zone converted by the range converter is arranged in a specific order, a music melody for each time zone is created, and the music melody is output to the music playback mechanism. The brain wave video coding and reproduction system according to claim 1, further comprising a melody creating machine for reproducing the music. The brain wave video coding and reproduction system according to claim 2, wherein the range converter further includes a time signature calculation function for calculating a time signature corresponding to each note in each range. The color conversion mechanism corresponds the frequency band of each brain wave to a different color, the delta wave corresponds to white, theta wave corresponds to red, the low alpha wave corresponds to orange, and the high alpha wave corresponds to yellow. Corresponding, low beta wave corresponds to green, high beta wave corresponds to blue, low gamma wave corresponds to indigo color, high gamma wave corresponds to purple, and when the music reproduction mechanism plays music, The brain wave video coding and reproduction system according to claim 3, wherein each note transmits and displays the corresponding color to the screen display mechanism based on the corresponding brain wave frequency band. The processor is connected to the music playback mechanism and the screen display mechanism, classifies the numerical values of each brain wave parameter at each time point into a plurality of types based on the magnitude of the amplitude, and each type has a different volume and a different volume. The first aspect of the present invention is that the music reproduction mechanism is further provided with a volume and a color density selector for controlling the loudness of the volume and the color density displayed on the screen display mechanism by corresponding to each color density. The brain wave video coding and playback system described in. The music reproduction mechanism further includes an instrument selector that receives the type of musical instrument specified by the subject and plays a musical melody using the tone of the musical instrument, and if there are a plurality of subjects, the melody to be played by different musical instruments. The brain wave video coding and reproduction system according to claim 1, wherein the music is combined as a composite music melody.

Images