TW202345749A - Brain wave audio/video encoding and playback system characterized by using the manner of music playback and image display to present the change and information of brain wave, thereby people can resonate with it by listening to the music and watching the image - Google Patents

Abstract

A brain wave audio/video encoding and playback system includes: a head-mounted instrument that is used to monitor testee's brain wave signals and consists of a head-mounted ring, a brain wave monitor, and an attention/meditation index calculator used to calculate testee's attention index and meditation index of brain wave; and a processing unit that is used to receive and process the brain wave signals output by the head-mounted instrument and includes: a melody converting mechanism used to be based on a specified algorithm to convert the testee's brain wave signals within a period of time into a corresponding music melody, a color converting mechanism used to be based on a specified algorithm to convert the testee's brain wave signals within a period of time into several corresponding colors, a music playback mechanism used to play the music melody obtained by the melody converting mechanism, and a picture displaying mechanism used to display various colors obtained by the color converting mechanism.

Description

Brainwave video encoding and playback system

The present invention relates to the application of brainwave analysis, in particular to a brainwave video encoding and playback system.

In the academic field of knowledge, in-depth research has been done on the brain wave phenomena corresponding to various activities of the human brain (including relaxation, hearing, memory, attention, logical judgment, vision, and reaction), and it can be based on Different mental activities calculate corresponding brain wave values for analysis.

Delta waves, Theta waves, High/Low Alpha waves, High/Low Beta waves and High/Low Gamma waves of the left and right brains of the human body. These different brain waves have different physical and physiological meanings, and also represent different characteristics of the subjects. state, so by measuring these different brain waves and performing numerical calculations, the degree of the subject's corresponding characteristics can be known. Relevant numerical operation methods have been extensively studied academically. Moreover, there are also very in-depth academic discussions on the use of electroencephalographs to measure brain waves and then use the algorithm in the chip to determine the degree of the subject's corresponding characteristics.

Technology has become increasingly sophisticated. In recent years, the scientific and technological community has vigorously advocated the "Metaverse" (Metaverse). A very important point is how to imitate the true human characteristics of human beings in order to integrate them into the virtual game world to create a worldly environment that is closer to reality. By using a head-mounted non-invasive brain wave meter, you can know the changes in brain wave responses at any time. Human emotional reactions will be realistically represented in brain waves, and they will also Causes rhythmic changes in brain waves. The emotions reflected by the same brain waves also have a similar correspondence with human feelings of color. For example, the brain waves when anxious will make the colors feel deep and have a rapid trembling effect. The brain waves displayed when the mood is low will correspond to Dark colors.

Therefore, based on the understanding and professional knowledge of this aspect, combined with many years of experience in the latest scientific and technological research, the inventor hopes to map the rhythmic changes of brain waves to the changes of musical melody and color, and use music and images to presented in a way. Through the playback of music and images, brain wave information is transmitted, so that people around you can resonate with the music.

A new digital encoding system for brainwave characteristics is proposed to solve the above-mentioned shortcomings of previous technologies.

Therefore, the purpose of the present invention is to solve the above-mentioned conventional technical problems. The present invention proposes a brainwave video encoding and playback system. In this case, the inventor found out the characteristics of brainwaves based on years of research and understanding of brainwaves. The changes are related to the rhythm of the human body's sense of sound and the light and dark colors, and the changes in brain waves are mapped to the music melody and image colors. Therefore, the above rules are created, and the changes in brain waves can be presented in the form of music playback and image display. . Through the playing of music and the display of images, brain wave information is transmitted, so that people around you can resonate with it by listening to the music and watching the images.

In order to achieve the above objectives, the present invention proposes a brainwave video encoding and playback system, which includes a head-mounted instrument for detecting the brain wave signal of a subject. The head-mounted instrument includes a headband, a brain wave A detector is located on the headband for detecting brain waves. A concentration and relaxation index calculator is connected to the brain wave detector for applying a specific algorithm to the brain wave detection data to obtain the measured results. By The concentration (Attention) index and the relaxation (Meditation) index of the brain waves, and an electroencephalograph transceiver is connected to the brain wave detector and the concentration and relaxation index calculator for transmitting the brain wave signals to External transmission; a processing unit is connected to the head-mounted instrument, receives and processes a sequence of brain wave signals output by the head-mounted instrument; these brain wave signals include Delta waves, Theta waves, High/Low Alpha wave, High/Low Beta wave and High/Low Gamma wave, as well as concentration (Attention) index and relaxation (Meditation) index; the processing unit includes a processing end transceiver connected to the brain waves of the head-mounted device A transceiver is used to receive signals transmitted from the electroencephalograph transceiver; a melody conversion mechanism is connected to the processing end transceiver and is used to convert the brain wave signals of the subject during a period of time according to a specific algorithm. The corresponding music melody is output; a color conversion mechanism is connected to the processing terminal transceiver, and is used to obtain the corresponding color according to the brain wave signal of the subject in a period of time according to a specific algorithm; a music playing mechanism is connected to the melody A conversion mechanism is used to play the music melody obtained by the melody conversion mechanism; and a picture display mechanism is connected to the color conversion mechanism and is used to display various colors obtained by the color conversion mechanism.

The features and advantages of the present invention can be further understood from the following description. Please refer to the accompanying drawings when reading.

10:Head mounted instrument

11:Headband

12:Brain wave detector

14: EEG transceiver

15:Relaxation Index Calculator

20: Processing unit

21: Processing end transceiver

30: Melody conversion mechanism

31: Brain wave change calculation unit

32: Coding unit

33:Voice range conversion unit

35: Melody building unit

40:Music player organization

41: Instrument selection unit

50: Color conversion mechanism

60:Screen display mechanism

70: Volume and color density selection mechanism

331: Beat calculation unit

Figure 1 shows the block diagram of the main component combination of this project.

Figure 2 shows a schematic diagram of the head-mounted instrument in this case.

Figure 3 shows the block diagram of the system architecture of this case.

Figure 4 shows the intensity difference table calculated from various brain wave parameters in this case.

Figure 5 shows the coding table calculated for the coding unit of this case.

Figure 6A shows the note conversion result table of the first musical range of this case.

Figure 6B shows the note conversion result table of the first musical range of this case, which is continued from the content of Figure 6A.

Figure 7A shows the note conversion result table of the second musical range of this case.

Figure 7B shows the note conversion result table of the second musical range of this case, which is continued from Figure 7A.

Figure 7C shows the note conversion result table of the second musical range of this case, which is continued from the content of Figure 7B.

Figure 7D shows the note conversion result table of the second musical range of this case, which is continued from the content of Figure 7C.

Figure 7E shows the note conversion result table of the second musical range of this case, which is continued from the content of Figure 7D.

Figure 8A shows the note conversion result table of the third musical range of this case.

Figure 8B shows the note conversion result table of the third musical range of this case, which is continued from Figure 8A.

Figure 8C shows the note conversion result table of the third musical range of this case, which is a continuation of the content of Figure 8B.

Figure 8D shows the note conversion result table of the third musical range of this case, which is continued from the content of Figure 8C.

Figure 8E shows the note conversion result table of the third musical range of this case, which is a continuation of the content of Figure 8D.

Figure 9A shows the note conversion result table of the fourth musical range of this case.

Figure 9B shows the note conversion result table of the fourth musical range of this case, which is continued from the content of Figure 9A.

Figure 9C shows the note conversion result table of the fourth musical range of this case, which is a continuation of the content of Figure 9B.

Figure 10A shows the beat conversion result table of this case.

Figure 10B shows the beat conversion result table of this case, which is a continuation of the content of Figure 10A.

Figure 10C shows the beat conversion result table of this case, which is a continuation of the content of Figure 10B.

Figure 10D shows the beat conversion result table of this case, which is a continuation of the content of Figure 10C.

Figure 10E shows the beat conversion result table of this case, which is a continuation of the content of Figure 10D.

Figure 10F shows the beat conversion result table of this case, which is a continuation of the content of Figure 10E.

Hereby we would like to share the structure and composition of this case, as well as the functions and advantages it can produce. With reference to the drawings, one preferred embodiment of this case will be described in detail as follows.

Please refer to Figures 1 to 3, which show the brainwave video encoding and playback system of the present invention, including the following components:

A head-mounted instrument 10 is used to detect the brain wave signal of the subject. When in use, the head-mounted instrument 10 is installed on the subject's head. As shown in Figures 1 and 2, the head-mounted instrument 10 includes a head-mounted ring 11, a brain wave detector 12 on the head-mounted ring 11 for detecting brain waves, a level of concentration and a degree of relaxation. The index calculator 15 is connected to the brainwave detector 12 and is used to apply a specific algorithm (this is well known in the art and will not be described in detail again) to the brainwave detection data to obtain the brainwave index of the subject. The concentration (Attention) index and the relaxation (Meditation) index, and an electroencephalograph transceiver 14 are connected to the brain wave detector 12 and the concentration and relaxation index calculator 15 for transmitting the electroencephalogram signal outward. Teleport.

A processing unit 20 is connected to the head-mounted instrument 10, receives a sequence of brain wave signals output by the head-mounted instrument 10, and processes them. These brain wave signals include Delta waves, Theta waves, High/Low Alpha waves, High/Low Beta waves and High/Low Gamma waves of the left and right brains of the human body, as well as the Attention index and Meditation index. As shown in Figures 1 and 3, the processing unit 20 includes:

A processing end transceiver 21 is connected to the electroencephalograph transceiver 14 of the head-mounted instrument 10 for receiving signals transmitted from the electroencephalograph transceiver 14 .

A melody conversion mechanism 30 is connected to the processing end transceiver 21 for converting the subject's brainwave signals in a period of time into a corresponding musical melody according to a specific algorithm. The method is mainly based on concentration Changes in (Attention) index and relaxation (Meditation) index, as well as changes in the Delta wave, Theta wave, High/Low Alpha wave, High/Low Beta wave and High/Low Gamma wave of the left and right brain in the brain wave waveform.

A color conversion mechanism 50 is connected to the processing end transceiver 21 and is used to convert the subject's brainwave signals in a period of time to obtain multiple corresponding colors according to a specific algorithm.

A music playing mechanism 40 is connected to the melody converting mechanism 30 for playing the music melody obtained by the melody converting mechanism 30 .

A picture display mechanism 60 is connected to the color conversion mechanism and used to display various colors obtained by the color conversion mechanism 50 .

The processing unit 20 can be installed in various electronic information devices, such as computers, mobile phones, tablets, etc.

The melody conversion mechanism 30 includes:

An brainwave change calculation unit 31 calculates the intensity differences D _t of each of the subject's various brainwave parameters X at each two adjacent time points t-1 and t, and t is greater than 0. The brain wave parameter X is selected from Att, Med, δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ . Among them, Att represents concentration index, Med represents relaxation index, δ represents Delta wave, θ represents Theta wave, α ^- represents Low Alpha wave, α ⁺ represents High Alpha wave, β ^- represents Low Beta wave, and β ⁺ represents High Beta wave. , γ ^- represents Low Gamma wave, γ ⁺ represents High Gamma wave. The calculated values are shown in Figure 4, which shows the calculation results of D ₁ to D ₈ corresponding to each brain wave parameter X.

An encoding unit 32 is connected to the brainwave change calculation unit 31, and encodes the change in the intensity difference corresponding to each brainwave parameter X into a corresponding binary value of each brainwave parameter X in the period T _n , the period T _n represents the nth period, and n is greater than 0. The encoding unit 32 creates a encoding table from these binary values. The encoding table uses each brain wave parameter X as a row and the period T _n as a column. Each binary value in the coding table is expressed as X(T _{n )} or T _n (X). X(T _n ) represents the intersection of the row corresponding to the brain wave parameter The carry value, T _n (X) represents the binary value at the intersection of the column corresponding to period T _n and the row corresponding to brain wave parameter X, that is, X (T _n ) and T _n (X) will correspond to the coding table. Binary values in the same position.

_The way _{to determine the value of} 0 and D _n-1 is 0, then X(T _n ) is 0;

When one of D _n and D _n-1 is greater than 0 and the other is less than 0, or D _n is 0 and D _n-1 is greater than 0, or D _n is 0 and D _n-1 is less than 0, then X(T _n ) is 1.

The encoding table of the encoding unit 32 is shown in FIG. 5 , which displays the encoding results of each brain wave parameter X in the time period T ₁ to T ₇ .

A sound range conversion unit 33 is connected to the encoding unit 32 and selects the corresponding sound range mode according to the binary value of the concentration index and relaxation index of each period T _n in the encoding table. Different sound range modes are applied in each sound range mode. The conversion rule converts the binary value of each brainwave parameter X in the encoding table into the note and pitch corresponding to the period T _n . Each note is converted from the binary value of at least one corresponding brainwave parameter. By.

The method is to determine the vocal range mode of T _n for a certain period of time based on the value of T _n (Att, Med), where T _n (Att, Med) = T _n (Att) × 2 + T _n (Med). Each range mode includes multiple note ranges, and each note range includes at least one corresponding note, and each note is generated in a specific order; the pitch range of each note range is one octave, and the corresponding note ranges Notes are an octave apart in pitch. It defines 0~7 as the eight notes in an octave.

The conversion methods of each range mode are as follows:

When T _n (Att, Med)=0, it is the first range mode, and its note ranges are the first note range, the second note range, the third note range and the fourth note range in ascending order according to the pitch. .

Among them, the notes in the first note range in the period T _n are in sequence:

δ(T _n )×2 ² +δ(T _n+1 )×2+δ(T _n+2 ), and

θ(T _n )×2 ² +θ(T _n+1 )×2+θ(T _n+2 );

Among them, the notes in the second note range in the period T _n are as follows:

(α ^- )(T _n )×2 ² +(α ^- )(T _n+1 )×2+(α ^- )(T _n+2 ), and

(α ⁺ )(T _n )×2 ² +(α ⁺ )(T _n+1 )×2+(α ⁺ )(T _n+2 );

Among them, the notes in the third note range in the period T _n are as follows:

(β ^- )(T _n )×2 ² +(β ^- )(T _n+1 )×2+(β ^- )(T _n+2 ), and

(β ⁺ )(T _n )×2 ² +(β ⁺ )(T _n+1 )×2+(β ⁺ )(T _n+2 );

Among them, the notes in the fourth note range in the period T _n are as follows:

(γ ^- )(T _n )×2 ² +(γ ^- )(T _n+1 )×2+(γ ^- )(T _n+2 ), and

(γ ⁺ )(T _n )×2 ² +(γ ⁺ )(T _n+1 )×2+(γ ⁺ )(T _n+2 ).

The conversion results of the first range mode are shown in FIGS. 6A to 6B , in which the conversion result tables for the time periods T ₁ , T ₂ , T ₃ , T ₄ and T _n are displayed.

When T _n (Att, Med)=1, it is the second range mode, and its note ranges are the first note range, the second note range and the third note range in ascending order according to the pitch. Among them, the brain wave parameter sequence K = "δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ , δ, θ, α ^- , α ⁺ " is defined. The i-th element of the sequence K is represented by K _i , such as K ₄ represents α ⁺ and K ₈ represents γ ⁺ .

Among them, the notes M _n in the first note range in the period T _n are in sequence:

(Att)(T _n )×2 ² +(Att)(T _n+1 )×2+(Att)(T _n+2 ), and

(Med)(T _n )×2 ² +(Med)(T _n+1 )×2+(Med)(T _n+2 );

Among them, the notes in the second note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=1~8.

Among them, the notes in the third note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=1~8.

The above-mentioned second and third note ranges are converted into corresponding notes in order from small to large according to the i value.

The conversion results of the second range mode are shown in FIGS. 7A to 7E , in which the conversion result tables for the time periods T ₁ , T ₂ , T ₃ and T _n are displayed.

When T _n (Att, Med)=2, it is the third range mode. The note ranges are the first note range, the second note range, the third note range and the fourth note range according to the pitch in ascending order. . The brainwave parameter sequence K = "δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ , δ, θ, α ^- , α ⁺ " is defined. The i-th element of the sequence K is represented by K _i , such as K ₄ represents α ⁺ and K ₈ represents γ ⁺ .

Among them, the notes in the first note range in the period T _n are in sequence:

(Att)(T _n )×2 ² +(Att)(T _n+1 )×2+(Att)(T _n+2 ), and

(Med)(T _n )×2 ² +(Med)(T _n+1 )×2+(Med)(T _n+2 );

Among them, the notes in the second note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=1~8.

Among them, the notes in the third note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=1~4.

Among them, the notes in the fourth note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=5~8.

The above-mentioned second, third and fourth note ranges are converted into corresponding notes in order from small to large according to the i value.

The conversion results of the third range mode are shown in FIGS. 8A to 8E , which display conversion result tables for periods T ₁ , T ₂ , T ₃ and T _n .

When T _n (Att, Med)=3, it is the fourth range mode. The note ranges are the first note range, the second note range, the third note range and the fourth note range according to the pitch in ascending order. . The brainwave parameter sequence K = "δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ , δ, θ, α ^- , α ⁺ " is defined. The i-th element of the sequence K is represented by K _i , such as K ₄ represents α ⁺ and K ₈ represents γ ⁺ .

Among them, the notes in the first note range in the period T _n are in sequence:

(K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=1~4.

Among them, the notes in the second note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=5~8.

Among them, the notes in the third note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=1~4.

Among them, the notes in the fourth note range in the period T _n are as follows:

(K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=5~8.

The above note ranges are converted into corresponding notes in order from small to large according to the i value.

The conversion results of the fourth range mode are shown in FIGS. 9A to 9C , which display conversion result tables for periods T ₁ , T ₂ , T ₃ and T _n .

The range conversion unit 33 also includes a beat calculation unit 331, which calculates the corresponding beat according to the conversion rules of each note.

It is defined that 0 represents full beat, 1 represents 1/2 beat, 2 represents 1/4 beat, and 3 represents 1/8 beat.

The beat calculation unit 331 calculates the beat in the following manner:

The note with the conversion rule of (Att)(T _n )×2 ² +(Att)(T _n+1 )×2+(Att)(T _n+2 ) has the beat of (Med)(T _n ) ×2+(Med)(T _n+1 ).

The note with the conversion rule of (Med)(T _n )×2 ² +(Med)(T _n+1 )×2+(Med)(T _n+2 ) has the beat of (Att)(T _n ) ×2+(Att)(T _n+1 ).

The note with the conversion rule of (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ) has a beat of (K _{i+ 3} )(T _n )×2+(K _i+4 )(T _n ), where i=1~8.

The note with the conversion rule of δ(T _n )×2 ² +δ(T _n+1 )×2+δ(T _n+2 ) has a beat of θ(T _n )×2+θ(T _{n+ 1} ).

The note with the conversion rule of θ(T _n )×2 ² +θ(T _n+1 )×2+θ(T _n+2 ) has a beat of δ(T _n )×2+δ(T _{n+ 1} ).

The note with the conversion rule of (α ^- )(T _n )×2 ² +(α ^- )(T _n+1 )×2+(α ^- )(T _n+2 ) has the beat of (α ⁺ ) (T _n )×2+(α ⁺ )(T _n+1 ).

The note with the conversion rule of (α ⁺ )(T _n )×2 ² +(α ⁺ )(T _n+1 )×2+(α ⁺ )(T _n+2 ) has a beat of (α ^- ) (T _n )×2+(α ^- )(T _n+1 ).

The note with the conversion rule of (β ^- )(T _n )×2 ² +(β ^- )(T _n+1 )×2+(β ^- )(T _n+2 ) has a beat of (β ⁺ ) (T _n )×2+(β ⁺ )(T _n+1 ).

The note with the conversion rule of (β ⁺ )(T _n )×2 ² +(β ⁺ )(T _n+1 )×2+(β ⁺ )(T _n+2 ) has a beat of (β ^- ) (T _n )×2+(β ^- )(T _n+1 ).

The note with the conversion rule of (γ ^- )(T _n )×2 ² +(γ ^- )(T _n+1 )×2+(γ ^- )(T _n+2 ) has a beat of (γ ⁺ ) (T _n )×2+(γ ⁺ )(T _n+1 ).

The note with the conversion rule of (γ ⁺ )(T _n )×2 ² +(γ ⁺ )(T _n+1 )×2+(γ ⁺ )(T _n+2 ) has a beat of (γ ^- ) (T _n )×2+(γ ^- )(T _n+1 ).

The conversion results of the beat calculation unit 331 are shown in FIGS. 10A to 10F , in which conversion result tables for periods T ₁ , T ₂ and T _n are displayed.

A melody creation unit 35 is connected to the range conversion unit 33, and arranges the notes in each period _Tn converted by the range conversion unit 33 in a specific order according to a specific algorithm, thereby establishing the music melody of each period _Tn . , and output the music melody to the music playing mechanism 40 for playing.

The method is to determine the sorting method of each note obtained by T _n in a certain period of time based on the value of T _n+1 (Att, Med), where T _n+1 (Att, Med) = T _n+1 (Att)×2 +T _n+1 (Med).

When T _n+1 (Att, Med)=0, then the note ranges corresponding to the period T _n are arranged from low to high according to their pitch range; where for all the notes in each note range:

If each note in the note range is converted from a single brain wave parameter Y, where the brain wave parameter Y is selected from δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ , such as δ(T _n )×2 ² +δ(T _n+1 )×2+δ(T n ₊₂ ) and θ(T _n )×2 ² +θ of the first note range of the first range mode (T _n+1 )×2+θ(T _n+2 ), then these notes are calculated according to their corresponding brain wave parameters δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ Arrange in order.

If each note in the note range is not converted by the above-mentioned single brain wave parameter Y, then these notes will be arranged from the first note to the last note in the order of their production, for example, for the second note of the second range mode Each note in the note range is (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), in the order of i=1~8 arrangement.

When T _n+1 (Att, Med)=1, the first note of each note range corresponding to period T _n is arranged at the first time point at the same time, and the second note of each note range is arranged at the first time point at the same time. At 2 time points, arrange the M-th notes of each note range at the M-th time point at the same time according to the above method, where M is greater than 0. When the number of notes in each note range corresponding to the period T _n is different, when the notes in the note range with a smaller number of notes are exhausted, the notes will be added to the sequence starting from the first note. The music playing mechanism 40 will simultaneously play all the corresponding notes at each time point to achieve a mixing effect.

When T _n+1 (Att, Med)=2, first arrange the note ranges corresponding to the period T _n according to their pitch ranges from low to high, and the notes in each note range in the order of their production are Arrange from the first note to the last note. Then, each note range is arranged once again according to its pitch range from high to low, and the notes in each note range are arranged in a reverse manner from the last note to the first note in the order in which they are produced. Repeat the arrangement in the same manner as above.

When T _n+1 (Att, Med)=3, then the note ranges corresponding to the period T _n are arranged from high to low according to their pitch ranges; where for all the notes in each note range:

If each note in the note range is converted by a single brain wave parameter Z, where the brain wave parameter Z is selected from γ ⁺ , γ ^- , β ⁺ , β ^- , α ⁺ , α ^- , θ, δ, such as δ(T _n )×2 ² +δ(T _n+1 )×2+δ(T n ₊₂ ) and θ(T _n )×2 ² +θ of the first note range of the first range mode (T _n+1 )×2+θ(T _n+2 ), then these notes are calculated according to their corresponding brain wave parameters γ ⁺ , γ ^- , β ⁺ , β ^- , α ⁺ , α ^- , θ, δ Arrange in order.

If each note in the note range is not converted by the above-mentioned single brain wave parameter Z, then the notes are arranged in reverse order from the last note to the first note in the order of their production, for example, for the second range Each note in the second note range of the pattern is (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), according to i=8 The order of ~1 is reversed.

The color conversion mechanism 50 corresponds each brain wave band to a different color, in which Delta waves correspond to white, Theta waves correspond to red, Low Alpha waves correspond to orange, High Alpha waves correspond to yellow, and Low Beta waves correspond to green. , High Beta waves correspond to blue, Low Gamma waves correspond to indigo, and High Gamma waves correspond to purple. When the music playing mechanism 40 plays music, the corresponding color is transmitted to the picture display mechanism 60 for display according to the brain wave band corresponding to each note.

The processing unit 20 also includes a volume and color density selection mechanism 70, which is connected to the music playing mechanism 40 and the image display mechanism 60, and is used to divide the values of each brain wave parameter at each time point into multiple categories according to their amplitudes. , each category corresponds to a different volume and color density, so as to control the volume of the music player 40 and the color density displayed by the screen display mechanism 60 .

The music playing mechanism 40 further includes an instrument selection unit 41 that receives the type of instrument specified by the subject and uses the timbre of the instrument to play the music melody. Therefore, when there are multiple subjects, the melodies played by different instruments can be combined into a composite music melody.

The music playing mechanism 40 can play the melody of the melody converting mechanism 30 in MIDI format.

In this case, based on years of research and understanding of brain waves, the inventor found out the relationship between brain wave changes and the human body's rhythm of sound and color light and shade, and mapped the brain wave changes to music melody and image color, thus creating Based on the above rules, the changes in brain waves can be displayed through music playback and image display. Through the playing of music and the display of images, brain wave information is transmitted, so that people around you can resonate with it by listening to the music and watching the images.

To sum up, the humanized and considerate design of this case is quite in line with actual needs. Its specific improvement has the existing deficiencies, and it has obvious breakthrough advantages compared to the conventional technology, and it does have an improvement in efficacy, and it is not easy to achieve. This case has not been published or disclosed in domestic or foreign documents or markets, and it complies with the provisions of the patent law.

The above detailed description is a specific description of one possible embodiment of the present invention. However, this embodiment is not intended to limit the patent scope of the present invention. Any equivalent implementation or modification that does not depart from the technical spirit of the present invention shall be included in within the scope of the patent in this case.

10:Head mounted instrument

11:Headband

12:Brain wave detector

14: EEG transceiver

15:Relaxation Index Calculator

20: Processing unit

21: Processing end transceiver

30: Melody conversion mechanism

40:Music player organization

50: Color conversion mechanism

60:Screen display mechanism

Claims (14)

A brainwave video encoding and playback system, including: A head-mounted instrument is used to detect brain wave signals of a subject. The head-mounted instrument includes a head-band, a brain-wave detector located on the head-band for detecting brain waves, and a The concentration and relaxation index calculator is connected to the brainwave detector and is used to apply a specific algorithm to the brainwave detection data to obtain the subject's brainwave concentration (Attention) index and relaxation (Meditation) index. , and an electroencephalograph transceiver connected to the electroencephalogram detector and the concentration and relaxation index calculator for transmitting electroencephalogram signals outward; A processing unit is connected to the head-mounted instrument, receives and processes a sequence of brain wave signals output by the head-mounted instrument; these brain wave signals include Delta waves, Theta waves, and High/Low of the left and right brains of the human body. Alpha wave, High/Low Beta wave and High/Low Gamma wave, as well as concentration (Attention) index and relaxation (Meditation) index; This processing unit contains: A processing end transceiver is connected to the electroencephalograph transceiver of the head-mounted instrument, and is used for receiving signals transmitted from the electroencephalograph transceiver; A melody conversion mechanism is connected to the processing end transceiver and is used to convert the subject's brainwave signals during a period of time into a corresponding musical melody based on a specific algorithm; A color conversion mechanism, connected to the processing end transceiver, is used to obtain the corresponding color based on a specific algorithm based on the subject's brainwave signals during a period of time; A music playing mechanism is connected to the melody converting mechanism and used to play the music melody obtained by the melody converting mechanism; and A picture display mechanism is connected to the color conversion mechanism and used to display various colors obtained by the color conversion mechanism. For the brainwave video encoding and playback system described in item 1 of the patent application, the melody conversion mechanism includes: A brainwave change calculation unit _, for various brainwave parameters X is selected from Att, Med, δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ ; where Att represents concentration index, Med represents relaxation index, δ represents Delta wave, and θ represents Theta Wave, α ^- represents Low Alpha wave, α ⁺ represents High Alpha wave, β ^- represents Low Beta wave, β ⁺ represents High Beta wave, γ ^- represents Low Gamma wave, γ ⁺ represents High Gamma wave; An encoding unit is connected to the brainwave change calculation unit, and encodes the _change in intensity difference corresponding to each brainwave parameter X into a corresponding binary value _of each brainwave parameter In the nth period, n is greater than 0; the coding unit creates a coding table from these _binary values. The coding table uses each brain wave parameter The value system is expressed as X(T _n ) or T _n (X). X(T _n ) represents _the binary value at the intersection of the row corresponding to the _brain wave parameter The binary value at the intersection of the column corresponding to period T _n and the row corresponding to brain wave parameter X, that is, X(T _n ) and T _n (X) will correspond to the binary value at the same position in the coding table; A sound range conversion unit is connected to the coding unit, and selects the corresponding sound range mode according to the binary value of the concentration index and relaxation index of each period T _n in the coding table. Different conversion rules are applied in each sound range mode. The binary value of each brainwave parameter X in the coding table is converted into the note and pitch corresponding to the period T _n , and each note is converted from the binary value of at least one corresponding brainwave parameter; and A melody creation unit is connected to the range conversion unit, and arranges the notes in each period T _n converted by the range conversion unit in a specific order according to a specific algorithm, thereby establishing the music melody of each period T _n , and The music melody is output to the music playing mechanism for playing. For _{example ,} in the brainwave video encoding and playback system _described in item 2 of the patent application, the encoding unit determines the value of are all 0, or D _n is greater than 0 and D _n-1 is 0, or D _n is less than 0 and D _n-1 is 0, then X(T _n ) is 0; When one of D _n and D _n-1 is greater than 0 and the other is less than 0, or D _n is 0 and D _n-1 is greater than 0, or D _n is 0 and D _n-1 is less than 0, then X(T _n ) is 1. For example, in the brainwave video encoding and playback system described in item 2 of the patent application, the sound range conversion unit determines the sound range mode of T _n for a certain period of time based on the value of T _n (Att, Med), where T _n (Att, Med) )=T _n (Att) × 2 + T _n (Med); each range mode includes multiple note ranges, each note range includes at least one corresponding note, and each note is generated in a specific order; each note range The pitch range is one octave, and the pitches of the corresponding notes in the multiple note ranges differ by octaves; 0~7 is defined as eight notes in an octave; the brainwave parameter sequence K=“δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ , δ, θ, α ^- , α ⁺ "; where the i-th element of the sequence K is represented by K _i . For example, in the brainwave video encoding and playback system described in item 4 of the patent application, when T _n (Att, Med) = 0, it is the first range mode, and the range of notes in order from small to large according to the pitch is: The first note range, the second note range, the third note range and the fourth note range; Among them, the notes in the first note range in the period T _n are in sequence: δ(T _n )×2 ² +δ(T _n+1 )×2+δ(T _n+2 ), and θ(T _n )×2 ² +θ(T _n+1 )×2+θ(T _n+2 ); Among them, the notes in the second note range in the period T _n are as follows: (α ^- )(T _n )×2 ² +(α ^- )(T _n+1 )×2+(α ^- )(T _n+2 ), and (α ⁺ )(T _n )×2 ² +(α ⁺ )(T _n+1 )×2+(α ⁺ )(T _n+2 ); Among them, the notes in the third note range in the period T _n are as follows: (β ^- )(T _n )×2 ² +(β ^- )(T _n+1 )×2+(β ^- )(T _n+2 ), and (β ⁺ )(T _n )×2 ² +(β ⁺ )(T _n+1 )×2+(β ⁺ )(T _n+2 ); Among them, the notes in the fourth note range in the period T _n are as follows: (γ ^- )(T _n )×2 ² +(γ ^- )(T _n+1 )×2+(γ ^- )(T _n+2 ), and (γ ⁺ )(T _n )×2 ² +(γ ⁺ )(T _n+1 )×2+(γ ⁺ )(T _n+2 ). For example, in the brainwave video encoding and playback system described in item 4 of the patent application, when T _n (Att, Med) = 1, it is the second range mode, and the range of notes in order from small to large according to the pitch is: First note range, second note range and third note range; Among them, the notes in the first note range in the period T _n are in sequence: (Att)(T _n )×2 ² +(Att)(T _n+1 )×2+(Att)(T _n+2 ), and (Med)(T _n )×2 ² +(Med)(T _n+1 )×2+(Med)(T _n+2 ); Among them, the notes in the second note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=1~8; Among them, the notes in the third note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=1~8; The above-mentioned second and third note ranges are converted into corresponding notes in order from small to large according to the i value. For example, in the brainwave video encoding and playback system described in item 4 of the patent application, when T _n (Att, Med) = 2, it is the third range mode, and the range of notes in order from small to large according to the pitch is: First note range, second note range, third note range and fourth note range; Among them, the notes in the first note range in the period T _n are in sequence: (Att)(T _n )×2 ² +(Att)(T _n+1 )×2+(Att)(T _n+2 ), and (Med)(T _n )×2 ² +(Med)(T _n+1 )×2+(Med)(T _n+2 ); Among them, the notes in the second note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=1~8; Among them, the notes in the third note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=1~4; Among them, the notes in the fourth note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=5~8; The above-mentioned second, third and fourth note ranges are converted into corresponding notes in order from small to large according to the i value. For example, in the brainwave video encoding and playback system described in item 4 of the patent application, when T _n (Att, Med) = 3, it is the fourth range mode, and the range of notes in order from small to large according to the pitch is: First note range, second note range, third note range and fourth note range; Among them, the notes in the first note range in the period T _n are in sequence: (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=1~4; Among them, the notes in the second note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ), where i=5~8; Among them, the notes in the third note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=1~4; Among them, the notes in the fourth note range in the period T _n are as follows: (K _i )(T _n )×2 ² +(K _i )(T _n+1 )×2+(K _i )(T _n+2 ), where i=5~8; The above note ranges are converted into corresponding notes in order from small to large according to the i value. For example, in the brainwave video encoding and playback system described in Item 5, 6, 7 or 8 of the patent application, the range conversion unit further includes a beat calculation unit, which calculates the corresponding beat according to the conversion rules of each note. For example, the brainwave video encoding and playback system described in item 9 of the patent application scope defines 0 as full beat, 1 as 1/2 beat, 2 as 1/4 beat, and 3 as 1/8 beat; The beat calculation unit calculates the beat in the following way: The note with the conversion rule of (Att)(T _n )×2 ² +(Att)(T _n+1 )×2+(Att)(T _n+2 ) has the beat of (Med)(T _n ) ×2+(Med)(T _n+1 ); The note with the conversion rule of (Med)(T _n )×2 ² +(Med)(T _n+1 )×2+(Med)(T _n+2 ) has the beat of (Att)(T _n ) ×2+(Att)(T _n+1 ); The note with the conversion rule of (K _i )(T _n )×2 ² +(K _i+1 )(T _n )×2+(K _i+2 )(T _n ) has a beat of (K _{i+ 3} )(T _n )×2+(K _i+4 )(T _n ), where i=1~8; The note with the conversion rule of δ(T _n )×2 ² +δ(T _n+1 )×2+δ(T _n+2 ) has a beat of θ(T _n )×2+θ(T _{n+ 1} ); The note with the conversion rule of θ(T _n )×2 ² +θ(T _n+1 )×2+θ(T _n+2 ) has a beat of δ(T _n )×2+δ(T _{n+ 1} ); The note with the conversion rule of (α ^- )(T _n )×2 ² +(α ^- )(T _n+1 )×2+(α ^- )(T _n+2 ) has the beat of (α ⁺ ) (T _n )×2+(α ⁺ )(T _n+1 ); The note with the conversion rule of (α ⁺ )(T _n )×2 ² +(α ⁺ )(T _n+1 )×2+(α ⁺ )(T _n+2 ) has a beat of (α ^- ) (T _n )×2+(α ^- )(T _n+1 ); The note with the conversion rule of (β ^- )(T _n )×2 ² +(β ^- )(T _n+1 )×2+(β ^- )(T _n+2 ) has a beat of (β ⁺ ) (T _n )×2+(β ⁺ )(T _n+1 ); The note with the conversion rule of (β ⁺ )(T _n )×2 ² +(β ⁺ )(T _n+1 )×2+(β ⁺ )(T _n+2 ) has a beat of (β ^- ) (T _n )×2+(β ^- )(T _n+1 ); The note with the conversion rule of (γ ^- )(T _n )×2 ² +(γ ^- )(T _n+1 )×2+(γ ^- )(T _n+2 ) has a beat of (γ ⁺ ) (T _n )×2+(γ ⁺ )(T _n+1 ); The note with the conversion rule of (γ ⁺ )(T _n )×2 ² +(γ ⁺ )(T _n+1 )×2+(γ ⁺ )(T _n+2 ) has a beat of (γ ^- ) (T _n )×2+(γ ^- )(T _n+1 ). For example, the brainwave video encoding and playback system described in item 5, 6, 7 or 8 of the patent application, wherein the melody creation unit determines each note obtained in the period T _n based on the value of T _n+1 (Att, Med) Sorting method, where T _n+1 (Att, Med)=T _n+1 (Att)×2+T _n+1 (Med); When T _n+1 (Att, Med)=0, then the note ranges corresponding to the period T _n are arranged from low to high according to their pitch range; where for all the notes in each note range: If each note in the note range is converted from a single brain wave parameter Y, where the brain wave parameter Y is selected from δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ , then arrange these notes in the order of their corresponding brain wave parameters δ, θ, α ^- , α ⁺ , β ^- , β ⁺ , γ ^- , γ ⁺ ; If each note in the note range is not determined by the above-mentioned single brain wave parameter Y Converted, these notes are arranged in the order of their production from the first note to the last note; When T _n+1 (Att, Med)=1, the first note of each note range corresponding to period T _n is arranged at the first time point at the same time, and the second note of each note range is arranged at the first time point at the same time. 2 time points, according to the above method, the M-th notes of each note range are arranged simultaneously at the M-th time point, where M is greater than 0; when the number of notes in each note range corresponding to the period T _n is different, then When the notes in the note range with a small number of notes are exhausted, the notes will be added to the sequence starting from the first note; the music player will play all the corresponding notes simultaneously at each point in time to achieve the effect of mixing ; When T _n+1 (Att, Med)=2, first arrange the note ranges corresponding to the period T _n according to their pitch ranges from low to high, and the notes in each note range in the order of their production are The first note is arranged in sequence to the last note; then each note range is arranged once according to its pitch range from high to low, and the notes in each note range are arranged in reverse order from the last to the last note in the order in which they are produced. Arrange from one note to the first note; repeat the arrangement in the same manner as above; When T _n+1 (Att, Med)=3, then the note ranges corresponding to the period T _n are arranged from high to low according to their pitch ranges; where for all the notes in each note range: If each note in the note range is converted by a single brain wave parameter Z, where the brain wave parameter Z is selected from γ ⁺ , γ ^- , β ⁺ , β ^- , α ⁺ , α ^- , θ, δ, then arrange these notes in the order of their corresponding brain wave parameters γ ⁺ , γ ^- , β ⁺ , β ^- , α ⁺ , α ^- , θ, δ; If each note in the note range is not converted by the above-mentioned single brain wave parameter Z, then the notes are arranged in reverse order from the last note to the first note in the order in which they were produced. For example, in the brainwave video encoding and playback system described in item 2 of the patent application, the color conversion mechanism corresponds to each brainwave band to a different color, in which Delta waves correspond to white, Theta waves correspond to red, and Low Alpha The wave corresponds to orange, the High Alpha wave corresponds to yellow, the Low Beta wave corresponds to green, the High Beta wave corresponds to blue, the Low Gamma wave corresponds to indigo, and the High Gamma wave corresponds to purple; when the music player is playing music At this time, according to the brain wave band corresponding to each note, the corresponding color is transmitted to the screen display mechanism for display. For example, in the brainwave video encoding and playback system described in Item 1 of the patent application, the processing unit further includes a volume and color density selection mechanism connected to the music playback mechanism and the image display mechanism for selecting the audio frequency at each time point. The value of each brain wave parameter is divided into multiple categories according to its amplitude, and each category corresponds to a different volume and color density to control the volume of the music player and the color density displayed by the screen display mechanism. For example, in the brainwave video encoding and playback system described in Item 1 of the patent application, the music playback mechanism further includes an instrument selection unit that receives the type of instrument specified by the subject and uses the timbre of the instrument to play the music melody; When there are multiple subjects, the melodies played by different instruments are combined into a composite music melody.

Images