CN115024684A - Stimulation paradigm generation system, brain-computer interface system, detection method and device - Google Patents

Abstract

The application provides a stimulation paradigm generation system, a brain-computer interface system, a detection method and a detection device, and relates to the technical field of artificial intelligence. The stimulation paradigm generation system includes: the display device is used for displaying the first fan-shaped ring visual stimulation block in the first disc ring and/or the second fan-shaped ring visual stimulation block in the second disc ring; and the stimulation reflection device is used for reflecting the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction so as to correspondingly present visual stimulation to the user in at least one first visual field fan ring of the first visual field and/or at least one second visual field fan ring of the second visual field of the user. This system can show two sets of fan ring vision amazing pieces in two disc rings through stimulating the reflect meter, realizes presenting visual stimulus respectively to user's left eye field of vision and right eye field of vision simultaneously, can shorten the length of time of visual stimulus, improves amazing detection efficiency.

Description

Stimulation paradigm generation system, brain-computer interface system, detection method and device

technical field

The present application relates to the technical field of artificial intelligence, and in particular, to a stimulation paradigm generation system, a brain-computer interface system, a detection method and an apparatus.

Background technique

The traditional visual field nerve pathway integrity detection methods include visual field detection, visual contrast sensitivity, etc. Among them, visual field detection is the gold standard for evaluating the degree of visual impairment, and is often used in the detection of common ophthalmic diseases such as glaucoma, cataract and macular degeneration. Visual field detection is to use a program to give light stimuli at specified positions, and measure the differences in light sensitivity (d.l.sensitivity) of different retinal positions to calculate the difference (missing) between the detected eye and the normal eye threshold. However, as a psychophysical detection method, visual field detection has high requirements on the cooperation of the subjects, and some subjects (the elderly, etc.) are prone to false positive results of fatigue and poor cooperation.

Brain-computer interface (BCI) is a communication system that does not depend on the normal output pathways composed of peripheral nerves and muscles. It recognizes specific brain signal patterns. The stimulation paradigm of the related art brain-computer interface is simple to encode, and the visual stimulation process takes a long time when it is used for visual field detection, and the stimulation detection efficiency is low.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a stimulation paradigm generation system, a brain-computer interface system, a detection method and an apparatus, which can shorten the duration of visual stimulation and improve stimulation detection efficiency.

In a first aspect, the embodiments of the present application provide a stimulus paradigm generation system, including:

A display device for displaying the first fan ring visual stimulation block in the first disc ring, and/or the second fan ring visual stimulation block in the second disc ring; the fan ring visual stimulation block is a disc circle The part in the sector ring unit included in the ring is formed by flickering according to the coding frequency corresponding to each of the sector ring units;

Stimulation reflection device, used to reflect the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction, so as to correspond to at least one first visual field fan ring of the first visual field, and/or all Visual stimulation is presented to the user in at least one second visual field fan ring of the user's second visual field; the target direction is when the stimulus reflection device makes the first center mark of the first disk ring and the When the second circle center marks of the two disc rings are visually coincident, the stimulus reflection device reflects the direction of the first circle center mark or the second circle center mark; the first visual field fan ring and the first fan ring are visually stimulated The positions of the fan ring units at the block are in a one-to-one correspondence; the second visual field fan ring is in a one-to-one correspondence with the positions of the fan ring units at the second fan ring visual stimulation block.

The stimulation paradigm generation system provided by the embodiment of the present application can simultaneously present the visual stimulation blocks of the left eye and the visual field of the right eye of the user at the same time through the stimulation reflection device through the two groups of fan-ring visual stimulation blocks displayed in the two disc rings. visual stimuli. The stimulus paradigm generation system utilizes the principle of binocular competition and simultaneously detects the left and right eyes, which can shorten the duration of visual stimuli and improve the efficiency of stimulus detection.

In a possible implementation manner, the first disk ring further includes a first closed inner ring, the second disk ring further includes a second closed inner ring; the first disk ring The ring and the first closed inner circle are marked with the first circle center as the circle center, and the second disk circle and the second closed inner circle are marked with the second circle center as the circle center; fan ring unit In order to take the center of the disk ring as the axis, when dividing the part between the disk ring and the inner ring contained by the first threshold into the equal sector of the first threshold and the concentric ring of the second threshold, the equal sector A graphic unit formed by the intersection of a region and a concentric ring.

In the stimulation paradigm generation system provided by this embodiment, the fan ring unit takes the center of the disk ring where it is located as an axis, and divides the part between the disk ring where it is located and the inner ring included in the disk ring. When a threshold is divided into sectors and the concentric rings are at a second threshold, the graphic units are formed by the intersection of the equal sectors and the concentric rings. In this system, the fan ring unit is a graphic unit outside the first closed inner ring and the second closed inner ring. Therefore, neither the interior of the first closed inner ring nor the interior of the second closed inner ring displays a fan ring. The visual stimulation block can inhibit the stimulation of the central area of the visual field, which can prevent the stimulation of the central area of the visual field from affecting the brain signals in the surrounding visual field, and further improve the efficiency of stimulus detection.

In a possible implementation manner, for any disc ring, the number of types of the encoding frequencies corresponding to the sector ring units included in the any disc ring is not greater than the first threshold.

In the stimulation paradigm generation system provided by this embodiment, for any disc ring, the number of types of the coding frequencies corresponding to the sector ring units included in the any disc ring is not greater than the first threshold. In the stimulation paradigm generation system, the number of types of the coding frequencies corresponding to the sector ring units included in the first disc ring, and the number of types of the coding frequencies corresponding to the sector ring units included in the second disc ring , are not greater than the first threshold when dividing equal sectors, so that a smaller number of coding frequencies are used to encode the sector ring units, which can reduce the difficulty of brain signal feature extraction when multi-frequency simultaneous stimulation is performed, and can further improve stimulation detection efficiency. .

In a possible implementation manner, in any disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies; in any disc ring, the same equal sector includes Each of the sector ring units is configured with the same encoding frequency.

In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equal sectors in each disk ring are configured with different coding frequencies , and each of the sector ring units included in the same equally divided sector is configured with the same coding frequency. In the stimulation paradigm generation system, in the same disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies, and each sector ring unit included in the same sector is configured with the same encoding Therefore, a smaller number of coding frequencies are used to encode the sector ring unit, and the difference in the coding frequency of the sector ring units in different equal sectors in the same disc ring is strengthened, which can reduce the simultaneous stimulation of multiple frequencies. The difficulty of brain signal feature extraction can further improve the efficiency of stimulus detection.

In a possible implementation manner, in any disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies; The encoding frequency of the sector ring unit is different from the encoding frequency of any one of the sector ring units included in the second disc ring.

In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equal sectors in each disk ring are configured with different coding frequencies , and the encoding frequency of any one of the sector ring units included in the first disk ring is different from the encoding frequency of any one of the sector ring units included in the second disk ring. In the stimulation paradigm generation system, in the same disk ring, the sector ring units included in different equal sectors are configured with different coding frequencies, and the sector rings included in the equal sectors in different disk rings are configured with different coding frequencies. The coding frequencies of the unit configurations are different, so that a smaller number of coding frequencies are used to code the fan-ring units, and the difference between the coding frequencies of the fan-ring units in different disc rings can be strengthened, which can reduce the multi-frequency simultaneous stimulation. The difficulty of brain signal feature extraction can further improve the efficiency of stimulus detection.

In a second aspect, an embodiment of the present application provides a brain-computer interface system, including the stimulation paradigm generation system described in any one of the first aspect; the brain-computer interface system further includes:

A data acquisition device for collecting brain signals generated by a subject; the brain signals are generated by the left and right eyes of the subject based on the visual stimulation of the stimulation paradigm generating system according to any one of the first aspects; the The brain signals include multifocal steady-state visual evoked potentials mfSSVEP;

The data processing device is used for acquiring the brain signal, analyzing the brain signal, and generating an evaluation result of the peripheral visual field of the user.

The brain-computer interface system provided by the embodiment of the present application, including the stimulation paradigm generation system, can realize simultaneous stimulation to the left side of the user through two sets of fan-ring visual stimulation blocks displayed in the two disc rings and stimulation reflex devices. Visual stimuli are presented separately in the visual field of the eye and the visual field of the right eye, so that the brain signals generated by the left and right eyes of the subject based on the visual stimuli are simultaneously collected, the brain signals are analyzed, and an evaluation result of the peripheral visual field of the user is generated. In the brain-computer interface system, the stimulation paradigm generation system utilizes the principle of binocular competition, and simultaneously detects the left and right eyes and analyzes the brain signals, which can shorten the duration of visual stimulation and improve the stimulation detection efficiency.

In a possible implementation, the brain signal is one of the following: an electroencephalogram (EEG) signal, a magnetoencephalogram (MEG) signal, and a functional near-infrared spectrogram (fNIRS) signal.

In a possible implementation manner, the data processing apparatus is specifically used for:

Feature extraction is performed on the brain signal to obtain feature signal information;

The variable correlation analysis is performed on the feature signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result of the user's surrounding visual field.

In the brain-computer interface system provided by this embodiment, the data processing device performs feature extraction on the brain signal to obtain feature signal information; performs variable correlation analysis on the feature signal information to obtain correlation coefficient result information; the correlation coefficient The resulting information is used to generate said evaluation of the user's surrounding visual field. The brain-computer interface system provides a mechanism for performing feature extraction on brain signals and performing variable correlation analysis to obtain correlation coefficient result information, and the correlation coefficient result information is used to generate the evaluation result of the user's surrounding visual field, The duration of visual stimulation can be shortened and the stimulation detection efficiency can be improved.

In a possible implementation manner, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulation is not applied; the second brain signal is a brain signal in a state where the visual stimulus is applied;

The data processing device is specifically used for:

Perform variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and perform variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein, the first characteristic signal information is obtained by feature extraction on the first brain signal; the second feature signal information is obtained by feature extraction on the second brain signal;

The correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

In the brain-computer interface system provided in this embodiment, variable correlation analysis is performed on the first brain signal in the state where the visual stimulus is not applied and the second brain signal in the state where the visual stimulus is applied, to obtain the first brain signal. A correlation coefficient result information and the second correlation coefficient result information, and the first correlation coefficient result information and the second correlation coefficient result information are combined to obtain the correlation coefficient result information. The brain-computer interface system can simultaneously combine the correlation coefficient result information corresponding to the brain signal in the state where the visual stimulus is not applied and the brain signal in the state where the visual stimulus is applied, so that a more stable correlation coefficient can be obtained. The result information, the correlation coefficient result information is used to generate the evaluation result of the user's peripheral visual field, which can shorten the duration of visual stimulation, improve the stimulus detection efficiency, and improve the accuracy of the evaluation result of the user's peripheral visual field.

In a possible implementation manner, the evaluation result of the user's peripheral visual field is information that there is a visual field fan ring with impaired visual function in the user's peripheral visual field.

In a third aspect, an embodiment of the present application provides a stimulus paradigm detection method, the method comprising:

Visual stimuli are presented to the user in at least one first field of view fan ring of the user's first field of view, and/or in at least one second field of view fan ring of the user's second field of view; A first fan ring visual stimulus block in a disc ring, and/or a second fan ring visual stimulus block in a second disc ring, and images of the first fan ring stimulus block and/or the second fan ring The stimulation block image is presented by reflection along the target direction; the fan ring visual stimulation block is a part of the fan ring unit included in the disc ring, and is formed by flickering according to the coding frequency corresponding to each of the fan ring units; The target direction is that when the stimulus reflection device visually overlaps the first center mark of the first disk ring with the second center mark of the second disk ring, the stimulus reflection device reflects the first center mark. The direction of the circle center mark or the second circle center mark; the first visual field fan ring corresponds to the position of the fan ring unit at the visual stimulation block of the first fan ring; the second visual field fan ring and the The positions of the fan-ring units at the two fan-ring visual stimulus blocks correspond one-to-one;

collecting brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potential mfSSVEP;

The brain signals are acquired and analyzed to produce an assessment of the user's peripheral visual field.

The stimulus paradigm detection method provides a mechanism for extracting features of brain signals and performing variable correlation analysis to obtain correlation coefficient result information, which is used to generate the evaluation result of the user's peripheral visual field, which can be Shorten the duration of visual stimuli and improve the efficiency of stimulus detection.

In a possible implementation manner, the user is presented to the user in at least one first field of view fan ring of the user's first field of view and/or at least one second field of view fan ring of the user's second field of view Visual stimuli, including:

In response to receiving the first-stage detection instruction, presenting visual stimuli to the user in at least one first field of view fan ring of the user's first field of view, and at least one second field of view fan ring of the user's second field of view, to detect each first field of view fan ring of the user's first field of view and each second field of view fan ring of the user's second field of view;

If the second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view fan ring to detect the user's target field of view fan ring; the target field of view fan ring is the One of the first field of view fan rings selected in the first field of view, or one of the second field of view fan rings selected in the second field of view.

The stimulus paradigm detection method provides a distributed detection mechanism, which can, in response to receiving a first-stage detection instruction, perform detection on each first visual field fan ring of the user's first visual field and the user's first visual field. Each second field of view fan ring of the two fields of view is detected, and the target field of view fan ring whose evaluation result meets the preset condition can be located in the first field of view and the second field of view, and according to the second stage detection instruction, in the user's target field of view Visual stimuli are presented to the user in the fan ring to detect the user's target visual field fan ring, so that the user's visual field can be more accurately evaluated.

In a fourth aspect, an embodiment of the present application provides a stimulus paradigm detection device, the device comprising:

a stimulus paradigm generation module for presenting visual stimuli to the user in at least one first field of view fan ring of the user's first field of view, and/or in at least one second field of view fan ring of the user's second field of view; The visual stimulation is obtained by displaying the first fan ring visual stimulation block in the first disk ring, and/or the second fan ring visual stimulation block in the second disk ring, and placing the first fan ring stimulation block image And/or the second fan ring stimulation block image is reflected along the target direction and presented; the fan ring visual stimulation block is a part of the fan ring unit included in the disc ring, according to the coding frequency corresponding to each of the fan ring units , which is formed by flickering; the target direction is that when the stimulus reflection device visually overlaps the first center mark of the first disk ring with the second center mark of the second disk ring, the The stimulus reflection device reflects the direction of the first circle center mark or the second circle center mark; the first visual field fan ring corresponds to the position of the fan ring unit at the visual stimulation block of the first fan ring one-to-one; the second The visual field fan ring is in one-to-one correspondence with the position of the fan ring unit at the second fan ring visual stimulation block;

a signal acquisition module for acquiring brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potential mfSSVEP;

The data processing module is used for acquiring the brain signal, analyzing the brain signal, and generating an evaluation result of the peripheral visual field of the user.

In a possible implementation manner, the data processing module is specifically used for:

Feature extraction is performed on the brain signal to obtain feature signal information;

The variable correlation analysis is performed on the feature signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result of the user's surrounding visual field.

In a possible implementation manner, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulation is not applied; the second brain signal is a brain signal in a state where the visual stimulus is applied;

The data processing module is specifically used for:

Perform variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and perform variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein, the first characteristic signal information is obtained by feature extraction on the first brain signal; the second feature signal information is obtained by feature extraction on the second brain signal;

The correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

In a possible implementation, the stimulus paradigm generation module is specifically used for:

In response to receiving the first-stage detection instruction, presenting visual stimuli to the user in at least one first field of view fan ring of the user's first field of view, and at least one second field of view fan ring of the user's second field of view, to detect each first field of view fan ring of the user's first field of view and each second field of view fan ring of the user's second field of view;

If the second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view fan ring to detect the user's target field of view fan ring; the target field of view fan ring is the One of the first field of view fan rings selected in the first field of view, or one of the second field of view fan rings selected in the second field of view.

In a fifth aspect, an embodiment of the present application provides a server, including a memory and a processor, where the memory stores a computer program that can run on the processor, and when the computer program is executed by the processor , to implement the method described in any one of the third aspect.

In a sixth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, any one of the third aspects is implemented. Methods.

For the technical effects brought by any one of the implementation manners of the fourth aspect to the sixth aspect, reference may be made to the technical effects brought by the implementation manners of the first aspect to the third aspect, which will not be repeated here.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the drawings used in the description of the embodiments. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

FIG. 1 is a structural block diagram of a stimulation paradigm generation system provided by an embodiment of the present application;

2 is a schematic diagram showing the presentation layout of a fan-ring visual stimulus block of a stimulus paradigm generation system provided by an embodiment of the present application;

3 is a schematic diagram of a stimulation paradigm of the stimulation paradigm generation system provided by the embodiment of the present application;

4 is a structural block diagram of a brain-computer interface system provided by an embodiment of the present application;

5 is a schematic flowchart of a stimulus paradigm detection method provided by an embodiment of the present application;

6 is a structural block diagram of a stimulus paradigm detection apparatus provided by an embodiment of the present application;

FIG. 7 is a structural block diagram of a server provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

The traditional visual field nerve pathway integrity detection methods include visual field detection, visual contrast sensitivity, etc. Among them, visual field detection is the gold standard for evaluating the degree of visual impairment, and is often used in the detection of common ophthalmic diseases such as glaucoma, cataract and macular degeneration. Visual field detection is to use a program to give light stimuli at specified positions, and measure the differences in light sensitivity (d.l.sensitivity) of different retinal positions to calculate the difference (missing) between the detected eye and the normal eye threshold. However, as a psychophysical detection method, visual field detection has high requirements on the cooperation of the subjects, and some subjects (the elderly, etc.) are prone to false positive results of fatigue and poor cooperation.

Brain-computer interface (BCI) is a communication system that does not depend on the normal output pathways composed of peripheral nerves and muscles. It recognizes specific brain signal patterns. The brain-computer interface of the related art has a simple stimulation paradigm to encode, and the visual stimulation process takes a long time for visual field detection, and the stimulation detection efficiency is low, which limits the popularization and application of the brain-computer interface in visual field detection.

Based on this, the embodiments of the present application provide a stimulation paradigm generation system, a brain-computer interface system, a detection method, and an apparatus. Wherein, the stimulation paradigm generation system includes: a display device for displaying the first fan-ring visual stimulation block in the first disk ring, and/or the second fan-ring visual stimulation block in the second disk ring The visual stimulation block of the fan ring is a part of the fan ring unit included in the disc ring, and is formed by flickering according to the coding frequency corresponding to each fan ring unit; the stimulation reflection device is used to convert the image of the first fan ring stimulation block And/or the second fan ring stimulation block image is reflected along the target direction to correspond to at least one first field of view fan ring in the first field of view according to the first fan ring stimulation block image, and/or according to the second fan ring stimulation block The image correspondingly presents visual stimuli to the user in at least one second visual field fan ring of the user's second visual field; the target direction is when the stimulus reflex device makes the first circle center mark of the first disk ring and the second disk ring When the second center mark of the visual field coincides visually, the stimulus reflection device reflects the direction of the first center mark or the second center mark; the first visual field fan ring corresponds to the position of the fan ring unit at the visual stimulation block of the first fan ring one-to-one; the second The visual field fan ring corresponds to the position of the fan ring unit at the second fan ring visual stimulation block one-to-one. The stimulus paradigm generation system utilizes the principle of binocular competition and simultaneously detects the left and right eyes, which can shorten the duration of visual stimuli and improve the efficiency of stimulus detection.

In order to make the invention purpose, technical solutions and advantages of the embodiments of the present application more clear, the present application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of them. example. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

FIG. 1 shows a structural block diagram of a stimulation paradigm generating system according to an embodiment of the present application. From the structural block diagram shown in FIG. 1 , it can be seen that the stimulation paradigm generating system 100 includes a display device 101 and a stimulation reflection device 102 .

Among them, the display device 101 is used to display the first fan ring visual stimulation block in the first disc ring 1011, and/or the second fan ring visual stimulation block in the second disk ring 1012; the fan ring visual stimulation block The block is a part of the sector ring unit included in the disc ring, and is formed by flickering according to the coding frequency corresponding to each sector ring unit;

The stimulation reflection device 102 is used to reflect the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction, so as to correspond to at least one first visual field fan ring in the first visual field, and/or Visual stimulation is presented to the user in at least one second visual field fan ring of the user's second visual field; the target direction is when the stimulus reflex device makes the first circle center mark 1013 of the first disk ring 1011 and the second disk ring 1012 When the second circle center mark 1014 is visually overlapped, the stimulus reflection device 102 reflects the direction of the first circle center mark 1013 or the second circle center mark 1014; the first visual field fan ring corresponds to the position of the fan ring unit at the visual stimulation block of the first fan ring one-to-one ; The second visual field fan ring corresponds to the position of the fan ring unit at the second fan ring visual stimulation block one-to-one.

In some embodiments of the present application, the first fan ring visual stimulation block may be left eye stimulation, and the second fan ring visual stimulation block may be right eye stimulation. Correspondingly, the first visual field is the left eye visual field, and the second visual field is the left eye visual field. for the right eye field of view. In other embodiments of the present application, the visual stimulation block of the first fan ring may be the stimulation of the right eye, and the visual stimulation block of the second fan ring may be stimulation of the left eye. Correspondingly, the first visual field is the visual field of the right eye, and the The second field of view is the field of view of the left eye. This application does not specifically limit this.

In the stimulation paradigm generation system 100 in FIG. 1 , the display device 101 is used to present left eye stimulation and right eye stimulation to the subject; the stimulation reflection device 102 is used to combine the left eye stimulation and right eye stimulation presented by the display device 101 .

In some embodiments of the stimulus paradigm generation system 100, the first disc ring further comprises a first closed inner ring, the second disc ring further comprises a second closed inner ring; A closed inner ring is marked with the first center as the center, and the second disk ring and the second closed inner ring are marked with the second center as the center; the fan ring unit is based on the center of the disk ring as the axis, and the When the part between the disk ring and the included inner ring is divided into the equal sector of the first threshold and the concentric ring of the second threshold, the graphic unit formed by the intersection of the equal sector and the concentric ring.

FIG. 2 is a schematic diagram showing the presentation layout of the fan-ring visual stimulation blocks of the stimulation paradigm generation system provided by the embodiment of the present application. Referring to FIG. 2 , the first disc ring 1011 in the embodiment of the present application is also It includes a first closed inner ring 1015, and the second disk ring 1012 also includes a second closed inner ring 1016; the first disk ring 1011 and the first closed inner ring 1015 are centered on the first circle center mark 1013, The second disk ring 1012 and the second closed inner ring 1016 take the second center mark 1014 as the center of the circle; the fan ring unit is based on the center of the disk ring where it is located as the axis, and the center of the disk ring and the inner circle included When the part between the rings divides the equal sectors of the first threshold and the concentric rings of the second threshold, the graphic units formed by the intersection of the equal sectors and the concentric rings. For example, taking the fan ring unit 1017 in the first disk ring 1011 as an example, the fan ring unit 1017 is the first circle center mark 1013 in the first disk ring 1011 where the fan ring unit 1017 is located as an axis, and the The part between a disk ring 1011 and the first closed inner ring 1015 included in the first disk ring 1011 is divided into equal sectors of the first threshold and concentric rings of the second threshold, the sectors are equally divided The graphic unit formed by the intersection of the area and the concentric rings, wherein the value of the first threshold corresponding to the sector ring unit 1017 in FIG. 2 is 8, and the value of the second threshold is 2.

FIG. 3 is a schematic diagram of the stimulation paradigm of the stimulation paradigm generation system provided by the embodiment of the present application. As shown in FIG. 3 , the visual stimulation area corresponding to the human visual field is abstracted as a circle, for example, the first disc ring 1011 corresponding to the visual field of the left eye in FIG. 3 ; within the first closed inner ring 1015 No visual stimulation is designed in the central visual field part of the visual field, and it is assumed that this area corresponds to the central visual field α ₀ ; the rest of the visual stimulation area is divided into m sectors (seg ₁ , seg ₂ ,..., seg _m ), the m sectors (seg ₁ , seg ₂ ,..., seg _m ) correspond to m polar angles (θ ₁ , θ ₂ ,..., θ _m ) respectively; using f _k frequency signals Encode m sectors; divide the rest of the central field of view into n rings (ring ₁ , ring ₂ ,..., ring _n ) equally, the n rings (ring ₁ , ring ₂ , ..., ring _n ) respectively correspond to n degrees of vision (α ₁ , α ₂ , ..., α _n ); the above-mentioned equally divided sectors and rings are combined to form m×n areas (area ₁ ,area ₂ ,...,area _m×n ), that is, m×n sector ring units.

In some embodiments of the stimulation paradigm generation system 100, for any disc ring, the number of kinds of encoding frequencies corresponding to the sector ring units included in any disc ring is not greater than the first threshold.

In a specific implementation, f _k frequencies are used to encode and stimulate m different sectors of the disc respectively, where f _k ≤m. When experimenting with the stimulation paradigm generation system 100, corresponding brain signals obtained using stimulation with f _k,on frequencies may be recorded, where f _k,on ≤f _k .

In some embodiments of the stimulus paradigm generation system 100, in any disc ring, the sector ring units contained in different bisectors are configured with different coding frequencies; in any disc ring, the same bisector sector Each of the included sector ring units is configured with the same encoding frequency.

In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equal sectors in each disk ring are configured with different coding frequencies, and Each sector ring unit included in the same equally divided sector is configured with the same coding frequency. In the stimulation paradigm generation system, in the same disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies, and each sector ring unit included in the same sector is configured with the same encoding frequency, so as to utilize A smaller number of coding frequencies encodes the sector-ring units, and at the same time strengthens the difference in the coding frequencies of the sector-ring units in different equal sectors of the same disc ring, which can reduce the feature extraction of brain signals when multiple frequencies are simultaneously stimulated The difficulty of stimuli detection can further improve the efficiency of stimulus detection.

In some implementations of the stimulation paradigm generation system 100, in any one disc ring, the sector ring units contained in different equal sectors are configured with different coding frequencies; any one sector ring contained in the first disc ring The coding frequency of the unit is different from the coding frequency of any sector ring unit contained in the second disc ring.

In the stimulation paradigm generation system provided by this embodiment, for the first disk ring and the second disk ring, the sector ring units contained in different equal sectors in each disk ring are configured with different coding frequencies, and The encoding frequency of any sector ring unit included in the first disk ring is different from the encoding frequency of any sector ring unit included in the second disk ring. In this stimulation paradigm generation system, in the same disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies, and the sector ring units included in the equal sectors in different disc rings are configured The coding frequencies are different, so that a smaller number of coding frequencies are used to encode the fan-ring units, and at the same time, the difference between the coding frequencies of the fan-ring units in different disc rings is strengthened, which can reduce the brain signal when multiple frequencies are stimulated at the same time. The difficulty of feature extraction can further improve the efficiency of stimulus detection.

In some embodiments of the stimulation paradigm generation system 100, the encoding frequency of the sector ring units contained in the first disc ring is the same as the encoding frequency of the sector ring units contained in the second disc ring.

Exemplarily, the first disk ring and the second disk ring both use f _k frequencies to encode stimulations on m different sectors of the disk, respectively, and the first disk ring and the second disk ring The coding frequency used by the loop is also the same.

It can be understood that, in some implementations of the stimulus paradigm generation system 100, the first disc ring and the second disc ring may also adopt the exact same encoding frequency configuration. Specifically, for the first disk ring and the second disk ring, the division of the sector ring units is exactly the same, the number of frequencies is the same, the encoding frequency is the same, and the configuration relationship between the encoding frequency and the sector ring units is also the same. Exemplarily, the configuration relationship between the encoding frequency and the sector ring unit is also the same, it may be that, assuming the same encoding rule is adopted for the sector ring units in the first disk ring and the second disk ring, for the first disk ring Any sector ring unit area' _i of the ring, and any sector ring unit area" _r of the second disc ring, if the numbers of the two are the same, i.e. i=r is satisfied, then the sector ring unit area' _i The same encoding frequency as the sector ring unit area” _r configuration.

The stimulation paradigm generation system of the present application can be used to detect peripheral visual field nerve pathway functions, such as glaucoma, cataract, macular degeneration, optic neuritis, papilledema, etc.; it can also be used to detect the degree of degenerative diseases, such as Parkinson's disease, Alzheimer's disease, etc. This can also be manifested as apparent in hemmer's disease, amyotrophic lateral sclerosis, head trauma, or other cognitive impairments (such as in aphasia where the subject confuses the order of individual words in a vocabulary or even the order of entire sentences) Neural parsing package missing); can also be used in the diagnosis of multiple sclerosis, where multiple sclerosis affects neurons with and without, but at least in the early stages of the disease, cells tend to recover, so a diagnosis can be expected The area of loss of visual field moves in the peripheral visual field over time, or temporarily recovers; when the disease progresses to the point where there are many areas of loss of vision on the retina, the area of loss will persist and cannot be recovered.

An embodiment of the present application further provides a brain-computer interface system, including the stimulation paradigm generation system of any one of the foregoing embodiments, in the brain-computer interface system, the stimulation paradigm generation system utilizes the principle of binocular competition, and simultaneously conducts stimulation on the left and right eyes. Detection and analysis of brain signals can shorten the duration of visual stimulation and improve the efficiency of stimulation detection.

FIG. 4 shows a structural block diagram of a brain-computer interface system provided by an embodiment of the present application. As shown in FIG. 4 , the brain-computer interface system 400 includes the stimulation paradigm generation system 100 of any one of the above embodiments; further includes:

The data acquisition device 401 is used to collect brain signals generated by the subject; the brain signals are generated by the left and right eyes of the subject based on the visual stimulation of the stimulation paradigm generation system 100; the brain signals include multifocal steady-state visual evoked potentials mfSSVEP;

The data processing device 402 is used for acquiring brain signals, analyzing the brain signals, and generating an evaluation result of the peripheral visual field of the user.

According to the multifocal steady-state visual evoked potential response mechanism, normal eyes with a healthy visual pathway can respond stably and strongly to any stimulus in any subregion; while abnormal eyes with visual impairments do not produce or produce at the location of the defect. Weaker response compared to other regions.

In some embodiments of the present application, the evaluation result of the user's peripheral visual field is specifically information representing whether there is a visual field fan ring with impaired visual function in the user's peripheral visual field.

Traditional visual brain-computer interfaces mostly use time division multiple access or frequency division multiple access coding strategies alone. Time division multiple access allows multiple users to share the same communication channel by dividing the signal into different time slots, and is most common in event-related potential-based brain-computer interfaces (such as P300 potential, mVEP potential); frequency division multiple access divides the entire frequency band Divided into multiple independent frequency bands, each of which is used for different users, the brain-computer interface based on SSVEP is a typical frequency division multiple access system.

The multifocal steady-state visual evoked potential paradigm of the brain-computer interface system of the embodiment of the present application takes into account both frequency division multiple access and spatial division multiple access, and significantly improves the coding efficiency of instructions. Among them, spatial division multiple access divides the geographic space into smaller spaces for multiple targets. The mfSSVEP paradigm designed in the present application is based on SSVEP, which realizes frequency division multiple access by encoding signals of multiple frequencies; at the same time, the mfSSVEP paradigm designed in the present invention is performed at different positions of the same stimulus instruction. Coding of multiple frequency signals to realize spatial division multiple access; using binocular competition equipment, the paradigm designed by the present invention can simultaneously stimulate the left and right eyes with different frequencies and different positions, and also realizes spatial division multiple access. The brain-computer interface system of the embodiments of the present application utilizes the mfSSVEP paradigm and the binocular competition device to realize the feasibility of the fusion of frequency division multiple access and spatial division multiple access of the brain-computer interface, which is of great significance for improving the performance of the brain-computer interface.

In some embodiments of the brain-computer interface system 400, the brain signal is one of: an electroencephalographic EEG signal, a magnetoencephalographic MEG signal, and a functional near-infrared spectrogram fNIRS signal.

The brain-computer interface system of the present application can use brain signal acquisition methods including but not limited to electroencephalogram (EEG), magnetoencephalography (MEG) and functional near-infrared spectroscopy (functional near-infrared spectroscopy). , fNIRS) and so on.

In some embodiments of the brain-computer interface system 400, the data processing device 402 is specifically configured to:

Perform feature extraction on brain signals to obtain feature signal information;

The variable correlation analysis is performed on the characteristic signal information to obtain the correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's surrounding visual field.

When implemented, the brain-computer interface system 400 presents visual stimuli through a display device. Visual stimuli are encoded using the multifocal steady-state visual evoked paradigm designed by the present invention, including the first fan-ring visual stimulation block and the second fan-ring visual stimulation block presented on the left and right of the screen respectively; The mirror reflected the first fan-ring visual stimulation block and the second fan-ring visual stimulation block presented in the display device to the subject; the subject achieved the effect of binocular competition by adjusting the mirror surface of the stimulation reflection device, so that the two visual stimuli were The eyes coincide; the brain signals generated with the user's operation intention are collected by the data acquisition device 401, and the analog signal processing and A/D conversion such as denoising and amplification are completed; the data processing device 402 uses the brain signal decoding method to characterize the brain signals processing and pattern recognition. Specifically, feature extraction is performed on the brain signal to obtain feature signal information; variable correlation analysis is performed on the feature signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result for the user's surrounding visual field.

In some embodiments of the present application, the variable correlation analysis specifically uses filter bank canonical correlation analysis (FBCCA) to identify the multifocal steady-state visual evoked potential mfSSVEP. Canonical correlation analysis (CCA) is a method to study the correlation of two groups of variables. It finds the projection matrix of two groups of high-dimensional vectors, and uses it to reduce the dimension of the high-dimensional vectors, so that the two vectors after dimensionality reduction are between the two vectors. most relevant.

是正余弦参考信号，其中，N_c为导联数量，N_p为采样点数，N_h为谐波数量，正余弦参考信号Y中既包括基波也包括谐波。The following embodiments of the present application will be described by taking the brain signal as an EEG signal as an example. Hypothetical EEG

is the sin-cos reference signal, where N _c is the number of leads, N _p is the number of sampling points, N _h is the number of harmonics, and the sin-cos reference signal Y includes both the fundamental wave and the harmonics.

The expression for Y is as follows:

in,

f is the stimulation frequency;

s is the sampling rate;

t is the time point.

The canonical correlation analysis CCA process is as follows:

in,

x is the spatially filtered signal of X,

y is the spatially filtered signal of Y,

W _X represents the projection matrix for dimensionality reduction of the EEG signal X;

W _Y represents the projection matrix that reduces the dimension of the sine and cosine reference signal Y;

E[ ] represents the operation of taking the expected value;

T represents the matrix transpose operation.

The FBCCA adopted in the embodiments of the present application is an improvement on CCA. On the basis of CCA, using the design of different frequency bands of the filter, the fundamental frequency, the second harmonic, the third harmonic, and the fifth harmonic of the stimulation frequency are filtered out in turn, and finally the discriminant analysis is carried out. The correlation coefficient matrix obtained by the FBCCA algorithm is subjected to coefficient fusion according to the following formula.

Among them, N=6, is the total number of filter banks;

j is the index number of the subfilter;

k is the index number of the stimulus frequency f;

ρ _k is the correlation coefficient matrix obtained by the FBCCA algorithm under different frequency bands;

a and b are two preset constants.

挑选出最大的数值作为输出结果。FBCCA is analyzed by filtering the frequency band canonical correlation, and finally a series of correlation coefficient values are obtained.

Pick out the largest value as the output result.

In some embodiments of the brain-computer interface system 400, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where no visual stimulation is applied; the second brain signal is a visual stimulation applied brain signals in a state of

The data processing device 402 is specifically used for:

Perform variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and perform variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein, the first characteristic signal information is a pair of The first brain signal is obtained by feature extraction; the second feature signal information is obtained by feature extraction on the second brain signal;

Correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

During specific implementation, the data of the brain electrical signals in the task state and the data of the brain signals in the resting state may be separately processed. Among them, the task state is the state in which visual stimulation is applied; the resting state is the state in which no visual stimulation is applied. The process of processing the data of the EEG signal in the task state, specifically, firstly, the data of the original EEG signal is filtered through the filter bank Filter Bank to form multiple groups of filtered signal data of different frequency bands, and then different The signal data of the frequency band is used to calculate the CCA coefficients through the CCA algorithm, and the coefficients are fused using the above formula to obtain the coefficients in the task state. The processing process of the EEG signal data in the resting state is the same as the processing process of the EEG signal data in the task state. The filter bank filter bank filters and calculates the CCA coefficients in turn, and the coefficients are fused to obtain the resting state. coefficients in the state. Finally, according to the coefficient in the task state and the coefficient in the resting state, the result information of the correlation coefficient is obtained.

In some embodiments of the present application, the correlation coefficient result information is obtained according to the coefficient in the task state and the coefficient in the resting state. Specifically, the coefficient in the task state and the coefficient in the resting state are subtracted to obtain the final result. Correlation coefficient result information.

The brain-computer interface system of the above embodiment uses the above decoding algorithm to analyze the brain signal data in the task state with stimulation and the rest state without stimulation respectively, and obtains the coefficient in the task state and the coefficient in the rest state. Output the results, and combine the decoding results of the brain signal data in the two states at the same time, so as to obtain a more stable feature analysis data value, which can shorten the duration of visual stimulation, improve the efficiency of stimulation detection, and improve the evaluation results of the user's peripheral vision. accuracy.

The brain-computer interface system provided by the embodiments of the present application can be used to monitor the peripheral visual field neural pathway function, and the brain-computer interface system can improve the accuracy of determining the visual pathway health level and visual function defect degree of the subject.

Based on the same inventive concept as the brain-computer interface system provided in the above-mentioned embodiment, the embodiment of the present application further provides a stimulation paradigm detection method, and FIG. 5 is a schematic flowchart of the method. As shown in Figure 5, the stimulus paradigm detection method includes:

Step S501, presenting visual stimuli to the user in at least one first field of view fan ring of the user's first field of view and/or at least one second field of view fan ring of the user's second field of view.

Wherein, the visual stimulation is obtained by displaying the first fan-ring visual stimulation block in the first disk ring, and/or the second fan-ring visual stimulation block in the second disk ring, and placing the first fan-ring stimulation block The image and/or the second fan ring stimulation block image is reflected along the target direction and presented; the fan ring visual stimulation block is a part of the fan ring unit included in the disc ring, and according to the coding frequency corresponding to each fan ring unit, It is formed by flickering; the target direction is that when the stimulus reflex device makes the first circle center mark of the first disc ring visually coincide with the second circle center mark of the second disc ring, the stimulus reflex device reflects the first circle center mark or the second circle center mark. The direction of the two center marks; the first visual field fan ring corresponds to the position of the fan ring unit at the first fan ring visual stimulation block one-to-one; the second visual field fan ring and the fan ring unit position at the second fan ring visual stimulation block one-to-one correspond.

In specific implementation, the fan ring visual stimulation block may be selected from the fan ring units included in the disc ring, as the target fan ring unit, so that the target fan ring unit is in accordance with the target fan ring unit in accordance with the target fan ring unit. The coding frequency corresponding to each sector ring unit is formed by flickering.

For the fan-ring unit in the fan-ring visual stimulus block, the flickering waveform should be periodic, and the frequency should usually be above 7Hz. The flickering waveform can be sine wave, square wave, triangle wave, sawtooth wave and other shapes. In the RGB space, two colors can be selected arbitrarily, and the value range is between [0,0,0]～[255,255,255], corresponding to the troughs and peaks in the waveform diagram. The two colors gradually changed frame by frame and appeared alternately in a certain period, presenting a stable flickering stimulus.

In the embodiment of the present application, the stimulus reflex device is a binocular rivalry instrument. In the process of stimulus paradigm detection, subjects adjusted the lens reflection angle of the binocular rivalry device so that the left and right stimuli presented in the display device coincided in the eyes. In order to achieve binocular competition, the embodiments of the present application may employ various devices, such as red and blue glasses, binocular prisms, and the like. The embodiment of the present application does not limit the specific form of the stimulus reflection device used to realize the binocular competition.

Step S502, collecting brain signals.

Among them, the brain signal is generated by the left and right eyes of the user based on visual stimulation; the brain signal includes the multifocal steady-state visual evoked potential mfSSVEP.

Step S503, acquiring brain signals, analyzing the brain signals, and generating an evaluation result of the user's peripheral visual field.

In some embodiments of the present application, in the process of stimulation paradigm detection, the brain signal of the subject can also be collected through electrodes, amplified and filtered by an amplifier to form data information, and then the data information is analyzed to generate Evaluation of the user's surrounding visual field.

The stimulus paradigm detection method provides a mechanism for feature extraction of brain signals and variable correlation analysis to obtain correlation coefficient result information, which is used to generate evaluation results for the user's surrounding visual field, which can shorten the visual The duration of stimulation improves the efficiency of stimulation detection.

In an optional embodiment, visual stimuli are presented to the user in at least one first field of view fan ring of the user's first field of view and/or in at least one second field of view fan ring of the user's second field of view, including:

In response to receiving the first-stage detection instruction, visual stimuli are presented to the user in at least one first field of view fan ring of the user's first field of view and at least one second field of view fan ring of the user's second field of view, so as to provide a visual stimulus to the user. Each first field of view fan ring of the first field of view is detected with each second field of view fan ring of the user's second field of view;

If the second-stage detection instruction is received, the user is presented with visual stimuli in the user's target visual field ring to detect the user's target visual field ring; the target visual field ring is a selected first field of view A field of view fan ring, or a second field of view fan ring selected in the second field of view.

Exemplarily, assuming that the visual field corresponding to the non-stimulated central visual field part on the disc ring is 3° (α ₀ =1.5°), the first threshold m is 4, and the second threshold n is 2, then the central visual field part will be removed. _{The rest of the} °), 2 rings (α ₁ =3.5°,α ₂ =7.5°), and configure sinusoidal stimulation with different coding frequencies for each equal sector, for example, the area where the θ ₁ equal sector is located is 13 Hz , the area where the _θ2 equal sector is located is 15Hz, the area where the _θ3 equal sector is located is 17Hz, and the area where the _θ4 equal sector is located is 19Hz. That is, different ring areas of the same sector are coded with the same frequency information, so that the area outside the non-stimulated central visual field on any disk ring is divided into 8 ring areas, which are different from any disk ring at this time. The number of types f _k of encoding frequencies corresponding to the sector ring units included in the circular ring is 4, and the first threshold m is 4, which satisfies that the number of types of encoding frequencies is not greater than the first threshold. It is assumed that the two disk rings are respectively a disk ring A and a disk ring B, and the disk ring A and the disk ring B correspond to the visual field of the left eye and the visual field of the right eye, respectively.

During the experiment, the detection stage 1 was used to locate the visual function damaged area, and the detection stage 2 was used to further accurately locate the visual function damaged area, so as to more accurately evaluate the visual function damage degree. Specifically, in the detection stage 1, the eyes are detected at different positions at the same time, 4 frequency stimuli (f _{k, on} = 4) are turned on at the same time, and the response of the brain signal of the multifocal steady-state visual evoked potential is recorded at the same time, traversing all the The position (8 sector ring areas) flashes. According to the analysis of the decoding algorithm of the present invention, it is assumed that the (θ ₁ =0°~90°, α ₁ =3.5°, α ₂ =7.5°) sector ring area of the upper left part of the disc ring A has a weak response. Among them, (θ _{1 =} 0°～90°, α ₁ =3.5°, α _{2 =} 7.5°) sector ring area =3.5°) and the sector ring area determined by the circular ring (α ₂ =7.5°).

In the detection stage 2, according to the position determined in the detection stage 1, that is, the sector ring of the upper left part of the disc ring A (θ ₁ =0°～90°, α ₁ =3.5°, α ₂ =7.5°) Regions, single-frequency stimulation was performed to exclude the influence of factors other than visual field defect factors on the decoding results of detection stage one. Assuming that the brain signal recorded by the stimulus in the detection stage 2 is analyzed by the decoding algorithm of the present invention, the response amplitude of the position is still weak, and it is determined that the upper left part of the disc ring A is (θ ₁ =0°～90°, α ₁ = 3.5°, α ₂ =7.5°, ), the fan-circle vision function corresponding to the position of the fan-ring region is defective.

In some embodiments of the present application, the brain-computer interface system 400 can further accurately locate the degree of visual function defect. Specifically, by reducing the stimulus size, for example, a fan-ring visual stimulus block is constructed (θ _{n_1} =0°～45°, α ₁ =3.5°, α ₂ =7.5°; θ _{n_2} =45°～90°, α ₁ =3.5 °, α ₂ =7.5°), continue the experiment. Analysis using the decoding strategy of the present invention. If the position response of the (θ _{n_1} , α ₁ , α ₂ ) sector ring area is weak, and the position response of the (θ _{n_2} , α ₁ , α ₂ ) sector ring area is strong, then determine the (θ _{n_1} , α ₁ , α ₂ ) sector ring area The visual field ring corresponding to the position is the position of visual function defect; on the contrary, if the position response of the (θ _{n_1} , α ₁ , α ₂ ) sector ring area is strong, and the position response of the (θ _{n_2} , α ₁ , α ₂ ) sector ring area is weak, then Determine the visual field sector ring corresponding to the position _of the _{( θ n_2} , α ₁ , α ₂ ) sector ring area as the position of visual function _{defect ; 2} ) The position response of the fan ring area is weak, then it is determined that (θ ₁ =0°～90°, α ₁ =3.5°, α ₂ =7.5°) the visual field fan ring corresponding to the position of the fan ring area is the position of visual function defect.

The stimulus paradigm detection method provides a distributed detection mechanism, and in response to receiving the first-stage detection instruction, each first visual field fan ring of the user's first visual field and each second visual field of the user's second visual field can be detected. The visual field fan ring can be detected, and the target visual field fan ring whose evaluation result meets the preset conditions can be located in the first field of view and the second field of view, and according to the second-stage detection instruction, the user's target visual field fan ring is presented to the user with visual stimuli , to detect the user's target field of view fan ring, which can more accurately evaluate the user's field of view.

Based on the same inventive concept as the stimulation paradigm detection method shown in FIG. 5 , an embodiment of the present application also provides a stimulation paradigm detection apparatus, which is arranged in a brain-computer interface system, such as the brain-computer interface system 400 in FIG. 4 . Since the device is a device corresponding to the stimulus paradigm detection method of the present application, and the principle of solving the problem of the device is similar to that of the method, the implementation of the device can refer to the implementation of the above method, and the repetition will not be repeated.

FIG. 6 shows a schematic structural diagram of a stimulation paradigm detection apparatus provided by an embodiment of the present application. The stimulation paradigm detection apparatus, which is arranged in a brain-computer interface system, as shown in FIG. 6 , includes a stimulation paradigm generation module 601, a signal acquisition module module 602 and data processing module 603.

Stimulation paradigm generation module 601, for presenting visual stimuli to the user in at least one first visual field fan ring of the user's first visual field, and/or at least one second visual field fan ring of the user's second visual field; Display the first fan ring visual stimulus block in the first disk ring, and/or the second fan ring visual stimulus block in the second disk ring, and display the first fan ring stimulus block image and/or the second The fan-ring stimulation block image is reflected along the target direction; the fan-ring visual stimulation block is a part of the fan-ring unit included in the disc ring, and is formed by flickering according to the coding frequency corresponding to each fan-ring unit; the target The direction is the direction in which the stimulus reflection device reflects the first center mark or the second center mark when the stimulus reflection device visually overlaps the first center mark of the first disc ring with the second center mark of the second disc ring; The first visual field fan ring corresponds to the position of the fan ring unit at the first fan ring visual stimulation block one-to-one; the second visual field fan ring corresponds to the position of the fan ring unit at the second fan ring visual stimulation block one-to-one;

The signal acquisition module 602 is used to acquire brain signals; the brain signals are generated by the left and right eyes of the user based on visual stimulation; the brain signals include multifocal steady-state visual evoked potentials mfSSVEP;

The data processing module 603 is configured to acquire brain signals, analyze the brain signals, and generate evaluation results for the user's peripheral visual field.

In an optional embodiment, the data processing module 603 is specifically configured to:

Perform feature extraction on brain signals to obtain feature signal information;

The variable correlation analysis is performed on the characteristic signal information to obtain the correlation coefficient result information; the correlation coefficient result information is used to generate an evaluation result of the user's surrounding visual field.

In an optional embodiment, the brain signal includes a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where no visual stimulation is applied; the second brain signal is a state in which visual stimulation is applied brain signals;

The data processing module 603 is specifically used for:

Perform variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and perform variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein, the first characteristic signal information is a pair of The first brain signal is obtained by feature extraction; the second feature signal information is obtained by feature extraction on the second brain signal;

Correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information.

In an optional embodiment, the stimulus paradigm generation module 601 is specifically configured to:

In response to receiving the first-stage detection instruction, visual stimuli are presented to the user in at least one first field of view fan ring of the user's first field of view and at least one second field of view fan ring of the user's second field of view, so as to provide a visual stimulus to the user. Each first field of view fan ring of the first field of view is detected with each second field of view fan ring of the user's second field of view;

If the second-stage detection instruction is received, the user is presented with visual stimuli in the user's target visual field ring to detect the user's target visual field ring; the target visual field ring is a selected first field of view A field of view fan ring, or a second field of view fan ring selected in the second field of view.

Based on the same inventive concept as the above method embodiments, the embodiments of the present application further provide an electronic device. The electronic device can be used for stimulus paradigm detection. In one embodiment, the electronic device may be a server or other electronic device. In this embodiment, the structure of the electronic device may be as shown in FIG. 7 , including a memory 701 , a communication module 703 and one or more processors 702 .

The memory 701 is used for storing computer programs executed by the processor 702 . The memory 701 may mainly include a stored program area and a stored data area, wherein the stored program area may store the operating system and the programs required for running the instant messaging function, and the like; the storage data area may store various instant messaging information and operation instruction sets.

The memory 701 may be a volatile memory (volatile memory), such as random-access memory (random-access memory, RAM); the memory 701 may also be a non-volatile memory (non-volatile memory), such as read-only memory, flash memory (flash memory), hard disk drive (HDD) or solid-state drive (SSD), or memory 701 is capable of carrying or storing desired program code in the form of instructions or data structures and capable of being used by a computer Access any other medium without limitation. The memory 701 may be a combination of the above-described memories.

The processor 702 may include one or more central processing units (central processing units, CPU) or be a digital processing unit or the like. The processor 702 is configured to implement the above stimulus paradigm detection method when invoking the computer program stored in the memory 701 .

The communication module 703 is used to communicate with the terminal device or other servers.

The specific connection medium between the memory 701 , the communication module 703 , and the processor 702 is not limited in the embodiments of the present application. In the embodiment of the present application, the memory 701 and the processor 702 are connected through a bus 704 in FIG. 7 , and the bus 704 is represented by a thick line in FIG. 7 . The connection mode between other components is only for schematic illustration, not for be limited. The bus 704 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in FIG. 7, but it does not mean that there is only one bus or one type of bus.

The embodiments of the present application further provide a computer storage medium, where computer-executable instructions are stored in the computer storage medium, and the computer-executable instructions are used to implement the stimulus paradigm detection method of any embodiment of the present application.

According to one aspect of the present application, there is provided a computer program product or computer program comprising computer instructions stored in a computer readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the stimulation paradigm detection method in the above embodiment. The program product may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or a combination of any of the above. More specific examples (non-exhaustive list) of readable storage media include: electrical connections with one or more wires, portable disks, hard disks, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

The above are only specific embodiments of the present application, but the protection scope of the present application is not limited to this. should be covered within the scope of protection of this application.

Claims (14)

1. A stimulus paradigm generation system, wherein the system comprises: A display device for displaying the first fan ring visual stimulation block in the first disc ring, and/or the second fan ring visual stimulation block in the second disc ring; the fan ring visual stimulation block is a disc circle The part in the sector ring unit included in the ring is formed by flickering according to the coding frequency corresponding to each of the sector ring units; Stimulation reflection device, used to reflect the first fan-ring stimulation block image and/or the second fan-ring stimulation block image along the target direction, so as to correspond to at least one first visual field fan ring of the first visual field, and/or all Visual stimulation is presented to the user in at least one second visual field fan ring of the user's second visual field; the target direction is when the stimulus reflection device makes the first center mark of the first disk ring and the When the second circle center marks of the two disc rings are visually coincident, the stimulus reflection device reflects the direction of the first circle center mark or the second circle center mark; the first visual field fan ring and the first fan ring are visually stimulated The positions of the fan ring units at the block are in a one-to-one correspondence; the second visual field fan ring is in a one-to-one correspondence with the positions of the fan ring units at the second fan ring visual stimulation block. 2. The system of claim 1, wherein the first disk ring further comprises a first closed inner ring, and the second disk ring further comprises a second closed inner ring; the The first disk ring and the first closed inner ring are marked with the first center of the circle, and the second disk ring and the second closed inner ring are marked with the second center is the center of the circle; the sector ring unit is a concentric circle that divides the part between the disk ring and the inner ring with the first threshold and the second threshold with the center of the disk ring as the axis. When a ring is used, the graphic unit formed by the intersection of equally divided sectors and concentric rings. 3. The system according to claim 2, wherein, for any disc ring, the number of types of the coding frequencies corresponding to the sector ring units included in the any disc ring is not greater than all the first threshold. 4. The system according to claim 3, wherein, in any disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies; in any disc ring, Each of the sector ring units included in the same equally divided sector is configured with the same coding frequency. 5. The system according to claim 3, wherein, in any disc ring, the sector ring units included in different equal sectors are configured with different coding frequencies; the first disc ring The encoding frequency of any one of the sector ring units included in the second disk ring is different from the encoding frequency of any one of the sector ring units included in the second disk ring. 6. A brain-computer interface system, comprising the stimulation paradigm generation system according to any one of the preceding claims 1-5; the brain-computer interface system, further comprising: A data acquisition device for collecting brain signals generated by a subject; the brain signals are generated by the left and right eyes of the subject based on the visual stimulation of the stimulation paradigm generating system according to any one of the above claims 1-5 ; the brain signal includes multifocal steady-state visual evoked potential mfSSVEP; The data processing device is used for acquiring the brain signal, analyzing the brain signal, and generating an evaluation result of the peripheral visual field of the user. 7. The system of claim 6, wherein the brain signal is one of the following: an electroencephalogram (EEG) signal, a magnetoencephalogram (MEG) signal, and a functional near-infrared spectrogram (fNIRS) signal. 8. The system according to claim 6, wherein the data processing device is specifically used for: Feature extraction is performed on the brain signal to obtain feature signal information; The variable correlation analysis is performed on the feature signal information to obtain correlation coefficient result information; the correlation coefficient result information is used to generate the evaluation result of the user's surrounding visual field. 9. The system according to claim 8, wherein the brain signal comprises a first brain signal and a second brain signal; the first brain signal is a brain signal in a state where the visual stimulation is not applied; the second brain signal is a brain signal in a state where the visual stimulus is applied; The data processing device is specifically used for: Perform variable correlation analysis on the first characteristic signal information to obtain first correlation coefficient result information, and perform variable correlation analysis on the second characteristic signal information to obtain second correlation coefficient result information; wherein, the first characteristic signal information is obtained by feature extraction on the first brain signal; the second feature signal information is obtained by feature extraction on the second brain signal; The correlation coefficient result information is obtained according to the first correlation coefficient result information and the second correlation coefficient result information. 10. A stimulus paradigm detection method, wherein the method comprises: Visual stimuli are presented to the user in at least one first field of view fan ring of the user's first field of view, and/or in at least one second field of view fan ring of the user's second field of view; A first fan ring visual stimulus block in a disc ring, and/or a second fan ring visual stimulus block in a second disc ring, and images of the first fan ring stimulus block and/or the second fan ring The stimulation block image is presented by reflection along the target direction; the fan ring visual stimulation block is a part of the fan ring unit included in the disc ring, and is formed by flickering according to the coding frequency corresponding to each of the fan ring units; The target direction is that when the stimulus reflection device visually overlaps the first center mark of the first disk ring with the second center mark of the second disk ring, the stimulus reflection device reflects the first center mark. The direction of the circle center mark or the second circle center mark; the first visual field fan ring corresponds to the position of the fan ring unit at the visual stimulation block of the first fan ring; the second visual field fan ring and the The positions of the fan-ring units at the two fan-ring visual stimulus blocks correspond one-to-one; collecting brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potential mfSSVEP; The brain signals are acquired and analyzed to produce an assessment of the user's peripheral visual field. 11. The method according to claim 10, wherein the at least one first field of view fan ring in the user's first field of view, and/or the at least one second field of view fan ring in the user's second field of view presenting visual stimuli to the user, including: In response to receiving the first-stage detection instruction, presenting visual stimuli to the user in at least one first field of view fan ring of the user's first field of view, and at least one second field of view fan ring of the user's second field of view, to detect each first field of view fan ring of the user's first field of view and each second field of view fan ring of the user's second field of view; If the second-stage detection instruction is received, visual stimulation is presented to the user in the user's target field of view fan ring to detect the user's target field of view fan ring; the target field of view fan ring is the One of the first field of view fan rings selected in the first field of view, or one of the second field of view fan rings selected in the second field of view. 12. A stimulus paradigm detection device, characterized in that the device comprises: a stimulus paradigm generation module for presenting visual stimuli to the user in at least one first field of view fan ring of the user's first field of view, and/or in at least one second field of view fan ring of the user's second field of view; The visual stimulation is obtained by displaying the first fan ring visual stimulation block in the first disk ring, and/or the second fan ring visual stimulation block in the second disk ring, and placing the first fan ring stimulation block image And/or the second fan ring stimulation block image is reflected along the target direction and presented; the fan ring visual stimulation block is a part of the fan ring unit included in the disc ring, according to the coding frequency corresponding to each of the fan ring units , which is formed by flickering; the target direction is that when the stimulus reflection device visually overlaps the first center mark of the first disk ring with the second center mark of the second disk ring, the The stimulus reflection device reflects the direction of the first circle center mark or the second circle center mark; the first visual field fan ring corresponds to the position of the fan ring unit at the visual stimulation block of the first fan ring one-to-one; the second The visual field fan ring is in one-to-one correspondence with the position of the fan ring unit at the second fan ring visual stimulation block; a signal acquisition module for acquiring brain signals; the brain signals are generated by the left and right eyes of the user based on the visual stimulation; the brain signals include multifocal steady-state visual evoked potential mfSSVEP; The data processing module is used for acquiring the brain signal, analyzing the brain signal, and generating an evaluation result of the peripheral visual field of the user. 13. A server, comprising a memory and a processor, wherein the memory stores a computer program that can run on the processor, and when the computer program is executed by the processor, the claims are realized The method of 10 or 11. 14. A computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, wherein when the computer program is executed by a processor, the method of claim 10 or 11 is implemented.

Images