WO2019119518A1 - 房颤信号的识别方法、装置和设备 - Google Patents
房颤信号的识别方法、装置和设备 Download PDFInfo
- Publication number
- WO2019119518A1 WO2019119518A1 PCT/CN2017/120106 CN2017120106W WO2019119518A1 WO 2019119518 A1 WO2019119518 A1 WO 2019119518A1 CN 2017120106 W CN2017120106 W CN 2017120106W WO 2019119518 A1 WO2019119518 A1 WO 2019119518A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- signal
- atrial fibrillation
- network
- layer
- accuracy
- Prior art date
Links
- 206010003658 Atrial Fibrillation Diseases 0.000 title claims abstract description 118
- 238000000034 method Methods 0.000 title claims abstract description 75
- 238000013527 convolutional neural network Methods 0.000 claims abstract description 41
- 238000012549 training Methods 0.000 claims abstract description 17
- 238000012545 processing Methods 0.000 claims description 21
- 230000035945 sensitivity Effects 0.000 claims description 12
- 238000011176 pooling Methods 0.000 claims description 10
- 238000013528 artificial neural network Methods 0.000 claims description 7
- 238000007781 pre-processing Methods 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 5
- 230000004942 nuclear accumulation Effects 0.000 claims 2
- 235000019580 granularity Nutrition 0.000 description 16
- 238000010586 diagram Methods 0.000 description 11
- 230000006870 function Effects 0.000 description 7
- 230000008569 process Effects 0.000 description 7
- 230000001746 atrial effect Effects 0.000 description 6
- 230000004913 activation Effects 0.000 description 3
- 206010003119 arrhythmia Diseases 0.000 description 3
- 230000006793 arrhythmia Effects 0.000 description 3
- 230000001684 chronic effect Effects 0.000 description 3
- 230000006835 compression Effects 0.000 description 3
- 238000007906 compression Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000001788 irregular Effects 0.000 description 3
- 238000012806 monitoring device Methods 0.000 description 3
- 230000002085 persistent effect Effects 0.000 description 3
- 230000009467 reduction Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000000747 cardiac effect Effects 0.000 description 2
- 238000003759 clinical diagnosis Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 208000019622 heart disease Diseases 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000001757 thermogravimetry curve Methods 0.000 description 2
- 208000002330 Congenital Heart Defects Diseases 0.000 description 1
- 206010011091 Coronary artery thrombosis Diseases 0.000 description 1
- 206010019280 Heart failures Diseases 0.000 description 1
- 206010020772 Hypertension Diseases 0.000 description 1
- 208000006011 Stroke Diseases 0.000 description 1
- 206010044565 Tremor Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 208000029078 coronary artery disease Diseases 0.000 description 1
- 208000002528 coronary thrombosis Diseases 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 230000008034 disappearance Effects 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 230000005831 heart abnormality Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000000513 principal component analysis Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
- G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
- A61B5/346—Analysis of electrocardiograms
- A61B5/349—Detecting specific parameters of the electrocardiograph cycle
- A61B5/352—Detecting R peaks, e.g. for synchronising diagnostic apparatus; Estimating R-R interval
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/24—Detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof
- A61B5/316—Modalities, i.e. specific diagnostic methods
- A61B5/318—Heart-related electrical modalities, e.g. electrocardiography [ECG]
- A61B5/346—Analysis of electrocardiograms
- A61B5/349—Detecting specific parameters of the electrocardiograph cycle
- A61B5/361—Detecting fibrillation
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
- A61B5/7235—Details of waveform analysis
- A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
- A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
Definitions
- the present disclosure relates to the field of electrocardiographic monitoring technologies, and in particular, to a method, device and device for identifying atrial fibrillation signals.
- Atrial fibrillation is the most common persistent chronic arrhythmia, often resulting from disordered atrial activity and irregular atrial compression. Atrial fibrillation signals in ECG signals can be identified by detecting variability in P-wave or RR interval, but the reliability and accuracy of these methods are difficult to meet clinical diagnostic requirements, resulting in no medical diagnostic or wearable monitoring devices. widely used.
- an object of the present disclosure is to provide a method, device and device for identifying atrial fibrillation signal to improve the reliability and accuracy of atrial fibrillation signal recognition.
- the present disclosure provides a method for identifying atrial fibrillation signal, the method comprising: acquiring an ECG signal to be identified; inputting an ECG signal to be identified into a pre-established AF signal recognition model, and outputting a room The recognition result of the tremor signal; wherein the AF signal recognition model is established by: acquiring a set number of ECG sample signals and corresponding identification information; wherein the identification information includes identification information of the normal signal and the AF signal; The number of normal signals is equalized by the SMOTE method; the network structure of the multi-channel convolutional neural network is established; each convolutional neural network is provided with a specific receptive field for identifying the corresponding granularity of the atrial fibrillation signal; The normal signal and the equalized processed AF signal are input into the network structure for training to generate atrial fibrillation signal recognition model.
- the present disclosure provides an apparatus for identifying atrial fibrillation signal, the apparatus comprising: a signal acquisition module for acquiring an ECG signal to be identified; and a result output module, configured to input an ECG signal to be identified to
- the pre-established AF signal recognition model outputs a recognition result of the atrial fibrillation signal; wherein the AF signal recognition model is established by acquiring a set number of ECG sample signals and corresponding identification information; wherein The identification information includes normal signal and identification information of the atrial fibrillation signal; according to the number of the normal signals, the atrial fibrillation signal is equalized by using a SMOTE method; and a network structure of the multi-channel convolutional neural network is established; each volume The neural network is provided with a specific receptive field for identifying a corresponding granularity of the AF signal; the normal signal and the equalized processed AF signal are input into the network structure for training to generate the AF signal recognition. model.
- the present disclosure provides an identification device for atrial fibrillation signal, comprising a processor and a machine readable storage medium storing machine executable instructions executable by a processor, the processor executing the machine The instructions are executed to implement the above method for identifying atrial fibrillation signals.
- the present disclosure provides a machine readable storage medium storing machine executable instructions that, when invoked and executed by a processor, cause the processor to implement the above A method of identifying atrial fibrillation signals.
- the atrial fibrillation signal recognition model is established by multi-channel convolutional neural network training, and each convolutional neural network is provided with a specific receptive field, Identifying the corresponding granularity of the AF signal; by inputting the ECG signal to be identified into the AF signal recognition model, the recognition result of the AF signal can be obtained; the method uses multiple convolutional neural networks of different size receptive fields to identify The atrial fibrillation signal can identify the atrial fibrillation signals of different granularities, can comprehensively identify the atrial fibrillation signal, and improve the reliability and accuracy of the AF signal recognition.
- the ECG signal required for this method has a short duration, and no manual intervention is required in the identification process, and the AF signal can be automatically and efficiently identified.
- FIG. 1 is a flowchart of a method for identifying atrial fibrillation signal according to an embodiment of the present disclosure
- FIG. 2 is a specific flowchart of establishing a model of atrial fibrillation signal recognition according to an embodiment of the present disclosure
- FIG. 3 is a schematic structural diagram of a model of atrial fibrillation signal recognition according to an embodiment of the present disclosure
- FIG. 4 is a flowchart of another method for identifying atrial fibrillation signal according to an embodiment of the present disclosure
- FIG. 5 is a thermogram of atrial fibrillation signal recognition result according to an embodiment of the present disclosure
- FIG. 6 is a schematic structural diagram of an apparatus for identifying atrial fibrillation signal according to an embodiment of the present disclosure
- FIG. 7 is a schematic structural diagram of an apparatus for identifying atrial fibrillation signal according to an embodiment of the present disclosure.
- Atrial fibrillation is the most common persistent chronic arrhythmia, often resulting from disordered atrial activity and irregular atrial compression. Atrial fibrillation is closely related to various diseases such as stroke, heart failure, coronary heart disease and thrombosis. Early identification of atrial fibrillation can help patients find heart abnormalities in time and reduce the disability and mortality caused by heart disease.
- the AF signal in the ECG signal can be identified by detecting the variability of the P wave or RR interval.
- the A-wave signal is identified based on the P-wave trigger signal equalization method, and the hypertension is identified according to the principle of P-wave disappearance.
- the present disclosure provides a method, device and device for identifying atrial fibrillation signal, which can be applied to a server, and can also be applied to a wearable cardiac monitoring device.
- a server In mobile phones, tablets, and other terminal devices, it is used to identify atrial fibrillation signals and to assist in the diagnosis of persistent chronic arrhythmias and other heart diseases.
- the technique can be implemented in related software or hardware, which is described below by way of example.
- Step S102 acquiring an ECG signal to be identified
- Step S104 inputting the ECG signal to be identified into the pre-established AF signal recognition model, and outputting the recognition result of the AF signal;
- the ECG signal to be identified generally includes a normal signal and atrial fibrillation signal; the ECG signal to be identified may be the original ECG signal collected by the device; in order to improve the accuracy of the recognition result, the original may be
- the ECG signals are preprocessed, for example, filtering, noise reduction, RELU (Rectified Linear Units), activation function processing, regularization processing, and the like.
- the pre-treated ECG signal can better adapt to the AF signal recognition model and improve the recognition effect.
- Step S202 acquiring a set number of ECG sample signals and corresponding identification information; wherein the identification information includes identification information of a normal signal and atrial fibrillation signal;
- Step S204 Perform equalization processing on the atrial fibrillation signal by using a SMOTE (Synthetic Minority Oversampling Technique) method according to the number of the normal signals;
- SMOTE Synthetic Minority Oversampling Technique
- Step S206 establishing a network structure of the multi-channel convolutional neural network; each convolutional neural network is provided with a specific receptive field for identifying a corresponding granularity of the atrial fibrillation signal;
- the above step S204 uses SMOTE to equalize the atrial fibrillation signal, and the SMOTE can analyze a small number of samples and add new samples to the data set according to a few types of samples, so that SMOTE can be used to increase
- the number of atrial fibrillation signals is such that the atrial fibrillation signal is roughly equal to the normal signal, facilitating the training of the network structure.
- Step S208 the normal signal and the equalized processed AF signal are input into the network structure for training, and the atrial fibrillation signal recognition model is generated.
- the atrial fibrillation signal originates from disordered atrial activity and irregular atrial compression. Therefore, the atrial fibrillation signal itself has various forms; for example, some of the atrial fibrillation signals have larger granularity, and the waveform is obvious or the wave height is higher; Some AF signals have smaller particle sizes, weaker waveforms or shorter wave heights.
- the single-channel convolutional neural network usually only can sense the atrial fibrillation signal in a narrow range of granularity due to the single field of receptive field. It is difficult to learn and recognize various forms of atrial fibrillation signals, resulting in incomplete recognition and low recognition accuracy.
- the present embodiment uses a multi-channel convolutional neural network to establish the above-mentioned atrial fibrillation signal recognition model, and each convolutional neural network is provided with a specific receptive field for identifying the corresponding granularity of the atrial fibrillation signal.
- Receptively small convolutional neural networks can identify small-scale atrial fibrillation signals, receptively large convolutional neural networks, and can identify large-scale atrial fibrillation signals.
- each neural network is constructed by a multi-layer convolutional layer, and the convolution kernel receptive field of each convolution layer can be set separately; therefore, the convolution kernel receptive field of each convolution layer in each neural network can be the same , can also be different.
- the convolution kernel receptive fields of each convolution layer may be increased layer by layer, or may be reduced layer by layer, and other setting manners may be adopted.
- the convolutional neural network may be an MS-CNN (Multi-scale Convolutional Neural Network) or other types of neural networks.
- a method for identifying atrial fibrillation signal wherein the atrial fibrillation signal recognition model is established by multi-channel convolutional neural network training, and each convolutional neural network is provided with a specific receptive field to identify the corresponding granularity.
- Atrial fibrillation signal; the recognition result of the atrial fibrillation signal can be obtained by inputting the ECG signal to be identified into the AF signal recognition model; the method uses multiple convolutional neural networks of different size receptive fields to identify the AF signal. It can identify the atrial fibrillation signals of different granularities, can comprehensively identify the AF signal, and improve the reliability and accuracy of AF signal recognition.
- the ECG signal required for this method has a short duration, and no manual intervention is required in the identification process, and the AF signal can be automatically and efficiently identified.
- the network structure of the multi-channel convolutional neural network includes two neural networks as an example, which are respectively a first network and a second network;
- the first network and the second network are both VGG-16 convolutional neural networks, and of course, other types of convolutional neural networks such as CaffeNet and ResNet.
- Each of the first network and the second network includes a multi-layer convolution layer and a multi-layer maximum pooling layer; as shown in FIG. 3, the first network includes 13 convolution layers (convolution layer, ie, ConvNet layer in FIG. 3) and 5 layers of the largest pooling layer (the largest pooling layer is the Maxpool layer in Figure 3); 13 layers of convolutional layers are arranged in sequence, 5 layers of the largest pooling layer are interspersed between 13 layers of convolutional layers; the second network also includes 13 The layer convolution layer and the 5 layer maximum pooling layer; 13 layers of convolution layers are sequentially arranged, and 5 layers of the largest pooling layer are interspersed between the 13 layers of convolution layers.
- the first network includes 13 convolution layers (convolution layer, ie, ConvNet layer in FIG. 3) and 5 layers of the largest pooling layer (the largest pooling layer is the Maxpool layer in Figure 3); 13 layers of convolutional layers are arranged in sequence, 5 layers of the largest pooling layer are interspersed between 13 layers of
- the receptive field of the convolution kernel in the first network is less than or equal to the receptive field of the convolution kernel in the second network; as shown in FIG. 3, the 13-layer volume of the first network
- the layered convolution kernels have the same receptive field, all of which are 3; of course, the receptive field can be adjusted to other values.
- the convolution kernel receptive field of the 13-layer convolutional layer in the second network can be set to different values. For example, in Figure 3, from left to right, the convolution kernel receptive fields of the first four layers of convolutional layers are set to 7, respectively.
- the convolution kernel receptive field of the layer is set to 3; of course, the convolution kernel receptive field of the first 4 layers of convolutional layer can also be set to 3, 5, 9, etc.; convolution of other layers except the first 4 layers of convolutional layer
- the nuclear receptive field can also be flexibly set to other values.
- Table 1 below shows various configuration parameters of the AF signal recognition model; wherein, in the MS-CNN (3, 3) configuration, the convolution kernel receptive fields of each convolution layer of the first network are all 3; The convolution kernel receptive field of each layer of convolutional layer is also 3; in the MS-CNN (3, 5) configuration, the convolution kernel receptive field of each convolutional layer of the first network is 3; The convolution kernel receptive field of the first four layers of convolutional layer is 5, and the convolution kernel receptive field of other layers is 3; in the MS-CNN (3,7) configuration, the convolution kernels of the convolutional layers of the first network The wild is 3; the convolution kernel receptive field of the first 4 layers of the second network is 7, and the convolution kernel receptive field of the other layers is 3; in the MS-CNN (3, 9) configuration, the first network The convolution kernel receptive field of each convolution layer is 3; the convolution kernel receptive field of
- the first pool and the largest pooled layer of the last layer of the second network are connected to each other; the interconnected maximum pooled layer is also connected with multiple layers of fully connected layers (the full connection layer is a map) The Full connect layer in 3) and the Softmax layer. As shown in FIG. 3, the first pool and the largest pooled layer of the last layer of the second network are connected in parallel, and then the four layers of the full connection layer and the first layer of the Softmax layer are sequentially connected.
- an ECG (Electrocardiogram) signal (corresponding to the ECG signal) is input to the first layer convolution layer of the first network and the second network, respectively, through each convolution layer, After the maximum pooling layer and the fully connected layer are processed, the classification result is output by the Softmax layer, and the result includes the AF signal and the normal signal Normal, thereby realizing the recognition of the atrial fibrillation signal.
- ECG Electrocardiogram
- the inventor In the establishment process of the above-mentioned atrial fibrillation signal recognition model, the inventor usually needs to repeatedly adjust various configuration parameters to optimize the recognition effect of the model; based on this, during the establishment of the above-mentioned atrial fibrillation signal recognition model, normal signals and equalization will be performed.
- the processed AF signal is input into the network structure for training, and the steps of generating the AF signal recognition model include:
- Step 1 input the normal signal and the equalized processed AF signal into the network structure for training to generate an initial model
- Step 2 calculate the sensitivity of the AF signal recognition model
- Step 3 calculate the specificity of the AF signal recognition model
- Step 4 Calculate the accuracy of the AF signal recognition model
- Step 5 Calculate the accuracy of the AF signal recognition model
- # represents the number
- TP is the correct atrial fibrillation signal
- FP is the wrong AF signal
- TN is the correct normal signal
- FN is the normal signal of the recognition error
- Step 6 determining whether the sensitivity, specificity, accuracy, and accuracy respectively meet the corresponding threshold, and if not, adjusting the configuration parameters in the network structure until the sensitivity, specificity, accuracy, and accuracy satisfy the corresponding threshold;
- step 7 the initial model is determined as a model of atrial fibrillation signal recognition.
- Step S402 acquiring an original ECG signal
- Step S404 pre-processing the original ECG signal to generate an ECG signal to be identified; the pre-processing includes filtering processing and regularization processing.
- the frequency of the ECG signal collected by the ECG collector or other cardiac testing equipment is wider than 150 Hz; and the inventors have repeatedly tested and found that the frequency contributing to the identification of the AF signal is concentrated at 0.5 Hz to 40 Hz. Therefore, in order to reduce the interference signal recognized by the model while reducing the amount of data and improve the recognition efficiency, the ECG signal needs to be filtered before being input to the model; for example, FIR (Finite Impulse Response, finite-length unit impulse response) can be used.
- FIR Finite Impulse Response, finite-length unit impulse response
- the filter downsamples the original ECG signal to filter out high frequency noise; the parameters of the FIR filter can be set to a low pass filter with a cutoff frequency of 60hz and 512 steps, and the original ECG signal can be downsampled. Up to 120Hz.
- the atrial fibrillation signal recognition model needs to use an activation function for activation processing before performing recognition processing; since the model in this embodiment is established by a two-way convolutional neural network, the model established by the two-way convolutional neural network is not suitable.
- the above RELU algorithm therefore, the regularization process is used in this embodiment to prevent the fitting of the model, which is beneficial to the diversity of the gradient of the model node.
- Step S406 the ECG signal to be identified is input into the AF signal recognition model, and the recognition result of the AF signal is output.
- a method for identifying atrial fibrillation signal provided by an embodiment of the present disclosure, wherein the atrial fibrillation signal recognition model is established by two-way convolutional neural network training, and each convolutional neural network is provided with a specific receptive field to identify the corresponding granularity.
- the atrial fibrillation signal after the ECG signal is filtered and regularized, it is input into the AF signal recognition model to obtain the recognition result of the atrial fibrillation signal; the method uses multiple convolutional neural networks of different size receptive fields. Identifying the atrial fibrillation signal can identify different sizes of atrial fibrillation signals, can comprehensively identify the AF signal, and improve the reliability and accuracy of AF signal recognition.
- the ECG signal required for this method has a short duration, and no manual intervention is required in the identification process, and the AF signal can be automatically and efficiently identified.
- the inventors In order to verify the recognition effect of the above-mentioned method for identifying the atrial fibrillation signal, the inventors also analyzed the data outputted by the above-mentioned atrial fibrillation signal recognition model, see the thermogram of the atrial fibrillation signal recognition result shown in FIG. 5; the above-mentioned atrial fibrillation signal recognition In the model, the 256-dimensional feature data output by the Softmax layer is subjected to principal component analysis, and 4 principal component data are intercepted for display; as shown in FIG. 5, the thermal powers of the five main component data of five atrial fibrillation signals and five normal signals are shown. Figure; It can be seen from the figure that the gray value of the AF signal and the normal signal Normal are significantly different, and the difference is obvious, indicating that the recognition method of the AF signal is better.
- Table 2 shows the accuracy of AF signal recognition in each receptive field configuration; four configuration parameters are counted in Table 2 (MS-CNN(3,3), MS-CNN(3,5), MS -CNN (3,7) and MS-CNN (3,9)), Sensi, Specific Spe, Accuracy Pre and Accuracy Acc data corresponding to the input length of the four ECG signals; Table 2 It shows that the accuracy of the data input length of the model is not less than 96% for 5 seconds, 10 seconds, 20 seconds and 30 seconds; among them, in the MS-CNN (3, 7) configuration, the 20-second input length corresponds to The accuracy rate reached 98.13%.
- FIG. 6 is a schematic structural diagram of an apparatus for identifying atrial fibrillation signal; the apparatus includes:
- a signal acquisition module 60 configured to acquire an ECG signal to be identified
- the result output module 61 is configured to input the ECG signal to be identified into the pre-established AF signal recognition model, and output the recognition result of the AF signal; wherein the AF signal recognition model is established by: acquiring the setting a quantity of ECG sample signals and corresponding identification information; wherein the identification information includes normal signal and identification information of the atrial fibrillation signal; according to the number of normal signals, the AMO signal is equalized by the SMOTE method; and the multi-channel convolutional nerve is established The network structure of the network; each convolutional neural network is provided with a specific receptive field for identifying the corresponding granularity of the AF signal; the normal signal and the equalized AF signal are input into the network structure for training to generate atrial fibrillation Signal recognition model.
- the network structure of the multi-channel convolutional neural network includes a first network and a second network; the first network and the second network are both VGG-16 convolutional neural networks; the first network and the second network each comprise a multi-layer convolution layer And a multi-layer maximum pooling layer; the receptive field of the convolution kernel in the first network is less than or equal to the receptive field of the convolution kernel in the second network; and the largest pooled layer of the last layer of the first network and the second network are interconnected The largest pooled layer after interconnection is also connected with multiple layers of fully connected layers and Softmax layers.
- the signal acquisition module is further configured to: acquire an original ECG signal; preprocess the original ECG signal to generate an ECG signal to be identified; and perform preprocessing including filtering processing and regularization processing.
- the result output module is further configured to: input the normal signal and the equalized processed AF signal into the network structure for training, and generate an initial model;
- TP is to identify the correct atrial fibrillation signal
- FP is to identify the wrong AF signal
- TN is to identify the correct normal signal
- FN is the normal signal to identify the error
- Corresponding threshold if not, adjust the configuration parameters in the network structure until the sensitivity, specificity, accuracy, and accuracy meet the corresponding threshold; determine the initial model as the AF signal recognition model.
- the device for identifying atrial fibrillation signal uses a multi-channel convolutional neural network of different size receptive fields to identify atrial fibrillation signals, can identify atrial fibrillation signals of different granularities, and can comprehensively identify atrial fibrillation signals. Improve the reliability and accuracy of AF signal recognition.
- the ECG signal required for this method has a short duration, and no manual intervention is required in the identification process, and the AF signal can be automatically and efficiently identified.
- the present embodiment provides an identification device for atrial fibrillation signal corresponding to the above method embodiment.
- 7 is a schematic structural diagram of the identification device. As shown in FIG. 7, the device includes a processor 1201 and a memory 1202. The memory 1202 is configured to store one or more computer instructions, and one or more computer instructions are executed by the processor. To achieve the above identification method of atrial fibrillation signal.
- the identification device shown in FIG. 7 further includes a bus 1203 and a forwarding chip 1204.
- the processor 1201, the forwarding chip 1204, and the memory 1202 are connected by a bus 1203.
- the identification device can be a network edge device.
- the memory 1202 may include a high-speed random access memory (RAM), and may also include a non-volatile memory, such as at least one disk storage.
- the bus 1203 may be an ISA bus, a PCI bus, or an EISA bus.
- the bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one double-headed arrow is shown in Figure 7, but it does not mean that there is only one bus or one type of bus.
- the forwarding chip 1204 is configured to connect to the at least one user terminal and other network elements through the network interface, and send the encapsulated IPv4 packet or the IPv6 packet to the user terminal through the network interface.
- the processor 1201 may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 1201 or an instruction in a form of software.
- the processor 1201 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP processor, etc.), or a digital signal processor (DSP). ), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component.
- the methods, steps, and logical block diagrams disclosed in the embodiments of the invention may be implemented or carried out.
- the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
- the steps of the method disclosed in connection with the embodiments of the present invention may be directly implemented by the hardware decoding processor, or may be performed by a combination of hardware and software modules in the decoding processor.
- the software module can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory or electrically erasable programmable memory, registers, and the like.
- the storage medium is located in the memory 1202, and the processor 1201 reads the information in the memory 1202 and, in conjunction with its hardware, performs the steps of the method of the foregoing embodiment.
- Embodiments of the present disclosure also provide a machine readable storage medium storing machine executable instructions that, when invoked and executed by a processor, cause the processor to implement
- a processor executes machine executable instructions that, when invoked and executed by a processor, cause the processor to implement
- the method, device and device for identifying atrial fibrillation signal do not require manual feature engineering and have the function of automatically extracting ECG features; two-way VGG-16 network is adopted, but the two networks have different granularities.
- the convolution kernel can capture more feature information of different granularity.
- each block of the flowchart or block diagram can represent a module, a program segment, or a portion of code that includes one or more of the Executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the blocks may also occur in a different order than those illustrated in the drawings.
- each block of the block diagrams and/or flowcharts, and combinations of blocks in the block diagrams and/or flowcharts can be implemented in a dedicated hardware-based system that performs the specified function or function. Or it can be implemented by a combination of dedicated hardware and computer instructions.
- each functional module or unit in each embodiment of the present invention may be integrated to form a separate part, or each module may exist separately, or two or more modules may be integrated to form a separate part.
- the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product. Based on such understanding, the portion of the technical solution of the present disclosure that contributes in essence or to the prior art or the portion of the technical solution may be embodied in the form of a software product stored in a storage medium, including The instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present disclosure.
- the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like. .
Landscapes
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Medical Informatics (AREA)
- Public Health (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Cardiology (AREA)
- Pathology (AREA)
- Theoretical Computer Science (AREA)
- Veterinary Medicine (AREA)
- Mathematical Physics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Evolutionary Computation (AREA)
- Heart & Thoracic Surgery (AREA)
- Data Mining & Analysis (AREA)
- Computational Linguistics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Computing Systems (AREA)
- General Physics & Mathematics (AREA)
- Physiology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Fuzzy Systems (AREA)
- Signal Processing (AREA)
- Psychiatry (AREA)
- Primary Health Care (AREA)
- Epidemiology (AREA)
- Databases & Information Systems (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
Description
Claims (10)
- 一种房颤信号的识别方法,其特征在于,所述方法包括:获取待识别的心电信号;将所述待识别的心电信号输入至预先建立的房颤信号识别模型中,输出房颤信号的识别结果;其中,所述房颤信号识别模型通过下述方式建立:获取设定数量的心电样本信号和对应的标识信息;其中,所述标识信息包括正常信号和房颤信号的标识信息;根据所述正常信号的数量,采用SMOTE方式对所述房颤信号进行均衡处理;建立多路卷积神经网络的网络结构;每路卷积神经网络设置有特定的感受野,用于识别相应粒度的房颤信号;将所述正常信号和均衡处理后的房颤信号输入至所述网络结构中进行训练,生成所述房颤信号识别模型。
- 根据权利要求1所述的方法,其特征在于,所述多路卷积神经网络的网络结构包括第一网络和第二网络;所述第一网络和第二网络均为VGG-16卷积神经网络;所述第一网络和第二网络均包括多层卷积层和多层最大池化层;所述第一网络内卷积核的感受野小于或等于所述第二网络内卷积核的感受野;所述第一网络和所述第二网络的最末层的最大池化层相互连接;相互连接后的所述最大池化层还依次连接有多层全连接层和Softmax层。
- 根据权利要求1所述的方法,其特征在于,所述获取待识别的心电信号的步骤,包括:获取原始心电信号;对所述原始心电信号进行预处理,生成待识别的心电信号;所述预处理包括滤波处理和正则化处理。
- 根据权利要求1所述的方法,其特征在于,所述将所述正常信号和均衡处理后的房颤信号输入至所述网络结构中进行训练,生成所述房颤信号识别模型的步骤,包括:将所述正常信号和均衡处理后的房颤信号输入至所述网络结构中进行训练,生成初始模型;其中,TP为识别正确的房颤信号;FP为识别错误的房颤信号;TN为识别正确的正常信号;FN为识别错误的正常信号;判断所述灵敏度、所述特异性、所述精确度和所述准确度是否分别满足对应的阈值,如果否,调整所述网络结构中的配置参数,直至所述灵敏度、所述特异性、所述精确度和所述准确度满足对应的阈值;将所述初始模型确定为所述房颤信号识别模型。
- 一种房颤信号的识别装置,其特征在于,所述装置包括:信号获取模块,配置成获取待识别的心电信号;结果输出模块,配置成将所述待识别的心电信号输入至预先建立的房颤信号识别模型中,输出房颤信号的识别结果;其中,所述房颤信号识别模型通过下述方式建立:获取设定数量的心电样本信号和对应的标识信息;其中,所述标识信息包括正常信号和房颤信号的标识信息;根据所述正常信号的数量,采用SMOTE方式对所述房颤信号进行均衡处理;建立多路卷积神经网络的网络结构;每路卷积神经网络设置有特定的感受野,配置成识别相应粒度的房颤信号;将所述正常信号和均衡处理后的房颤信号输入至所述网络结构中进行训练,生成所述房颤信号识别模型。
- 根据权利要求5所述的装置,其特征在于,所述多路卷积神经网络的网络结构包括第一网络和第二网络;所述第一网络和第二网络均为VGG-16卷积神经网络;所述第一网络和第二网络均包括多层卷积层和多层最大池化层;所述第一网络内卷积核的感受野小于或等于所述第二网络内卷积核的感受野;所述第一网络和所述第二网络的最末层的最大池化层相互连接;相互连接后的所述最大池化层还依次连接有多层全连接层和Softmax层。
- 根据权利要求5所述的装置,其特征在于,所述信号获取模块,还配置成:获取原始心电信号;对所述原始心电信号进行预处理,生成待识别的心电信号;所述预处理包括滤波处理和正则化处理。
- 一种房颤信号的识别设备,其特征在于,包括处理器和机器可读存储介质,所述机器可读存储介质存储有能够被所述处理器执行的机器可执行指令,所述处理器执行所述机器可执行指令以实现权利要求1至4任一项所述的方法。
- 一种机器可读存储介质,其特征在于,所述机器可读存储介质存储有机器可执行指令,所述机器可执行指令在被处理器调用和执行时,所述机器可执行指令促使所述处理器实现权利要求1至4任一项所述的方法。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2020532967A JP7053836B2 (ja) | 2017-12-19 | 2017-12-29 | 心房細動信号の識別方法、装置及び機器 |
US16/901,033 US11538588B2 (en) | 2017-12-19 | 2020-06-15 | Atrial fibrillation signal recognition method, apparatus and device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711380466.9 | 2017-12-19 | ||
CN201711380466.9A CN108113666B (zh) | 2017-12-19 | 2017-12-19 | 房颤信号的识别方法、装置和设备 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/901,033 Continuation US11538588B2 (en) | 2017-12-19 | 2020-06-15 | Atrial fibrillation signal recognition method, apparatus and device |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019119518A1 true WO2019119518A1 (zh) | 2019-06-27 |
Family
ID=62229643
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2017/120106 WO2019119518A1 (zh) | 2017-12-19 | 2017-12-29 | 房颤信号的识别方法、装置和设备 |
Country Status (4)
Country | Link |
---|---|
US (1) | US11538588B2 (zh) |
JP (1) | JP7053836B2 (zh) |
CN (1) | CN108113666B (zh) |
WO (1) | WO2019119518A1 (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113749668A (zh) * | 2021-08-23 | 2021-12-07 | 华中科技大学 | 一种基于深度神经网络的可穿戴心电图实时诊断系统 |
Families Citing this family (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110897629A (zh) * | 2018-09-14 | 2020-03-24 | 杭州脉流科技有限公司 | 基于深度学习算法的心电特征提取方法、装置、系统、设备和分类方法 |
CN109171712B (zh) * | 2018-09-28 | 2022-03-08 | 东软集团股份有限公司 | 心房颤动识别方法、装置、设备及计算机可读存储介质 |
CN109871808B (zh) * | 2019-02-21 | 2021-03-02 | 天津惊帆科技有限公司 | 房颤模型训练、检测方法和装置 |
CN110037685A (zh) * | 2019-04-01 | 2019-07-23 | 上海数创医疗科技有限公司 | 具有改进卷积神经网络识别算法的便携式心电图仪 |
CN110037683B (zh) * | 2019-04-01 | 2020-12-29 | 上海数创医疗科技有限公司 | 用于识别心律类型的改进卷积神经网络及其训练方法 |
CN110037682B (zh) * | 2019-04-01 | 2020-07-21 | 上海数创医疗科技有限公司 | 基于改进卷积神经网络的识别心律类型的方法 |
CN110037684A (zh) * | 2019-04-01 | 2019-07-23 | 上海数创医疗科技有限公司 | 基于改进卷积神经网络的识别心律类型的装置 |
CN110493072A (zh) * | 2019-07-11 | 2019-11-22 | 网宿科技股份有限公司 | 基于深度学习的带宽滤波方法、装置、服务器及存储介质 |
US11005689B2 (en) | 2019-07-11 | 2021-05-11 | Wangsu Science & Technology Co., Ltd. | Method and apparatus for bandwidth filtering based on deep learning, server and storage medium |
CN110688942B (zh) * | 2019-09-25 | 2023-05-26 | 西安邮电大学 | 一种基于InResNet网络的心电信号联合识别模块及方法 |
CN110619322A (zh) * | 2019-10-18 | 2019-12-27 | 武汉大学 | 一种基于多流态卷积循环神经网络的多导联心电异常信号识别方法及系统 |
US11596344B2 (en) * | 2019-10-30 | 2023-03-07 | Tencent America LLC | Deep neural network on ECG Poincare plot for atrial fibrillation classification |
CN112826514B (zh) * | 2019-11-22 | 2022-07-22 | 华为技术有限公司 | 一种房颤信号的分类方法、装置、终端以及存储介质 |
CN111329445B (zh) * | 2020-02-20 | 2023-09-15 | 广东工业大学 | 基于组卷积残差网络和长短期记忆网络的房颤识别方法 |
CN111671416B (zh) * | 2020-05-29 | 2022-11-29 | 中国科学院深圳先进技术研究院 | 心电信号滤波方法及装置 |
CN111700609A (zh) * | 2020-07-27 | 2020-09-25 | 郑州大学 | 基于短时心电信号的房颤检测方法、装置及设备 |
CN111904411B (zh) * | 2020-08-25 | 2022-09-23 | 浙江工业大学 | 基于多尺度特征提取的多导联心跳信号分类方法及装置 |
CN112932497A (zh) * | 2021-03-10 | 2021-06-11 | 中山大学 | 一种不平衡单导联心电数据分类方法及系统 |
CN113080992A (zh) * | 2021-03-30 | 2021-07-09 | 北京芯动卫士科技有限公司 | 一种基于dcgan和深度神经网络方法的房颤识别方法 |
CN113425272B (zh) * | 2021-08-02 | 2024-02-20 | 北京雪扬科技有限公司 | 一种通过穿戴设备采集数据分析房颤、室颤的方法 |
CN114098754B (zh) * | 2021-10-29 | 2024-07-16 | 西安交通大学 | 一种房颤信号预处理方法、检测系统、设备及存储介质 |
CN114469133B (zh) * | 2021-12-14 | 2023-10-03 | 中国科学院深圳先进技术研究院 | 一种无扰式房颤监测方法 |
CN114176600B (zh) * | 2021-12-28 | 2023-10-20 | 上海交通大学 | 基于因果分析的心电图st段异常判别系统 |
CN117257324B (zh) * | 2023-11-22 | 2024-01-30 | 齐鲁工业大学(山东省科学院) | 基于卷积神经网络和ecg信号的房颤检测方法 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105726018A (zh) * | 2016-02-06 | 2016-07-06 | 河北大学 | 一种与rr间期无关的房颤自动检测方法 |
US20170032221A1 (en) * | 2015-07-29 | 2017-02-02 | Htc Corporation | Method, electronic apparatus, and computer readable medium of constructing classifier for disease detection |
CN107391900A (zh) * | 2017-05-05 | 2017-11-24 | 陈昕 | 房颤检测方法、分类模型训练方法及终端设备 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9775533B2 (en) * | 2013-03-08 | 2017-10-03 | Singapore Health Services Pte Ltd | System and method of determining a risk score for triage |
CN104970789B (zh) * | 2014-04-04 | 2017-12-19 | 中国科学院苏州纳米技术与纳米仿生研究所 | 心电图分类方法及系统 |
CN106570564B (zh) | 2016-11-03 | 2019-05-28 | 天津大学 | 基于深度网络的多尺度行人检测方法 |
-
2017
- 2017-12-19 CN CN201711380466.9A patent/CN108113666B/zh active Active
- 2017-12-29 WO PCT/CN2017/120106 patent/WO2019119518A1/zh active Application Filing
- 2017-12-29 JP JP2020532967A patent/JP7053836B2/ja active Active
-
2020
- 2020-06-15 US US16/901,033 patent/US11538588B2/en active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170032221A1 (en) * | 2015-07-29 | 2017-02-02 | Htc Corporation | Method, electronic apparatus, and computer readable medium of constructing classifier for disease detection |
CN105726018A (zh) * | 2016-02-06 | 2016-07-06 | 河北大学 | 一种与rr间期无关的房颤自动检测方法 |
CN107391900A (zh) * | 2017-05-05 | 2017-11-24 | 陈昕 | 房颤检测方法、分类模型训练方法及终端设备 |
Non-Patent Citations (1)
Title |
---|
BRUSER, C. ET AL.: "Automatic Detection of Atrial Fibrillation in Cardiac Vibration Signals", IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS, vol. 17, no. 1, 16 October 2012 (2012-10-16), pages 162 - 171, XP011494169, ISSN: 1089-1089 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113749668A (zh) * | 2021-08-23 | 2021-12-07 | 华中科技大学 | 一种基于深度神经网络的可穿戴心电图实时诊断系统 |
CN113749668B (zh) * | 2021-08-23 | 2022-08-09 | 华中科技大学 | 一种基于深度神经网络的可穿戴心电图实时诊断系统 |
Also Published As
Publication number | Publication date |
---|---|
CN108113666A (zh) | 2018-06-05 |
US11538588B2 (en) | 2022-12-27 |
CN108113666B (zh) | 2019-06-21 |
JP7053836B2 (ja) | 2022-04-12 |
US20200312459A1 (en) | 2020-10-01 |
JP2021506421A (ja) | 2021-02-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019119518A1 (zh) | 房颤信号的识别方法、装置和设备 | |
KR102451795B1 (ko) | 심전도 신호의 검출 방법 | |
US10869610B2 (en) | System and method for identifying cardiac arrhythmias with deep neural networks | |
WO2021017313A1 (zh) | 房颤的检测方法、装置、计算机设备及存储介质 | |
CN111163690B (zh) | 心律失常的检测方法、装置、电子设备及计算机存储介质 | |
CN109171712B (zh) | 心房颤动识别方法、装置、设备及计算机可读存储介质 | |
CN104970789B (zh) | 心电图分类方法及系统 | |
WO2019100562A1 (zh) | 基于人工智能的心电图心搏自动识别分类方法 | |
CN104706349B (zh) | 一种基于脉搏波信号的心电信号构建方法 | |
CN106377247B (zh) | 基于特征选择的心律失常分类方法 | |
CN109009084B (zh) | 多导联心电信号的qrs波群校验方法、装置及设备、介质 | |
CN113080990B (zh) | 一种基于CycleGAN和BiLSTM神经网络方法的心博异常检测方法 | |
JP6583892B2 (ja) | Ecg信号の並行解析装置、方法及び移動端末 | |
JP7119012B2 (ja) | 不整脈に関係する心拍を分類するためのシステム | |
CN106580307A (zh) | 心电图的质量判断方法及质量判断系统 | |
CN115177262B (zh) | 一种基于深度学习的心音心电联合诊断装置和系统 | |
CN106485213A (zh) | 一种利用心电信号进行自动身份识别的特征提取方法 | |
US10743789B2 (en) | ECG signal parallel analysis apparatus, method and mobile terminal | |
KR102437349B1 (ko) | 어텐션 메커니즘을 이용한 부정맥 탐지 장치 | |
WO2020155169A1 (zh) | 房颤筛查的方法和装置 | |
CN114519370A (zh) | 一种基于深度学习早停机制的左心室肥大检测方法及系统 | |
CN116528763A (zh) | 生物信号解析系统 | |
WO2021068107A1 (zh) | 基于心冲击信号的身份识别方法、电子设备及存储介质 | |
Shaik et al. | A novel approach for QRS delineation in ECG signal based on chirplet transform | |
CN114652324B (zh) | 一种单心拍分类方法、装置、设备及计算机可读存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17935463 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2020532967 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 19.11.2020) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 17935463 Country of ref document: EP Kind code of ref document: A1 |