US20140378855A1 - Apparatus and method for feature extraction and classification of fetal heart rate - Google Patents
Apparatus and method for feature extraction and classification of fetal heart rate Download PDFInfo
- Publication number
- US20140378855A1 US20140378855A1 US14/314,918 US201414314918A US2014378855A1 US 20140378855 A1 US20140378855 A1 US 20140378855A1 US 201414314918 A US201414314918 A US 201414314918A US 2014378855 A1 US2014378855 A1 US 2014378855A1
- Authority
- US
- United States
- Prior art keywords
- fhr
- feature
- signal
- feature value
- alphabet
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/02—Detecting, measuring or recording pulse, heart rate, blood pressure or blood flow; Combined pulse/heart-rate/blood pressure determination; Evaluating a cardiovascular condition not otherwise provided for, e.g. using combinations of techniques provided for in this group with electrocardiography or electroauscultation; Heart catheters for measuring blood pressure
- A61B5/024—Detecting, measuring or recording pulse rate or heart rate
- A61B5/02411—Detecting, measuring or recording pulse rate or heart rate of foetuses
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/03—Detecting, measuring or recording fluid pressure within the body other than blood pressure, e.g. cerebral pressure; Measuring pressure in body tissues or organs
- A61B5/033—Uterine pressure
Definitions
- the present invention generally relates to non-invasive methods and an apparatus for detection and monitoring of fetal health and, more particularly, to methods for monitoring fetal heart rate during intrapartum.
- the fetus During contractions, the fetus relies on appropriate residual perfusion of both maternal and fetal blood across the intervillous space, i.e., placental reserve, for oxygen supply. Uteroplacental oxygen insufficiency can occur due to an infarction in the placenta that will result in poor oxygen transfer during relaxation of the uterus, resulting in low oxygen levels, i.e., fetal hypoxemia. Alternatively, very deep contractions or an excess number of contractions per unit time will cause the placenta to not have sufficient time to absorb oxygen from maternal blood between contractions.
- Another cause of uteroplacental oxygen insufficiency is decreased maternal perfusion of the placenta that may occur if the mother is hypotensive, hypoxic, or has other complications. Even for contractions of normal length and size, the fetus may undergo distress because the fetus cannot absorb enough oxygen even after the contraction. A further cause of uteroplacental oxygen insufficiency occurs with umbilical cord constriction, which decreases oxygen delivery to the fetus.
- Oxygenation levels in the fetal heart have a direct effect on the functioning of the fetal brain and nervous system. Since cardiac contractions in the fetal heart are regulated by the autonomic nervous system, as in adults, cardiac contractions have a direct effect on cardiovascular functioning. Accordingly, intrapartum, i.e., close to delivery, fetal heart rate (FHR) monitoring is critical since a change in oxygen level directly affects the autonomic nervous system, and therefore affects the FHR.
- FHR fetal heart rate
- ECG electrocardiogram
- the FHR is derived from the ECG signal, which has distinct morphological features in each heart beat called fiducial points, denoted the P wave, QRS complex, and the T and U waves.
- the R peak in the QRS complex is the most distinct and easiest to detect.
- the time interval between successive R peaks is called the RR interval, with the inverse called instantaneous heart rate.
- ultrasound waves are used to detect the rhythmic movement of fetal heart valves and pulsatile blood flow via Doppler frequency shifts.
- a transducer that emits ultrasound waves and a sensor that detects reflected waves are placed on the maternal abdomen with a coupling gel to receive reflected waves from different moving sources, which creates a spectrum of many different frequency shifts corresponding to many different velocities, with the velocity spectrum repeated with each heart beat.
- An autocorrelation method is used to detect periodicity in the spectrum.
- significant post-processing is done on the signal after acquisition to eliminate noise.
- the autocorrelation process requires at least several heartbeats to obtain data for accurate rhythmic detection, and an implicit smoothing can obscure certain high-frequency variations.
- a plastic, fluid filled catheter is inserted into the uterus along one side of the fetal head.
- the catheter is connected to a strain-gauge pressure sensor calibrated to the same level as the catheter tip in the uterus. Pressure variation within the fluid system, caused by contraction activity in the uterus, creates a potential difference that is amplified and measured as a percentage signal.
- a displacement transducer typically formed as a button or plunger, is held against the abdominal wall. Each contraction moves of the plunger in proportion to the contraction strength, thereby creating a measurable electrical signal relative to contraction intensity, typically used to measure contraction onset, contraction peak and contraction return.
- the present invention overcomes the above-describes short-comings of conventional systems by providing a method for receiving an FHR signal at each interval during a monitoring period, receiving a uterine pressure (UP) signal at each of the intervals to obtain a plurality of FHR-UP signal pairs, and extracting a feature value for each FHR-UP signal pair, with the feature value extracted from a finite sized alphabet of feature values.
- UP uterine pressure
- the present invention also provides an apparatus that monitors fetal health utilizing a controller that receives, from a heart rate monitor, an FHR signal at each interval of a plurality of intervals during a monitoring period, receives a UP signal at each interval of the plurality of intervals, obtains a plurality of FHR-UP signal pairs, and extracts a feature value for each FHR-UP signal pair, with the feature value being extracted from a finite sized alphabet of feature values.
- FIG. 1 is a block diagram illustrating components of an apparatus for feature extraction and classification of FHR according to an embodiment of the present invention.
- FIG. 2 is a feature sequence chart showing symbol numbers along the top thereof, and FHR and UP signals as the upper and bottom graphs, respectively, according to an embodiment of the present invention.
- FIG. 1 shows an apparatus for feature extraction and classification of fetal heart rate including a scale with a range between 0 and 100, then estimating a baseline via mode estimation.
- the UP signal is generally a clean signal, smoothed by an averaging filter having a fixed sample length, e.g., a length of seventeen samples.
- a Gaussian kernel method is preferably used to estimate the probability mass function (pmf) using bins centered at ⁇ 0.5, 1.5, . . . , 99.5 ⁇ , with kernel widths calculated using Equation 1:
- Kernel width S 0.9 min ⁇ , 1.4826 M u ⁇ , (1)
- the u value at which the pmf is maximized is considered baseline b u .
- Onset and return detections are recursively performed until a valid contraction, if any, is detected. Once a valid contraction is detected, peak time of the contraction is n p u .
- the contraction frequency F u defined as the number of detected contractions in a twenty minute period, is calculated as a feature of interest.
- Preprocessing can be performed on input FHR before feature extraction to remove various artifacts, e.g., movement artifacts. Preprocessing is typically performed on an FHR time series acquired via Doppler-autocorrelation or internal scalp-electrode method, to remove spiky artifacts. Upon detection of FHR segments with successive HR differences greater than twenty-five beats per minute (bpm), linear interpolation is performed between the first detection and the first subsequent stable segment, i.e., a group of five samples with beat-to-beat difference not exceeding ten bpm. See, D. Ayres-de Campos, et al., SisPorto 2.0: A Program for Automated Analysis of Cardiotocograms, The Journal of Maternal-Fetal Medicine, 9(5):311-318, 2000).
- Feature extractor 110 stores time information of interpolated segments to isolate tracing areas with large amounts of noise.
- sub-segments of an epoch are searched, with the epoch having a defined duration, e.g., twenty minutes. If a total duration of interpolated periods during any sub-segment exceeds thirty percent of the sub-segment duration, the sub-segment is rejected from the search.
- Baseline is clinically defined as average heart rate over FHR periods free from episodic deviations such as accelerations, decelerations and marked variability-periods.
- episodic deviations are defined with reference to a pre-calculated baseline FHR, which leads to a problem in conventional baseline definition. Accordingly, feature extractor 110 utilizes a programmatic baseline estimation description.
- Feature extractor 110 estimates baseline FHR using a windowed median filtering method with a five minute window length found appropriate for accurate baseline estimation, providing a sufficiently short window to include important slow changes in FHR trends of periods free of episodes, while rejecting shorter episode-related deviations.
- the baseline signal is denoted b h [n] over a same time interval.
- Decelerations are abrupt or gradual decreases from the baseline.
- the extracted features are input into feature symbolizer 120 for segmentation and feature discretization by addition of time information.
- Feature symbolizer 120 segments a dataset of an FHR-UP time series being considered, to extract sequences of feature values indicative of the morphological changes, and performs subsequent discretization of the features into a finite-sized feature value alphabet.
- the discretization enables efficient modeling of feature sequences using multinomial distributions, which simplifies parameter update and inference.
- Feature symbolizer 120 performs a variability calculation upon determination that a considered segment is suitable for the variability calculation. If the considered segment is not suitable for the variability calculation, feature symbolizer 120 identifies an acceleration or deceleration, and calculates a different symbol depending on whether acceleration or deceleration is identified.
- a contiguous input time-series pair i.e., a FHR-UP signal pair denoted ⁇ y, u ⁇
- Tf s samples with length of Tf s samples
- f s as the sampling frequency
- feature sequences are made amenable to analysis using generative models (GMs) by first partitioning both y and u into synchronized segments of length tf s samples, with no overlap.
- GMs generative models
- a discretization module assigns a feature value x j using an H x -sized feature value alphabet, based on the following steps.
- the normalized FHR variability of the jth segment is allowed to be denoted by v j , where v j ⁇ [0,1]. If this segment is not classified as an acceleration or deceleration, then discretization is performed to a label ⁇ j according to Equation 3:
- ⁇ j ⁇ 1 , v j ⁇ [ 0 , b ) , 2 , v j ⁇ [ b , 2 ⁇ b ) , ... H v , v j ⁇ [ 1 - b , 1 ] , ( 3 )
- H A 3.
- segment j has at least 50% of samples classified as part of a deceleration
- H D 5.
- FIG. 2 is a feature sequence chart showing symbol numbers, FHR, and UP in the top, center and bottom rows, respectively.
- FIG. 2 provides an example of a feature sequence that, unlike conventional FHR feature extraction methods, e.g., rule-based systems which also consider the baseline FHR as a feature, the restriction of one label per segment forces a choice between the baseline FHR value and variability for all segments not classified as acceleration/deceleration episodes.
- Feature sequences calculator 140 performs a feature sequence likelihood calculation based on the feature discretization models, with the feature sequences using GMs.
- Feature sequence likelihood calculator 140 utilizes parameter learning parameters input from parameter learning module 130 , which includes a memory for storing training feature sequences, which are divided into category-specific groups.
- Parameter learning module 130 uses a training database to learn probabilistic models for each possible fetal category, e.g., healthy and unhealthy. For each newly obtained FHR-UP record, a calculation is performed of a likelihood that the record came from a learnt model, and likelihoods are compared to decide which model is most probable, to provide an output of a corresponding fetal category as a final classifier decision.
- a count is obtained for all occurring symbols, and a count is obtained for all symbol transitions.
- estimation is performed for a memory-less feature alphabet model and a pmf is output for each category.
- an estimate is performed of first order Markov chain parameters for a feature-alphabet model, and a feature-symbol transition matrix is output for each category.
- a pmf for initial segment symbols output for each category.
- a decision output based on the feature sequence likelihood calculation performed by the feature sequence calculator 140 , indicates variation in fetal health and is output on display 150 .
- a plurality of FHR-UP signal pairs are obtained from FHR and UP signals received at each interval of a plurality of intervals during a monitoring period.
- a feature value is extracted from a finite sized alphabet of feature values for each FHR-UP signal pair, with the size of the alphabet of feature values determined by varying bin width and segmentation period.
- the extracted feature value is based on a variation of a previous FHR-UP signal pair, and the extracted feature value describes a time dynamic of the FHR-UP signal pair, with the time dynamic including a change in UP contractions, FHR accelerations, FHR decelerations and FHR baseline-variability.
- the variation includes UP contraction, FHR acceleration, FHR deceleration and FHR baseline-variability.
- the plurality of FHR-UP signal pairs are replaced with a feature value sequence for each FHR-UP signal pair, with the sequences of feature values indicating morphological changes.
- the feature value sequence is compared with a plurality of possibly previously obtained feature value sequences, the feature value sequence is classified using a generative model and, based on the comparison, an indication is output of health of a fetus from which the FHR signals are obtained, with the fetus being within a uterus associated with the obtained UP signal, and parameter learning is performed to update a database of probabilistic models of possible fetal health.
- An apparatus that monitors fetal health, the apparatus including a controller that receives a FHR signal from a heart rate monitor at each interval of a plurality of intervals during a monitoring period, receives the UP signal at each interval of the plurality of intervals, obtains a plurality of FHR-UP signal pairs, and extracts feature values for each FHR-UP signal pair, with the feature values being extracted from a finite sized alphabet of feature values.
- the controller also outputs an indication of fetus health based on a comparison of the feature value sequence and a plurality of possibly previously obtained feature value sequences, and performs parameter learning to update a database of probabilistic models of possible fetal health.
- the apparatus and method are provided to indicate variations in fetal health, with a system that includes a processor configured to execute the above described method.
- the methods of the preferred aspects are implemented in systems that use software run on a computer processor to carry out the above described methods. While in preferred embodiments, the methods are carried out in an automated format, entirely within the computer processor, it should be understood that one or more components may be carried out by a human and that the methods may involve human interaction or intervention at one or more points.
- the computer processor for conducting aspects of the methods of the present invention may be housed in devices that include desktop computers, scientific instruments, hand-held devices, personal digital assistants, phones, a non-transitory computer readable medium, and the like.
- the methods need not be carried out on a single processor. For example, one or more steps may be conducted on a first processor, while other steps are conducted on a second processor.
- the processors may be located in the same physical space or may be located distantly. In certain embodiments, multiple processors are linked over an electronic communications network, such as the Internet.
- Preferred embodiments include processors associated with a display device for showing the results of the methods to a user or users, outputting results as a video image that includes feeder outlines or motifs.
- the processors may be directly or indirectly associated with information databases.
- processor central processing unit
- CPU central processing unit
- CPU central processing unit
- CPU central processing unit
- CPU central processing unit
- CPU central processing unit
- CPU central processing unit
- encode refers to the process of converting one type of information or signal into a different type of information or signal to, for example, facilitate the transmission and/or interpretability of the information or signal.
- image files can be converted into, i.e., encoded into, electrical or digital information.
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Cardiology (AREA)
- Physics & Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Gynecology & Obstetrics (AREA)
- Pregnancy & Childbirth (AREA)
- Hematology (AREA)
- Physiology (AREA)
- Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
- Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)
Abstract
Provided are an apparatus and method for receiving a fetal heart rate (FHR) signal at each interval during a monitoring period, receiving a uterine pressure (UP) signal at each of the intervals to obtain a plurality of FHR-UP signal pairs, and extracting a feature value for each FHR-UP signal pair, with the feature value being extracted from a predefined alphabet of feature values.
Description
- This application claims priority to Provisional Patent Applications Nos. 61/839,077 and 61/987,628, filed with the U.S. Patent and Trademark Office on Jun. 25, 2013 and May 2, 2014, respectively, the contents of each of which are incorporated herein by reference.
- 1. Field of the Invention
- The present invention generally relates to non-invasive methods and an apparatus for detection and monitoring of fetal health and, more particularly, to methods for monitoring fetal heart rate during intrapartum.
- 2. Description of the Related Art
- Uterine contractions cause reduction in uterine and placental blood flow. Consequently, oxygen exchange through the placenta is temporarily decreased, followed by normalization of the perfusion after relaxation of the uterus. Oxygenation of the fetus is directly dependent on four factors: maternal blood pressure, maternal oxygenation, available placental surface area for perfusion, and whether the umbilical cord is sufficiently open and unobstructed. Compromise of any factor will compromise oxygen transfer and cause uteroplacental oxygen insufficiency.
- During contractions, the fetus relies on appropriate residual perfusion of both maternal and fetal blood across the intervillous space, i.e., placental reserve, for oxygen supply. Uteroplacental oxygen insufficiency can occur due to an infarction in the placenta that will result in poor oxygen transfer during relaxation of the uterus, resulting in low oxygen levels, i.e., fetal hypoxemia. Alternatively, very deep contractions or an excess number of contractions per unit time will cause the placenta to not have sufficient time to absorb oxygen from maternal blood between contractions. Another cause of uteroplacental oxygen insufficiency is decreased maternal perfusion of the placenta that may occur if the mother is hypotensive, hypoxic, or has other complications. Even for contractions of normal length and size, the fetus may undergo distress because the fetus cannot absorb enough oxygen even after the contraction. A further cause of uteroplacental oxygen insufficiency occurs with umbilical cord constriction, which decreases oxygen delivery to the fetus.
- Oxygenation levels in the fetal heart have a direct effect on the functioning of the fetal brain and nervous system. Since cardiac contractions in the fetal heart are regulated by the autonomic nervous system, as in adults, cardiac contractions have a direct effect on cardiovascular functioning. Accordingly, intrapartum, i.e., close to delivery, fetal heart rate (FHR) monitoring is critical since a change in oxygen level directly affects the autonomic nervous system, and therefore affects the FHR.
- Conventional fetal monitors typically measure the FHR signal and maternal uterine activity, either externally or internally. Internal monitoring of the fetal heart is achieved via direct acquisition of electrocardiogram (ECG) data. In internal monitoring, the FHR is derived from the ECG signal, which has distinct morphological features in each heart beat called fiducial points, denoted the P wave, QRS complex, and the T and U waves. The R peak in the QRS complex is the most distinct and easiest to detect. The time interval between successive R peaks is called the RR interval, with the inverse called instantaneous heart rate.
- In external fetal monitoring, ultrasound waves are used to detect the rhythmic movement of fetal heart valves and pulsatile blood flow via Doppler frequency shifts. A transducer that emits ultrasound waves and a sensor that detects reflected waves are placed on the maternal abdomen with a coupling gel to receive reflected waves from different moving sources, which creates a spectrum of many different frequency shifts corresponding to many different velocities, with the velocity spectrum repeated with each heart beat. An autocorrelation method is used to detect periodicity in the spectrum. In conventional Doppler fetal monitoring units, significant post-processing is done on the signal after acquisition to eliminate noise. The autocorrelation process requires at least several heartbeats to obtain data for accurate rhythmic detection, and an implicit smoothing can obscure certain high-frequency variations.
- Despite the problems associated with Doppler monitoring, it is the preferred choice of obstetric care providers for FHR monitoring, with scalp-electrodes used only when warranted by necessity, such as when a cleaner signal is required for more detailed study.
- To internally monitor uterine activity, a plastic, fluid filled catheter is inserted into the uterus along one side of the fetal head. The catheter is connected to a strain-gauge pressure sensor calibrated to the same level as the catheter tip in the uterus. Pressure variation within the fluid system, caused by contraction activity in the uterus, creates a potential difference that is amplified and measured as a percentage signal. To externally monitor uterine activity, a displacement transducer, typically formed as a button or plunger, is held against the abdominal wall. Each contraction moves of the plunger in proportion to the contraction strength, thereby creating a measurable electrical signal relative to contraction intensity, typically used to measure contraction onset, contraction peak and contraction return.
- Conventional methods for analysis of FHR and uterine pressure patterns generally rely on parametric approaches and use summary features obtained from long stretches of data, which fail to account for local nonlinearities and nonstationarity, and are not effective in many applications, in particular for monitoring FHR during intrapartum.
- The present invention overcomes the above-describes short-comings of conventional systems by providing a method for receiving an FHR signal at each interval during a monitoring period, receiving a uterine pressure (UP) signal at each of the intervals to obtain a plurality of FHR-UP signal pairs, and extracting a feature value for each FHR-UP signal pair, with the feature value extracted from a finite sized alphabet of feature values.
- The present invention also provides an apparatus that monitors fetal health utilizing a controller that receives, from a heart rate monitor, an FHR signal at each interval of a plurality of intervals during a monitoring period, receives a UP signal at each interval of the plurality of intervals, obtains a plurality of FHR-UP signal pairs, and extracts a feature value for each FHR-UP signal pair, with the feature value being extracted from a finite sized alphabet of feature values.
- The above and other aspects, features and advantages of certain embodiments of the present invention will be more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:
-
FIG. 1 is a block diagram illustrating components of an apparatus for feature extraction and classification of FHR according to an embodiment of the present invention; and -
FIG. 2 is a feature sequence chart showing symbol numbers along the top thereof, and FHR and UP signals as the upper and bottom graphs, respectively, according to an embodiment of the present invention. - The following detailed description of certain embodiments of the present invention will be made with reference to the accompanying drawings. In describing the invention, explanation of related functions or constructions known in the art are omitted for the sake of clearness in understanding the concept of the invention, to avoid obscuring the invention with unnecessary detail.
-
FIG. 1 shows an apparatus for feature extraction and classification of fetal heart rate including a scale with a range between 0 and 100, then estimating a baseline via mode estimation. The UP signal is generally a clean signal, smoothed by an averaging filter having a fixed sample length, e.g., a length of seventeen samples. For extraction byfeature extractor 120, a Gaussian kernel method is preferably used to estimate the probability mass function (pmf) using bins centered at {0.5, 1.5, . . . , 99.5}, with kernel widths calculated using Equation 1: -
Kernel width S=0.9 min {σ, 1.4826 Mu}, (1) -
-
- u={u[1], . . . u[N fs]},
- σ2=Variance of u,
- Mu=Mean absolute deviation of u.
, where u[n] is a UP signal at time instant n, N=20 minutes, with σ being the standard deviation of the UP time series under consideration, with the square of σ being the variance statistic that is used as a heuristic guide to decide the Gaussian kernel width for mode estimation.
- The u value at which the pmf is maximized is considered baseline bu. Onset of uterine contraction is detected whenever u[n] exceeds bu by a minimum of θs u=3%, with that time instant denoted by ns u. For each such onset candidate, a return time nr u is detected. If duration of contraction Lu=(nr u−ns 7) exceeds threshold θL u=185 fsr, the mode for the candidate period is recalculated utilizing the above procedure. Onset and return detections are recursively performed until a valid contraction, if any, is detected. Once a valid contraction is detected, peak time of the contraction is np u. For diagnosis, the contraction frequency Fu, defined as the number of detected contractions in a twenty minute period, is calculated as a feature of interest.
- Preprocessing can be performed on input FHR before feature extraction to remove various artifacts, e.g., movement artifacts. Preprocessing is typically performed on an FHR time series acquired via Doppler-autocorrelation or internal scalp-electrode method, to remove spiky artifacts. Upon detection of FHR segments with successive HR differences greater than twenty-five beats per minute (bpm), linear interpolation is performed between the first detection and the first subsequent stable segment, i.e., a group of five samples with beat-to-beat difference not exceeding ten bpm. See, D. Ayres-de Campos, et al., SisPorto 2.0: A Program for Automated Analysis of Cardiotocograms, The Journal of Maternal-Fetal Medicine, 9(5):311-318, 2000).
-
Feature extractor 110 stores time information of interpolated segments to isolate tracing areas with large amounts of noise. To detect a deceleration/acceleration/variability FHR feature, sub-segments of an epoch are searched, with the epoch having a defined duration, e.g., twenty minutes. If a total duration of interpolated periods during any sub-segment exceeds thirty percent of the sub-segment duration, the sub-segment is rejected from the search. - Baseline is clinically defined as average heart rate over FHR periods free from episodic deviations such as accelerations, decelerations and marked variability-periods. However, episodic deviations are defined with reference to a pre-calculated baseline FHR, which leads to a problem in conventional baseline definition. Accordingly,
feature extractor 110 utilizes a programmatic baseline estimation description. -
Feature extractor 110 estimates baseline FHR using a windowed median filtering method with a five minute window length found appropriate for accurate baseline estimation, providing a sufficiently short window to include important slow changes in FHR trends of periods free of episodes, while rejecting shorter episode-related deviations. The baseline signal is denoted bh[n] over a same time interval. - Accelerations are visually apparent abrupt increases from the baseline. Once
feature extractor 110 estimates baseline FHR, the onset times of accelerations are detected as the first sample indices ns A when the FHR h[n] upwardly deviates from bh[n] by at least θs A=1 bpm. For each onset candidate, return time nr A and duration LA=nr A−ns A are estimated. If LZ>θL A(=15 fs), location np A of the peak deviation from baseline, which is denotedh P A, is estimated. Since the FHR is typically not a smooth signal, detecting an obvious peak is difficult. Hence, only a first significant peak, which is the first local maximum within a top twentieth percentile of the series of FHR deviations during acceleration. If there is no such local maximum, a global maximum is calculated during the acceleration duration. The candidate acceleration is determined to be valid upon satisfying the conditions of Equation 2: -
n p A −n s A<θp A=30 fs, -
h p A>θh A=15 bpm, -
LA∈[15 fs, 600 fs] (2) - Decelerations are abrupt or gradual decreases from the baseline. Once
feature extractor 110 estimates the baseline FHR, onset times of decelerations are detected as the first sample indices ns D when the FHR h[n] downwardly deviates from bh[n] by at least θs D=1 bpm. For each onset candidate, a return time nr D is estimated with durations LD=nr Dns D. If LD>θL D(=15 fs), it is considered a likely deceleration candidate, and nadir np D and the corresponding deviation from the baselineh p D at the nadir location are then found. In order to detect only the first significant nadir, a procedure similar to the above procedure for detection of accelerations is used. Deceleration detection is prone to false positives due to a higher degree of noise due to electrode movement/drop-off. In such instances, the signal suddenly dips below threshold, requiring time to return to baseline, artificially increasing episode abruptness. Episode abruptness is overcome by utilizing threshold θp D=3 fs to differentiate true decelerations from false episodes, with candidate deceleration having to take at least three seconds from onset to nadir to qualify as a valid deceleration. - FHR signal variability is an important feature for detection of fetal distress. Despite the literature regarding adult heart rate variability and standards of measurement, agreement does not exist for FHR studies, which beat-to-beat variability and long-term variability conventionally being visually determined as a unit. To overcome this shortcoming of conventional methods,
feature extractor 110 utilizes a zero-crossing method that initially finds sub-segments in an FHR series h={h[1], . . . , h {Nfs}} which are free of accelerations, decelerations and noise. Each such sub-segment is de-baselined using a corresponding bh value and divided into non-overlapping one-minute segments. A resulting signalh v[n] is utilized to estimate a number of times that the signal went above, resp. below, thresholds θδ(resp. −θδ), with the result denoted kv, taken as an estimate of a number of FHR cycles around the baseline. If the per minute cycle frequency (=kv) exceeds a clinical threshold, e.g., two cycles/min, for a valid variability signal, the feature of interest is estimated as follows. For each detected cycle, a crest-to-trough range is estimated with a median of these values being variability {tilde over (V)}h for a one-minute sub-segment. To calculate a variability value for the full twenty minute signal, the median value of all the {tilde over (V)}h, over that period is calculated, denoted Vh. - The extracted features, including FHR deceleration, FHR baseline and baseline variability, are input into
feature symbolizer 120 for segmentation and feature discretization by addition of time information.Feature symbolizer 120 segments a dataset of an FHR-UP time series being considered, to extract sequences of feature values indicative of the morphological changes, and performs subsequent discretization of the features into a finite-sized feature value alphabet. The discretization enables efficient modeling of feature sequences using multinomial distributions, which simplifies parameter update and inference.Feature symbolizer 120 performs a variability calculation upon determination that a considered segment is suitable for the variability calculation. If the considered segment is not suitable for the variability calculation, featuresymbolizer 120 identifies an acceleration or deceleration, and calculates a different symbol depending on whether acceleration or deceleration is identified. - For a contiguous input time-series pair, i.e., a FHR-UP signal pair denoted {y, u}, with length of Tfs samples, with fs as the sampling frequency, feature sequences are made amenable to analysis using generative models (GMs) by first partitioning both y and u into synchronized segments of length tfs samples, with no overlap. For each segment, indexed by j, a discretization module assigns a feature value xj using an Hx-sized feature value alphabet, based on the following steps.
- As a first step, the normalized FHR variability of the jth segment is allowed to be denoted by vj, where vj∈[0,1]. If this segment is not classified as an acceleration or deceleration, then discretization is performed to a label ξj according to Equation 3:
-
- , with b=1/Hv as a bin width controlling discretization granularity.
- Following the above step, if segment j has at least 50% of samples classified as part of an acceleration, the label ξj takes a value depending on acceleration type, with values quantified as ξj=Hv+1 (normal), ξj=Hv+2 (prolonged) or ξj=Hv+3 (baseline change). Thus, HA=3.
- If segment j has at least 50% of samples classified as part of a deceleration, the label ξj is a value depending on deceleration type, with: ξj=Hv+HA+1 (early), ξj=Hv+HA+2 (late), ξj=Hv+HA+3 (variable) or ξj=Hv+HA+5 (baseline change). Thus, HD=5.
- A final feature value xj is assigned. If segment j of the UP signal u has at least 50% of samples classified as part of a contraction, then the feature xj=ξj+Hv+HA+HD ; otherwise, xj=ξj. Therefore, Hx=2(Hv+HA+HD).
- Two important parameters are thereby provided for control of the size of feature-symbol-sequence size and feature resolution, i.e., segmentation period t and bin width b. Available information from both FHR and UP signals is combined into a single discrete feature value.
-
FIG. 2 is a feature sequence chart showing symbol numbers, FHR, and UP in the top, center and bottom rows, respectively.FIG. 2 provides an example of a feature sequence that, unlike conventional FHR feature extraction methods, e.g., rule-based systems which also consider the baseline FHR as a feature, the restriction of one label per segment forces a choice between the baseline FHR value and variability for all segments not classified as acceleration/deceleration episodes. InFIG. 2 , a feature sequence is displayed as a row of symbol numbers at the top thereof, extracted from an FHR, with feature value alphabet Hx size of thirty-four and segment length of t=60 seconds, FHR in bpm, and UP scaled to percentage values. - In a preferred embodiment, FHR variability is utilized instead of baseline to more accurately determine fetal health, with the feature sequence from an ith FHR record denoted as xi={xi1, . . . , xidi}, with the second subscript identifying the segment, and di as a total number of segments in the ith record.
Feature sequences calculator 140 performs a feature sequence likelihood calculation based on the feature discretization models, with the feature sequences using GMs. - Feature
sequence likelihood calculator 140 utilizes parameter learning parameters input fromparameter learning module 130, which includes a memory for storing training feature sequences, which are divided into category-specific groups.Parameter learning module 130 uses a training database to learn probabilistic models for each possible fetal category, e.g., healthy and unhealthy. For each newly obtained FHR-UP record, a calculation is performed of a likelihood that the record came from a learnt model, and likelihoods are compared to decide which model is most probable, to provide an output of a corresponding fetal category as a final classifier decision. - For each divided category-specific group in the training database, a count is obtained for all occurring symbols, and a count is obtained for all symbol transitions. Using the obtained count of all occurring symbols, estimation is performed for a memory-less feature alphabet model and a pmf is output for each category. Using the obtained count of all symbol transitions, an estimate is performed of first order Markov chain parameters for a feature-alphabet model, and a feature-symbol transition matrix is output for each category. Using the obtained count of all symbols in the first segments of the training records, a pmf for initial segment symbols output for each category. A decision output, based on the feature sequence likelihood calculation performed by the
feature sequence calculator 140, indicates variation in fetal health and is output ondisplay 150. - During monitoring, a plurality of FHR-UP signal pairs are obtained from FHR and UP signals received at each interval of a plurality of intervals during a monitoring period. A feature value is extracted from a finite sized alphabet of feature values for each FHR-UP signal pair, with the size of the alphabet of feature values determined by varying bin width and segmentation period. The extracted feature value is based on a variation of a previous FHR-UP signal pair, and the extracted feature value describes a time dynamic of the FHR-UP signal pair, with the time dynamic including a change in UP contractions, FHR accelerations, FHR decelerations and FHR baseline-variability. In addition, the variation includes UP contraction, FHR acceleration, FHR deceleration and FHR baseline-variability.
- The plurality of FHR-UP signal pairs are replaced with a feature value sequence for each FHR-UP signal pair, with the sequences of feature values indicating morphological changes. The feature value sequence is compared with a plurality of possibly previously obtained feature value sequences, the feature value sequence is classified using a generative model and, based on the comparison, an indication is output of health of a fetus from which the FHR signals are obtained, with the fetus being within a uterus associated with the obtained UP signal, and parameter learning is performed to update a database of probabilistic models of possible fetal health.
- An apparatus is provided that monitors fetal health, the apparatus including a controller that receives a FHR signal from a heart rate monitor at each interval of a plurality of intervals during a monitoring period, receives the UP signal at each interval of the plurality of intervals, obtains a plurality of FHR-UP signal pairs, and extracts feature values for each FHR-UP signal pair, with the feature values being extracted from a finite sized alphabet of feature values. The controller also outputs an indication of fetus health based on a comparison of the feature value sequence and a plurality of possibly previously obtained feature value sequences, and performs parameter learning to update a database of probabilistic models of possible fetal health.
- In the preferred aspects, the apparatus and method are provided to indicate variations in fetal health, with a system that includes a processor configured to execute the above described method. The methods of the preferred aspects are implemented in systems that use software run on a computer processor to carry out the above described methods. While in preferred embodiments, the methods are carried out in an automated format, entirely within the computer processor, it should be understood that one or more components may be carried out by a human and that the methods may involve human interaction or intervention at one or more points.
- The computer processor for conducting aspects of the methods of the present invention may be housed in devices that include desktop computers, scientific instruments, hand-held devices, personal digital assistants, phones, a non-transitory computer readable medium, and the like. The methods need not be carried out on a single processor. For example, one or more steps may be conducted on a first processor, while other steps are conducted on a second processor. The processors may be located in the same physical space or may be located distantly. In certain embodiments, multiple processors are linked over an electronic communications network, such as the Internet. Preferred embodiments include processors associated with a display device for showing the results of the methods to a user or users, outputting results as a video image that includes feeder outlines or motifs. The processors may be directly or indirectly associated with information databases. As used herein, the terms processor, central processing unit, and CPU are used interchangeably and refer to a device that is able to read a program from a computer memory, e.g., ROM or other computer memory, and perform a set of steps according to the program. The terms computer memory and computer memory device refer to any storage media readable by a computer processor. Examples of computer memory include, but are not limited to, RAM, ROM, computer chips, digital video discs, compact discs, hard disk drives and magnetic tape. Also, computer readable medium refers to any device or system for storing and providing information, e.g., data and instructions, to a computer processor, DVDs, CDs, hard disk drives, magnetic tape and servers for streaming media over networks. As used herein, encode refers to the process of converting one type of information or signal into a different type of information or signal to, for example, facilitate the transmission and/or interpretability of the information or signal. For example, image files can be converted into, i.e., encoded into, electrical or digital information.
- While the invention has been shown and described with reference to certain aspects thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention as defined by the appended claims and equivalents thereof.
Claims (20)
1. A monitoring method comprising:
receiving, from a heart rate monitor, a fetal heart rate (FHR) signal at a plurality of intervals;
receiving a uterine pressure (UP) signal at each interval of the plurality of intervals, to obtain a plurality of FHR-UP signal pairs; and
extracting a feature value for each FHR-UP signal pair,
wherein the feature value is extracted from an alphabet of feature values.
2. The method of claim 1 , wherein the extracted feature value describes a time dynamic of the FHR-UP signal pair, with the time dynamic being one of a change in UP contractions, FHR accelerations, FHR decelerations and FHR baseline-variability.
3. The method of claim 1 , wherein the extracted feature value is based on a variation of a previous FHR-UP signal pair.
4. The method of claim 3 , wherein the variation is one of a UP contraction, FHR acceleration, FHR deceleration and FHR baseline-variability.
5. The method of claim 1 , wherein the alphabet of feature values is a finite size.
6. The method of claim 5 , wherein the size of the alphabet of feature values is determined by varying a bin width.
7. The method of claim 5 , wherein the size of the alphabet of feature values is determined by varying a segmentation period.
8. The method of claim 1 , further comprising replacing each FHR-UP signal pair with a feature value sequence.
9. The method of claim 8 , further comprising:
comparing the feature value sequence with a plurality of previously obtained feature value sequences;
classifying the feature value sequence; and
outputting, based on the comparison, an indication of fetus health.
10. The method of claim 9 , wherein changes between feature value sequences indicate morphological changes.
11. The method of claim 10 , wherein the classifying of the feature value sequence is performed using a generative model.
12. The method of claim 1 , further comprising performing parameter learning to update a database of probabilistic models of fetal health.
13. An apparatus for monitoring fetal health, the apparatus comprising:
a controller configured to receive a fetal heart rate (FHR) signal at a plurality of intervals, to receive a uterine pressure (UP) signal at each interval of the plurality of intervals, to obtain a plurality of FHR-UP signal pairs, and to extract feature values for each FHR-UP signal pair.
14. The apparatus of claim 13 , wherein the feature values are extracted from an alphabet of feature values.
15. The apparatus of claim 14 , wherein the alphabet of feature values is limited to a finite size, with the size of the alphabet of feature values being determined by varying a segmentation period and a bin width.
16. The apparatus of claim 13 , wherein the extracted feature value is based on a variation of a previous FHR-UP signal pair, with the extracted feature value describing time dynamics of the FHR-UP signal pair.
17. The apparatus of claim 16 , wherein the variation is one of a UP contraction, FHR acceleration, FHR deceleration, and FHR baseline-variability.
18. The apparatus of claim 11 , wherein the controller is further configured to replace each FHR-UP signal pair with a feature value sequence.
19. The apparatus of claim 11 , wherein a change between sequences of feature values indicates a morphological change.
20. The apparatus of claim 11 , wherein the controller is further configured to perform parameter learning to update a database of probabilistic models of fetal health.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/314,918 US20140378855A1 (en) | 2013-06-25 | 2014-06-25 | Apparatus and method for feature extraction and classification of fetal heart rate |
US15/824,215 US10368755B2 (en) | 2013-06-25 | 2017-11-28 | Apparatus and method for feature extraction and classification of fetal heart rate |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201361839077P | 2013-06-25 | 2013-06-25 | |
US201461987628P | 2014-05-02 | 2014-05-02 | |
US14/314,918 US20140378855A1 (en) | 2013-06-25 | 2014-06-25 | Apparatus and method for feature extraction and classification of fetal heart rate |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/824,215 Continuation US10368755B2 (en) | 2013-06-25 | 2017-11-28 | Apparatus and method for feature extraction and classification of fetal heart rate |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140378855A1 true US20140378855A1 (en) | 2014-12-25 |
Family
ID=52111477
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/314,918 Abandoned US20140378855A1 (en) | 2013-06-25 | 2014-06-25 | Apparatus and method for feature extraction and classification of fetal heart rate |
US15/824,215 Active US10368755B2 (en) | 2013-06-25 | 2017-11-28 | Apparatus and method for feature extraction and classification of fetal heart rate |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/824,215 Active US10368755B2 (en) | 2013-06-25 | 2017-11-28 | Apparatus and method for feature extraction and classification of fetal heart rate |
Country Status (1)
Country | Link |
---|---|
US (2) | US20140378855A1 (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105147307A (en) * | 2015-06-18 | 2015-12-16 | 广州三瑞医疗器械有限公司 | Uterine contraction state real-time determination method, and analgesia method based on same |
WO2016170435A3 (en) * | 2015-03-16 | 2016-12-15 | Nuvo Group Ltd. | Continuous non-invasive monitoring of a pregnant human subject |
US9572504B2 (en) * | 2015-03-16 | 2017-02-21 | Nuvo Group Ltd. | Continuous non-invasive monitoring of a pregnant human subject |
CN112971799A (en) * | 2021-02-04 | 2021-06-18 | 北京理工大学 | Non-stimulation fetal heart monitoring classification method based on machine learning |
EP3881754A1 (en) * | 2020-03-16 | 2021-09-22 | Koninklijke Philips N.V. | Processing unit and method for use in fetal monitoring |
CN113456064A (en) * | 2021-07-15 | 2021-10-01 | 广州三瑞医疗器械有限公司 | Intelligent interpretation method for prenatal fetal heart monitoring signal |
WO2023144627A3 (en) * | 2022-01-28 | 2023-09-21 | Nuvo Group Ltd. | Systems, devices, and methods utilizing bio-potential data obtained by a plurality of bio-potential sensors for prenatal tracking |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5609156A (en) * | 1992-06-09 | 1997-03-11 | University Of Plymouth | Foetal monitor |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5419322A (en) | 1993-07-22 | 1995-05-30 | Joseph; Barry M. | Internal apparatus for continuous electrical and oximetric intrapartum monitoring of the fetus |
JP2011516238A (en) | 2008-04-15 | 2011-05-26 | タフツ メディカル センター インコーポレイテッド | Fetal ECG monitoring |
US9180453B2 (en) | 2008-08-15 | 2015-11-10 | University Of Washington | Method and apparatus for the discretization and manipulation of sample volumes |
EP2440126A1 (en) | 2009-06-12 | 2012-04-18 | Newcardio, Inc. | Systems and methods for quantitative assessment of cardiac electrical events |
US20130158366A1 (en) | 2011-12-20 | 2013-06-20 | General Electric Company | Handheld device for fetal health monitoring and method thereof |
KR101554381B1 (en) | 2012-07-30 | 2015-09-18 | 가톨릭대학교 산학협력단 | Method and apparatus for performing fetal health |
-
2014
- 2014-06-25 US US14/314,918 patent/US20140378855A1/en not_active Abandoned
-
2017
- 2017-11-28 US US15/824,215 patent/US10368755B2/en active Active
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5609156A (en) * | 1992-06-09 | 1997-03-11 | University Of Plymouth | Foetal monitor |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016170435A3 (en) * | 2015-03-16 | 2016-12-15 | Nuvo Group Ltd. | Continuous non-invasive monitoring of a pregnant human subject |
US9572504B2 (en) * | 2015-03-16 | 2017-02-21 | Nuvo Group Ltd. | Continuous non-invasive monitoring of a pregnant human subject |
AU2016252353B2 (en) * | 2015-03-16 | 2017-10-19 | Nuvo Group Ltd. | Continuous non-invasive monitoring of a pregnant human subject |
CN107427241A (en) * | 2015-03-16 | 2017-12-01 | 努沃集团有限公司 | The continuous, non-invasive monitoring of the human experimenter of pregnancy |
CN105147307A (en) * | 2015-06-18 | 2015-12-16 | 广州三瑞医疗器械有限公司 | Uterine contraction state real-time determination method, and analgesia method based on same |
EP3881754A1 (en) * | 2020-03-16 | 2021-09-22 | Koninklijke Philips N.V. | Processing unit and method for use in fetal monitoring |
WO2021185787A1 (en) * | 2020-03-16 | 2021-09-23 | Koninklijke Philips N.V. | Processing unit and method for use in fetal monitoring |
CN112971799A (en) * | 2021-02-04 | 2021-06-18 | 北京理工大学 | Non-stimulation fetal heart monitoring classification method based on machine learning |
CN113456064A (en) * | 2021-07-15 | 2021-10-01 | 广州三瑞医疗器械有限公司 | Intelligent interpretation method for prenatal fetal heart monitoring signal |
WO2023144627A3 (en) * | 2022-01-28 | 2023-09-21 | Nuvo Group Ltd. | Systems, devices, and methods utilizing bio-potential data obtained by a plurality of bio-potential sensors for prenatal tracking |
US11972868B2 (en) * | 2022-01-28 | 2024-04-30 | Nuvo Group Ltd. | Systems, devices, and methods utilizing bio-potential data obtained by a plurality of bio-potential sensors for prenatal tracking |
US20240355473A1 (en) * | 2022-01-28 | 2024-10-24 | Nuvo Group Ltd. | Systems, devices, and methods utilizing bio-potential data obtained by a plurality of bio-potential sensors for prenatal tracking |
Also Published As
Publication number | Publication date |
---|---|
US10368755B2 (en) | 2019-08-06 |
US20180078160A1 (en) | 2018-03-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10368755B2 (en) | Apparatus and method for feature extraction and classification of fetal heart rate | |
US11337616B2 (en) | Fetal heart rate extraction from maternal abdominal ECG recordings | |
Signorini et al. | Monitoring fetal heart rate during pregnancy: contributions from advanced signal processing and wearable technology | |
EP3379997B1 (en) | Method to quantify photoplethysmogram (ppg) signal quality | |
Ferrario et al. | Complexity analysis of the fetal heart rate variability: early identification of severe intrauterine growth-restricted fetuses | |
Pimentel et al. | Heart beat detection in multimodal physiological data using a hidden semi-Markov model and signal quality indices | |
CN107622259B (en) | T wave detection method, electrocardiogram data analysis method and device | |
Mollakazemi et al. | Fetal QRS detection in noninvasive abdominal electrocardiograms using principal component analysis and discrete wavelet transforms with signal quality estimation | |
Namadurai et al. | Multifractal analysis of uterine electromyography signals for the assessment of progression of pregnancy in term conditions | |
Sulas et al. | A non-invasive multimodal foetal ECG–Doppler dataset for antenatal cardiology research | |
Gupta et al. | A derivative-based approach for QT-segment feature extraction in digitized ECG record | |
Bhoi et al. | QRS Complex Detection and Analysis of Cardiovascular Abnormalities: A Review. | |
Dong et al. | Automated detection of perinatal hypoxia using time–frequency-based heart rate variability features | |
Peters et al. | Beat-to-beat heart rate detection in multi-lead abdominal fetal ECG recordings | |
Magenes et al. | Cardiotocography for fetal monitoring: Technical and methodological aspects | |
Pimentel et al. | Hidden semi-Markov model-based heartbeat detection using multimodal data and signal quality indices | |
Katebi et al. | Unsupervised hidden semi-Markov model for automatic beat onset detection in 1D Doppler ultrasound | |
Jaeger et al. | Machine learning-based detection of in-utero fetal presentation from non-invasive fetal ECG | |
Mansourian et al. | Fetal QRS extraction from single-channel abdominal ECG using adaptive improved permutation entropy | |
Jahani et al. | Mathematical model presenting to assess variations in heart rate of different age groups. | |
Hopenfeld | Fetal QRS Detection by Multiple Channel Temporal Pattern Search Applied to the NInFEA Database | |
Kupka et al. | Reconstruction of True Fetal Heart Rate Signals Obtained via Ultrasound Bedside Monitor in Relation to Fetal Electrocardiography | |
Kasturiwale et al. | Machine learning approach for medical diagnosis based on prediction model | |
Bukhari et al. | Deep Learning Enhanced Dynamical Analysis to Detect Fetal Arrhythmia | |
Dash et al. | Implementation of NICHD diagnostic criteria for feature extraction and classification of fetal heart rate signals |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THE RESEARCH FOUNDATION FOR THE STATE UNIVERSITY O Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DASH, SHISHIR;QUIRK, J. GERALD;DJURIC, PETAR M.;SIGNING DATES FROM 20140707 TO 20140722;REEL/FRAME:033523/0891 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |