Solving Inverse Electrocardiographic Mapping Using Machine Learning and Deep Learning Frameworks
<p>The overall study process. Part I indicates the study that trained the data for one pig only. Part II used data from all five pigs and had an additional step (registration of the electrogram data) that transformed the original data into a uniform data format. In terms of the metrics, the models were evaluated in two ways: (1) the correlation coefficients of the reconstructed electrogram and the recorded one, (2) the correlation coefficients for the AT map derived from the reconstructed and recorded electrograms. CC, correlation coefficients; AT, map activation time across all epicardial nodes.</p> "> Figure 2
<p>Models used in cross-validation over data from the same pigs as in Part II. (<b>Left</b>): The fully connected model used in this study; (<b>right</b>): the LSTM model used in this study. The input size ranged from 1 × 150–165 depending on the ECG recording vest used for the different pigs.</p> "> Figure 3
<p>Registration of the torso nodes to the 2D plane. The torso node geometry data were first centered on the geometric origin, and then the nodes were projected to a cylinder surface. ???? is the degree from the <span class="html-italic">y</span>-axis to the node and <span class="html-italic">h</span> is the height from the <span class="html-italic">x</span>–<span class="html-italic">y</span> plane to the node.</p> "> Figure 4
<p>Results of torso node registration to the 2D plane. The 3D view shows the original 3D distribution of the torso nodes, where the ECGs were recorded. The 2D scatter plot shows the distribution of the nodes after projection to a cylinder. The double arrow indicates regions that belong to the anterior, posterior, top, or bottom areas of the torso.</p> "> Figure 5
<p>Bilinear interpolation was used to transform the data into 2D format. Left: Normalized torso node distribution. The node color indicates the potential value. Right: Grids with 30 × 90 pixels were merged with the scattered nodes. Nodes in the grid were used as sampling points. The potential values were computed by the bilinear interpolation method. The potential values shown here are data from Pig 1’s first recording at 90 ms after pacing.</p> "> Figure 6
<p>Registration of epicardial notes to the 2D plane. The apex of the heart was used as the origin of the coordinate system. The nodes were then projected onto the <span class="html-italic">x</span>–<span class="html-italic">y</span> plane at <span class="html-italic">n</span> and then the selected node was extended along the vector between the tip and <span class="html-italic">n</span> until the distance between the origin and node was <span class="html-italic">r</span>, where <span class="html-italic">r</span> is the distance between the origin and the epicardial node; the final location is <span class="html-italic">n’</span> on the <span class="html-italic">x</span>–<span class="html-italic">y</span> plane. The scatter plot was further shrunk to a circular area by dividing the map into segments. In each section, we found the node <span class="html-italic">M</span> with the maximal radius L and then shrunk this node concentrically to a position with radius <span class="html-italic">R</span>. For the rest of the nodes in this segment, we reduced their radius so that the ratio of the new radius to the old radius was retained (equal to <span class="html-italic">L/R</span>). The arc of the segment in this figure is 30°.</p> "> Figure 7
<p>Results of epicardial node registration to the 2D plane. (<b>Top</b>): Original 3D distribution of the epicardial nodes. (<b>Middle</b>): Initial registration of the nodes. (<b>Bottom</b>): Further transformation of the nodes into a circular area.</p> "> Figure 8
<p>Transformation of 1D data by resampling with the new registration. Far left: First 10 nodes of the original potential data sequence 90 ms after the start of pacing. Middle left: Scatter plot of all epicardial nodes after the new registration. The larger nodes are 10 examples. The small purple nodes are the sampling locations of the template. Middle right: Results from sampling at the locations on the template. The bigger nodes are the first 10 nodes of the template. Far right: The first 10 nodes of the potential data after transformation. The potential values shown here are data from Pig 1’s first recording at 90 ms after the start of pacing.</p> "> Figure 9
<p>The model used in cross-validation for different pigs. Filter 32 indicates that the output depth of the CNN layer was 32. Tanh is the hyperbolic tangent that was used as an activation function.</p> "> Figure 10
<p>Example of visualizing the potential. The figure shows the potential in three time steps from top to bottom. First column: Electrogram of the recorded and predicted potential. The vertical red line indicates the time step. Second column: Visualization of the torso’s potential. Third column: Potential from the torso lead’s recording after 2D transformation. Fourth column: Visualization of the epicardial potential. Fifth column: Epicardial node potential after transformation into a template. Sixth column: Visualization of the reconstructed epicardial potential.</p> "> Figure 11
<p>Examples of epicardial site electrograms (recorded and predicted). The corresponding correlation coefficients are also shown in the right upper part of the sub-graphs. The testing data shown here are the first recording from Pig 2. Graph 1–8 shows the recorded and the predicted electro-cardiac waves over 8 epicardial site as examples. The number listed over the right upper corner shows the correlation coefficient between the recorded and the predicted wave from different models. FCN: predicted result from the Fully Connected Neural network for cross-validation within the same pig; LSTM: predicted result from the Long Short-term Memory model for same-pig cross-validation; CNN: predicted result from the Convolutional Neural Network for cross-validation with different pigs.</p> "> Figure 12
<p>Cross-validation results. (<b>Left</b>): Cross-validation results using data from the same pig. (<b>Right</b>): Cross-validation results using data from all pigs. Each dot represents the median correlation coefficient across 239 epicardial nodes.</p> "> Figure 13
<p>Examples of activation time maps, shown as scatter plots. The recording here is from Pig 2. Recorded: The activation map derived from the recorded electrogram. The spots represent one node on the epicardial surface. The colors indicate the value of the activation time. FCN model: The activation map derived from the electrocardiogram reconstructed by the Fully Connected Neural network model. LSTM model: The activation map derived from the electrogram reconstructed by the Long Short-term Model. CNN model: The activation map derived from the electrogram reconstructed by the Convolutional Neural Network model. Green triangles: real pacing site in the experiment; light blue triangles: predicted pacing site with the lowest activation time.</p> "> Figure 14
<p>Correlation coefficients between the activation time maps derived from the recorded data and the reconstructed electrogram. (<b>Left</b>): Correlation coefficients of the activation time map for the validation data after cross-validation. (<b>Right</b>): Correlation coefficients of the activation time maps of all validation data in the cross-validation. Each dot represents a correlation coefficient between the activation time map from the recorded data and the reconstructed data.</p> "> Figure 15
<p>Localization error. (<b>Left</b>): Localization error of cross-validation of the data from the same pig. (<b>Right</b>): Localization error of cross-validation with different pigs.</p> ">
Abstract
:1. Introduction
1.1. Inverse Electrocardiographic Mapping
1.2. The Importance of Inverse Electrocardiographic Mapping
1.3. Traditional Methods
1.4. Problems Faced by the Current Methods
1.5. Neural Network for Prediction
2. Materials and Methods
2.1. Data Collection
2.2. Final Data Used in the Study
2.3. Part I: Not Considering the Geometry
Model Selection
2.4. Part II: Adding Geometrical Information
2.4.1. Torso Node Registration
2.4.2. Transforming 1D Data into 2D Data
2.4.3. Epicardial Surface Node Registration
2.4.4. Transforming 2D Data into 1D Data with the Same Geometrical Sequence
- Transforming the 1D data of the epicardial potential into a 2D scatter plot;
- Using a template with 165 nodes to sample the potential;
- Training the model, with the output in the form of 165 1D sequences;
- During testing, the output of the model was transformed back into the original sequence of epicardial potential by sampling the potential using the 2D scatter plot locations.
2.4.5. Model Selection
2.5. Model Evaluation
2.5.1. Leave-One-Out Cross-Validation
2.5.2. Evaluation Metric: Potential Prediction
2.5.3. Activation Time Reconstruction and Pacing Site Localization
2.5.4. Evaluation Metric: Activation Time
2.5.5. Evaluation Metric: Localization Error
3. Results
3.1. Potential Visualization
3.2. Median Correlation Coefficient
3.3. Activation Time Correlation
3.4. Localization Error
4. Discussion
4.1. Interpretation of the Results
4.2. Previous Studies Using Machine Learning and Deep Learning for Inverse Problem
4.3. Comparison with Previous Reported Accuracy
4.4. How Important Is the Geometrical Information?
4.5. Potential Clinical Application
4.6. Limitations
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Oster, H.S.; Taccardi, B.; Lux, R.L.; Ershler, P.R.; Rudy, Y. Noninvasive electrocardiographic imaging: Reconstruction of epicardial potentials, electrograms, and isochrones and localization of single and multiple electrocardiac events. Circulation 1997, 96, 1012–1024. [Google Scholar] [CrossRef] [PubMed]
- Cheniti, G.; Puyo, S.; Martin, C.A.; Frontera, A.; Vlachos, K.; Takigawa, M.; Bourier, F.; Kitamura, T.; Lam, A.; Dumas-Pommier, C.; et al. Noninvasive Mapping and Electrocardiographic Imaging in Atrial and Ventricular Arrhythmias (CardioInsight). Card. Electrophysiol. Clin. 2019, 11, 459–471. [Google Scholar] [CrossRef] [PubMed]
- Bear, L.; Cuculich, P.S.; Bernus, O.; Efimov, I.; Dubois, R. Introduction to Noninvasive Cardiac Mapping. Card. Electrophysiol. Clin. 2015, 7, 1–16. [Google Scholar] [CrossRef]
- Jaakko Malmivuo, R.P. Bioelectromagnetism: Principles and Applications of Bioelectric and Biomagnetic Fields; Oxford University Press: Oxford, UK, 1995. [Google Scholar]
- Macfarlane, P.W.; Van Oosterom, A.; Pahlm, O.; Kligfield, P.; Janse, M.; Camm, J. (Eds.) Comprehensive Electrocardiology, 2nd ed.; Springer: Berlin/Heidelberg, Germany, 2011; Volume 1. [Google Scholar]
- Wang, Y.; Rudy, Y. Application of the method of fundamental solutions to potential-based inverse electrocardiography. Ann. Biomed. Eng. 2006, 34, 1272–1288. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Ramanathan, C.; Rudy, Y. Electrocardiographic Imaging: I. Effect of Torso Inhomogeneities on Body Surface Electrocardiographic Potentials. J. Cardiovasc. Electrophysiol. 2001, 12, 229–240. [Google Scholar] [CrossRef] [PubMed]
- Ramanathan, C.; Rudy, Y. Electrocardiographic Imaging: II. Effect of Torso Inhomogeneities on Noninvasive Reconstruction of Epicardial Potentials, Electrograms, and Isochrones. J. Cardiovasc. Electrophysiol. 2001, 12, 241–252. [Google Scholar] [CrossRef]
- Milanič, M.; Jazbinšek, V.; Macleod, R.S.; Brooks, D.H.; Hren, R. Assessment of regularization techniques for electrocardiographic imaging. J. Electrocardiol. 2014, 47, 20–28. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Cluitmans, M.; Brooks, D.H.; MacLeod, R.; Dössel, O.; Guillem, M.S.; van Dam, P.M.; Svehlikova, J.; He, B.; Sapp, J.; Wang, L.; et al. Validation and Opportunities of Electrocardiographic Imaging: From Technical Achievements to Clinical Applications. Front. Physiol. 2018, 9, 1305. [Google Scholar] [CrossRef]
- Bear, L.R.; LeGrice, I.J.; Sands, G.B.; Lever, N.A.; Loiselle, D.S.; Paterson, D.J.; Cheng, L.K.; Smaill, B.H. How Accurate Is Inverse Electrocardiographic Mapping? A Systematic In Vivo Evaluation. Circ. Arrhythm. Electrophysiol. 2018, 11, e006108. [Google Scholar] [CrossRef]
- Duchateau, J.; Sacher, F.; Pambrun, T.; Derval, N.; Chamorro-Servent, J.; Denis, A.; Ploux, S.; Hocini, M.; Jaïs, P.; Bernus, O.; et al. Performance and limitations of noninvasive cardiac activation mapping. Heart Rhythm 2019, 16, 435–442. [Google Scholar] [CrossRef] [Green Version]
- Joe Horvath, L.S.; Tommy, P.; Avinash, M.; Mark, T.; Laura, B. Deep learning neural nets for detecting heart activity. arXiv 2019, arXiv:1901.09831. [Google Scholar]
- Bear, L.R.; Cheng, L.K.; LeGrice, I.J.; Sands, G.B.; Lever, N.A.; Paterson, D.J.; Smaill, B.H. Forward problem of electrocardiography: Is it solved? Circ. Arrhythm. Electrophysiol. 2015, 8, 677–684. [Google Scholar] [CrossRef] [PubMed]
- Aras, K.; Good, W.; Tate, J.; Burton, B.; Brooks, D.; Coll-Font, J.; Doessel, O.; Schulze, W.; Potyagaylo, D.; Wang, L.; et al. Experimental Data and Geometric Analysis Repository-EDGAR. J. Electrocardiol. 2015, 48, 975–981. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Duchateau, J.; Potse, M.; Dubois, R. Spatially coherent activation maps for electrocardiographic imaging. IEEE Trans. Biomed. Eng. 2017, 64, 1149–1156. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- McCann, M.T.; Jin, K.H.; Unser, M. Convolutional Neural Networks for Inverse Problems in Imaging: A Review. IEEE Signal Process. Mag. 2017, 34, 85–95. [Google Scholar] [CrossRef] [Green Version]
- Raissi, M.; Karniadakis, G.E. Hidden physics models: Machine learning of nonlinear partial differential equations. J. Comput. Phys. 2018, 357, 125–141. [Google Scholar] [CrossRef] [Green Version]
- Raissi, M. Deep hidden physics models: Deep learning of nonlinear partial differential equations. J. Mach. Learn. Res. 2018, 19, 932–955. [Google Scholar]
- Raissi, M.; Perdikaris, P.; Karniadakis, G.E. Physics-informed neural networks: A deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. J. Comput. Phys. 2019, 378, 686–707. [Google Scholar] [CrossRef]
- Ongie, G.; Jalal, A.; Metzler, C.A.; Baraniuk, R.G.; Dimakis, A.G.; Willett, R. Deep learning techniques for inverse problems in imaging. IEEE J. Sel. Areas Inf. Theory 2020, 1, 39–56. [Google Scholar] [CrossRef]
- Burnes, J.E.; Taccardi, B.; Ershler, P.R.; Rudy, Y. Noninvasive electrocardiogram imaging of substrate and intramural ventricular tachycardia in infarcted hearts. J. Am. Coll. Cardiol. 2001, 38, 2071–2078. [Google Scholar] [CrossRef] [Green Version]
- Ghanem, R.N.; Jia, P.; Ramanathan, C.; Ryu, K.; Markowitz, A.; Rudy, Y. Noninvasive electrocardiographic imaging (ECGI): Comparison to intraoperative mapping in patients. Heart Rhythm 2005, 2, 339–354. [Google Scholar] [CrossRef] [Green Version]
- Sapp, J.L.; Dawoud, F.; Clements, J.C.; Horáček, B.M. Inverse solution mapping of epicardial potentials: Quantitative comparison with epicardial contact mapping. Circ. Arrhythm. Electrophysiol. 2012, 5, 1001–1009. [Google Scholar] [CrossRef] [Green Version]
- Graham, A.J.; Orini, M.; Zacur, E.; Dhillon, G.; Daw, H.; Srinivasan, N.T.; Lane, J.D.; Cambridge, A.; Garcia, J.; O’Reilly, N.J.; et al. Simultaneous comparison of electrocardiographic imaging and epicardial contact mapping in structural heart disease. Circ. Arrhythm. Electrophysiol. 2019, 12, e007120. [Google Scholar] [CrossRef] [Green Version]
- Cluitmans, M.J.; Bonizzi, P.; Karel, J.M.; Das, M.; Kietselaer, B.L.; de Jong, M.M.; Prinzen, F.W.; Peeters, R.L.; Westra, R.L.; Volders, P.G. In Vivo Validation of Electrocardiographic Imaging. JACC Clin. Electrophysiol. 2017, 3, 232–242. [Google Scholar] [CrossRef]
- Hohmann, S.; Rettmann, M.E.; Konishi, H.; Borenstein, A.; Wang, S.; Suzuki, A.; Michalak, G.J.; Monahan, K.H.; Parker, K.D.; Newman, L.K.; et al. Spatial Accuracy of a Clinically Established Noninvasive Electrocardiographic Imaging System for the Detection of Focal Activation in an Intact Porcine Model. Circ. Arrhythm. Electrophysiol. 2019, 12, e007570. [Google Scholar] [CrossRef]
- Cuculich, P.S.; Schill, M.R.; Kashani, R.; Mutic, S.; Lang, A.; Cooper, D.; Faddis, M.; Gleva, M.; Noheria, A.; Smith, T.W.; et al. Noninvasive Cardiac Radiation for Ablation of Ventricular Tachycardia. N. Engl. J. Med. 2017, 377, 2325–2336. [Google Scholar] [CrossRef]
Pig 1 | Pig 2 | Pig 3 | Pig 4 | Pig 5 | |
---|---|---|---|---|---|
Sinus rhythm | 1 | 1 | 1 | 1 | 1 |
Endocardial pacing | 4 | 5 | 0 | 12 | 10 |
Epicardial pacing | 8 | 18 | 4 | 0 | 10 |
Total number | 13 | 24 | 5 | 13 | 11 |
Torso lead number | 158 | 150 | 171 | 165 | 170 |
Epicardial lead number | 239 | 239 | 239 | 239 | 239 |
Subject Type | Subjects | ECG Cycles | Electrogram Correlation Coefficient | Localization Error mm | Activation Time Correlation | Reference |
---|---|---|---|---|---|---|
Torso tank | 4 | >0.8 | 2–10 | [1,22] | ||
Human | 3 | 5 | [23] | |||
Human | 4 | 79 | [24] | |||
Human * | 6 | [12] | ||||
Human | 4 | 46 | 20.7 [9.6–33.2] | 0.71 [0.65–0.74] | [25] | |
Dog | 4 | 93 | 0.71 [0.36–0.86] | 10 [7–17] | 0.82 | [26] |
Pig | 9 | 118 | 20.7 [13.8–25.6] | [27] | ||
Pig | 5 | 70 | 0.72 [0.40–0.84] | 16 [9–26] | 0.78 | [11] |
Pig ** | 5 | 71 | 0.74 [0.22–0.89] | 9.3 [3.4–17.0] | 0.82 [0.67–0.93] | This study |
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Chen, K.-W.; Bear, L.; Lin, C.-W. Solving Inverse Electrocardiographic Mapping Using Machine Learning and Deep Learning Frameworks. Sensors 2022, 22, 2331. https://doi.org/10.3390/s22062331
Chen K-W, Bear L, Lin C-W. Solving Inverse Electrocardiographic Mapping Using Machine Learning and Deep Learning Frameworks. Sensors. 2022; 22(6):2331. https://doi.org/10.3390/s22062331
Chicago/Turabian StyleChen, Ke-Wei, Laura Bear, and Che-Wei Lin. 2022. "Solving Inverse Electrocardiographic Mapping Using Machine Learning and Deep Learning Frameworks" Sensors 22, no. 6: 2331. https://doi.org/10.3390/s22062331
APA StyleChen, K. -W., Bear, L., & Lin, C. -W. (2022). Solving Inverse Electrocardiographic Mapping Using Machine Learning and Deep Learning Frameworks. Sensors, 22(6), 2331. https://doi.org/10.3390/s22062331