More Web Proxy on the site http://driver.im/

research-article

Open access

Demystifying and Mitigating Cross-Layer Deficiencies of Soft Error Protection in Instruction Duplication

Authors:

Guanpeng LiAuthors Info & Claims

SC '23: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

Article No.: 86, Pages 1 - 13

https://doi.org/10.1145/3581784.3607078

Published: 11 November 2023 Publication History

Abstract

Soft errors are prevalent in modern High-Performance Computing (HPC) systems, resulting in silent data corruptions (SDCs), compromising system reliability. Instruction duplication is a widely used software-based protection technique against SDCs. Existing instruction duplication techniques are mostly implemented at LLVM level and may suffer from low SDC coverage at assembly level. In this paper, we evaluate instruction duplication at both LLVM and assembly levels. Our study shows that existing instruction duplication techniques have protection deficiency at assembly level and are usually over-optimistic in the protection. We investigate the root-causes of the protection deficiency and propose a mitigation technique, Flowery, to solve the problem. Our evaluation shows that Flowery can effectively protect programs from SDCs evaluated at assembly level.

Supplemental Material

MP4 File - SC23 paper presentation recording for "Demystifying and Mitigating Cross-Layer Deficiencies of Soft Error Protection in Instruction Duplication"

SC23 paper presentation recording for "Demystifying and Mitigating Cross-Layer Deficiencies of Soft Error Protection in Instruction Duplication", by Zhengyang He, Yafan Huang, Hui Xu, Dingwen Tao and Guanpeng Li

Download
192.88 MB

References

[1]

Rizwan A. Ashraf, Roberto Gioiosa, Gokcen Kestor, Ronald F. DeMara, Chen-Yong Cher, and Pradip Bose. 2015. Understanding the propagation of transient errors in HPC applications. In SC '15: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis. 1--12.

Digital Library

[2]

Chun-Kai Chang, Guanpeng Li, and Mattan Erez. 2019. Evaluating Compiler IR-Level Selective Instruction Duplication with Realistic Hardware Errors. In 2019 IEEE/ACM 9th Workshop on Fault Tolerance for HPC at eXtreme Scale (FTXS). 41--49.

[3]

Mojtaba Ebrahimi and Mehdi B. Tahoori. 2016. Invited - Cross-Layer Approaches for Soft Error Modeling and Mitigation (DAC '16). Association for Computing Machinery, New York, NY, USA, Article 32, 6 pages.

Digital Library

[4]

Shuguang Feng, Shantanu Gupta, Amin Ansari, and Scott Mahlke. 2010. Shoestring: Probabilistic Soft Error Reliability on the Cheap. In Proceedings of the Fifteenth International Conference on Architectural Support for Programming Languages and Operating Systems (Pittsburgh, Pennsylvania, USA) (ASP-LOS XV). Association for Computing Machinery, New York, NY, USA, 385--396.

Digital Library

[5]

Giorgis Georgakoudis, Ignacio Laguna, Dimitrios S. Nikolopoulos, and Martin Schulz. 2017. REFINE: Realistic Fault Injection via Compiler-based Instrumentation for Accuracy, Portability and Speed. In SC17: International Conference for High Performance Computing, Networking, Storage and Analysis. 1--14.

[6]

R. W. Hamming. 1950. Error detecting and error correcting codes. The Bell System Technical Journal 29, 2 (1950), 147--160.

[7]

Siva Kumar Sastry Hari, Sarita V. Adve, and Helia Naeimi. 2012. Low-cost program-level detectors for reducing silent data corruptions. In IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2012). 1--12.

[8]

Jie Hu, Feihui Li, Vijay Degalahal, Mahmut Kandemir, Vijaykrishnan Narayanan, and Mary Irwin. 2005. Compiler-Directed Instruction Duplication for Soft Error Detection. 1056--1057.

Digital Library

[9]

Yafan Huang, Shengjian Guo, Sheng Di, Guanpeng Li, and Franck Cappello. 2022. Hardening selective protection across multiple program inputs for HPC applications. In Proceedings of the 27th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 437--438.

Digital Library

[10]

Yafan Huang, Shengjian Guo, Sheng Di, Guanpeng Li, and Franck Cappello. 2022. Mitigating Silent Data Corruptions in HPC Applications across Multiple Program Inputs. In SC22: International Conference for High Performance Computing, Networking, Storage and Analysis. 1--14.

[11]

Charu Kalra, Fritz Previlon, Norm Rubin, and David Kaeli. 2020. ArmorAll: Compiler-based resilience targeting GPU applications. ACM Transactions on Architecture and Code Optimization (TACO) 17, 2 (2020), 1--24.

Digital Library

[12]

Ignacio Laguna, Martin Schulz, David F Richards, Jon Calhoun, and Luke Olson. 2016. Ipas: Intelligent protection against silent output corruption in scientific applications. In 2016 IEEE/ACM International Symposium on Code Generation and Optimization (CGO). IEEE, 227--238.

Digital Library

[13]

Chris Lattner and Vikram Adve. 2004. LLVM: A compilation framework for lifelong program analysis & transformation. In International Symposium on Code Generation and Optimization. IEEE, 75.

[14]

Guanpeng Li and Karthik Pattabiraman. 2018. Modeling Input-Dependent Error Propagation in Programs. In 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). 279--290.

[15]

Guanpeng Li, Karthik Pattabiraman, Siva Kumar Sastry Hari, Michael Sullivan, and Timothy Tsai. 2018. Modeling Soft-Error Propagation in Programs. In 2018 48th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN). 27--38.

[16]

Zhimin Li, Harshitha Menon, Kathryn Mohror, Peer-Timo Bremer, Yarden Livant, and Valerio Pascucci. 2021. Understanding a program's resiliency through error propagation. In Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 362--373.

Digital Library

[17]

Qining Lu, Guanpeng Li, Karthik Pattabiraman, Meeta S. Gupta, and Jude A. Rivers. 2017. Configurable Detection of SDC-Causing Errors in Programs. 16, 3, Article 88 (mar 2017), 25 pages.

Digital Library

[18]

Qining Lu, Karthik Pattabiraman, Meeta S Gupta, and Jude A Rivers. 2014. SDC-Tune: a model for predicting the SDC proneness of an application for configurable protection. In Proceedings of the 2014 International Conference on Compilers, Architecture and Synthesis for Embedded Systems. 1--10.

Digital Library

[19]

Chi-Keung Luk, Robert Cohn, Robert Muth, Harish Patil, Artur Klauser, Geoff Lowney, Steven Wallace, Vijay Janapa Reddi, and Kim Hazelwood. 2005. Pin: Building Customized Program Analysis Tools with Dynamic Instrumentation. SIGPLAN Not. 40, 6 (2005), 190--200.

Digital Library

[20]

H. Madeira, D. Costa, and M. Vieira. 2000. On the emulation of software faults by software fault injection. In Proceeding International Conference on Dependable Systems and Networks. DSN 2000. 417--426.

[21]

Abdulrahman Mahmoud, Siva Kumar Sastry Hari, Michael B Sullivan, Timothy Tsai, and Stephen W Keckler. 2018. Optimizing software-directed instruction replication for gpu error detection. In SC18: International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 842--854.

Digital Library

[22]

Shubhendu S Mukherjee, Christopher Weaver, Joel Emer, Steven K Reinhardt, and Todd Austin. 2003. A systematic methodology to compute the architectural vulnerability factors for a high-performance microprocessor. In Proceedings. 36th Annual IEEE/ACM International Symposium on Microarchitecture, 2003. MICRO-36. IEEE, 29--40.

Digital Library

[23]

Bin Nie, Ji Xue, Saurabh Gupta, Christian Engelmann, Evgenia Smirni, and Devesh Tiwari. 2017. Characterizing temperature, power, and soft-error behaviors in data center systems: Insights, challenges, and opportunities. In 2017 IEEE 25th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS). IEEE, 22--31.

[24]

Nahmsuk Oh, Philip P Shirvani, and Edward J McCluskey. 2002. Error detection by duplicated instructions in super-scalar processors. IEEE Transactions on Reliability 51, 1 (2002), 63--75.

[25]

Md Hasanur Rahman, Aabid Shamji, Shengjian Guo, and Guanpeng Li. 2021. PEPPA-X: Finding Program Test Inputs to Bound Silent Data Corruption Vulnerability in HPC Applications. In SC21: International Conference for High Performance Computing, Networking, Storage and Analysis. 1--14.

Digital Library

[26]

Philip P Shirvani, Namsuk Oh, Edward J Mccluskey, DL Wood, Michael N Lovellette, and KS Wood. 2000. Software-implemented hardware fault tolerance experiments: COTS in space. In International Conference on Dependable Systems and Networks (FTCS-30 and DCCA-8), New York (NY).

[27]

Philip P Shirvani, Nirmal Saxena, Nahmsuk Oh, Subhasish Mitra, Shu-Yi Yu, Wei-Je Huang, Santiago Fernandez-Gomez, Nur A Touba, and Edward J McCluskey. 1999. Fault-Tolerance Projects at Stanford CRC. In MAPLD 1999- Annual Military and Aerospace Applications of Programmable Devices and Technologies Conference, 2 nd, Johns Hopkins Univ, APL, Laurel, MD. Citeseer.

[28]

Premkishore Shivakumar, Michael Kistler, Stephen W Keckler, Doug Burger, and Lorenzo Alvisi. 2002. Modeling the effect of technology trends on the soft error rate of combinational logic. In Proceedings International Conference on Dependable Systems and Networks. IEEE, 389--398.

[29]

D.T. Stott, B. Floering, D. Burke, Z. Kalbarczpk, and R.K. Iyer. 2000. NFTAPE: a framework for assessing dependability in distributed systems with lightweight fault injectors. In Proceedings IEEE International Computer Performance and Dependability Symposium. IPDS 2000. 91--100.

[30]

Devesh Tiwari, Saurabh Gupta, James Rogers, Don Maxwell, Paolo Rech, Sudharshan Vazhkudai, Daniel Oliveira, Dave Londo, Nathan DeBardeleben, Philippe Navaux, Luigi Carro, and Arthur Bland. 2015. Understanding GPU errors on large-scale HPC systems and the implications for system design and operation. In 2015 IEEE 21st International Symposium on High Performance Computer Architecture (HPCA). 331--342.

[31]

A. Vallero, A. Savino, G. Politano, S. Di Carlo, A. Chatzidimitriou, S. Tselonis, M. Kaliorakis, D. Gizopoulos, M. Riera, R. Canal, A. Gonzalez, M. Kooli, A. Bosio, and G. Di Natale. 2016. Cross-layer system reliability assessment framework for hardware faults. In 2016 IEEE International Test Conference (ITC). 1--10.

[32]

Jiesheng Wei, Anna Thomas, Guanpeng Li, and Karthik Pattabiraman. 2014. Quantifying the Accuracy of High-Level Fault Injection Techniques for Hardware Faults. In 2014 44th Annual IEEE/IFIP International Conference on Dependable Systems and Networks. 375--382.

Digital Library

[33]

Lishan Yang, Bin Nie, Adwait Jog, and Evgenia Smirni. 2021. Enabling software resilience in gpgpu applications via partial thread protection. In 2021 IEEE/ACM 43rd International Conference on Software Engineering (ICSE). IEEE, 1248--1259.

Digital Library

Cited By

Huang YDi SZhang ZLu XLi G(2024)Versatile Datapath Soft Error Detection on the Cheap for HPC ApplicationsSC24: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41406.2024.00061(1-15)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SC41406.2024.00061
Menaka CSaraswat NBhagwan S(2024)Exploring the Behavior of Soft-Error Rate Reduction Algorithms in Digital Circuits2024 International Conference on Optimization Computing and Wireless Communication (ICOCWC)10.1109/ICOCWC60930.2024.10470803(1-5)Online publication date: 29-Jan-2024
https://doi.org/10.1109/ICOCWC60930.2024.10470803
Wei XTong SSun ZLi FLi XYue H(2024)HPC-Crash: Characterizing Crash-Proneness of HPC Programs from Various Perspectives2024 10th IEEE International Conference on High Performance and Smart Computing (HPSC)10.1109/HPSC62738.2024.00023(89-94)Online publication date: 10-May-2024
https://doi.org/10.1109/HPSC62738.2024.00023
Show More Cited By

Index Terms

Demystifying and Mitigating Cross-Layer Deficiencies of Soft Error Protection in Instruction Duplication
1. Computer systems organization
  1. Dependable and fault-tolerant systems and networks

Recommendations

Mitigating silent data corruptions in HPC applications across multiple program inputs
SC '22: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis

With the ever-shrinking size of transistors, silent data corruptions (SDCs) are becoming a common yet serious issue in HPC. Selective instruction duplication (SID) is a widely used fault-tolerance technique that can obtain high SDC coverage with low ...
An efficient vulnerability-driven method for hardening a program against soft-error using genetic algorithm

Soft-errors are one of the major causes of software failures. Restricted reliability-improvement and undesirable performance-overhead are the main shortcomings of the state-of-the-art software-based methods to detect and recover soft-errors in a ...
Detecting SDCs in GPGPUs Through an Efficient Instruction Duplication Mechanism
Knowledge Science, Engineering and Management
Abstract
As General-Purpose Graphics Processing Units (GPGPUs) are widely used in High-Performance Computing (HPC) applications, the vulnerability of GPGPUs to soft errors becomes a critical concern. In this paper, we propose an efficient instruction ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '23: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis

November 2023

1428 pages

ISBN:9798400701092

DOI:10.1145/3581784

Chair:
Dorian Arnold,
Program Chair:
Rosa M Badia,
Program Co-chair:
Kathryn Mohror

Copyright © 2023 Owner/Author(s).

This work is licensed under a Creative Commons Attribution International 4.0 License.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 November 2023

Check for updates

Badges

Author Tags

Qualifiers

Research-article

Conference

SC '23

Sponsor:

SIGHPC

SC '23: International Conference for High Performance Computing, Networking, Storage and Analysis

November 12 - 17, 2023

CO, Denver, USA

Acceptance Rates

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

5
Total Citations
View Citations
485
Total Downloads

Downloads (Last 12 months)406
Downloads (Last 6 weeks)50

Reflects downloads up to 03 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Huang YDi SZhang ZLu XLi G(2024)Versatile Datapath Soft Error Detection on the Cheap for HPC ApplicationsSC24: International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SC41406.2024.00061(1-15)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SC41406.2024.00061
Menaka CSaraswat NBhagwan S(2024)Exploring the Behavior of Soft-Error Rate Reduction Algorithms in Digital Circuits2024 International Conference on Optimization Computing and Wireless Communication (ICOCWC)10.1109/ICOCWC60930.2024.10470803(1-5)Online publication date: 29-Jan-2024
https://doi.org/10.1109/ICOCWC60930.2024.10470803
Wei XTong SSun ZLi FLi XYue H(2024)HPC-Crash: Characterizing Crash-Proneness of HPC Programs from Various Perspectives2024 10th IEEE International Conference on High Performance and Smart Computing (HPSC)10.1109/HPSC62738.2024.00023(89-94)Online publication date: 10-May-2024
https://doi.org/10.1109/HPSC62738.2024.00023
He ZXu HLi G(2024)A Fast Low-Level Error Detection Technique2024 54th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN)10.1109/DSN58291.2024.00023(90-98)Online publication date: 24-Jun-2024
https://doi.org/10.1109/DSN58291.2024.00023
Yang LPapadimitriou GSartzetakis DJog ASmirni EGizopoulos D(2024)GPU Reliability Assessment: Insights Across the Abstraction Layers2024 IEEE International Conference on Cluster Computing (CLUSTER)10.1109/CLUSTER59578.2024.00008(1-13)Online publication date: 24-Sep-2024
https://doi.org/10.1109/CLUSTER59578.2024.00008

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents