More Web Proxy on the site http://driver.im/

Article

Free access

A coverage metric for the validation of interacting processes

Author:

Ian G. HarrisAuthors Info & Claims

DATE '06: Proceedings of the conference on Design, automation and test in Europe: Proceedings

Pages 1019 - 1024

Published: 06 March 2006 Publication History

Abstract

We present a coverage metric which evaluates the testing of a set of interacting concurrent processes. Existing behavioral coverage metrics focus almost exclusively on the testing of individual processes. However the vast majority of practical hardware descriptions are composed of many processes which must correctly interact to implement the system. Coverage metrics which evaluate processes separately are unlikely to model the range of design errors which manifest themselves when components are integrated to build a system. A metric which models component interactions is essential to enable validation techniques to scale with growing design complexity. We describe the effectiveness of our metric and provide results to demonstrate that coverage computation using our metric is tractable.

References

[1]

B. Beizer. Software Testing Techniques, Second Edition. Van Nostrand Reinhold, 1990.

Digital Library

[2]

K.-T. Cheng and J.-Y. Jou. A functional fault model for sequential machines. IEEE Transactions on Computer-Aided Design, 11(9):1065--1073, September 1992.

Digital Library

[3]

M. Chiodo, P. Giusto, A. Jurecska, H. Hsieh, A. Sangiovanni-Vincentelli, and L. Lavagno. Hardware-software codesign of embedded systems. IEEE Micro, pages 26--36, August 1994.

Digital Library

[4]

F. Corno, M. S. Reorda, and G. Squillero. Rt-level itc 99 benchmarks and first atpg results. IEEE Design and Test of Computers, pages 44--53, July-August 2000.

Digital Library

[5]

F. Corno, M. S. Reorda, G. Squillero, A. Manzone, and A. Pincetti. Automatic test bench generation for validation of RT-level descriptions: an industrial experience. In Design Automation and Test in Europe, pages 385--389, 2000.

Digital Library

[6]

S. Devadas, A. Ghosh, and K. Keutzer. An observability-based code coverage metric for functional simulation. In International Conference on Computer-Aided Design, pages 418--425, November 1996.

Digital Library

[7]

O. Edelstein, E. Farchi, E. Goldin, Y. Nir, G. Ratsaby, and S. Ur. Framework for testing multi-threaded java programs. Concurrency and Computation: Practice and Experience, 15(3-5):485--499, July 2003.

[8]

F. Fallah, S. Devadas, and K. Keutzer. Occom: Efficient computation of observability-based code coverage metrics for functional verification. In Design Automation Conference, pages 152--157, June 1998.

Digital Library

[9]

F. Ferrandi, F. Fummi, E. Macii, M. Poncino, and D. Sciuto. Symbolic optimization of interacting controllers based on redundancy identification and removal. IEEE Transactions on Computer-Aided Design, 19(7):760--772, July 2000.

Digital Library

[10]

D. D. Gajski and F. Vahid. Specification and design of embedded hardware-software systems. IEEE Design and Test of Computers, 12(1):53--67, 1995.

Digital Library

[11]

A. Hajjar, T. Chen, and A. von Mayrhauser. On statistical behavior of branch coverage in testing behavioral vhdl models. In High Level Design Validation and Test Workshop, pages 89--94, 2000.

Digital Library

[12]

I. G. Harris. Hardware-software covalidation: Fault models and test generation. IEEE Design and Test of Computers, 20(4):40--47, July-August 2003.

Digital Library

[13]

Z. Hasan and M. Ciesielski. Functional verification & simulation of fsm networks. In VLSI Test Symposium, pages 326--332, April 1993.

[14]

Z. Kohavi. Switching and Finite Automata Theory. McGraw Hill, 1978.

Digital Library

[15]

D. Lee and M. Yannakakis. Principles and methods of testing finite state machines - a survey. IEEE Transactions on Computers, 84(8):1090--1123, August 1996.

[16]

N. Malik, S. Roberts, A. Pita, and R. Dobson. Automaton: an autonomous coverage-based multiprocessor system verification environment. In IEEE International Workshop on Rapid System Prototyping, pages 168--172, June 1997.

Digital Library

[17]

D. Moundanos, J. A. Abraham, and Y. V. Hoskote. Abstraction techniques for validation coverage analysis and test generation. IEEE Transactions on Computers, 47(1):2--14, January 1998.

Digital Library

[18]

T. K. Shih, C.-M. Chung, Y.-H. Wang, Y.-F. Kuo, and W.-C. Lin. Software testing and metrics for concurrent computation. In Third Asia-Pacific Software Engineering Conference, pages 336--344, 1996.

Digital Library

[19]

S. Tasiran and K. Keutzer. Coverage metrics for functional validation of hardware designs. IEEE Design and Test of Computers, 18(4):36--45, July/August 2001.

Digital Library

[20]

R. N. Taylor, D. L. Levine, and C. D. Kelly. Structural testing of concurrent programs. IEEE Transactions on Software Engineering, 18(3):206--215, March 1992.

Digital Library

[21]

P. A. Thaker, V. D. Agrawal, and M. E. Zaghloul. Validation vector grade (VVG): A new coverage metric for validation and test. In VLSI Test Symposium, pages 182--188, 1999.

Digital Library

[22]

S. Verma, K. Ramineni, and I. G. Harris. An efficient control-oriented coverage metric. In Asian-Pacific Design Automation Conference, 2005.

Digital Library

[23]

A. von Mayrhauser, T. Chen, J. Kok, C. Anderson, A. Read, and A. Hajjar. On choosing test criteria for behavioral level harware design verification. In High Level Design Validation and Test Workshop, pages 124--130, 2000.

Digital Library

[24]

H. Y. Wang and R. K. Brayton. Exploitation of input don't care sequences in logic optimization of fsm networks. In International Conference on Computer-Aided Design, pages 728--735, November 1995.

Digital Library

[25]

Q. Zhang and I. G. Harris. A data flow fault coverage metric for validation of behavioral hdl descriptions. In International Conference on Computer-Aided Design, November 2000.

Digital Library

Cited By

Rodrigues Cda Silva KCunha HShin SOssowski S(2009)Improving functional verification of embedded systems using hierarchical composition and set theoryProceedings of the 2009 ACM symposium on Applied Computing10.1145/1529282.1529650(1632-1636)Online publication date: 8-Mar-2009
https://dl.acm.org/doi/10.1145/1529282.1529650

Recommendations

A framework for simulation validation coverage
WSC '13: Proceedings of the 2013 Winter Simulation Conference: Simulation: Making Decisions in a Complex World

Although verification and validation have been studied for modeling and simulation for many decades, we do not yet have a quantitative measure of the level of validation performed on a simulation model. Validation is especially important as it ...
Coverage-based quality metric of mutation operators for test suite improvement

The choice of mutation operators is a fundamental aspect in mutation testing to guide the tester to an effective test suite. Designing a set of mutation operators is subject to a trade-off between effectiveness and computational cost: a larger mutation ...
Domain Strategy and Coverage Metric for Validation
ISQED '05: Proceedings of the 6th International Symposium on Quality of Electronic Design

An innovative domain strategy and coverage metric for integrated circuit design validation is proposed. The domain strategy generates test points to examine the borders of a domain to detect whether a design fault has occurred, as either one or more of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image Guide Proceedings

DATE '06: Proceedings of the conference on Design, automation and test in Europe: Proceedings

March 2006

1390 pages

ISBN:3981080106

General Chair:
Georges Gielen
KU Leuven, BE

Sponsors

EDAA: European Design Automation Association
The EDA Consortium
IEEE-CS\DATC: The IEEE Computer Society

Publisher

European Design and Automation Association

Leuven, Belgium

Publication History

Published: 06 March 2006

Qualifiers

Article

Acceptance Rates

DATE '06 Paper Acceptance Rate 267 of 834 submissions, 32%;

Overall Acceptance Rate 518 of 1,794 submissions, 29%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
324
Total Downloads

Downloads (Last 12 months)30
Downloads (Last 6 weeks)2

Reflects downloads up to 09 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Rodrigues Cda Silva KCunha HShin SOssowski S(2009)Improving functional verification of embedded systems using hierarchical composition and set theoryProceedings of the 2009 ACM symposium on Applied Computing10.1145/1529282.1529650(1632-1636)Online publication date: 8-Mar-2009
https://dl.acm.org/doi/10.1145/1529282.1529650

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Figures

Tables

Media

View Table of Conten