research-article

Free access

Evaluation of computer architectures via test programs

Authors:

Samuel H. Fuller,

Paul Shaman,

David Lamb,

William E. BurrAuthors Info & Claims

AFIPS '77: Proceedings of the June 13-16, 1977, national computer conference

Pages 147 - 160

https://doi.org/10.1145/1499402.1499434

Published: 13 June 1977 Publication History

PDF eReader

Abstract

This article presents the evaluation of the Computer Family Architecture (CFA) candidate architectures via a set of test programs. The measures used to rank the computer architectures were S, the size of the test program, and M and R, two measures designed to estimate the principal components contributing to the nominal execution speed of the architecture. Descriptions of the twelve test programs and definitions of the S, M, and R measures are included here. The statistical design of the assignment of test programs to programmers is also discussed. Each program was coded from two to four times on each machine to minimize the uncertainty due to programmer variability. The final results show that for all three measures (S, M, and R) the Interdata 8/32 is the superior architecture, followed closely by the PDP-11, and the IBM S/370 trailed by a significant margin.

References

[1]

Fuller, S. F., H. S. Stone, and W. E. Burr: "Initial Selection and Screening of the CFA Candidate Computer Architecture", AFIPS Conference Proceedings, Vol. 46, 1977 National Computer Conference.

Digital Library

Google Scholar

[2]

Lucas, H. C., "Performance Evaluation and Monitoring", ACM Computing Surveys, 3, 3, 1971, pp. 79--91.

Digital Library

Google Scholar

[3]

Bernwell, N. (editor), Benchmarking: Computer Evaluation and Measurement, John Wiley & Sons, New York, 1975.

Google Scholar

[4]

Wichmann, B. A., Algol 60 Compilation and Assessment, Anderson Press, New York, 1973.

Digital Library

Google Scholar

[5]

Fuller, S. F., W. E. Burr, P. Shaman, and D. Lamb: Evaluation of Computer Architectures via Test Programs. Volume III of Computer Family Architecture Selection Committee Final Report, Naval Research Laboratory, Washington, D.C., 1 December 1976.

Google Scholar

[6]

Bell, C. G. and A. Newell, Computer Structures: Readings and Examples, McGraw-Hill, New York, 1971.

Digital Library

Google Scholar

[7]

Computer Review, GML Corporation, Lexington, Mass., 1976.

Google Scholar

[8]

Stone, H. S. (editor), Introduction to Computer Architecture, Science Research Associates, Chicago, 1975.

Google Scholar

[9]

Davies, O. L. (editor), Design and Analysis of Industrial Experiments, 2nd ed., Oliver and Boyd, Edinburgh, 1971.

Google Scholar

[10]

Anderson, V. L. and R. A. McLean, Design of Experiments, a Realistic Approach, Marcel Dekker; Inc., New York, 1974.

Google Scholar

[11]

Connor, W. S. and M. Zelen, Fractional Factorial Experiment Designs for Factors at Three Levels, National Bureau of Standards, Applied Mathematics Series 54, 1959.

Google Scholar

[12]

Rao, C. R., Linear Statistical Inference and its Applications, 2nd ed., John Wiley & Sons, New York, 1973.

Google Scholar

[13]

Cornyn, J. J., W. R. Smith, W. R. Svirsky, and A. H. Coleman, "Two Life-Cycle Cost Models for Comparing Computer Architectures", AFIPS Conference Proceedings, Vol. 46, 1977 National Computer Conference.

Digital Library

Google Scholar

[14]

Box, G. E. P. and B. R. Cox, "An Analysis of Transformations", The Journal of the Royal Statistical Society, Series B, Vol. 26, 1964, pp. 211--252.

Crossref

Google Scholar

Cited By

View all

Leibson S(2016)Using Performance Metrics to Select Microprocessor Cores for IC DesignsElectronic Design Automation for IC System Design, Verification, and Testing10.1201/b19569-13(199-228)Online publication date: 14-Apr-2016
https://doi.org/10.1201/b19569-13
(1978)BIBLIOGRAPHYComputer Engineering10.1016/B978-0-932376-00-8.50036-0(553-561)Online publication date: 1978
https://doi.org/10.1016/B978-0-932376-00-8.50036-0
Cornyn JSmith WColeman ASvirsky W(1977)Life cycle cost models for comparing computer family architecturesProceedings of the June 13-16, 1977, national computer conference10.1145/1499402.1499437(185-199)Online publication date: 13-Jun-1977
https://dl.acm.org/doi/10.1145/1499402.1499437
Show More Cited By

Recommendations

An evaluation of software test environment architectures
ICSE '96: Proceedings of the 18th international conference on Software engineering

Software test environments (STEs) provide a means of automating the test process and integrating testing tools to support required testing capabilities across the test process. Specifically, STEs may support test planning, test management, test ...
Optimizing test prioritization via test distribution analysis
ESEC/FSE 2018: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Test prioritization aims to detect regression faults faster via reordering test executions, and a large number of test prioritization techniques have been proposed accordingly. However, test prioritization effectiveness is usually measured in terms of ...
VLSI Test Principles and Architectures: Design for Testability

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

AFIPS '77: Proceedings of the June 13-16, 1977, national computer conference

June 1977

1039 pages

ISBN:9781450379144

DOI:10.1145/1499402

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 June 1977

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
192
Total Downloads

Downloads (Last 12 months)64
Downloads (Last 6 weeks)10

Reflects downloads up to 31 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Leibson S(2016)Using Performance Metrics to Select Microprocessor Cores for IC DesignsElectronic Design Automation for IC System Design, Verification, and Testing10.1201/b19569-13(199-228)Online publication date: 14-Apr-2016
https://doi.org/10.1201/b19569-13
(1978)BIBLIOGRAPHYComputer Engineering10.1016/B978-0-932376-00-8.50036-0(553-561)Online publication date: 1978
https://doi.org/10.1016/B978-0-932376-00-8.50036-0
Cornyn JSmith WColeman ASvirsky W(1977)Life cycle cost models for comparing computer family architecturesProceedings of the June 13-16, 1977, national computer conference10.1145/1499402.1499437(185-199)Online publication date: 13-Jun-1977
https://dl.acm.org/doi/10.1145/1499402.1499437
Barbacci MSiewiorek DGordon RHowbrigg RZuckerman S(1977)An architectural research facilityProceedings of the June 13-16, 1977, national computer conference10.1145/1499402.1499435(161-173)Online publication date: 13-Jun-1977
https://dl.acm.org/doi/10.1145/1499402.1499435
Fuller SStone HBurr W(1977)Initial selection and screening of the CFA candidate computer architecturesProceedings of the June 13-16, 1977, national computer conference10.1145/1499402.1499433(139-146)Online publication date: 13-Jun-1977
https://dl.acm.org/doi/10.1145/1499402.1499433
Burr WColeman ASmith W(1977)Overview of the military computer family architecture selectionProceedings of the June 13-16, 1977, national computer conference10.1145/1499402.1499432(131-137)Online publication date: 13-Jun-1977
https://dl.acm.org/doi/10.1145/1499402.1499432

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Recommendations

An evaluation of software test environment architectures

Optimizing test prioritization via test distribution analysis

VLSI Test Principles and Architectures: Design for Testability