More Web Proxy on the site http://driver.im/

research-article

Management of Performance Requirements for Information Systems

Author:

Brian A. NixonAuthors Info & Claims

IEEE Transactions on Software Engineering, Volume 26, Issue 12

Pages 1122 - 1146

https://doi.org/10.1109/32.888627

Published: 01 December 2000 Publication History

Abstract

Management of performance requirements is a major challenge for information systems as well as other software systems. This is because performance requirements (e.g., a student records system should have good response time for registering students ) can have a global impact on the target system. In addition, there are interactions and trade-offs among performance requirements, other nonfunctional requirements (NFRs, or software quality attributes, e.g., accuracy), and the numerous alternatives for the target system. To provide a systematic approach to managing performance requirements, this paper presents a Performance Requirements Framework (PeRF). It integrates and catalogues a variety of kinds of knowledge of information systems and performance. These include performance concepts, Software Performance Engineering (SPE) principles for building performance into systems, and information systems development knowledge (including requirements, design, implementation, and performance). In addition, layered structures organize performance knowledge and the development process. All this knowledge is represented using an existing goal-oriented approach, the NFR Framework, which offers a developer-directed graphical treatment for stating NFRs, analyzing and interrelating them, and determining the impact of decisions upon NFRs. This approach allows customized solutions to be built, taking into account the characteristics of the particular domain. The use of PeRF in managing performance requirements is illustrated in a study of performance requirements and other NFRs for a university's student records system. This paper concludes with a summary of other studies of information systems, tool support, and directions for future work.

References

[1]

Artificial Intelligence, vol. 24, nos. 1–3, Dec. 1984.

[2]

M.P. Atkinson and O.P. Buneman, “Types and Persistence in Database Programming Languages,” Computing Surveys, vol. 19, no. 2, pp. 105–190, June 1987.

Digital Library

[3]

R. Balzer, “A 15 Year Perspective on Automatic Programming,” IEEE Trans. Software Eng., vol. 11, no. 11, pp. 1,257–1,268, Nov. 1985.

Digital Library

[4]

V.R. Basili and J.D. Musa, “The Future Engineering of Software: A Management Perspective,” Computer, vol. 24, no. 9, pp. 90–96, Sept. 1991.

Digital Library

[5]

B.W. Boehm J.R. Brown H. Kaspar M. Lipow G.J. MacLeod and M.J. Merritt, Characteristics of Software Quality. Amsterdam: North-Holland, 1978.

[6]

A. Borgida J. Mylopoulos J.W. Schmidt and I. Wetzel, “Support for Data-Intensive Applications: Conceptual Design and Software Development,” Proc. Second Int'l Workshop Database Programming Languages, R. Hull, R. Morrison, and D. Stemple, eds., pp. 258–280, 1990.

Digital Library

[7]

A. Borgida J. Mylopoulos and J.W. Schmidt, “The TaxisDL Software Description Language,” Database Application Eng. with DAIDA, M. Jarke, ed., pp. 65–84, 1993.

[8]

G. Brataas A.L. Opdahl V. Vetland and A. Sølvberg, “Information Systems: Final Evaluation of the IMSE,” technical report, IMSE Project Deliverable D6.6–2, SINTEF, Univ. of Trondheim, Norway, Feb. 1992.

[9]

G. Brataas, “Performance Engineering Method for Workflow Systems: An Integrated View of Human and Computerised Work Processes,” doctoral thesis, Norwegian Univ. of Science and Technology, 1996.

[10]

P.P.-S. Chen, “The Entity-Relationship Model—Toward a Unified View of Data,” ACM Trans. Database Systems, vol. 1, no. 1, pp. 9–36, Mar. 1976.

Digital Library

[11]

K.L. Chung, “An Extended Taxis Compiler,” masters thesis, Dept. of Computer Science, Univ. of Toronto, 1984.

[12]

K.L. Chung D. Rios-Zertuche B.A. Nixon and J. Mylopoulos, “Process Management and Assertion Enforcement for a Semantic Data Model,” Proc. Int'l Conf. Extending Database Technology, EDBT '88, J.W. Schmidt, S. Ceri, and M. Missikof, eds., pp. 469–487, 1988.

Digital Library

[13]

K.L. Chung, “Representing and Using Non-Functional Requirements: A Process-Oriented Approach,” doctoral thesis, Dept. of Computer Science, Univ. of Toronto, June 1993.

Digital Library

[14]

L. Chung B.A. Nixon and E. Yu, “Using Quality Requirements to Systematically Develop Quality Software,” Proc. Fourth Int'l Conf. Software Quality, Oct. 1994.

[15]

L. Chung and B.A. Nixon, “Tool Support for Systematic Treatment of Non-Functional Requirements,” Dec. 1994.

[16]

L. Chung B.A. Nixon and E. Yu, “Using Non-Functional Requirements to Systematically Select Among Alternatives in Architectural Design,” Proc.Workshop Architectures for Software Systems, ICSE-17, Apr. 1995.

[17]

L. Chung and B.A. Nixon, “Dealing with Non-Functional Requirements: Three Experimental Studies of a Process-Oriented Approach,” Proc. 17th Int'l Conf. Software Eng., pp. 25–37, Apr. 1995.

Digital Library

[18]

L. Chung B.A. Nixon and E. Yu, “Dealing with Change: An Approach Using Non-Functional Requirements,” Requirements Eng., vol. 1, no. 4, pp. 238–260, 1996.

Digital Library

[19]

L. Chung B.A. Nixon E. Yu and J. Mylopoulos, Non-Functional Requirements in Software Engineering. Boston: Kluwer Academic, 2000.

[20]

L.M. Cysneiros and J.C. Sampaio do Prado Leite, “Integrating Non-Functional Requirements into Data Modeling,” Proc. Int'l Symp. Requirements Eng., 1999.

Digital Library

[21]

A. Dardenne A. van Lamsweerde and S. Fickas, “Goal-Directed Requirements Acquisition,” Science of Computer Programming, vol. 20, pp. 3–50, 1993.

Digital Library

[22]

S.F. Fickas, “Automating the Transformational Development of Software,” IEEE Trans. Software Eng., vol. 11, no. 11, pp. 1,268–1,277, Nov. 1985.

Digital Library

[23]

S. Green, “Goal-Driven Approaches to Requirements Engineering,” Technical Report 94/9, Dept. of Computing, Univ. of the West of England, Bristol, 1994.

[24]

S.J. Greenspan J. Mylopoulos and A. Borgida, “Capturing More World Knowledge in the Requirements Specification,” Proc. Sixth Int'l Conf. Software Eng., pp. 225–234, 1982.

Digital Library

[25]

R. Hull and R. King, “Semantic Database Modeling: Survey, Applications, and Research Issues,” Computing Surveys, vol. 19, no. 3, pp. 201–260, Sept. 1987.

Digital Library

[26]

W.F. Hyslop, “Performance Prediction of Relational Database Management Systems,” doctoral thesis, Dept. of Computer Science, Univ. of Toronto, 1991.

Digital Library

[27]

R. Jain, The Art of Computer System Performance Analysis. New York: Wiley, 1991.

[28]

M. Jarke J. Mylopoulos J.W. Schmidt and Y. Vassiliou, “DAIDA: An Environment for Evolving Information Systems,” ACM Trans. Information Systems, vol. 10, no. 1, pp. 1–50, Jan. 1992.

Digital Library

[29]

ConceptBase V3.1 User Manual, M. Jarke, ed., Univ. of Passau, 1992.

[30]

I. Jurisica and B.A. Nixon, “Building Quality into Case-Based Reasoning Systems,” Proc. 10th Int'l Conf. Advanced Information Systems Eng., CAiSE '98, B. Pernici and C. Thanos, eds., pp. 363–380, June 1998.

Digital Library

[31]

E. Kant and D.R. Barstow, “The Refinement Paradigm: The Interaction of Coding and Efficiency Knowledge in Program Synthesis,” IEEE Trans. Software Eng., vol. 7, no. 5, pp. 458–471, Sept. 1981.

Digital Library

[32]

S.E. Keller L.G. Kahn and R.B. Panara, “Specifying Software Quality Requirements with Metrics,” Tutorial: System and Software Requirements Eng., R.H. Thayer and M. Dorfman, eds., pp. 145–163, 1990.

[33]

W. Kim K.-C. Kim and A. Dale, “Indexing Techniques for Object-Oriented Databases,” Object-Oriented Concepts, Databases, and Applications, W. Kim and F.H. Lochovsky, eds., pp. 371–394, 1989.

Digital Library

[34]

E.D. Lazowska J. Zahorjan G.S. Graham and K.C. Sevcik, Quantitative System Performance. Englewood Cliffs, N.J.: Prentice Hall, 1984.

Digital Library

[35]

A.S. Lee, “A Scientific Methodology for MIS Case Studies,” MIS Quarterly, pp. 30–50, Mar. 1991.

[36]

J. Lee, “Extending the Potts and Bruns Model for Recording Design Rationale,” Proc. 13th Int'l Conf. Software Eng., pp. 114–125, May 1991.

Digital Library

[37]

J. Mylopoulos P.A. Bernstein and H.K.T. Wong, “A Language Facility for Designing Database-Intensive Applications,” ACM Trans. Database Systems, vol. 5, no. 2, pp. 185–207, 1980.

Digital Library

[38]

J. Mylopoulos A. Borgida M. Jarke and M. Koubarakis, “Telos: Representing Knowledge About Information Systems,” ACM Trans. Information Systems, vol. 8, pp. 325–362, Oct. 1990.

Digital Library

[39]

J. Mylopoulos L. Chung and B. Nixon, “Representing and Using Non-Functional Requirements: A Process-Oriented Approach,” IEEE Trans. Software Eng., vol. 18, no. 6, pp. 483–497, June 1992.

Digital Library

[40]

N. Nilsson, Problem-Solving Methods in Artificial Intelligence. New York: McGraw-Hill, 1971.

Digital Library

[41]

B.A. Nixon, “A Taxis Compiler,” master's thesis, Dept. of Computer Science, Univ. of Toronto, 1983.

[42]

B. Nixon L. Chung D. Lauzon A. Borgida J. Mylopoulos and M. Stanley, “Implementation of a Compiler for a Semantic Data Model: Experiences with Taxis,” Proc. ACM SIGMOD '87, U. Dayal and I. Traiger, eds., pp. 118–131, May 1987.

Digital Library

[43]

B.A. Nixon K.L. Chung, D. Lauzon A. Borgida J. Mylopoulos and M. Stanley, “Design of a Compiler for a Semantic Data Model,” Foundations of Knowledge Base Management, J.W. Schmidt and C. Thanos, eds., pp. 293–343, 1989.

Digital Library

[44]

B. Nixon and J. Mylopoulos, “Integration Issues in Implementing Semantic Data Models,” Advances in Database Programming Languages, F. Bancilhon and P. Buneman, eds., 1990.

Digital Library

[45]

B. Nixon, “Implementation of Information System Design Specifications: A Performance Perspective,” Proc. Third Int'l Workshop Database Programming Languages: Bulk Types and Persistent Data, P. Kanellakis and J.W. Schmidt, eds., pp. 149–168, Aug. 1991.

Digital Library

[46]

B.A. Nixon, “Dealing with Performance Requirements during the Development of Information Systems,” Proc. IEEE Int'l Symp. Requirements Eng., pp. 42–49, Jan. 1993.

[47]

B.A. Nixon, “Representing and Using Performance Requirements during the Development of Information Systems,” Proc. Fourth Int'l Conf. Extending Database Technology, EDBT '94, M. Jarke, J. Bubenko, and K. Jeffery, eds. pp. 187–200, Mar. 1994.

Digital Library

[48]

B.A. Nixon, “Performance Requirements for Information Systems,” doctoral thesis, Dept. of Computer Science, Univ. of Toronto, 1997.

Digital Library

[49]

B.A. Nixon, “An Approach to Dealing with Performance Requirements during Information System Development,” Proc. Doctoral Consortion, Third IEEE Int'l Symp. Requirements Eng. RE '97, pp. 73–88, Jan. 1997.

Digital Library

[50]

B.A. Nixon, “Managing Performance Requirements for Information Systems,” Proc. First Int'l Workshop Software and Performance, WOSP '98, pp. 131–144, Oct. 1998.

Digital Library

[51]

A.L. Opdahl, “Performance Engineering during Information System Development,” doctoral thesis and Technical Report 1992:5, Information Systems Group, Faculty of Computer Science and Electrical Eng., Norwegian Inst. of Technology, Univ. of Trondheim, Norway, 1992.

[52]

A.L. Opdahl, “Requirements Engineering for Software Performance,” Proc. First Int'l Workshop on Requirements Eng. Foundation of Software Quality, REFSQ '94, pp. 16–32, June 1994.

[53]

J. Peckham and F. Maryanski, “Semantic Data Models,” Computing Surveys, vol. 20, no. 3, pp. 153–189, Sept. 1988.

Digital Library

[54]

S. Rozen, “Automating Physical Database Design: An Extensible Approach,” doctoral dissertation, Dept. of Computer Science, New York Univ., 1993.

Digital Library

[55]

J.W. Schmidt and F. Matthes, “The DBPL Project: Advances in Modular Database Programming,” Information Systems, vol. 19, no. 2, pp. 121–140, 1994.

Digital Library

[56]

H.A. Simon, The Sciences of the Artificial, second ed. Cambridge, Mass.: MIT Press, 1981.

Digital Library

[57]

C.U. Smith, “Independent General Principles for Constructing Responsive Software Systems,” ACM Trans. Computer Systems, vol. 4, no. 1, pp. 1–31, Feb. 1986.

Digital Library

[58]

C.U. Smith, Performance Engineering of Software Systems. Reading, Mass.: Addison-Wesley, 1990.

Digital Library

[59]

J.M. Smith and D.C.P. Smith, “Database Abstractions: Aggregation and Generalization,” ACM Trans. Database Systems, vol. 2, no. 2, pp. 105–133, June 1977.

Digital Library

[60]

Software AG of Canada, “University of Toronto Student Records System: High Level Business Requirements Study,” Apr. 1996 (unpublished).

[61]

University of Toronto, Faculty of Arts and Science, “1998–1999 Registration Handbook & Timetable,” 1998.

[62]

University of Toronto, Faculty of Arts and Science, St. George Campus, “Registration Handbook & Timetable, 1999–2000 Fall/Winter Session,” 1999.

[63]

E.S.K. Yu, “Modelling Strategic Relationships for Process Reengineering,” doctoral thesis, Dept. of Computer Science, Univ. of Toronto, Dec. 1994.

Digital Library

[64]

P. Zave, “Classification of Research Efforts in Requirements Engineering,” Computing Surveys, vol. 29, no. 4, pp. 315–321, 1997.

Digital Library

[65]

M.D. Zisman, “Use of Production Systems for Modeling Concurrent Processes,” Pattern-Directed Inference Systems, D.A. Waterman and F. Hayes-Roth, eds., pp. 53–68, New York: Academic Press, 1978.

Cited By

Abdeen WChen XUnterkalmsteiner M(2023)An approach for performance requirements verification and test environments generationRequirements Engineering10.1007/s00766-022-00379-328:1(117-144)Online publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1007/s00766-022-00379-3
Hu JHu XZhang WZhu SLiu ZHuang J(2009)Monotonic indices space method and its application in the capability indices effectiveness analysis of a notional antistealth information systemIEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans10.1109/TSMCA.2008.201079339:2(404-413)Online publication date: 1-Mar-2009
https://dl.acm.org/doi/10.1109/TSMCA.2008.2010793
Yen CHsu JLin JChao HChong P(2008)An architecture evaluation of campus systems toward SOAProceedings of the International Conference on Mobile Technology, Applications, and Systems10.1145/1506270.1506305(1-4)Online publication date: 10-Sep-2008
https://dl.acm.org/doi/10.1145/1506270.1506305
Show More Cited By

Index Terms

Management of Performance Requirements for Information Systems
1. General and reference
  1. Cross-computing tools and techniques
    1. Metrics
2. Software and its engineering
  1. Software creation and management
    1. Designing software
      1. Requirements analysis
      2. Software implementation planning
        Software design techniques
    2. Software development process management

Recommendations

Representing and Using Nonfunctional Requirements: A Process-Oriented Approach
Special issue on knowledge representation and reasoning in software development

A comprehensive framework for representing and using nonfunctional requirements during the development process is proposed. The framework consists of five basic components which provide the representation of nonfunctional requirements in terms of ...
Optimal selection of operationalizations for non-functional requirements
APCCM '13: Proceedings of the Ninth Asia-Pacific Conference on Conceptual Modelling - Volume 143

Several long-standing problems in software engineering are concerned with inadequate requirements elicitation, analysis, specification, validation, and management. This deficit is a major cause of project failure and as such several techniques and ...
Towards Optimising Non-functional Requirements
QSIC '09: Proceedings of the 2009 Ninth International Conference on Quality Software

Non-functional requirements are an important, and often critical, aspect of any software system. However, determining the degree to which any particular software system meets such requirements and incorporating such considerations into the software ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image IEEE Transactions on Software Engineering

IEEE Transactions on Software Engineering Volume 26, Issue 12

December 2000

96 pages

ISSN:0098-5589

Editor:
Anneliese A. Andrews
Colorado State Univ., Fort Collins

Issue’s Table of Contents

Copyright © Copyright © 2000 IEEE. All Rights Reserved.

Publisher

IEEE Press

Publication History

Published: 01 December 2000

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Abdeen WChen XUnterkalmsteiner M(2023)An approach for performance requirements verification and test environments generationRequirements Engineering10.1007/s00766-022-00379-328:1(117-144)Online publication date: 1-Mar-2023
https://dl.acm.org/doi/10.1007/s00766-022-00379-3
Hu JHu XZhang WZhu SLiu ZHuang J(2009)Monotonic indices space method and its application in the capability indices effectiveness analysis of a notional antistealth information systemIEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans10.1109/TSMCA.2008.201079339:2(404-413)Online publication date: 1-Mar-2009
https://dl.acm.org/doi/10.1109/TSMCA.2008.2010793
Yen CHsu JLin JChao HChong P(2008)An architecture evaluation of campus systems toward SOAProceedings of the International Conference on Mobile Technology, Applications, and Systems10.1145/1506270.1506305(1-4)Online publication date: 10-Sep-2008
https://dl.acm.org/doi/10.1145/1506270.1506305
Din GSchieferdecker IPetre R(2008)Performance Test Design Process and Its Implementation Patterns for Multi-services SystemsProceedings of the 20th IFIP TC 6/WG 6.1 international conference on Testing of Software and Communicating Systems: 8th International Workshop10.1007/978-3-540-68524-1_11(135-152)Online publication date: 10-Jun-2008
https://dl.acm.org/doi/10.1007/978-3-540-68524-1_11
Biskup JMenzel R(2006)Optimising abstract object-oriented database schemasProceedings of the 25th international conference on Conceptual Modeling10.1007/11901181_39(528-543)Online publication date: 6-Nov-2006
https://dl.acm.org/doi/10.1007/11901181_39
Gregoriades ASutcliffe A(2005)Scenario-Based Assessment of Nonfunctional RequirementsIEEE Transactions on Software Engineering10.1109/TSE.2005.5931:5(392-409)Online publication date: 1-May-2005
https://dl.acm.org/doi/10.1109/TSE.2005.59
Zhang HJarzabek SYang B(2003)Quality prediction and assessment for product linesProceedings of the 15th international conference on Advanced information systems engineering10.5555/1758398.1758458(681-695)Online publication date: 16-Jun-2003
https://dl.acm.org/doi/10.5555/1758398.1758458
Biskup JMenzel R(2002)A Flexible Cost Model for Abstract Object-Oriented Database SchemasProceedings of the 21st International Conference on Conceptual Modeling10.5555/647525.725903(444-462)Online publication date: 7-Oct-2002
https://dl.acm.org/doi/10.5555/647525.725903
Petriu DWoodside MBalsamo SInverardi PSelic B(2002)Analysing software requirements specifications for performanceProceedings of the 3rd international workshop on Software and performance10.1145/584369.584371(1-9)Online publication date: 24-Jul-2002
https://dl.acm.org/doi/10.1145/584369.584371

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents