More Web Proxy on the site http://driver.im/

article

Measuring organizational IS effectiveness: an overview and update of senior management perspectives

Authors:

Peter B. Seddon,

Valerie Graeser,

Leslie P. WillcocksAuthors Info & Claims

ACM SIGMIS Database: the DATABASE for Advances in Information Systems, Volume 33, Issue 2

Pages 11 - 28

https://doi.org/10.1145/513264.513270

Published: 01 June 2002 Publication History

Abstract

This paper reports the views of 80 senior IT managers about IT evaluation approaches, and the benefits that IT provides for their organizations. Their views were obtained through a survey mailed to medium to large organizations in both Europe and the US. The survey sought answers to three questions: How does the senior IT manager's organization assess the value of its (1) overall IT investment portfolio? (2) individual IT projects and applications? (3) IT function? Questions for the survey were based on a thorough review of prior research into IT evaluation. The paper provides a summary of that prior work and compares current findings to prior research. Consistent with prior research, the paper concludes that many firms do not conduct rigorous evaluations of all their IT investments, and offers a tentative explanation of why it might be rational to skip formal evaluations in some circumstances. It also posits five push factors to explain occasions when more lasting improvements in IT evaluation practice have occurred.

References

[1]

Allen, T.J. and Scott-Morton, M.S. (1994). Information Technology and the Corporation of the 1990s, New York: Oxford University Press.

Digital Library

[2]

Applegate, L.M., McFarlan, F.W., and McKenney, J.L. (1996). Corporate Information Systems Management: Text and Cases, 4th ed. Chicago: Irwin

Digital Library

[3]

Bacon, C.J. (1992). "The Use of Decision Criteria in Selecting Information Systems/Technology Investments," Management Information Systems Quarterly, Vol.16, No.3, pp.335--353.

Digital Library

[4]

Ballantine, J.A., Galliers, R.D. and Stray, S.J. (1999). "Information Systems/Technology Evaluation Practices: Evidence from UK Organizations," in Willcocks L.P. and Lester, S. (eds.) Beyond the IT Productivity Paradox Chichester, UK: Wiley, pp.123--150.

[5]

Brown, C.V. (1999). "Horizontal Mechanisms under differing IS organizational contexts," Management Information Systems Quarterly, Vol 23, No. 3, pp. 421--454.

Digital Library

[6]

Davis, F.D. (1989). "Perceived usefulness, perceived ease of use, and user acceptance of information technology". Management Information Systems Quarterly, Vol.13, No.3, pp. 319--340.

Digital Library

[7]

DeLone, W.H., and McLean, E.R. (1992). "Information systems success: the quest for the dependent variable". Information Systems Research Vol.3, No.1, pp.60--95.

Digital Library

[8]

Doll, W.J. and Torkzadeh, G. (1988). "The measurement of end-user computer satisfaction". Management Information Systems Quarterly, Vol.12, No.2, pp. 259--274.

Digital Library

[9]

Earl, M.J. (1989). Management Strategies for Information Technology, Hemel Hempstead: Prentice-Hall.

Digital Library

[10]

Farbey B., Land, F. and Targett, D. (1993). How to Assess your IT Investment: A Study of Methods and Practice, Oxford: Butterworth-Heineman.

[11]

Farbey B., Land, F. and Targett, D. (1999a). "Evaluating Investments in IT: Finding A Framework". In Willcocks, L.P. and Lester, S. (eds). Beyond the IT Productivity Paradox Chichester, UK: Wiley, pp.183--215.

[12]

Farbey B., Land, F. and Targett, D. (1999b). "Moving IS evaluation forward: learning themes and research issues". Journal of Strategic Information Systems, Vol. 8, No.2, pp.189--207.

[13]

Goodhue, D.L. & Thompson, R.L. (1995). "Task-Technology Fit and Individual Performance," MIS Quarterly, Vol.19, No.2, pp. 213--236.

Digital Library

[14]

Graeser. V., Willcocks, L. and Pisanias, N. (1998). Developing the IT Scorecard, Wimbledon, London: Business Intelligence Ltd.

[15]

Grover, V., Jeong, S.R., and Segars, A.H. (1996). "Information systems effectiveness: The construct space and patterns of application," Information and Management, Vol. 31, No. 4, pp.177--191.

Digital Library

[16]

Hammer, M. and Champy, J., (1993). Reengineering the Corporation: a Manifesto for Business Revolution, N.Y.: Harper Collins.

[17]

Ives, B., Olson, M.H., and Baroudi, J.J. (1983). "The measurement of user information satisfaction". Communications of the ACM, Vol.26, No. 10, pp. 785--793.

Digital Library

[18]

Kaplan, R.S. and Norton D.P. (1996). The Balanced Scorecard: translating strategy into action, Boston: Harvard Business School Press.

[19]

Keen, P.G.W. (1991) Shaping the Future: Business Design through Information Technology, Boston: Harvard Business School Press.

Digital Library

[20]

Keil, M. (1995). "Pulling the plug: software project management and the problem of project escalation," Management Information Systems Quarterly, Vol.19, No.4, pp. 421--447.

Digital Library

[21]

Keil, M., Mann J. and Rai, A. (2000). "Why software projects escalate: an empirical analysis and test of four theoretical models," Management Information Systems Quarterly, Vol. 24, No.4, pp.631--664.

Digital Library

[22]

Kettinger W.J. and Lee, C.C. (1994). "Perceived service quality and user satisfaction with the information services function," Decision Sciences, Vol.26, No.5, pp. 737--766.

[23]

Kettinger W.J. and. Lee, C.C. (1997). "Pragmatic perspectives on the measurement of information systems service quality," Management Information Systems Quarterly Vol. 21, No.2, pp. 223--240.

Digital Library

[24]

King, S.F. and Aisthorpe, P. (2000). "Reengineering in the face of a merger: soft systems and concurrent dynamics," Journal of Information Technology Vol.15, No. 2, pp.165--179.

[25]

Klepper, R. and Jones, C. (1998). Outsourcing Information Technology, Systems and Services, New York: Prentice Hall.

Digital Library

[26]

Lacity, M.C. and Willcocks, L.P. (1998). "An empirical investigation of information technology sourcing practices: lessons from experience," Management Information Systems Quarterly, Vol 22, No. 3, pp.363--408.

Digital Library

[27]

Lacity, M.C. and Willcocks, L.P. (2001). Global Information Technology Outsourcing, Chichester, UK: Wiley.

Digital Library

[28]

Markus, M.L. and Tanis, C. (2000). "The Enterprise Systems Experience--From Adoption to Success," In Zmud, R. W. (Ed.), Framing the Domains of IT Research: Glimpsing the Future Through the Past, Cincinnati, OH: Pinnaflex Educational Resources, Inc.

[29]

Markus, M.L. Axline, S., Petrie, D. and Tanis, C. (2000). "Learning from adopters' experiences with ERP: problems encountered and success achieved". Journal of Information Technology, Vol.15, No. 4, pp. 245--266.

[30]

Mukhopadhyay, T., Kekre, S., and Kalathur S. (1995). "Business Value of Information Technology: A Study of Electronic Data Interchange," Management Information Systems Quarterly, Vol.19, No. 2, pp. 137--156.

Digital Library

[31]

National Computing Centre (NCC). (1999). "Budgets bonanza set to end," Computer Weekly, June 17th, pp. 17--18.

[32]

Norris, G.D., (1996). "Post-investment appraisal," In Willcocks (ed ) Investing in Information Systems, London: Chapman and Hall, pp.193--223.

[33]

Parasuraman, A., Zeithaml, V. and Berry, L.L. (1988). "SERVQUAL: A multiple-item scale for measuring consumer perceptions of service quality," Journal of Retailing, Vol.64, No.1, pp.12--40.

[34]

Parasuraman, A., Zeithaml, V. and Berry, L.L. (1994). "Reassessment of expectations as a comparison standard in measuring service quality: implications for further research," Journal of Marketing, Vol.58, No.1, January, pp.111--124.

[35]

Parker, M., and Benson, R. and Trainor, H. (1988). Information Economics: Linking Business Performance to Information Technology, London: Prentice-Hall.

[36]

Peppard, J. and Ward, J. (1999). "'Mind the Gap': diagnosing the relationship between the IT organization and the reset of the business," The Journal of Strategic Information Systems, Vol.8, No.1, pp. 29--60.

[37]

Pitt, L.F., Watson, R.T., and Kavan, C.B. (1995). "Service Quality: A measure of information systems effectiveness," Management Information Systems Quarterly, Vol.19, No. 2, pp. 173--188.

Digital Library

[38]

Pitt, L.F., Watson, R.T., and Kavan, C.B. (1997). "Measuring information systems service quality: concerns for a complete canvas," Management Information Systems Quarterly, Vol. 21, No. 2, pp. 209--222.

Digital Library

[39]

Remenyi, D., Sherwood-Smith, M., with White, T. (1997). Achieving Maximum value from information systems: A process approach, Chichester: Wiley.

Digital Library

[40]

Remenyi, D., Money, A., Sherwood-Smith, M., with Irani, Z. (2000). The effective measurement and management of IT costs and benefits, 2nd ed. Oxford: Butterworth-Heinemann.

Digital Library

[41]

Sarker, S. and Lee, A.S. (1999). "IT-enabled organizational transformation: a case study of BPR failure at TELECO," The Journal of Strategic Information Systems, Vol.8, No.1, pp. 83--103.

[42]

Seddon, P.B., Staples, D. S., Patnayakuni, R., and Bowtell, M.J. (1999). "Dimensions of Information Systems Success," Communications of the Association for Information Systems (CAIS), Volume 2, Article 20.

Digital Library

[43]

Serafeimidis, V. and Smithson, S. (2000). "Information systems evaluation in practice: a case study of organizational change," Journal of Information Technology, 15: 93--105.

[44]

Smithson, S and Hirschheim, R.A., (1998). "Analysing information systems evaluation: another look at an old problem," European Journal of Information Systems, Vol.7, No.3, pp. 158--174.

[45]

Strassmann, P. (1990). The Business Value of Computers, New Caanan, CN: Information Economics Press.

Digital Library

[46]

Strassmann, P. (1997). The Squandered Computer, New Caanan, CN: Information Economics Press.

Digital Library

[47]

Taylor, I. and Norris, G. (1989). Myth and Reality: The strategic impact of IT on Britain's Leading Businesses. The Datasolve Report, Sunbury-on-Thames. (Cited in Norris 1996)

[48]

Venkatraman, N. (1994). "IT-enabled business transformation: from automation to business scope redefinition," Sloan Management Review, Vol.35, No.2, pp. 73--87.

[49]

Venkatraman, N. (1997). "Beyond Outsourcing: Managing IT Resources as a Value Center," Sloan Management Review, Vol.38, No.3, pp.51--64.

[50]

Watson, R.T., Pitt, L.F., and Kavan, C.B. (1998). "Measuring information systems service quality: Lessons from two longitudinal case studies," Management Information Systems Quarterly, Vol. 22, No. 1, pp. 61--80.

Digital Library

[51]

Weill, P., and Olson, M. (1989). "Managing investment in information technology: Mini case examples and implications," Management Information Systems Quarterly, Vol.13, No.1, pp. 3--18.

Digital Library

[52]

Weill, P. (1992). "The relationship between investment in information technology and firm performance: a study of the valve manufacturing sector," Information Systems Research, Vol.3, No. 4, pp.307--333.

Digital Library

[53]

Weill, P., and Broadbent, M. (1998). Leveraging the New Infrastructure: How Market Leaders Capitalize on Information Technology, Boston: Harvard Business School Press.

Digital Library

[54]

Willcocks, L.P. (ed.) (1994). Information Management: Evaluation of IS Investments. London: Chapman and Hall.

[55]

Willcocks, L.P. (ed.) (1996). Investing in Information Systems, London: Chapman and Hall.

[56]

Willcocks, L.P., Feeny, D., and Islei G. (eds.) (1997). Managing IT as a Strategic Resource, Berkshire: McGraw-Hill (UK) Ltd.

Digital Library

[57]

Willcocks, L.P., and Lacity, M. (eds.) (1998). Strategic Sourcing of Information Systems, Perspectives and Practices, Chichester, UK: Wiley.

Digital Library

[58]

Willcocks, L.P., and Lester, S. (1996). "The evaluation and management of information systems investments: from feasibility to routine operations," In Willcocks, L.P. (ed.), Investing in Information Systems, London: Chapman and Hall, pp.15--36.

[59]

Willcocks, L.P., and Lester, S. (1999). "Information Technology: Transformer or Sink Hole," In Willcocks, L.P., and Lester, S. (eds). Beyond the IT Productivity Paradox Chichester, UK: Wiley, pp.1--30.

Cited By

Nugroho ANugroho LPermanasari AKusumawardani S(2023)Evaluation of User Acceptance of the Information System in E-Government: A Systematic Literature Review2023 IEEE 7th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE)10.1109/ICITISEE58992.2023.10405284(197-201)Online publication date: 29-Nov-2023
https://doi.org/10.1109/ICITISEE58992.2023.10405284
Guillemette MRaymond LParé G(2022)Assessing the maturity and performance of the IT function in acute-care hospitals: a configurational viewHealth Systems10.1080/20476965.2022.207579713:1(11-23)Online publication date: 26-May-2022
https://doi.org/10.1080/20476965.2022.2075797
Yim MGomez R(2021)Strengthening ICT4D evaluation: lessons from the fields of program evaluation, IS/IT evaluation, and aid/development evaluationInformation Technology for Development10.1080/02681102.2021.187661927:2(381-415)Online publication date: 15-Feb-2021
https://doi.org/10.1080/02681102.2021.1876619
Show More Cited By

Index Terms

Measuring organizational IS effectiveness: an overview and update of senior management perspectives
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems

Recommendations

Effective information technology (IT) governance mechanisms: An IT outsourcing perspective

Effective IT governance will ensure alignment between IT and business goals. Organizations with ineffective IT governance will suffer due to poor performance of IT resources such as inaccurate information quality, inefficient operating costs, runaway IT ...
IT offshoring in the professional media (1999-2003): a social representations analysis
SIGMIS CPR '04: Proceedings of the 2004 SIGMIS conference on Computer personnel research: Careers, culture, and ethics in a networked environment

The offshore outsourcing of information technology services has been called an 'irreversible megatrend.' Management decisions regarding IT offshoring have major impacts on companies, their IT departments and IT professionals. The dislocation of IT jobs ...
Information technology outsourcing and non-IT operating costs: an empirical investigation

Does information technology outsourcing reduce non-IT operating costs? This study examines this question and also asks whether internal IT investments moderate the relationship between IT outsourcing and non-IT operating costs. Using a panel data set of ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM SIGMIS Database: the DATABASE for Advances in Information Systems

ACM SIGMIS Database: the DATABASE for Advances in Information Systems Volume 33, Issue 2

Spring 2002

50 pages

ISSN:0095-0033

EISSN:1532-0936

DOI:10.1145/513264

Issue’s Table of Contents

Copyright © 2002 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2002

Published in SIGMIS Volume 33, Issue 2

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

84
Total Citations
View Citations
6,242
Total Downloads

Downloads (Last 12 months)36
Downloads (Last 6 weeks)15

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Nugroho ANugroho LPermanasari AKusumawardani S(2023)Evaluation of User Acceptance of the Information System in E-Government: A Systematic Literature Review2023 IEEE 7th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE)10.1109/ICITISEE58992.2023.10405284(197-201)Online publication date: 29-Nov-2023
https://doi.org/10.1109/ICITISEE58992.2023.10405284
Guillemette MRaymond LParé G(2022)Assessing the maturity and performance of the IT function in acute-care hospitals: a configurational viewHealth Systems10.1080/20476965.2022.207579713:1(11-23)Online publication date: 26-May-2022
https://doi.org/10.1080/20476965.2022.2075797
Yim MGomez R(2021)Strengthening ICT4D evaluation: lessons from the fields of program evaluation, IS/IT evaluation, and aid/development evaluationInformation Technology for Development10.1080/02681102.2021.187661927:2(381-415)Online publication date: 15-Feb-2021
https://doi.org/10.1080/02681102.2021.1876619
Boakye KNatesan PPrybutok V(2020)A correlated uniqueness model of service quality measurement among users of cloud-based service platformsJournal of Retailing and Consumer Services10.1016/j.jretconser.2020.10209855(102098)Online publication date: Jul-2020
https://doi.org/10.1016/j.jretconser.2020.102098
Gallivan M(2019)Author Highlights for the Past 35 YearsACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/3312576.331258650:1(54-76)Online publication date: 12-Feb-2019
https://dl.acm.org/doi/10.1145/3312576.3312586
Raymond LBergeron FCroteau AUwizeyemungu S(2019)Determinants and outcomes of IT governance in manufacturing SMEs: A strategic IT management perspectiveInternational Journal of Accounting Information Systems10.1016/j.accinf.2019.07.001Online publication date: Aug-2019
https://doi.org/10.1016/j.accinf.2019.07.001
Basar A(2019)A novel methodology for performance evaluation of IT projects in a fuzzy environment: a case studySoft Computing10.1007/s00500-019-04579-yOnline publication date: 7-Dec-2019
https://doi.org/10.1007/s00500-019-04579-y
Kasemsap K(2018)The Role of Information System Within Enterprise Architecture and Their Impact on Business PerformanceGlobal Business Expansion10.4018/978-1-5225-5481-3.ch049(1078-1102)Online publication date: 2018
https://doi.org/10.4018/978-1-5225-5481-3.ch049
Marchand MRaymond L(2018)Performance measurement and management systems as IT artefactsInternational Journal of Productivity and Performance Management10.1108/IJPPM-08-2017-020667:7(1214-1233)Online publication date: 10-Sep-2018
https://doi.org/10.1108/IJPPM-08-2017-0206
Franco EHirama KCarvalho M(2018)Applying system dynamics approach in software and information system projectsInformation and Software Technology10.1016/j.infsof.2017.08.01393:C(58-73)Online publication date: 1-Jan-2018
https://dl.acm.org/doi/10.1016/j.infsof.2017.08.013
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents