Abstract
Today, many companies design and maintain a vast amount of conceptual models. It has been also observed that such large model collections exhibit serious quality issues in industry practice. A number of quality frameworks have been proposed in the literature, but the practice is that practitioners continue to evaluate conceptual models in an ad-hoc and subjective way, based on common sense and experience. Therefore, there is a lack of empirical works in the evaluation of conceptual frameworks. This paper reports an empirical qualitative study on the evaluation of the quality of a conceptual framework in the domain of transport logistics, using existent quality evaluation frameworks. The results show how the users perceive the ease of understanding, the usefulness, the perceived semantic quality and satisfaction with the models included in the conceptual framework. The results also provided their view on advantages, challenges and improvements to be performed in the framework.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Natvig, M.K., et al.: ARKTRANS ‐ The multimodal ITS framework architecture v6 (2007)
Freightwise Project, http://www.freightwise.info/cms/
e-Freight Project, http://www.efreightproject.eu/
SMARTFREIGHT Project, http://www.smartfreight.info/
Moody, D.L.: Theoretical and practical issues in evaluating the quality of conceptual models: current state and future directions. Data & Knowledge Engin. 55, 243–276 (2005)
Mendling, J.: Empirical studies in process model verification. In: Jensen, K., van der Aalst, W.M.P. (eds.) Transactions on Petri Nets and Other Models of Concurrency II. LNCS, vol. 5460, pp. 208–224. Springer, Heidelberg (2009)
Krogstie, J., Lindland, O.I., Sindre, G.: Defining quality aspects for conceptual models. In: Proceedings of the 3rd IFIP 8.1 Working Conference on Information Systems, Marburg, Germany, pp. 216–231 (1995)
Krogstie, J., Sindre, G., Jørgensen, H.D.: Process models representing knowledge for action: a revised quality framework. EJIS 15(1), 91–102 (2006)
Lindland, O.I., Sindre, G., Sølvberg, A.: “Understanding Quality in Conceptual Modeling. IEEE Software 11(2), 42–49 (1994)
Maes, A., Poels, G.: Evaluating quality of conceptual modelling scripts based on user perceptions. Data and Knowledge Engineering 63, 701–724 (2007)
Maes, A., Poels, G.: Evaluating Quality of Conceptual Models Based on User Perceptions. In: Embley, D.W., Olivé, A., Ram, S. (eds.) ER 2006. LNCS, vol. 4215, pp. 54–67. Springer, Heidelberg (2006)
Burton-Jones, A., Weber, R.: Understanding Relationships with Attributes in Entity-Relationship Diagrams. In: 20th Int. Conference on Information Systems, pp. 214–228 (1999)
Gemino, A., Wand, Y.: Foundations for Empirical Comparisons of Conceptual Modeling Techniques. In: Batra, D., Parsons, J., Ramesh, E. (eds.) Proc. of the Second Annual Symposium on Research in Systems Analysis and Design, Miami, Florida (2003)
Gemino, A., Wand, Y.: A framework for empirical evaluation of conceptual modeling techniques. Requirements Engineering Journal 9, 248–260 (2004)
Davis, F.D., Bagozzi, R.P., Warshaw, P.R.: User acceptance of computer technology: A comparison of two theoretical models, Manag. Science 35(8), 982–1003 (1989)
Venkatesh, V., Morris, M.G., Davis, G.B., Davis, F.D.: User acceptance of information technology: toward a unified view. MIS Quarterly 27(3), 425–478 (2003)
Passos, C., Cruzes, D.S., Mendonca, M.: Beliefs Underlying Teams Intention and Practice: An Application of the Theory of Planned Behavior. In: ESELAW 2013, Uruguay (2013)
Passos, C., Cruzes, D.S.: Applying the theory of reasoned action in the context of software development practices: insights into teams intentions and behavior. In: EASE 2013, Brazil (2013)
Boyatzis, R.E.: Transforming qualitative information: thematic analysis and code development. Sage Publications (1998)
Braun, V., Clarke, V.: Using thematic analysis in psychology. Qualitative Research in Psychology 3(2), 77–101 (2006)
Cruzes, D.S., Dybå, T.: Recommended steps for thematic synthesis in software engineering. In: ESEM 2011, pp. 275–284. IEEE (2011)
Miles, M.B., Huberman, A.M.: Qualitative Data Analysis: An Expanded Sourcebook, vol. 2. Sage (1994)
Nelson, H.J., Poels, G., Genero, M., Piattini, M.: A conceptual modeling quality framework. Software Quality Journal 20(1), 201–228 (2012)
NVivo, QSR international (2010), http://www.qsrinternational.com/products_nvivo.aspx
Fettke, P., Loos, P., Zwicker, J.: Business Process Reference Models: Survey and Classification. In: Bussler, C.J., Haller, A. (eds.) BPM 2005. LNCS, vol. 3812, pp. 469–483. Springer, Heidelberg (2006)
Cloutier, R., Muller, G., Verma, D., Nilchiani, R., Hole, E., Bone, M.: The Concept of Reference Architectures. Systems Engineering 13(1), 14–27 (2010)
Patton, M.Q.: Enhancing the quality and credibility of qualitative analysis! Health Services Research 34 (5, pt. 2), 1189–1208 (1999)
Wand, Y., Weber, R.: An ontological model of an information system. IEEE Transactions on Software Engineering 16(11), 1282–1292 (1990a)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2013 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Cruzes, D.S., Vennesland, A., Natvig, M.K. (2013). Empirical Evaluation of the Quality of Conceptual Models Based on User Perceptions: A Case Study in the Transport Domain. In: Ng, W., Storey, V.C., Trujillo, J.C. (eds) Conceptual Modeling. ER 2013. Lecture Notes in Computer Science, vol 8217. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-41924-9_34
Download citation
DOI: https://doi.org/10.1007/978-3-642-41924-9_34
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-41923-2
Online ISBN: 978-3-642-41924-9
eBook Packages: Computer ScienceComputer Science (R0)