More Web Proxy on the site http://driver.im/

research-article

Operationalizing human values in software: a research roadmap

Authors:

Davoud Mougouei,

Jon WhittleAuthors Info & Claims

ESEC/FSE 2018: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

Pages 780 - 784

https://doi.org/10.1145/3236024.3264843

Published: 26 October 2018 Publication History

Abstract

Software influences several aspects of people's lives and therefore needs to reflect their values. However, existing software engineering methods fail to account for human values, which may result in breaching those values in software and, therefore, dissatisfaction of users and loss of profit and reputation. To avoid such negative consequences, human values need to be integrated -- in a verifiable way -- into software. We refer to this as Operationalizing Human Values in Software. But this is not easy to achieve due to three main obstacles: first, human values are hard to define in a way that can be put into practice; second, existing software design decisions are mainly ignorant of values; finally, values are hard to determine and quantify in software. This paper aims to establish a research roadmap for overcoming these obstacles. The proposed roadmap focuses on (i) establishing practical definitions for human values, (ii) integrating values into software design, and (iii) measuring values in the software development life cycle.

References

[1]

Huib Aldewereld, Virginia Dignum, and Yao-hua Tan. 2015. Design for values in software development. Handbook of Ethics, Values, and Technological Design: Sources, Theory, Values and Application Domains (2015), 831–845.

[2]

Julia Angwin, Jeff Larson, Lauren Kirchner, and Surya Mattu. 2016. Machine Bias. https://www.propublica.org/article/machine-bias-risk-assessmentsin-criminal-sentencing.

[3]

Pauline Anthonysamy, Phil Greenwood, and Awais Rashid. 2012. A method for analysing traceability between privacy policies and privacy controls of online social networks. In Annual Privacy Forum. Springer, 187–202.

Digital Library

[4]

Ken Barker, Mina Askari, Mishtu Banerjee, Kambiz Ghazinour, Brenan Mackas, Maryam Majedi, Sampson Pun, and Adepele Williams. 2009. A data privacy taxonomy. In British National Conference on Databases. Springer, 42–54.

Digital Library

[5]

Balbir Barn, Ravinder Barn, and Franco Raimondi. 2015. On the role of value sensitive concerns in software engineering practice. In Software Engineering (ICSE), 2015 IEEE/ACM 37th IEEE International Conference on, Vol. 2. IEEE, 497– 500.

Digital Library

[6]

Stefan Biffl, Aybuke Aurum, Barry Boehm, Hakan Erdogmus, and Paul Grünbacher. 2006. Value-based software engineering. Springer Science & Business Media.

Digital Library

[7]

Harry Chen. 2004. An intelligent broker architecture for pervasive context-aware systems. Ph.D. Dissertation. University of Maryland, Baltimore County.

[8]

Betty HC Cheng, Pete Sawyer, Nelly Bencomo, and Jon Whittle. 2009. A goalbased modeling approach to develop requirements of an adaptive system with environmental uncertainty. In International Conference on Model Driven Engineering Languages and Systems. Springer, 468–483.

Digital Library

[9]

Paresh Dave. 2018. Google bars uses of its artificial intelligence tech in weapons. https://www.reuters.com/article/us-alphabet-ai/google-bars-uses-ofits-artificial-intelligence-tech-in-weapons-idUSKCN1J32M7.

[10]

Christian Detweiler, Koen Hindriks, and Catholijn Jonker. 2011. Principles for Value-Sensitive Agent-Oriented Software Engineering. In Agent-Oriented Software Engineering XI, Danny Weyns and Marie-Pierre Gleizes (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 1–16.

Digital Library

[11]

Nick Doty and Mohit Gupta. 2013. Privacy Design Patterns and Anti-Patterns Patterns Misapplied and Unintended Consequences. Proceedings of the Ninth Symposium on Usable Privacy and Secu (2013), 1–5.

[12]

Golnaz Elahi and Eric Yu. 2007. A goal oriented approach for modeling and analyzing security trade-offs. In International Conference on Conceptual Modeling. Springer, 375–390.

Digital Library

[13]

Maria Angela Ferrario, Will Simm, Stephen Forshaw, Adrian Gradinar, Marcia Tavares Smith, and Ian Smith. 2016. Values-first SE: research principles in practice. In Proceedings of the 38th International Conference on Software Engineering Companion. ACM, 553–562.

Digital Library

[14]

Batya Friedman, David G Hendry, Alan Borning, et al. 2017. A survey of value sensitive design methods. Foundations and Trends® in Human–Computer Interaction 11, 2 (2017), 63–125.

Digital Library

[15]

Batya Friedman, Peter Kahn, and Alan Borning. 2002. Value sensitive design: Theory and methods. University of Washington technical report (2002), 02–12.

[16]

Batya Friedman, Peter H Kahn, Alan Borning, and Alina Huldtgren. 2013. Value sensitive design and information systems. In Early engagement and new technologies: Opening up the laboratory. Springer, 55–95.

[17]

Sainyam Galhotra, Yuriy Brun, and Alexandra Meliou. 2017. Fairness testing: testing software for discrimination. In Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering - ESEC/FSE 2017. ACM Press, New York, New York, USA, 498–510.

Digital Library

[18]

Preston Gralla. 2016. Amazon Prime and the racist algorithms. https://www.computerworld.com.au/article/599661/amazon-prime-racistalgorithms.

[19]

Daniel Graziotin, Xiaofeng Wang, and Pekka Abrahamsson. 2014. Happy software developers solve problems better: psychological measurements in empirical software engineering. PeerJ 2 (2014), e289.

[20]

Maaike Harbers, Christian Detweiler, and Mark A Neerincx. 2015. Embedding stakeholder values in the requirements engineering process. In International Working Conference on Requirements Engineering: Foundation for Software Quality. Springer, 318–332.

[21]

Michael Hecker, Tharam S Dillon, and Elizabeth Chang. 2008. Privacy ontology support for e-commerce. IEEE Internet Computing 12, 2 (2008).

Digital Library

[22]

Debra S Herrmann. 2007. Complete guide to security and privacy metrics: measuring regulatory compliance, operational resilience, and ROI. CRC Press.

Digital Library

[23]

Tim Holmes, Elena Blackmore, Richard Hawkins, and Tom Wakeford. 2011. The common cause handbook. Public Interest Research Centre (2011).

[24]

Waqar Hussain, Davoud Mougouei, and Jon Whittle. 2018. Integrating Social Values into Software Design Patterns. In Proceedings of the International Workshop on Software Fairness (FairWare ’18). ACM, New York, NY, USA, 8–14.

Digital Library

[25]

Sven H Koch, Rumyana Proynova, Barbara Paech, and Thomas Wetter. 2013. How to approximate users’ values while preserving privacy: experiences with using attitudes towards work tasks as proxies for personal value elicitation. Ethics and information technology 15, 1 (2013), 45–61.

Digital Library

[26]

Julia Kollewe. 2016. VW profits down 20 after diesel emissions scandal. https://www.theguardian.com/business/2016/may/31/vw-volkswagenprofits-down-20-diesel-emissions-scandal.

[27]

Patricia K Kuhl. 1994. Learning and representation in speech and language. Current opinion in neurobiology 4, 6 (1994), 812–822.

[28]

Sari Kujala and Kaisa Väänänen-Vainio-Mattila. 2008. value of information systems and products: understanding the users’ perspective and values. JITTA: Journal of Information Technology Theory and Application 9, 4 (2008), 23.

[29]

Davoud Mougouei. 2016. Factoring requirement dependencies in software requirement selection using graphs and integer programming. In Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering - ASE 2016. ACM Press, New York, New York, USA, 884–887.

Digital Library

[30]

Davoud Mougouei and David MW Powers. 2017. Modeling and Selection of Interdependent Software Requirements Using Fuzzy Graphs. International Journal of Fuzzy Systems 19, 6 (2017), 1812–1828.

[31]

Davoud Mougouei, David M. W. Powers, and Asghar Moeini. 2017. An Integer Linear Programming Model for Binary Knapsack Problem with Dependent Item Values. Springer, Cham, 144–154.

[32]

Davoud Mougouei, David M. W. Powers, and Asghar Moeini. 2017. Dependencyaware software release planning. In 2017 IEEE/ACM 39th International Conference on Software Engineering Companion (ICSE-C). IEEE, 198–200.

Digital Library

[33]

Alessandro Murgia, Parastou Tourani, Bram Adams, and Marco Ortu. 2014. Do developers feel emotions? an exploratory analysis of emotions in software artifacts. In Proceedings of the 11th working conference on mining software repositories. ACM, 262–271.

Digital Library

[34]

Gail C Murphy, David Notkin, and Kevin J. Sullivan. 2001. Software reflexion models: Bridging the gap between design and implementation. IEEE Transactions on Software Engineering 27, 4 (2001), 364–380.

Digital Library

[35]

Cliff Nass and Scott Brave. 2007. Emotion in human-computer interaction., 94–109 pages.

[36]

Justin Sablich. 2017. ’Price Gouging’ and Hurricane Irma: What Happened and What to Do. https://www.nytimes.com/2017/09/17/travel/price-gouginghurricane-irma-airlines.html.

[37]

Shalom H Schwartz. 2006. Les valeurs de base de la personne: théorie, mesures et applications. Revue française de sociologie 47, 4 (2006), 929–968.

[38]

Shalom H Schwartz. 2012. An overview of the Schwartz theory of basic values. Online readings in Psychology and Culture 2, 1 (2012), 11.

[39]

Shalom H Schwartz and Klaus Boehnke. 2004. Evaluating the structure of human values with confirmatory factor analysis. Journal of research in personality 38, 3 (2004), 230–255.

[40]

Fabrizio Sebastiani. 2002. Machine learning in automated text categorization. ACM computing surveys (CSUR) 34, 1 (2002), 1–47.

Digital Library

[41]

David Smith. 2018. https://www.theguardian.com/technology/2018/apr/11/ zuckerberg-hearing-facebook-tracking-questions-house-back-foot. Zuckerberg put on back foot as House grills Facebook CEO over user tracking.

[42]

Axel Van Lamsweerde. 2001. Goal-oriented requirements engineering: A guided tour. In Requirements Engineering, 2001. Proceedings. Fifth IEEE International Symposium on. IEEE, 249–262.

Digital Library

[43]

Wei Wang, Payam Mamaani Barnaghi, and Andrzej Bargiela. 2010. Probabilistic topic models for learning terminological ontologies. IEEE Transactions on Knowledge and Data Engineering 22, 7 (2010), 1028–1040.

Digital Library

Cited By

Baresi LCamilli MDolci TQuattrocchi GFilkov VRay BZhou M(2024)A Conceptual Framework for Quality Assurance of LLM-based Socio-critical SystemsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695306(2314-2318)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695306
Boltz NGetir Yaman SInverardi PDe Lemos RVan Landuyt DZisman ABaresi LMa XPasquale L(2024)Human empowerment in self-adaptive socio-technical systemsProceedings of the 19th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3643915.3644082(200-206)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643915.3644082
Dwivedi UElsayed-Ali SBonsignore EKacorri H(2024)Exploring AI Problem Formulation with Children via Teachable MachinesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642692(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642692
Show More Cited By

Index Terms

Operationalizing human values in software: a research roadmap
1. Software and its engineering

Recommendations

A study on the prevalence of human values in software engineering publications, 2015 -- 2018
ICSE '20: Proceedings of the ACM/IEEE 42nd International Conference on Software Engineering

Failure to account for human values in software (e.g., equality and fairness) can result in user dissatisfaction and negative socio-economic impact. Engineering these values in software, however, requires technical and methodological support throughout ...
Measuring human values in software engineering
ESEM '18: Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement

Background: Human values, such as prestige, social justice, and financial success, influence software production decision-making processes. While their subjectivity makes some values difficult to measure, their impact on software motivates our research. ...
Towards a Human Values Dashboard for Software Development: An Exploratory Study
ESEM '21: Proceedings of the 15th ACM / IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM)

Background: There is a growing awareness of the importance of human values (e.g., inclusiveness, privacy) in software systems. However, there are no practical tools to support the integration of human values during software development. We argue that a ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ESEC/FSE 2018: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering

October 2018

987 pages

ISBN:9781450355735

DOI:10.1145/3236024

General Chair:
Gary T. Leavens
University of Central Florida, USA
,
Program Chairs:
Alessandro Garcia
PUC-Rio, Brazil
,
Corina S. Păsăreanu
NASA Ames Research Center, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSOFT: ACM Special Interest Group on Software Engineering

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ESEC/FSE '18

Sponsor:

SIGSOFT

ESEC/FSE '18: 26th ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering

November 4 - 9, 2018

FL, Lake Buena Vista, USA

Acceptance Rates

Overall Acceptance Rate 112 of 543 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

49
Total Citations
View Citations
693
Total Downloads

Downloads (Last 12 months)73
Downloads (Last 6 weeks)6

Reflects downloads up to 21 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Baresi LCamilli MDolci TQuattrocchi GFilkov VRay BZhou M(2024)A Conceptual Framework for Quality Assurance of LLM-based Socio-critical SystemsProceedings of the 39th IEEE/ACM International Conference on Automated Software Engineering10.1145/3691620.3695306(2314-2318)Online publication date: 27-Oct-2024
https://dl.acm.org/doi/10.1145/3691620.3695306
Boltz NGetir Yaman SInverardi PDe Lemos RVan Landuyt DZisman ABaresi LMa XPasquale L(2024)Human empowerment in self-adaptive socio-technical systemsProceedings of the 19th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3643915.3644082(200-206)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643915.3644082
Dwivedi UElsayed-Ali SBonsignore EKacorri H(2024)Exploring AI Problem Formulation with Children via Teachable MachinesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642692(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642692
Shen YBreaux T(2024)Stakeholder Preference Extraction From ScenariosIEEE Transactions on Software Engineering10.1109/TSE.2023.333326550:1(69-84)Online publication date: Jan-2024
https://doi.org/10.1109/TSE.2023.3333265
Raatikainen PPekkola SMäkelä M(2023)Narrativization in Information Systems DevelopmentJournal of Database Management10.4018/JDM.33347135:1(1-30)Online publication date: 7-Nov-2023
https://dl.acm.org/doi/10.4018/JDM.333471
Ferrario MWinter E(2023)Applying Human Values Theory to Software Engineering Practice: Lessons and ImplicationsIEEE Transactions on Software Engineering10.1109/TSE.2022.317008749:3(973-990)Online publication date: 1-Mar-2023
https://doi.org/10.1109/TSE.2022.3170087
McIntosh PMueller IHussain W(2023)Human Values-Driven User Requirements with the ACT Matrix: An eExam Case Study2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)10.1109/REW57809.2023.00078(397-406)Online publication date: Sep-2023
https://doi.org/10.1109/REW57809.2023.00078
Kaur JMussbacher G(2023)Based on Past Experience: Highlighting Potential Human Value Issues in Domain Modelling2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)10.1109/REW57809.2023.00054(277-286)Online publication date: Sep-2023
https://doi.org/10.1109/REW57809.2023.00054
Shams RBano MZowghi DLu QWhittle J(2023)Human Value Requirements in AI Systems: Empirical Analysis of Amazon Alexa2023 IEEE 31st International Requirements Engineering Conference Workshops (REW)10.1109/REW57809.2023.00030(138-145)Online publication date: Sep-2023
https://doi.org/10.1109/REW57809.2023.00030
Marczak-Czajka ANabrzyski JCleland-Huang J(2023)Accountable Design for Individual, Societal, and Regulated Values in the UAV Domain2023 IEEE 31st International Requirements Engineering Conference (RE)10.1109/RE57278.2023.00037(287-292)Online publication date: Sep-2023
https://doi.org/10.1109/RE57278.2023.00037
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents