[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to main content
Springer Nature Link
Log in

A Toolkit to Enable the Design of Trustworthy AI

  • Conference paper
  • First Online:
HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 13095))

Included in the following conference series:

Abstract

Technological progress in artificial intelligence (AI) and machine learning (ML) has an enormous impact on our society, economy and environment. And although the urgent need for creating sustainable and ethical AI technology is admitted, there exists a lack of design tools and expertise to facilitate this advancement. This study investigates how to help designers design for the value of trust in AI systems. A literature review unveiled a myriad of ethical AI principles as well as gathered existing tools addressing the research area. Iterative reviews together with an expert on trust in technology evaluated these guidelines and a first iteration of the toolkit containing 28 design principles had been created. Through multiple participatory design workshops the next iteration of the toolkit was co-designed in collaboration with design professionals. The result is an iterated toolkit comprising 16 principles relevant in the design for trust in AI systems, and providing tool suggestions for each principle.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution

Subscribe and save

Springer+ Basic
£29.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
GBP 19.95
Price includes VAT (United Kingdom)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
GBP 71.50
Price includes VAT (United Kingdom)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
GBP 89.99
Price includes VAT (United Kingdom)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Pooley, L., Metcalfe, M.: We need to talk about A.I [Motion picture]. GFC Films (2020)

    Google Scholar 

  2. van den Hoven, J., Vermaas, P.E., van de Poel, I.: Design for values: an introduction. In: van den Hoven, J., Vermaas, P.E., van de Poel, I. (eds.) Handbook of Ethics, Values, and Technological Design, pp. 1–7. Springer, Dordrecht (2015). https://doi.org/10.1007/978-94-007-6970-0_40

    Chapter  Google Scholar 

  3. Dignum, V.: Ethics in artificial intelligence: introduction to the special issue. Ethics Inf. Technol. 20(1), 1–3 (2018). https://doi.org/10.1007/s10676-018-9450-z

    Article  MathSciNet  Google Scholar 

  4. Hagendorff, T.: The ethics of ai ethics: an evaluation of guidelines. Mind. Mach. 30(1), 99–120 (2020). https://doi.org/10.1007/s11023-020-09517-8

    Article  Google Scholar 

  5. Jobin, A., Ienca, M., Vayena, E.: Artificial Intelligence: the global landscape of ethics guidelines. ETH Zürich: Health Ethics & Policy Lab (2019)

    Google Scholar 

  6. Fjeld, J., Achten, N., Hilligoss, H., Nagy, A., Srikumar, M.: Principled artificial intelligence: mapping consensus in ethical and rights-based approaches to principles for AI. SSRN Electron. J. 1–68 (2020). https://doi.org/10.2139/ssrn.3518482

  7. Morley, J., Floridi, L., Kinsey, L., Elhalal, A.: From what to how: an initial review of publicly available AI ethics tools, methods and research to translate principles into practices. Sci. Eng. Ethics 26(4), 2141–2168 (2019). https://doi.org/10.1007/s11948-019-00165-5

    Article  Google Scholar 

  8. McNamara, A., Smith, J., Murphy-Hill, E.: Does ACM’s code of ethics change ethical decision making in software development? In: Proceedings of the 2018 26th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering, pp. 729–733 (2018). https://doi.org/10.1145/3236024.3264833

  9. Ryan, M., Stahl, B.C.: Artificial intelligence ethics guidelines for developers and users: clarifying their content and normative implications. J. Inf. Commun. Ethics Soc. 1–26 (2020). https://doi.org/10.1108/jices-12-2019-0138

  10. Coeckelbergh, M.: AI Ethics. MIT Press, Cambridge (2020)

    Book  Google Scholar 

  11. Boden, M.A.: Ai: Its Nature and Future. Oxford University Press. ProQuest Ebook Central (2016). http://ebookcentral.proquest.com/lib/cut-ebooks/detail.action?docID=4545415

  12. Zimmerman, J., Forlizzi, J., Evenson, S.: Research through design as a method for interaction design research in HCI. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 493–502 (2007). https://doi.org/10.1145/1240624.1240704

  13. Pärnpuu, M.: Designing for values: value elicitation toolkit (thesis). Tallinn University (2020). https://www.etis.ee/Portal/Mentorships/Display/f1774a45-1cd1-4712-853a-f7a10d3fd315

  14. Arksey, H., O’Malley, L.: Scoping studies: towards a methodological framework. Int. J. Soc. Res. Methodol. 8(1), 19–32 (2005)

    Article  Google Scholar 

  15. Colquhoun, H.L., et al.: Scoping reviews: time for clarity in definition, methods, and reporting. J. Clin. Epidemiol. 67(12), 1291–1294 (2014). https://doi.org/10.1016/j.jclinepi.2014.03.013

    Article  Google Scholar 

  16. Bostrom, N.: The ethics of artificial intelligence. In: Yudkowsky, E. (ed.) The Cambridge Handbook of Artificial Intelligence, pp. 316–334. Machine Intelligence Research Institute (2014). https://www.cambridge.org/core/product/identifier/CBO9781139046855A027/type/book_part

  17. Leslie, D.: Understanding artificial intelligence ethics and safety: a guide for the responsible design and implementation of AI systems in the public sector. The Alan Turing Institute (2019). https://doi.org/10.5281/zenodo.3240529

  18. Stone, P., et al.: Artificial Intelligence and Life in 2030. Stanford University, Stanford, CA (2016). http://ai100.stanford.edu/2016-report

  19. Gambelin, O.: Brave: what it means to be an AI Ethicist. AI Ethics 1(1), 87–91 (2020). https://doi.org/10.1007/s43681-020-00020-5

    Article  Google Scholar 

  20. Bietti, E.: From ethics washing to ethics bashing: a view on tech ethics from within moral philosophy. In: FAT* 2020: Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency, pp. 210–219 (2020). https://doi.org/10.1145/3351095.3372860

  21. van Wynsberghe, A., Robbins, S.: Ethicist as designer: a pragmatic approach to ethics in the lab. Sci. Eng. Ethics 20(4), 947–961 (2013). https://doi.org/10.1007/s11948-013-9498-4

    Article  Google Scholar 

  22. Hagerty, A., Rubinov, I.: Global AI ethics: a review of the social impacts and ethical implications of artificial intelligence, pp. 1–27 (2019). https://arxiv.org/abs/1907.07892

  23. High-Level Expert Group on Artificial Intelligence (AI-HLEG). Ethics Guidelines for Trustworthy AI. Brussels: European Commission (2019). https://ec.europa.eu/futurium/en/ai-alliance-consultation/

  24. Shneiderman, B.: Human-centered artificial intelligence: three fresh ideas. AIS Trans. Hum.-Comput. Interact. 109–124 (2020). https://doi.org/10.17705/1thci.00131

  25. Auernhammer, J.: Human-centered AI: the role of human-centered design research in the development of AI. In: DRS2020: Synergy, pp. 1–19 (2020). https://doi.org/10.21606/drs.2020.282

  26. Helsinki.fi. The Ethics of AI online course urges us to consider what technology should be used for. University of Helsinki (2020). https://www.helsinki.fi/en/news/data-science-news/the-ethics-of-ai-online-course-urges-us-to-consider-what-technology-should-be-used-for. Accessed 27 Nov 2020

  27. AI Ethics Impact Group. From Principles to Practice - An interdisciplinary framework to operationalise AI ethics. VDE Association for Electrical Electronic & Information Technologies e.V., Bertelsmann Stiftung, pp. 1–56 (2020)

    Google Scholar 

  28. Krafft, T.D., Zweig, K.A., König, P.D.: How to regulate algorithmic decision‐making: a framework of regulatory requirements for different applications. Regulat. Govern. 1–18 (2020). https://doi.org/10.1111/rego.12369

  29. Shneiderman, B.: Bridging the gap between ethics and practice: guidelines for reliable, safe, and trustworthy human-centered AI systems. ACM Trans. Interact. Intell. Syst. 10(4), 1–31 (2020). Article 26. https://doi.org/10.1145/3419764

  30. Floridi, L., et al.: AI4People—an ethical framework for a good AI society: opportunities, risks, principles, and recommendations. Mind. Mach. 28(4), 689–707 (2018). https://doi.org/10.1007/s11023-018-9482-5

    Article  Google Scholar 

  31. Glikson, E., Woolley, A.: Human trust in artificial intelligence: Review of empirical research. Academy of Management Annals (in press). The Academy of Management Annals (2020)

    Google Scholar 

  32. Xu, W.: Toward human-centered AI. Interactions 26(4), 42–46 (2019). https://doi.org/10.1145/3328485

    Article  Google Scholar 

  33. Ferrario, A., Loi, M., Viganò, E.: In AI we trust incrementally: a multi-layer model of trust to analyze human-artificial intelligence interactions. Philos. Technol. 33(3), 523–539 (2019). https://doi.org/10.1007/s13347-019-00378-3

    Article  Google Scholar 

  34. Thiebes, S., Lins, S., Sunyaev, A.: Trustworthy artificial intelligence. Electron. Mark. 31(2), 447–464 (2020). https://doi.org/10.1007/s12525-020-00441-4

    Article  Google Scholar 

  35. Rossi, F.: Building trust in artificial intelligence. J. Int. Aff. 72(127), 127–133 (2018)

    Google Scholar 

  36. Ryan, M.: In AI we trust: ethics, artificial intelligence, and reliability. Sci. Eng. Ethics 26(5), 2749–2767 (2020). https://doi.org/10.1007/s11948-020-00228-y

    Article  Google Scholar 

  37. Sutrop, M.: Should we trust artificial intelligence? TRAMES XXIII(4), 499–522 (2019). https://kirj.ee/public/trames_pdf/2019/issue_4/Trames-4-2019-499-522.pdf

  38. Design Council. The Design Process (2005). http://www.designcouncil.org.uk/designprocess

  39. Gulati, S., Sousa, S., Lamas, D.: Design, development and evaluation of a human-computer trust scale. Behav. Inf. Technol. 38(10), 1004–1015 (2019). https://doi.org/10.1080/0144929x.2019.1656779

    Article  Google Scholar 

  40. Floridi, L.: Translating principles into practices of digital ethics: five risks of being unethical. Philosophy & Technology 32(2), 185–193 (2019). https://doi.org/10.1007/s13347-019-00354-x

    Article  Google Scholar 

  41. Blackler, A., Swann, L., Chamorro-Koc, M., Mohotti, W.A., Balasubramaniam, T., Nayak, R.: Can we define design? Analyzing twenty years of debate on a large email discussion list. She Ji: J. Design Econ. Innov. 7(1), 41–70 (2021). https://doi.org/10.1016/j.sheji.2020.11.004

    Article  Google Scholar 

  42. Martin, B., Hanington, B.M.: Universal Methods of Design:100 Ways to Research Complex Problems, Develop Innovative Ideas, and Design Effective Solutions. Rockport Publishers, Beverly (2012)

    Google Scholar 

  43. Sanders, E.B.N., Stappers, P.J.: Co-creation and the new landscapes of design. CoDesign 4(1), 5–18 (2008). https://doi.org/10.1080/15710880701875068

    Article  Google Scholar 

  44. Stickdorn, M., Schneider, J.: This is Service Design Thinking: Basics, Tools, Cases. 1st edn. BIS Publishers Amsterdam (2012)

    Google Scholar 

  45. Sanders, E.B.N., Stappers, P.J.: Convivial Toolbox: Generative Research for the Front End of Design. BIS Publishers, Amsterdam (2016)

    Google Scholar 

  46. Sanders, E.B.N., Brandt, E., Binder, T.: A framework for organizing the tools and techniques of participatory design. In: Proceedings of the 11th Biennial Participatory Design Conference, pp. 195–198 (2010)

    Google Scholar 

  47. Gutman, J.: A means-end chain model based on consumer categorization processes. J. Mark. 46(2), 60–72 (1982). https://doi.org/10.1177/002224298204600207

    Article  Google Scholar 

  48. Nielsen, J.: Enhancing the explanatory power of usability heuristics. In: Proceedings of ACM CHI 1994 Conference, Boston, MA, 24–28 April 1994, pp. 152–158 (1994)

    Google Scholar 

  49. International Organization for Standardization. (2019). Ergonomics of human-system interaction—Part 210: Human-centred design for interactive systems (ISO Standard No. 9241-210). Retrieved from https://www.iso.org/obp/ui/#iso:std:iso:9241:-210:ed-2:v1:en

  50. Giaccardi, E., Redström, J.: Technology and more-than-human design. Des. Issues 36(4), 33–44 (2020). https://doi.org/10.1162/desi_a_00612

    Article  Google Scholar 

  51. Hair, J.F., Jr., Hult, G.T.M., Ringle, C., Sarstedt, M.: A Primer on Partial Least Squares Structural Equation Modeling (PLS-SEM). Sage Publications, Los Angeles (2016)

    MATH  Google Scholar 

  52. Lucero, A., Dalsgaard, P., Halskov, K., Buur, J.: Designing with cards. In: Markopoulos, P., Martens, J.-B., Malins, J., Coninx, K., Liapis, A. (eds.) Collaboration in Creative Design, pp. 75–95. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-29155-0_5

    Chapter  Google Scholar 

  53. Ideo.Com: AI & Ethics: Collaborative Activities for Designers, July 2019. https://www.ideo.com/post/ai-ethics-collaborative-activities-for-designers

  54. Hesketh, P.: Ethics kit in 2019 - ethics kit. Medium (2019). https://medium.com/ethics-kit/ethics-kit-in-2019-ba1bf483663

  55. Santa Clara University: An Ethical Toolkit for Engineering/Design Practice. Markkula Center for Applied Ethics (2018). https://www.scu.edu/ethics-in-technology-practice/ethical-toolkit/

  56. People + AI Research: People + AI Research (2017). https://pair.withgoogle.com/

  57. Ribeiro, M. T., Singh, S., Guestrin, C.: Why should i trust you? In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (2016). https://doi.org/10.1145/2939672.2939778

  58. Gipson, J.: Ethics for designers—the toolkit. ethics for designers (2017). https://www.ethicsfordesigners.com/tools

  59. Lane, G., Angus, A., Murdoch, A.: UnBias fairness toolkit (version 1). Zenodo (2018). https://doi.org/10.5281/zenodo.2667808

  60. High-Level Expert Group on Artificial Intelligence (AI-HLEG). Assessment List for Trustworthy Artificial Intelligence (ALTAI) for self-assessment. European Commission (2020)

    Google Scholar 

  61. Smith, C.J.: Designing trustworthy AI: a human-machine teaming framework to guide development, pp. 1–6 (2019). http://arxiv.org/abs/1910.03515

  62. Zhou, K.: DESIGN ETHICALLY (2021). https://www.designethically.com/toolkit

  63. Fleetwood, A., Unsworth, G., Tobia, T.: Product development with consequence scanning. TechTransformed, April 2019

    Google Scholar 

  64. Friedman, B., Hendry, D.G.: Value Sensitive Design: Shaping Technology with Moral Imagination. The MIT Press, Cambridge (2019). (Illustrated ed.)

    Google Scholar 

  65. Ballard, S., Chappell, K.M., Kennedy, K.: Judgment call the game. In: Proceedings of the 2019 on Designing Interactive Systems Conference, pp. 421–433 (2019). https://doi.org/10.1145/3322276.3323697

  66. The Open Data Institute: The Data Ethics Canvas – The ODI (2019)

    Google Scholar 

  67. Reijers, W., Lewis, D., Levacher, K., Calvo, A., Burburan, A., Mohri, F.: The ethics canvas. The Ethics Canvas (2017)

    Google Scholar 

  68. SRI International: Design for trust (2020)

    Google Scholar 

  69. The IEEE Global Initiative on Ethics of Autonomous and Intelligent Systems. Ethically Aligned Design: A Vision for Prioritizing Human Well-being with Autonomous and Intelligent Systems, First Edition. IEEE (2019)

    Google Scholar 

  70. Lockton, D., Harrison, D., Stanton, N.A.: Design with intent. Equifine (2010)

    Google Scholar 

Download references

Acknowledgment

This research was supported by AI-Mind “Intelligent digital tools for screening of brainconnectivity and dementia risk estimation in people affected by mild cognitive impairment”. Sónia Sousa. H2020 CORDIS No: 964220.

Author information

Authors and Affiliations

  1. Cyprus University of Technology, Archiepiskopou Kyprianou 30, 3036, Limassol, Cyprus

    Stefan Schmager

  2. Tallinn University, Narva mnt 25, 10120, Tallinn, Estonia

    Sonia Sousa

Authors
  1. Stefan Schmager
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sonia Sousa
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sonia Sousa .

Editor information

Editors and Affiliations

  1. University of Creteand Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Constantine Stephanidis

  2. The Open University of Japan, Chiba, Japan

    Masaaki Kurosu

  3. U.S. Army Research Laboratory, Aberdeen Proving Ground, MD, USA

    Jessie Y. C. Chen

  4. U.S. Army Combat Capabilities Development Command Soldier Center, Orlando, FL, USA

    Gino Fragomeni

  5. Smart Future Initiative, Frankfurt am Main, Hessen, Germany

    Norbert Streitz

  6. Faculty of Arts and Science, Kyushu University, Fukuoka, Japan

    Shin'ichi Konomi

  7. Siemens (United States), Princeton, NJ, USA

    Helmut Degen

  8. Foundation for Research and Technology – Hellas (FORTH), Heraklion, Crete, Greece

    Stavroula Ntoa

Appendix

Appendix

Table 2: Toolkit to enable the design of trustworthy AI
Full size table

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Schmager, S., Sousa, S. (2021). A Toolkit to Enable the Design of Trustworthy AI. In: Stephanidis, C., et al. HCI International 2021 - Late Breaking Papers: Multimodality, eXtended Reality, and Artificial Intelligence. HCII 2021. Lecture Notes in Computer Science(), vol 13095. Springer, Cham. https://doi.org/10.1007/978-3-030-90963-5_41

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-90963-5_41

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-90962-8

  • Online ISBN: 978-3-030-90963-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation