More Web Proxy on the site http://driver.im/

research-article

AI systems and product liability

Author:

Georg BorgesAuthors Info & Claims

ICAIL '21: Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law

Pages 32 - 39

https://doi.org/10.1145/3462757.3466099

Published: 27 July 2021 Publication History

Abstract

The article examines whether the current product liability law provides an appropriate regulation for AI systems. This question, which is discussed at the example of the European Product Liability Directive, is of great practical importance in the current legal policy discussion on liability for AI systems.

This article demonstrates that in principle the liability requirements are also applicable to AI systems. If the conduct of an AI system is carefully distinguished from its properties, excessive liability can be avoided. To reverse the burden of proof in favour of the injured party in the case of faulty behaviour enables a liability regime that is fair to the interests at stake.

However, product liability law only applies if AI systems lead directly to personal injury or damage to property. Product liability law is not applicable insofar as AI systems indirectly lead to considerable disadvantages for the person concerned, in particular through assessments of persons. Protection against discrimination or otherwise unfair assessments by AI systems shall be effected by other legal instruments.

References

[1]

Virginia Foggo, John Villasenor, Pratyush Garg. 2021. Algorithms and Fairness, Ohio State Technology Law Journal 17(1), 123--188.

[2]

Federal Trade Commission (FTC). 2021. Aiming for truth, fairness, and equity in your company's use of AI, retrieved from https://www.ftc.gov/news-events/blogs/business-blog/2021/04/aiming-truth-fairness-equily-your-compa-nys-use-ai (accessed 17.5.2021).

[3]

Communication from the Commission to the European Parliament, the European Council, the Council, the European Economic and Social Committee and the Committee of the Regions, Artificial Intelligence for Europe, COM(2018) 237 final, 25.4.2018, https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52018DC0237 (accessed 17.5.2021).

[4]

For detailed information on the group see https://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.groupDetail&groupID=3591&news=1 (accessed 17.5.2021).

[5]

High-Level Expert Group on AI, Ethics Guidelines for Trustworthy Artificial Intelligence, retrieved form https://digital-strategy.ec.europa.eu/en/library/eth-ics-guidelines-trustworthy-ai (accessed 17.5.2021).

[6]

For detailed information on the group see https://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.groupDetail&groupID=359 (accessed 17.5.2021).

[7]

Proposal for a Regulation laying down harmonized rules on artificial intelligence (Artificial Intelligence Act), 21.4.2021, https://ec.europa.eu/news-room/dae/redirection/document/75788 (accessed 17.5.2021).

[8]

Report from the Expert Group on Liability and New Technologies - New Technologies Formation, Executive Summary, 3 f.; https://ec.europa.eu/transparency/regexpert/index.cfm?do=groupDetail.groupMeetingDoc&docid=36608 (accessed 17.5.2021).

[9]

Civil liability regime for artificial intelligence, European Parliament resolution of 20 October 2020 with recommendations to the Commission on a civil liability regime for artificial intelligence (2020/2014(INL)), retrieved from https://www.europarl.europa.eu/doceo/document/TA-9-2020-0276_EN.pdf (accessed 17.5.2021).

[10]

Proposal for a Regulation of the European Parliament and of the Council on liability for the operation of Artificial Intelligence-systems, (2020/2014(INL)), retrieved from https://www.europarl.europa.eu/doceo/document/TA-9-2020-0276_EN.pdf (accessed 17.5.2021).

[11]

ExamAI - Testing and Auditing of AI systems; retrieved from https://testing-ai.gi.de (accessed 17.5.2021).

[12]

Rasmus Adler, Jens Heidrich, Lisa Jöckel, Michael Kläs. 2020. Anwendungsszenarien: KI-Systeme in der Produktionsautomatisierung; retrieved from https://testing-ai.gi.de/fileadmin/GI/Projekte/KI_Testing_Auditing/Exa-mAI_Publikation_Anwendungsszenarien_KI_Industrie.pdf (accessed 17.5.2021).

[13]

National Transportation Safety Board (NTSB). 2018. Collision Between Vehicle Controlled by Developmental Automated Driving System and Pedestrian Tempe, Arizona, March 18, 2018 accident report, retrieved from https://www.ntsb.gov/investigations/AccidentReports/Reports/HAR1903.pdf (accessed 17.5.2021).

[14]

Julia Angwin, Jeff Larson, Surya Mattu and Lauren Kirchner. 2016. Machine Bias, ProPublica, May 23, 2016, retrieved from https://www.propublica.org/article/machine-bias-risk-assessments-in-criminal-sentencing (accessed 17.5.2021).

[15]

Anthony W. Flores, Kristin Bechtel, Christopher T. Lowenkamp. 2016. False Positives, False Negatives and False Anaylses: A Rejoinder to "Machine Bias: There's Software Used Across the Country to Predict Future Criminals. And It's Biased Against Blacks.", Federal Probation 80(2), 38--46.

[16]

Katharina Zweig, Marc Hauer, Franziska Raudonat. 2020. Anwendungsszenarien: KI-Systeme im Personal- und Talentmanagement, retrieved from https://testing-ai.gi.de/fileadmin/PR/Testing-AI/ExamAI_Publikation_Anwen-dungsszenarien_KI_HR.pdf (accessed 17.5.2021).

[17]

Steven Shavell. 2004. Foundations of Economic Analysis of Law. Cambridge, MA: Belknap Press.

[18]

Hans-Bernd Schäfer, Claus Ott. 2012. Lehrbuch der ökonomischen Analyse des Zivilrechts, Springer.

[19]

Petra Buck-Heeb, Andreas Dieckmann. 2020. in: Oppermann/Stender-Vorwachs (eds.), Autonomes Fahren, C.H. Beck, 2nd ed., Chap. 3.1.1.

[20]

Peter Kreutz. 2020. in: Oppermann/Stender-Vorwachs (eds.), Autonomes Fahren, C.H. Beck, 2nd ed., Ch. 3.1.2.

[21]

Geraint Howells. 1993. Comparative Product Liability, Dartmouth Publishing.

[22]

Greenman v. Yuba Power Products, Inc. (1963), 59 Cal. 2d 57.

[23]

Fairgrieve, Howells, Møgelvang-Hansen, Straetmans, Verhoevens, Machnikowski, Janssen, Schulze. 2016. Product Liability Directive. In Pjotr Machnikowski (Ed.), European Product Liability. An Analysis of the State of the Art in the Era of New Technologies, 17--111.

[24]

Matthias Reimann, M. 2015. Product liability. In M. Bussani & A. Sebok (eds.), Comparative Tort Law, 250 -- 279, Edward Elgar Publishing.

[25]

Council Directive of 25 July 1985 on the approximation of the laws, regulations and administrative provisions of the Member States concerning liability for defective products (85/374/EEC), O.J. 1985 No. L 210/9.

[26]

Astrid Seehafer, Joel Kohler. 2020. Künstliche Intelligenz: Updates für das Produkthaftungsrecht? Mögliche Anpassungen der europäischen Produkthaftungsrichtlinie für neue Technologien, EuZW 2020, 213--218.

[27]

Thomas Riehm. 2010. 25 Jahre Produkthaftungsrichtlinie - Ein Lehrstück zur Vollharmonisierung, EuZW 2010, 567--571.

[28]

Georg Borges. 2018. Rechtliche Rahmenbedingungen für autonome Systeme, NJW 2018, 977--982.

[29]

Georg Borges. 2021. in: Borges/Hilber (Eds.), Beck'scher Online-Kommentar IT-Recht, § 1 ProdHaftG.

[30]

Gerhard Wagner. 2020. in: Münchener Kommentar zum BGB, 8th ed., § 4 ProdHaftG.

[31]

Georg Borges. 2020. Kann ein Gegenstand nicht Sache und doch Sache sein?. Computerprogramme im Privatrecht, in: Omlor (ed.), Weltbürgerliches Recht, Festschrift für Michael Martinek zum 70. Geburtstag, 45--58, C.H. Beck.

[32]

OLG Hamm NJW-RR 2012, 355.

[33]

Erwin Deutsch. 1989. Der Schutzbereich der Produzentenhaftung nach dem BGB und dem PHG, JZ 1989, 465--470.

[34]

Gerhard Wagner. 2020. in: Münchener Kommentar zum BGB, 8th ed., § 1 ProdHaftG.

[35]

Ulrich Berz, Eva Dedy, Claudia Granich. 2000. Haftungsfragen bei dem Einsatz von Telematik-Systemen im Straßenverkehr, DAR 2000, 545--554.

[36]

Volker Jänich, Paul Schrader, Vivian Reck. 2015. Rechtsprobleme des autonomen Fahrens, NZV 2015, 313--318.

[37]

Paul Schrader. 2015. Haftungsrechtlicher Begriff des Fahrzeugführers bei zunehmender Automatisierung von Kraftfahrzeugen, NJW 2015, 3537--3542.

[38]

Bundesgerichtshof [German Federal Supreme Court], GRUR 1985, 1041.

[39]

Helmut Redeker. 2017. IT-Recht, 6th ed., C.H.Beck.

[40]

Philipp Reusch. 2020. In Kaulartz/Braegelmann (eds.), Rechtshandbuch Artificial Intelligence und Machine Learning, Chap. 4.1, C.H.Beck.

[41]

Friedrich-Wilhelm Engel. 1986. Produzentenhaftung für Software, CR 1986, 702--708.

[42]

Gerhard Wagner. 2017. Produkthaftung für autonome Systeme, AcP 2017(6), 707--765.

[43]

Georg Borges. 2021. in: Borges/Hilber (eds.), Beck'scher Online-Kommentar IT-Recht, § 2 ProdHaftG.

[44]

Ulrich Magnus. 2017. In Machnikowski (ed.), European Product Liability. Intersentia.

[45]

Thomas Schulz. 2015. Verantwortlichkeit bei autonom agierenden Systemen. Nomos.

[46]

Hans Steege. 2021. Auswirkungen von künstlicher Intelligenz auf die Produzentenhaftung in Verkehr und Mobilität. Zum Thema des Plenarvortrags auf dem 59. Deutschen Verkehrsgerichtstag, NZV 2021, 6--13.

[47]

Chris Reed, Elizabeth Kennedy, Sara Silva. 2016. Responsibility, Autonomy and Accountability: Legal Liability for Machine Learning, Queen Mary University of London Legal Studies Research Paper No. 243/2016.

[48]

Georg Borges. 2016. Haftung für selbstfahrende Autos. Warum eine Kausalhaftung für selbstfahrende Autos gesetzlich geregelt werden sollte, CR 2016, 272--280.

[49]

Sabine Gless, Ruth Janal. 2016. Hochautomatisiertes und autonomes Autofahren - Risiko und rechtliche Verantwortung, JR 2016, 561--575.,

[50]

Herbert Zech. 2019. Künstliche Intelligenz und Haftungsfragen, ZfPW 2019, 198--219.

[51]

Christian Gomille. 2016. Herstellerhaftung für automatisierte Fahrzeuge, JZ 2016, 76--82.

[52]

Geoffrey Hazard, Michele Taruffo. 1993. American Civil Procedure. Yale University Press.

[53]

Mario Martini. 2019. Blackbox Algorithmus - Grundfragen einer Regulierung Künstlicher Intelligenz. Springer.

Cited By

van Staalduinen J(2024)European Product Liability for AI-based Clinical Decision Support SystemsDigital Governance10.1007/978-94-6265-639-0_2(15-40)Online publication date: 17-Dec-2024
https://doi.org/10.1007/978-94-6265-639-0_2
Onitiu DYazdanpanah VChapman AGerding EMid-dleton SWilliams J(2024)On the Legal Aspects of Responsible AI: Adaptive Change, Human Oversight, and Societal OutcomesAI for People, Democratizing AI10.1007/978-3-031-71304-0_6(73-85)Online publication date: 3-Oct-2024
https://doi.org/10.1007/978-3-031-71304-0_6
Landini SLa Fata F(2023)Automated Vehicles, Liability, and InsuranceThe Regulation of Automated and Autonomous Transport10.1007/978-3-031-32356-0_9(311-335)Online publication date: 13-Aug-2023
https://doi.org/10.1007/978-3-031-32356-0_9
Show More Cited By

Index Terms

AI systems and product liability
1. Applied computing
  1. Law, social and behavioral sciences
    1. Law

Recommendations

Liability for Autonomous Agent Design

Though exciting scientifically, autonomous agent design can result in legal liability. This paper surveys those legal concerns, focusing on issues arising from the unique qualities of agents not found in conventional software. Informed designers can ...
AI Opacity and Explainability in Tort Litigation
FAccT '22: Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency

A spate of recent accidents and a lawsuit involving Tesla's ‘self-driving’ cars highlights the growing need for meaningful accountability when harms are caused by AI systems. Tort (or civil liability) lawsuits are one important way for victims to redress ...
Liability for Crimes Involving Artificial Intelligence Systems

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences

ICAIL '21: Proceedings of the Eighteenth International Conference on Artificial Intelligence and Law

June 2021

319 pages

ISBN:9781450385268

DOI:10.1145/3462757

Conference Chair:
Juliano Maranhão
University of São Paulo, Brazil
,
Program Chair:
Adam Zachary Wyner
Swansea University, United Kingdom

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGAI: ACM Special Interest Group on Artificial Intelligence

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 July 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICAIL '21

Sponsor:

SIGAI

ICAIL '21: Eighteenth International Conference for Artificial Intelligence and Law

June 21 - 25, 2021

São Paulo, Brazil

Acceptance Rates

Overall Acceptance Rate 69 of 169 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
356
Total Downloads

Downloads (Last 12 months)54
Downloads (Last 6 weeks)12

Reflects downloads up to 03 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

van Staalduinen J(2024)European Product Liability for AI-based Clinical Decision Support SystemsDigital Governance10.1007/978-94-6265-639-0_2(15-40)Online publication date: 17-Dec-2024
https://doi.org/10.1007/978-94-6265-639-0_2
Onitiu DYazdanpanah VChapman AGerding EMid-dleton SWilliams J(2024)On the Legal Aspects of Responsible AI: Adaptive Change, Human Oversight, and Societal OutcomesAI for People, Democratizing AI10.1007/978-3-031-71304-0_6(73-85)Online publication date: 3-Oct-2024
https://doi.org/10.1007/978-3-031-71304-0_6
Landini SLa Fata F(2023)Automated Vehicles, Liability, and InsuranceThe Regulation of Automated and Autonomous Transport10.1007/978-3-031-32356-0_9(311-335)Online publication date: 13-Aug-2023
https://doi.org/10.1007/978-3-031-32356-0_9
Borges G(2022)Liability for Autonomous SystemsLaw and Technology in a Global Digital Society10.1007/978-3-030-90513-2_3(51-73)Online publication date: 7-May-2022
https://doi.org/10.1007/978-3-030-90513-2_3

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten