[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3594536.3595155acmotherconferencesArticle/Chapter ViewAbstractPublication PagesicailConference Proceedingsconference-collections
research-article

On predicting and explaining asylum adjudication

Published: 07 September 2023 Publication History

Abstract

Asylum is a legal protection granted by a state to individuals who demonstrate a well-founded fear of persecution or who face real risk of being subjected to torture in their country. However, asylum adjudication often depends on the decision maker's subjective assessment of the applicant's credibility. To investigate potential sources of bias in asylum adjudication practices researchers have used statistics and machine learning models, finding significant sources of variation with respect to a number of extra-legal variables. In this paper, we analyse an original dataset of Danish asylum decisions from the Refugee Appeals Board to understand the variables that explain Danish Adjudication. We train a number of classifiers and, while all classifiers agree that candidate credibility is the single most important variable, we find that performance and variable importance change significantly depending on whether data imbalance and temporality are taken into account. We discuss the implications of our findings with respect to the theory and practice of predicting and explaining asylum adjudication.

References

[1]
Rembrant Aarts, Lennard van Wanrooij, Evert Bloemen, and Geert Smid. 2019. Expert medico-legal reports: The relationship between levels of consistency and judicial outcomes in asylum seekers in the Netherlands. Torture Journal 29, 1 (2019), 36--46.
[2]
Philip J. Boland. 1989. Majority Systems and the Condorcet Jury Theorem. Journal of the Royal Statistical Society. Series D (The Statistician) 38, 3 (1989), 181--189.
[3]
Daniel L Chen and Jess Eagel. 2017. Can machine learning help predict the outcome of asylum adjudications?. In Proceedings of the 16th edition of the International Conference on Articial Intelligence and Law. 237--240.
[4]
Innessa Colaiacovo. 2013. Not just the facts: Adjudicator bias and decisions of the Immigration and Refugee Board of Canada (2006-2011). Journal on Migration and Human Security 1, 4 (2013), 122--147.
[5]
Keyvan Dorostkar, Daniel Ghezelbash, and Shannon Walsh. 2022. A data driven approach to evaluating and improving judicial decision-making: Statistical analysis of the judicial review of refugee cases in Australia. UNIVERSITY OF NEW SOUTH WALES LAW JOURNAL 45, 3 (2022), 1085--1123.
[6]
Matt Dunn, Levent Sagun, Hale Şirin, and Daniel Chen. 2017. Early predictability of asylum court decisions. In Proceedings of the 16th edition of the International Conference on Articial Intelligence and Law. 233--236.
[7]
Mathilde Emeriau. 2021. Learning to be unbiased: Evidence from the French Asylum Office. American Journal of Political Science (2021).
[8]
Valeria Ferraris, Teresa Consoli, et al. 2022. Asylum adjudication system: A new frontier of legal culture. Oñati Socio-Legal Series 12, 6 (2022), 1417--1441.
[9]
William Hamilton Byrne, Thomas Gammeltoft-Hansen, Sebastiano Piccolo, Naja Holten MØller, Tijs Slaats, and Panagiota Katsikouli. 2023. Data-Driven Futures of International Refugee Law. Journal of Refugee Studies (02 2023).
[10]
Haibo He and Edwardo A Garcia. 2009. Learning from imbalanced data. IEEE Transactions on knowledge and data engineering 21, 9 (2009), 1263--1284.
[11]
Michael Kagan. 2003. Is truth in the eye of the beholder-objective credibility assessment in refugee status determination. Geo. Immigr. LJ 17 (2003), 367.
[12]
Panagiota Katsikouli, William H Byrne, Thomas Gammeltoft-Hansen, Anna Højberg Høgenhaug, Naja Holten Møller, Trine Rask Nielsen, Henrik Palmer Olsen, and Tijs Slaats. 2022. Machine Learning and Asylum Adjudications: From Analysis of Variations to Outcome Predictions. IEEE Access 10 (2022), 130955--130967.
[13]
Andreas Kirkedal, Barbara Plank, Leon Derczynski, and Natalie Schluter. 2019. The Lacunae of Danish Natural Language Processing. In Proceedings of the 22nd Nordic Conference on Computational Linguistics. Linköping University Electronic Press, Turku, Finland, 356--362.
[14]
Bartosz Krawczyk. 2016. Learning from imbalanced data: open challenges and future directions. Progress in Artificial Intelligence 5, 4 (2016), 221--232.
[15]
Fatma E Marouf. 2010. Implicit bias and immigration courts. New Eng. L. Rev. 45 (2010), 417.
[16]
David Matas. 1989. Fairness in refugee determination. Man. LJ 18 (1989), 71.
[17]
Jenni Millbank. 2003. Gender, sex and visibility in refugee claims on the basis of sexual orientation. Geo. Immigr. LJ 18 (2003), 71.
[18]
Edith Montgomery and Anders Foldspang. 2005. Predictors of the authorities' decision to grant asylum in Denmark. Journal of Refugee Studies 18, 4 (2005), 454--467.
[19]
H James Norton and George Divine. 2015. Simpson's paradox... and how to avoid it. Significance 12, 4 (2015), 40--43.
[20]
Jaya Ramji-Nogales, Andrew I Schoenholtz, and Philip G Schrag. 2007. Refugee roulette: Disparities in asylum adjudication. Stan. L. Rev. 60 (2007), 295.
[21]
Sean Rehaag. 2012. Judicial Review of Refugee Determinations: The Luck of the Draw? Queen's LJ 1 (2012), 1.
[22]
Sean Rehaag. 2017. I simply do not believe: A case study of credibility determinations in Canadian refugee adjudication. Windsor Rev. Legal & Soc. Issues 38 (2017), 38.
[23]
Galit Shmueli. 2010. To Explain or to Predict? Statist. Sci. 25, 3 (2010), 289--310.
[24]
Judith Spirig. 2018. Like cases alike or asylum lottery? Inconsistency in judicial decision making at the Swiss Federal Administrative Court. Ph. D. Dissertation. University of Zurich.

Cited By

View all
  • (2024)AI, Law and beyond. A transdisciplinary ecosystem for the future of AI & LawArtificial Intelligence and Law10.1007/s10506-024-09404-yOnline publication date: 16-May-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences
ICAIL '23: Proceedings of the Nineteenth International Conference on Artificial Intelligence and Law
June 2023
499 pages
ISBN:9798400701979
DOI:10.1145/3594536
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

  • IAAIL: Intl Asso for Artifical Intel & Law

In-Cooperation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 September 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Asylum adjudication
  2. Data Imbalance
  3. Explanatory Modelling
  4. Predictive Modelling

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

ICAIL 2023
Sponsor:
  • IAAIL

Acceptance Rates

Overall Acceptance Rate 69 of 169 submissions, 41%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)42
  • Downloads (Last 6 weeks)2
Reflects downloads up to 15 Jan 2025

Other Metrics

Citations

Cited By

View all
  • (2024)AI, Law and beyond. A transdisciplinary ecosystem for the future of AI & LawArtificial Intelligence and Law10.1007/s10506-024-09404-yOnline publication date: 16-May-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media