More Web Proxy on the site http://driver.im/

research-article

Fair ranking: a critical review, challenges, and future directions

Authors:

Gourab K. Patro,

Lorenzo Porcaro,

Laura Mitchell,

Nikhil GargAuthors Info & Claims

FAccT '22: Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency

Pages 1929 - 1942

https://doi.org/10.1145/3531146.3533238

Published: 20 June 2022 Publication History

Abstract

Ranking, recommendation, and retrieval systems are widely used in online platforms and other societal systems, including e-commerce, media-streaming, admissions, gig platforms, and hiring. In the recent past, a large “fair ranking” research literature has been developed around making these systems fair to the individuals, providers, or content that are being ranked. Most of this literature defines fairness for a single instance of retrieval, or as a simple additive notion for multiple instances of retrievals over time. This work provides a critical overview of this literature, detailing the often context-specific concerns that such approaches miss: the gap between high ranking placements and true provider utility, spillovers and compounding effects over time, induced strategic incentives, and the effect of statistical uncertainty. We then provide a path forward for a more holistic and impact-oriented fair ranking research agenda, including methodological lessons from other fields and the role of the broader stakeholder community in overcoming data bottlenecks and designing effective regulatory environments.

References

[1]

Himan Abdollahpouri, Robin Burke, and Bamshad Mobasher. 2017. Controlling popularity bias in learning-to-rank recommendation. In Proceedings of the Eleventh ACM Conference on Recommender Systems. 42–46. https://doi.org/10.1145/3109859.3109912

Digital Library

[2]

Gediminas Adomavicius and Alexander Tuzhilin. 2005. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE transactions on knowledge and data engineering 17, 6(2005), 734–749. https://doi.org/10.1109/TKDE.2005.99

Digital Library

[3]

Aman Agarwal, Ivan Zaitsev, Xuanhui Wang, Cheng Li, Marc Najork, and Thorsten Joachims. 2019. Estimating position bias without intrusive interventions. In Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining. 474–482. https://doi.org/10.1145/3289600.3291017

Digital Library

[4]

McKane Andrus, Elena Spitzer, Jeffrey Brown, and Alice Xiang. 2021. What We Can’t Measure, We Can’t Understand: Challenges to Demographic Data Procurement in the Pursuit of Fairness. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. 249–260. https://doi.org/10.1145/3442188.3445888

Digital Library

[5]

Guy Aridor, Duarte Goncalves, and Shan Sikdar. 2020. Deconstructing the Filter Bubble: User Decision-Making and Recommender Systems. In RecSys 2020 - 14th ACM Conference on Recommender Systems. 82–91. https://doi.org/10.1145/3383313.3412246

Digital Library

[6]

Dan Ariely and Simon Jones. 2008. Predictably irrational. Harper Audio New York, NY.

[7]

Abolfazl Asudeh, H.V. Jagadish, Julia Stoyanovich, and Gautam Das. 2019. Designing fair ranking schemes. In Proceedings of the 2019 International Conference on Management of Data. 1259–1276. https://doi.org/10.1145/3299869.3300079

Digital Library

[8]

Ricardo Baeza-Yates. 2018. Bias on the web. Commun. ACM 61, 6 (2018), 54–61. https://doi.org/10.1145/3209581

Digital Library

[9]

Gal Bahar, Rann Smorodinsky, and Moshe Tennenholtz. 2016. Economic recommendation systems. In EC ’16: Proceedings of the 2016 ACM Conference on Economics and Computation. https://doi.org/10.1145/2940716.2940719

Digital Library

[10]

Eytan Bakshy, Itamar Rosenn, Cameron Marlow, and Lada Adamic. 2012. The role of social networks in information diffusion. In Proceedings of the 21st international conference on World Wide Web. 519–528. https://doi.org/10.1145/2187836.2187907

Digital Library

[11]

Ashmi Banerjee, Gourab K. Patro, Linus W. Dietz, and Abhijnan Chakraborty. 2020. Analyzing ‘Near Me’ Services: Potential for Exposure Bias in Location-based Retrieval. 2020 IEEE International Conference on Big Data (Big Data) (2020), 3642–3651. https://doi.org/10.1109/BigData50022.2020.9378476

[12]

Judit Bar-Ilan, Kevin Keenoy, Mark Levene, and Eti Yaari. 2009. Presentation bias is significant in determining user preference for search results—A user study. Journal of the American Society for Information Science and Technology 60, 1 (2009), 135–149. https://doi.org/10.1002/asi.20941

[13]

Omer Ben-Porat, Itay Rosenberg, and Moshe Tennenholtz. 2020. Content Provider Dynamics and Coordination in Recommendation Ecosystems. Advances in Neural Information Processing Systems 33 (2020).

[14]

Omer Ben-Porat and Moshe Tennenholtz. 2018. A game-theoretic approach to recommendation systems with strategic content providers. Advances in Neural Information Processing Systems 31 (2018).

[15]

Emily M. Bender, Angelina McMillan-Major, Timnit Gebru, and Shmargaret Shmitchell. 2021. On the dangers of stochastic parrots: can language models be too big?. In FAccT 2021 - Proceedings of the 2021 Conference on Fairness, Accountability, and Transparency, Vol. 1. 271–278. https://doi.org/10.1145/3442188.3445922

Digital Library

[16]

James Benhardus and Jugal Kalita. 2013. Streaming trend detection in Twitter. International Journal of Web Based Communities 9, 1(2013), 122–139. https://doi.org/10.1504/IJWBC.2013.051298

Digital Library

[17]

James Bennett, Stan Lanning, 2007. The netflix prize. In Proceedings of KDD cup and workshop, Vol. 2007. New York, NY, USA., 35.

[18]

Asia J Biega, Krishna P Gummadi, and Gerhard Weikum. 2018. Equity of attention: Amortizing individual fairness in rankings. In The 41st international ACM SIGIR Conference on Research and Development in Information Retrieval. 405–414. https://doi.org/10.1145/3209978.3210063

Digital Library

[19]

Asia J Biega, Peter Potash, Hal Daumé, Fernando Diaz, and Michèle Finck. 2020. Operationalizing the legal principle of data minimization for personalization. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 399–408. https://doi.org/10.1145/3397271.3401034

Digital Library

[20]

Anand V Bodapati. 2008. Recommendation systems with purchase data. Journal of marketing research 45, 1 (2008), 77–93.

[21]

Miranda Bogen, Aaron Rieke, and Shazeda Ahmed. 2020. Awareness in practice: tensions in access to sensitive attribute data for antidiscrimination. In Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. 492–500. https://doi.org/10.1145/3351095.3372877

Digital Library

[22]

Dimitrios Bountouridis, Jaron Harambam, Mykola Makhortykh, Mónica Marrero, Nava Tintarev, and Claudia Hauff. 2019. SIREN: A simulation framework for understanding the effects of recommender systems in online news environments. In FAT* 2019 - Proceedings of the 2019 Conference on Fairness, Accountability, and Transparency. 150–159. https://doi.org/10.1145/3287560.3287583

Digital Library

[23]

Amanda Bower, Hamid Eftekhari, Mikhail Yurochkin, and Yuekai Sun. 2021. Individually Fair Ranking. ICLR (2021).

[24]

Robin Burke. 2017. Multisided fairness for recommendation. arXiv preprint arXiv:1707.00093(2017).

[25]

William Cai, Johann Gaebler, Nikhil Garg, and Sharad Goel. 2020. Fair allocation through selective information acquisition. In Proceedings of the AAAI/ACM Conference on AI, Ethics, and Society. 22–28.

Digital Library

[26]

Colin F Camerer. 2003. Behavioural studies of strategic thinking in games. Trends in cognitive sciences 7, 5 (2003), 225–231.

[27]

Pedro G Campos, Fernando Díez, and Iván Cantador. 2014. Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols. User Modeling and User-Adapted Interaction 24, 1 (2014), 67–119.

Digital Library

[28]

Carlos Castillo. 2019. Fairness and transparency in ranking. In ACM SIGIR Forum, Vol. 52. ACM New York, NY, USA, 64–71.

[29]

L Elisa Celis, Damian Straszak, and Nisheeth K Vishnoi. 2018. Ranking with Fairness Constraints. In 45th International Colloquium on Automata, Languages, and Programming (ICALP 2018), Vol. 107. Schloss Dagstuhl–Leibniz-Zentrum fuer Informatik, 28.

[30]

Abhijnan Chakraborty, Saptarshi Ghosh, Niloy Ganguly, and Krishna P Gummadi. 2017. Optimizing the recency-relevancy trade-off in online news recommendations. In Proceedings of the 26th International Conference on World Wide Web. 837–846.

Digital Library

[31]

Abhijnan Chakraborty, Gourab K Patro, Niloy Ganguly, Krishna P Gummadi, and Patrick Loiseau. 2019. Equality of voice: Towards fair representation in crowdsourced top-k recommendations. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 129–138.

Digital Library

[32]

Praveen Chandar and Ben Carterette. 2018. Estimating clickthrough bias in the cascade model. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. 1587–1590.

Digital Library

[33]

Allison J B Chaney, Brandon M Stewart, and Barbara E Engelhardt. 2018. How Algorithmic Confounding in Recommendation Systems Increases Homogeneity and Decreases Utility. In RecSys ’18 Proceedings of the 12th ACM Conference on Recommender Systems. https://doi.org/10.1145/3240323.3240370 arXiv:1710.11214

Digital Library

[34]

Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. 2020. Bias and Debias in Recommender System: A Survey and Future Directions. arXiv preprint arXiv:2010.03240(2020).

[35]

European Commission. 2020. Guidelines on ranking transparency pursuant to Regulation (EU) 2019/1150 of the European Parliament and of the Council. Retrieved August 18, 2021 from https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52020XC1208(01)&rid=2

[36]

European Commission. 2021. Proposal for a Regulation laying down harmonised rules on artificial intelligence. Retrieved June 03, 2021 from https://digital-strategy.ec.europa.eu/en/library/proposal-regulation-laying-down-harmonised-rules-artificial-intelligence

[37]

Sam Corbett-Davies and Sharad Goel. 2018. The measure and mismeasure of fairness: A critical review of fair machine learning. arXiv preprint arXiv:1808.00023(2018).

[38]

Nick Craswell, Onno Zoeter, Michael Taylor, and Bill Ramsey. 2008. An experimental comparison of click position-bias models. In Proceedings of the 2008 international conference on web search and data mining. 87–94.

Digital Library

[39]

Paolo Cremonesi, Yehuda Koren, and Roberto Turrin. 2010. Performance of recommender algorithms on top-n recommendation tasks. In Proceedings of the fourth ACM conference on Recommender systems. 39–46.

Digital Library

[40]

Alexander D’Amour, Hansa Srinivasan, James Atwood, Pallavi Baljekar, D. Sculley, and Yoni Halpern. 2020. Fairness is not static: Deeper understanding of long term fairness via simulation studies. In FAT* 2020 - Proceedings of the 2020 Conference on Fairness, Accountability, and Transparency. 525–534. https://doi.org/10.1145/3351095.3372878

Digital Library

[41]

Abhisek Dash, Abhijnan Chakraborty, Saptarshi Ghosh, Animesh Mukherjee, and Krishna P Gummadi. 2021. When the Umpire is also a Player: Bias in Private Label Product Recommendations on E-commerce Marketplaces. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. 873–884.

Digital Library

[42]

Fernando Diaz, Bhaskar Mitra, Michael D Ekstrand, Asia J Biega, and Ben Carterette. 2020. Evaluating stochastic rankings with expected exposure. In Proceedings of the 29th ACM International Conference on Information & Knowledge Management. 275–284.

Digital Library

[43]

Virginie Do, Sam Corbett-Davies, Jamal Atif, and Nicolas Usunier. 2021. Two-sided fairness in rankings via Lorenz dominance. Advances in Neural Information Processing Systems 34 (2021).

[44]

Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012. Fairness through awareness. In Proceedings of the 3rd innovations in theoretical computer science conference. 214–226.

Digital Library

[45]

Benjamin Edelman, Michael Luca, and Dan Svirsky. 2017. Racial discrimination in the sharing economy: Evidence from a field experiment. American Economic Journal: Applied Economics 9, 2 (2017), 1–22.

[46]

Michael D. Ekstrand, Robin Burke, and Fernando Diaz. 2019. Fairness and Discrimination in Retrieval and Recommendation. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (Paris, France) (SIGIR’19). Association for Computing Machinery, New York, NY, USA, 1403–1404. https://doi.org/10.1145/3331184.3331380

Digital Library

[47]

Michael D Ekstrand, Mucun Tian, Ion Madrazo Azpiazu, Jennifer D Ekstrand, Oghenemaro Anuyah, David McNeill, and Maria Soledad Pera. 2018. All the cool kids, how do they fit in?: Popularity and demographic biases in recommender evaluation and effectiveness. In Conference on Fairness, Accountability and Transparency. PMLR, 172–186.

[48]

Vitalii Emelianov, Nicolas Gast, Krishna P Gummadi, and Patrick Loiseau. 2020. On fair selection in the presence of implicit variance. In Proceedings of the 21st ACM Conference on Economics and Computation. 649–675.

Digital Library

[49]

Ayman Farahat and Tarun Bhatia. 2016. App Installs on iOS and Android: Cross Platform Spillover. Available at SSRN 2759557(2016).

[50]

Mehrdad Farajtabar, Yichen Wang, Manuel Gomez-Rodriguez, Shuang Li, Hongyuan Zha, and Le Song. 2017. Coevolve: A joint point process model for information diffusion and network evolution. The Journal of Machine Learning Research 18, 1 (2017), 1305–1353.

Digital Library

[51]

Andres Ferraro, Dietmar Jannach, and Xavier Serra. 2020. Exploring Longitudinal Effects of Session-based Recommendations. In RecSys 2020 - 14th ACM Conference on Recommender Systems. 1–8. https://doi.org/10.1145/3383313.3412213 arXiv:2008.07226

Digital Library

[52]

Flavio Figueiredo, Jussara M Almeida, Marcos André Gonçalves, and Fabricio Benevenuto. 2014. On the dynamics of social media popularity: A YouTube case study. ACM Transactions on Internet Technology (TOIT) 14, 4 (2014), 1–23.

Digital Library

[53]

Jessie Finocchiaro, Roland Maio, Faidra Monachou, Gourab K Patro, Manish Raghavan, Ana-Andreea Stoica, and Stratis Tsirtsis. 2021. Bridging Machine Learning and Mechanism Design towards Algorithmic Fairness. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. 489–503.

Digital Library

[54]

Luke Fortney. 2022. Why Is Kellogg’s Diner Selling Food Under 18 Different Restaurant Names on Delivery Apps?Retrieved April 19, 2022 from https://ny.eater.com/2022/4/14/23016676/kelloggs-diner-ghost-kitchens-virtual-brands-williamsburg-nyc

[55]

Santo Fortunato, Alessandro Flammini, Filippo Menczer, and Alessandro Vespignani. 2006. Topical interests and the mitigation of search engine bias. Proceedings of the national academy of sciences 103, 34(2006), 12684–12689.

[56]

Sorelle A. Friedler, Carlos Scheidegger, and Suresh Venkatasubramanian. 2021. The (Im)possibility of Fairness: Different Value Systems Require Different Mechanisms For Fair Decision Making. Commun. ACM (2021).

Digital Library

[57]

Maik Fröbe, Jan Philipp Bittner, Martin Potthast, and Matthias Hagen. 2020. The effect of content-equivalent near-duplicates on the evaluation of search engines. In European Conference on Information Retrieval. Springer, 12–19.

Digital Library

[58]

FTC. 2019. H.R.2231 - Algorithmic Accountability Act of 2019. Retrieved August 18, 2021 from https://www.congress.gov/bill/116th-congress/house-bill/2231/text

[59]

Yongqing Gao, Guangda Huzhang, Weijie Shen, Yawen Liu, Wen-Ji Zhou, Qing Da, and Yang Yu. 2021. Imitate TheWorld: A Search Engine Simulation Platform. arXiv preprint arXiv:2107.07693(2021).

[60]

David García-Soriano and Francesco Bonchi. 2021. Maxmin-fair ranking: individual fairness under group-fairness constraints. In Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining. 436–446.

Digital Library

[61]

Nikhil Garg, Hannah Li, and Faidra Monachou. 2021. Standardized tests and affirmative action: The role of bias and variance. In Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency. 261–261.

Digital Library

[62]

Yingqiang Ge, Shuchang Liu, Ruoyuan Gao, Yikun Xian, Yunqi Li, Xiangyu Zhao, Changhua Pei, Fei Sun, Junfeng Ge, Wenwu Ou, 2021. Towards Long-term Fairness in Recommendation. WSDM (2021).

[63]

Timnit Gebru, Jamie Morgenstern, Briana Vecchione, Jennifer Wortman Vaughan, Hanna Wallach, Hal Daumé, and Kate Crawford. 2018. Datasheets for Datasets. (2018). https://doi.org/10.1145/3458723 arxiv:1803.09010

Digital Library

[64]

Sahin Cem Geyik, Stuart Ambler, and Krishnaram Kenthapadi. 2019. Fairness-aware ranking in search & recommendation systems with application to linkedin talent search. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2221–2231.

Digital Library

[65]

Avijit Ghosh, Ritam Dutt, and Christo Wilson. 2021. When Fair Ranking Meets Uncertain Inference. (2021).

[66]

Oana Goga, Giridhari Venkatadri, and Krishna P Gummadi. 2015. The doppelganger bot attack: Exploring identity impersonation in online social networks. In Proceedings of the 2015 internet measurement conference. 141–153.

Digital Library

[67]

Carlos A Gomez-Uribe and Neil Hunt. 2015. The netflix recommender system: Algorithms, business value, and innovation. ACM Transactions on Management Information Systems (TMIS) 6, 4(2015), 1–19.

Digital Library

[68]

Laura A Granka, Thorsten Joachims, and Geri Gay. 2004. Eye-tracking analysis of user behavior in WWW search. In Proceedings of the 27th annual international ACM SIGIR conference on Research and development in information retrieval. 478–479.

Digital Library

[69]

Bryan T Grenfell, Ottar N Bjørnstad, and Jens Kappey. 2001. Travelling waves and spatial hierarchies in measles epidemics. Nature 414, 6865 (2001), 716–723.

[70]

Ruocheng Guo, Lu Cheng, Jundong Li, P Richard Hahn, and Huan Liu. 2020. A survey of learning causality with data: Problems and methods. ACM Computing Surveys (CSUR) 53, 4 (2020), 1–37.

Digital Library

[71]

Wenshuo Guo, Karl Krauth, Michael Jordan, and Nikhil Garg. 2021. The Stereotyping Problem in Collaboratively Filtered Recommender Systems. In Equity and Access in Algorithms, Mechanisms, and Optimization. 1–10.

[72]

Kristina Halvorson and Melissa Rach. 2012. Content Strategy for the Web: Content Strategy Web _p2. New Riders.

[73]

Mark S Handcock and Krista J Gile. 2010. Modeling social networks from sampled data. The Annals of Applied Statistics 4, 1 (2010), 5.

[74]

Steve Hanneke, Wenjie Fu, and Eric P Xing. 2010. Discrete temporal models of social networks. Electronic journal of statistics 4 (2010), 585–605.

[75]

F Maxwell Harper and Joseph A Konstan. 2015. The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5, 4(2015), 1–19.

[76]

Naieme Hazrati, Mehdi Elahi, and Francesco Ricci. 2020. Simulating the Impact of Recommender Systems on the Evolution of Collective Users’ Choices. In Proceedings ofthe 31st ACM Conference on Hypertext and Social Media (HT’20). 207–212. https://doi.org/10.1145/3372923.3404812

Digital Library

[77]

Sherry He, Brett Hollenbeck, and Davide Proserpio. 2021. The market for fake reviews. Available at SSRN 3664992(2021).

[78]

Dustin Hillard, Stefan Schroedl, Eren Manavoglu, Hema Raghavan, and Chirs Leggetter. 2010. Improving ad relevance in sponsored search. In Proceedings of the third ACM international conference on Web search and data mining. 361–370.

Digital Library

[79]

Donna L Hoffman and Marek Fodor. 2010. Can you measure the ROI of your social media marketing?MIT Sloan management review 52, 1 (2010), 41.

[80]

Russell Holly. 2012. The Play Store. In Taking Your Android Tablets to the Max. Springer, 71–88.

[81]

Yujing Hu, Qing Da, Anxiang Zeng, Yang Yu, and Yinghui Xu. 2018. Reinforcement learning to rank in e-commerce search engine: Formalization, analysis, and application. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 368–377.

Digital Library

[82]

Dietmar Jannach and Christine Bauer. 2020. Escaping the McNamara Fallacy: Toward More Impactful Recommender Systems Research. AI Magazine 41, 4 (2020), 79–95. https://doi.org/10.1609/aimag.v41i4.5312

Digital Library

[83]

Bernard J Jansen and Paulo R Molina. 2006. The effectiveness of Web search engines for retrieving relevant ecommerce links. Information Processing & Management 42, 4 (2006), 1075–1098.

Digital Library

[84]

Kalervo Järvelin and Jaana Kekäläinen. 2002. Cumulated gain-based evaluation of IR techniques. ACM Transactions on Information Systems (TOIS) 20, 4 (2002), 422–446.

Digital Library

[85]

Kalervo Järvelin and Jaana Kekäläinen. 2017. IR evaluation methods for retrieving highly relevant documents. In ACM SIGIR Forum, Vol. 51. ACM New York, NY, USA, 243–250.

Digital Library

[86]

Thorsten Joachims, Laura Granka, Bing Pan, Helene Hembrooke, and Geri Gay. 2017. Accurately interpreting clickthrough data as implicit feedback. In ACM SIGIR Forum, Vol. 51. Acm New York, NY, USA, 4–11.

[87]

Thorsten Joachims, Adith Swaminathan, and Tobias Schnabel. 2017. Unbiased learning-to-rank with biased feedback. In Proceedings of the Tenth ACM International Conference on Web Search and Data Mining. 781–789.

Digital Library

[88]

Kwon Jung, Yoon C Cho, and Sun Lee. 2014. Online shoppers’ response to price comparison sites. Journal of Business Research 67, 10 (2014), 2079–2087.

[89]

Roger A Kerin, P Rajan Varadarajan, and Robert A Peterson. 1992. First-mover advantage: A synthesis, conceptual framework, and research propositions. Journal of marketing 56, 4 (1992), 33–52.

[90]

Bernard Koch, Alex Hanna, Emily Denton, and Jacob Foster. 2021. Reduced, Reused and Recycled: The Life of a Dataset in Machine Learning Research. In 35th Conference on Neural Information Processing Systems (NeurIPS 2021).

[91]

Karl Krauth, Sarah Dean, Alex Zhao, Wenshuo Guo, Mihaela Curmei, Benjamin Recht, and Michael I Jordan. 2020. Do Offline Metrics Predict Online Performance in Recommender Systems?arXiv preprint arXiv:2011.07931(2020).

[92]

Haris Krijestorac, Rajiv Garg, and Vijay Mahajan. 2020. Cross-platform spillover effects in consumption of viral content: A quasi-experimental analysis using synthetic controls. Information Systems Research 31, 2 (2020), 449–472.

Digital Library

[93]

Preethi Lahoti, Alex Beutel, Jilin Chen, Kang Lee, Flavien Prost, Nithum Thain, Xuezhi Wang, and Ed Chi. 2020. Fairness without Demographics through Adversarially Reweighted Learning. In 34th Conference on Neural Information Processing Systems. Curran Associates, Inc.

Digital Library

[94]

Shiyang Lai and Ningyuan Fan. 2021. Understanding the attenuation of the accommodation recommendation spillover effect in view of spatial distance. Journal of the Association for Information Science and Technology (2021).

[95]

Shyong K Lam and John Riedl. 2004. Shilling recommender systems for fun and profit. In Proceedings of the 13th international conference on World Wide Web. 393–402.

Digital Library

[96]

Julian Lamont and Christi Favor. 2017. Distributive Justice. In The Stanford Encyclopedia of Philosophy (winter 2017 ed.), Edward N. Zalta (Ed.). Metaphysics Research Lab, Stanford University.

[97]

Bo Li, Yining Wang, Aarti Singh, and Yevgeniy Vorobeychik. 2016. Data poisoning attacks on factorization-based collaborative filtering. arXiv preprint arXiv:1608.08182(2016).

[98]

Chen Liang, Zhan Shi, and TS Raghu. 2019. The spillover of spotlight: Platform recommendation in the mobile app market. Information Systems Research 30, 4 (2019), 1296–1318.

[99]

Lydia T Liu, Sarah Dean, Esther Rolf, Max Simchowitz, and Moritz Hardt. 2018. Delayed impact of fair machine learning. In International Conference on Machine Learning. PMLR, 3150–3158.

[100]

Lydia T Liu, Nikhil Garg, and Christian Borgs. 2021. Strategic ranking. arXiv preprint arXiv:2109.08240(2021).

[101]

Tie-Yan Liu. 2011. Learning to rank for information retrieval. (2011).

[102]

Zhi Liu and Nikhil Garg. 2021. Test-Optional Policies: Overcoming Strategic Behavior and Informational Gaps., Article 11 (2021), 13 pages. https://doi.org/10.1145/3465416.3483293

Digital Library

[103]

Zeyang Liu, Yiqun Liu, Ke Zhou, Min Zhang, and Shaoping Ma. 2015. Influence of vertical result in web search examination. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. 193–202.

Digital Library

[104]

Michael Luca. 2016. Reviews, reputation, and revenue: The case of Yelp. com. Com (March 15, 2016). Harvard Business School NOM Unit Working Paper12-016 (2016).

[105]

Michael Luca and Georgios Zervas. 2016. Fake it till you make it: Reputation, competition, and Yelp review fraud. Management Science 62, 12 (2016), 3412–3427.

Digital Library

[106]

Eli Lucherini, Matthew Sun, Amy Winecoff, and Arvind Narayanan. 2021. T-RECS: A simulation tool to study the societal impact of recommender systems. arXiv preprint arXiv:2107.08959(2021).

[107]

Masoud Mansoury, Himan Abdollahpouri, Mykola Pechenizkiy, Bamshad Mobasher, and Robin Burke. 2020. Feedback Loop and Bias Amplification in Recommender Systems. In CIKM’20: International Conference on Information and Knowledge Management. 2145–2148. https://doi.org/10.1145/3340531.3412152 arXiv:2007.13019

Digital Library

[108]

Brian McFee, Thierry Bertin-Mahieux, Daniel PW Ellis, and Gert RG Lanckriet. 2012. The million song dataset challenge. In Proceedings of the 21st International Conference on World Wide Web. 909–916.

Digital Library

[109]

James McInerney, Ehtsham Elahi, Justin Basilico, Yves Raimond, and Tony Jebara. 2021. Accordion: A trainable simulator forlong-term interactive systems. In RecSys 2021 - 15th ACM Conference on Recommender Systems. 102–113. https://doi.org/10.1145/3460231.3474259

Digital Library

[110]

Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2019. A survey on bias and fairness in machine learning. arXiv preprint arXiv:1908.09635(2019).

[111]

Rishabh Mehrotra, James McInerney, Hugues Bouchard, Mounia Lalmas, and Fernando Diaz. 2018. Towards a fair marketplace: Counterfactual evaluation of the trade-off between relevance, fairness & satisfaction in recommendation systems. In Proceedings of the 27th acm international conference on information and knowledge management. 2243–2251.

Digital Library

[112]

Ali Mesbah, Arie Van Deursen, and Stefan Lenselink. 2012. Crawling Ajax-based web applications through dynamic analysis of user interface state changes. ACM Transactions on the Web (TWEB) 6, 1 (2012), 1–30.

Digital Library

[113]

Jacob Metcalf, Emanuel Moss, Elizabeth Anne Watkins, Ranjit Singh, and Madeleine Clare Elish. 2021. Algorithmic Impact Assessments and Accountability: The Co-construction of Impacts. In FAccT 2021 - Proceedings of the 2021 Conference on Fairness, Accountability, and Transparency. 735–746.

Digital Library

[114]

Milagros Miceli, Tianling Yang, Laurens Naudts, Martin Schuessler, Diana Serbanescu, and Alex Hanna. 2021. Documenting computer vision datasets: An invitation to reflexive data practices. FAccT 2021 - Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency(2021), 161–172. https://doi.org/10.1145/3442188.3445880

Digital Library

[115]

Shira Mitchell, Eric Potash, Solon Barocas, Alexander D’Amour, and Kristian Lum. 2021. Algorithmic fairness: Choices, assumptions, and definitions. Annual Review of Statistics and Its Application 8 (2021), 141–163. https://doi.org/10.1146/annurev-statistics-042720-125902

[116]

Martin Mladenov, Elliot Creager, Omer Ben-Porat, Kevin Swersky, Richard Zemel, and Craig Boutilier. 2020. Optimizing long-term social welfare in recommender systems: A constrained matching approach. In International Conference on Machine Learning. PMLR, 6987–6998.

[117]

Martin Mladenov, Chih-Wei Hsu, Vihan Jain, Eugene Ie, Christopher Colby, Nicolas Mayoraz, Hubert Pham, Dustin Tran, Ivan Vendrov, and Craig Boutilier. 2021. RecSim NG: Toward Principled Uncertainty Modeling for Recommender Ecosystems. (2021). arxiv:2103.08057http://arxiv.org/abs/2103.08057

[118]

Wendy W Moe and Peter S Fader. 2004. Dynamic conversion behavior at e-commerce sites. Management Science 50, 3 (2004), 326–335.

Digital Library

[119]

Arash Molavi Kakhki, Chloe Kliman-Silver, and Alan Mislove. 2013. Iolaus: Securing online content rating systems. In Proceedings of the 22nd international conference on World Wide Web. 919–930.

Digital Library

[120]

Faidra Georgia Monachou and Itai Ashlagi. 2019. Discrimination in online markets: Effects of social bias on learning from reviews and policy design. Advances in Neural Information Processing Systems 32 (2019), 2145–2155.

[121]

Aadi Swadipto Mondal, Rakesh Bal, Sayan Sinha, and Gourab K Patro. 2021. Two-Sided Fairness in Non-Personalised Recommendations. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 35. 15851–15852.

[122]

Marco Morik, Ashudeep Singh, Jessica Hong, and Thorsten Joachims. 2020. Controlling fairness and bias in dynamic learning-to-rank. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval. 429–438.

Digital Library

[123]

Tien T. Nguyen, Pik-Mai Hui, F. Maxwell Harper, Loren Terveen, and Joseph A. Konstan. 2014. Exploring the Filter Bubble: The Effect of Using Recommender Systems on Content Diversity. In Proceedings of the 23rd international conference on World wide web - WWW ’14. 677–686.

Digital Library

[124]

NIST. 2004. TREC Data. https://trec.nist.gov/data.html. [Online; accessed May-2022].

[125]

Giorgio Maria Di Nunzio, Alessandro Fabris, Gianmaria Silvello, and Gian Antonio Susto. 2021. Incentives for Item Duplication Under Fair Ranking Policies. In International Workshop on Algorithmic Bias in Search and Recommendation. Springer, 64–77.

[126]

European Commission Independent High-Level Expert Group on Artificial Intelligence. 2019. Ethics Guidelines for Trustworthy AI. Retrieved August 10, 2021 from https://ec.europa.eu/newsroom/dae/document.cfm?doc_id=60419

[127]

Harrie Oosterhuis and Maarten de Rijke. 2018. Ranking for relevance and display preferences in complex presentation layouts. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval. 845–854.

Digital Library

[128]

Gourab K Patro, Arpita Biswas, Niloy Ganguly, Krishna P Gummadi, and Abhijnan Chakraborty. 2020. Fairrec: Two-sided fairness for personalized recommendations in two-sided platforms. In Proceedings of The Web Conference 2020. 1194–1204.

Digital Library

[129]

Gourab K Patro, Abhijnan Chakraborty, Ashmi Banerjee, and Niloy Ganguly. 2020. Towards safety and sustainability: Designing local recommendations for post-pandemic world. In Fourteenth ACM Conference on Recommender Systems. 358–367.

Digital Library

[130]

Gourab K Patro, Abhijnan Chakraborty, Niloy Ganguly, and Krishna Gummadi. 2020. Incremental fairness in two-sided market platforms: on smoothly updating recommendations. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 34. 181–188.

[131]

Michael J Pazzani and Daniel Billsus. 2007. Content-based recommendation systems. In The adaptive web. Springer, 325–341.

Digital Library

[132]

Edward L Platt, Rahul Bhargava, and Ethan Zuckerman. 2015. The international affiliation network of YouTube trends. In Ninth International AAAI Conference on Web and Social Media.

[133]

Pearl Pu, Li Chen, and Rong Hu. 2011. A user-centric evaluation framework for recommender systems. In Proceedings of the fifth ACM conference on Recommender systems. 157–164.

Digital Library

[134]

Kira Radinsky, Krysta M Svore, Susan T Dumais, Milad Shokouhi, Jaime Teevan, Alex Bocharov, and Eric Horvitz. 2013. Behavioral dynamics on the web: Learning, modeling, and prediction. ACM Transactions on Information Systems (TOIS) 31, 3 (2013), 1–37.

Digital Library

[135]

Nimrod Raifer, Fiana Raiber, Moshe Tennenholtz, and Oren Kurland. 2017. Information retrieval meets game theory: The ranking competition between documents’ authors. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. 465–474.

Digital Library

[136]

Manav Raj. 2021. Friends in High Places: Demand Spillovers and Competition on Digital Platforms. Available at SSRN 3843249(2021).

[137]

Dillon Reisman, Jason Schultz, Kate Crawford, and Meredith Whittaker. 2018. Algorithmic impact assessments: A practical framework for public agency accountability. AI Now InstituteApril(2018), 22. https://ainowinstitute.org/aiareport2018.pdf

[138]

Rejoiner. 2018. The Amazon Recommendations Secret to Selling More Online. (2018).

[139]

Marco Tulio Ribeiro, Anisio Lacerda, Edleno Silva, D E Moura, Edleno Silva De Moura, Itamar Hata, Adriano Veloso, and Nivio Zi. 2013. Multi-Objective Pareto-Efficient Approaches for Recommender Systems. ACM Trans. Intell. Syst. Technol 9, 1 (2013). https://doi.org/10.1145/2629350

Digital Library

[140]

Stephen E Robertson. 1977. The probability ranking principle in IR. Journal of documentation(1977).

[141]

David Rohde, Stephen Bonner, Travis Dunlop, Flavian Vasile, and Alexandros Karatzoglou. 2018. RecoGym: A Reinforcement Learning Environment for the problem of Product Recommendation in Online Advertising. (2018). arxiv:1808.00720http://arxiv.org/abs/1808.00720

[142]

Matthew J Salganik and Duncan J Watts. 2008. Leading the herd astray: An experimental study of self-fulfilling prophecies in an artificial cultural market. Social psychology quarterly 71, 4 (2008), 338–355.

[143]

Marlesson R. O. Santana, Luckeciano C. Melo, Fernando H. F. Camargo, Bruno Brandão, Anderson Soares, Renan M. Oliveira, and Sandor Caetano. 2020. MARS-Gym: A Gym framework to model, train, and evaluate Recommender Systems for Marketplaces. In 2020 International Conference on Data Mining Workshops (ICDMW). 189–197. https://doi.org/10.1109/ICDMW51313.2020.00035

[144]

Piotr Sapiezynski, Wesley Zeng, Ronald E Robertson, Alan Mislove, and Christo Wilson. 2019. Quantifying the Impact of User Attention on Fair Group Representation in Ranked Lists. In Companion Proceedings of The 2019 World Wide Web Conference. 553–562.

[145]

Murugesan Saravanakumar and T SuganthaLakshmi. 2012. Social media marketing. Life science journal 9, 4 (2012), 4444–4451.

[146]

Morgan Klaus Scheuerman, Alex Hanna, and Emily Denton. 2021. Do Datasets Have Politics? Disciplinary Values in Computer Vision Dataset Development. Proceedings of the ACM on Human-Computer Interaction 5, CSCW2(2021), 1–37. https://doi.org/10.1145/3476058 arxiv:2108.04308

Digital Library

[147]

Tobias Schnabel, Adith Swaminathan, Ashudeep Singh, Navin Chandak, and Thorsten Joachims. 2016. Recommendations as treatments: Debiasing learning and evaluation. In international conference on machine learning. PMLR, 1670–1679.

[148]

Andrew D. Selbst, Danah Boyd, Sorelle A. Friedler, Suresh Venkatasubramanian, and Janet Vertesi. 2018. Fairness and Abstraction in Sociotechnical Systems. In ACM Conference on Fairness, Accountability, and Transparency (FAccT), Vol. 1. 59–68. https://doi.org/10.1145/3287560.3287598

Digital Library

[149]

Amit Sharma, Jake M Hofman, and Duncan J Watts. 2015. Estimating the causal impact of recommendation systems from observational data. In Proceedings of the Sixteenth ACM Conference on Economics and Computation. 453–470.

Digital Library

[150]

Jing-Cheng Shi, Yang Yu, Qing Da, Shi-Yong Chen, and An-Xiang Zeng. 2019. Virtual-taobao: Virtualizing real-world online retail environment for reinforcement learning. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 4902–4909.

Digital Library

[151]

Ashudeep Singh and Thorsten Joachims. 2018. Fairness of exposure in rankings. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2219–2228.

Digital Library

[152]

Till Speicher, Hoda Heidari, Nina Grgic-Hlaca, Krishna P Gummadi, Adish Singla, Adrian Weller, and Muhammad Bilal Zafar. 2018. A unified approach to quantifying algorithmic unfairness: Measuring individual &group unfairness via inequality indices. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2239–2248.

Digital Library

[153]

Harald Steck. 2011. Item popularity and recommendation accuracy. In Proceedings of the fifth ACM conference on Recommender systems. 125–132.

Digital Library

[154]

Tom Sühr, Asia J Biega, Meike Zehlike, Krishna P Gummadi, and Abhijnan Chakraborty. 2019. Two-sided fairness for repeated matchings in two-sided markets: A case study of a ride-hailing platform. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 3082–3092.

Digital Library

[155]

Tom Sühr, Sophie Hilgard, and Himabindu Lakkaraju. 2020. Does Fair Ranking Improve Minority Outcomes? Understanding the Interplay of Human and Algorithmic Biases in Online Hiring. arXiv preprint arXiv:2012.00423(2020).

[156]

Özge Sürer, Robin Burke, and Edward C Malthouse. 2018. Multistakeholder recommendation with provider constraints. In Proceedings of the 12th ACM Conference on Recommender Systems. 54–62.

Digital Library

[157]

Moshe Tennenholtz and Oren Kurland. 2019. Rethinking search engines and recommendation systems: a game theoretic perspective. Commun. ACM 62, 12 (2019), 66–75.

Digital Library

[158]

TrustPilot. 2020. Action We Take. Retrieved January 10, 2022 from https://uk.legal.trustpilot.com/for-everyone/action-we-take

[159]

European Union. 2016. Data minimization principle. https://gdpr-info.eu/art-5-gdpr/. [Article 5(1)(c) of the GDPR and Article 4(1)(c) of Regulation (EU) 2018/1725].

[160]

Briana Vecchione, Solon Barocas, and Karen Levy. 2021. Algorithmic Auditing and Social Justice: Lessons from the History of Audit Studies. In Equity and Access in Algorithms, Mechanisms, and Optimization (EAAMO ’21), Vol. 1. Association for Computing Machinery, 1–14. https://doi.org/10.1145/3465416.3483294 arXiv:2109.06974

Digital Library

[161]

Patrick Vonderau. 2019. The Spotify effect: Digital distribution and financial growth. Television & New Media 20, 1 (2019), 3–19.

[162]

Ellen M Voorhees. 1999. The TREC-8 question answering track report. In Trec, Vol. 99. Citeseer, 77–82.

[163]

Ellen M Voorhees. 2000. Variations in relevance judgments and the measurement of retrieval effectiveness. Information processing & management 36, 5 (2000), 697–716.

[164]

Xuanhui Wang, Nadav Golbandi, Michael Bendersky, Donald Metzler, and Marc Najork. 2018. Position bias estimation for unbiased learning to rank in personal search. In Proceedings of the Eleventh ACM International Conference on Web Search and Data Mining. 610–618.

Digital Library

[165]

Yixin Wang, Dawen Liang, Laurent Charlin, and David M Blei. 2020. Causal inference for recommender systems. In Fourteenth ACM Conference on Recommender Systems. 426–431.

Digital Library

[166]

Yue Wang, Dawei Yin, Luo Jie, Pengyuan Wang, Makoto Yamada, Yi Chang, and Qiaozhu Mei. 2016. Beyond ranking: Optimizing whole-page presentation. In Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. 103–112.

Digital Library

[167]

Lin Xiao, Zhang Min, Zhang Yongfeng, Gu Zhaoquan, Liu Yiqun, and Ma Shaoping. 2017. Fairness-aware group recommendation with pareto-efficiency. In Proceedings of the eleventh ACM conference on recommender systems. 107–115.

Digital Library

[168]

Leyang Xue, Peng Zhang, and An Zeng. 2019. Enhancing the long-term performance of recommender system. Physica A: Statistical Mechanics and its Applications 531 (2019), 121731.

[169]

Tao Yang and Qingyao Ai. 2021. Maximizing Marginal Fairness for Dynamic Learning to Rank. In Proceedings of the Web Conference 2021. 137–145.

Digital Library

[170]

Liuyi Yao, Zhixuan Chu, Sheng Li, Yaliang Li, Jing Gao, and Aidong Zhang. 2021. A Survey on Causal Inference. ACM Transactions on Knowledge Discovery from Data (TKDD) 15, 5(2021), 1–46.

[171]

Sirui Yao, Yoni Halpern, Nithum Thain, Xuezhi Wang, Kang Lee, Flavien Prost, Ed H. Chi, Jilin Chen, and Alex Beutel. 2020. Measuring Recommender System Effects with Simulated Users. In Second Workshop on Fairness, Accountability, Transparency, Ethics and Society on the Web. arXiv:2101.04526http://arxiv.org/abs/2101.04526

[172]

Sirui Yao and Bert Huang. 2017. Beyond Parity: Fairness Objectives for Collaborative Filtering. Advances in Neural Information Processing Systems 30 (2017), 2921–2930.

[173]

YouTube. 2018. Preventing Harm to the Broader YouTube Community. Retrieved January 10, 2022 from https://blog.youtube/news-and-events/preventing-harm-to-broader-youtube/

[174]

Quan Yuan, Gao Cong, Zongyang Ma, Aixin Sun, and Nadia Magnenat Thalmann. 2013. Time-aware point-of-interest recommendation. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval. 363–372.

Digital Library

[175]

Yisong Yue, Rajan Patel, and Hein Roehrig. 2010. Beyond position bias: Examining result attractiveness as a source of presentation bias in clickthrough data. In Proceedings of the 19th international conference on World wide web. 1011–1018.

Digital Library

[176]

Meike Zehlike, Francesco Bonchi, Carlos Castillo, Sara Hajian, Mohamed Megahed, and Ricardo Baeza-Yates. 2017. Fa* ir: A fair top-k ranking algorithm. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1569–1578.

Digital Library

[177]

Meike Zehlike and Carlos Castillo. 2020. Reducing disparate exposure in ranking: A learning to rank approach. In Proceedings of The Web Conference 2020. 2849–2855.

Digital Library

[178]

Meike Zehlike, Tom Sühr, Ricardo Baeza-Yates, Francesco Bonchi, Carlos Castillo, and Sara Hajian. 2022. Fair Top-k Ranking with multiple protected groups. Information Processing & Management 59, 1 (2022), 102707.

Digital Library

[179]

Meike Zehlike, Ke Yang, and Julia Stoyanovich. 2021. Fairness in Ranking: A Survey. (2021), 39–4. arxiv:arXiv:2103.14000v1

[180]

Hengtong Zhang, Yaliang Li, Bolin Ding, and Jing Gao. 2020. Practical Data Poisoning Attack against Next-Item Recommendation. In Proceedings of The Web Conference 2020. 2458–2464.

Digital Library

[181]

Jingjing Zhang, Gediminas Adomavicius, Alok Gupta, and Wolfgang Ketter. 2020. Consumption and performance: Understanding longitudinal dynamics of recommender systems via an agent-based simulation framework. Information Systems Research 31, 1 (2020), 76–101. https://doi.org/10.1287/ISRE.2019.0876

Digital Library

[182]

Xueru Zhang, Mohammad Mahdi Khalili, and Mingyan Liu. 2020. Long-term impacts of fair machine learning. Ergonomics in Design 28, 3 (2020), 7–11.

Cited By

Aird AFarastu PSun JStefancová EAll CVoida AMattei NBurke R(2024)Dynamic Fairness-aware Recommendation Through Multi-agent Social ChoiceACM Transactions on Recommender Systems10.1145/36906533:2(1-35)Online publication date: 28-Sep-2024
https://dl.acm.org/doi/10.1145/3690653
Lee JHarvey EZhou JGarg NJoachims TKizilcec R(2024)Ending Affirmative Action Harms Diversity Without Improving Academic MeritProceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization10.1145/3689904.3694706(1-17)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3689904.3694706
Aird AŠtefancová EAll CVoida AHomola MMattei NBurke R(2024)Social Choice for Heterogeneous Fairness in RecommendationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3691706(1096-1101)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3640457.3691706
Show More Cited By

Index Terms

Fair ranking: a critical review, challenges, and future directions
1. Applied computing
2. Information systems
  1. Information retrieval
  2. Information systems applications

Index terms have been assigned to the content through auto-classification.

Recommendations

Re-ranking search results using query logs
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

This work addresses two common problems in search, frequently occurring with underspecified user queries: the top-ranked results for such queries may not contain documents relevant to the user's search intent, and fresh and relevant pages may not get ...
Controlling Fairness and Bias in Dynamic Learning-to-Rank
SIGIR '20: Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval

Rankings are the primary interface through which many online platforms match users to items (e.g. news, products, music, video). In these two-sided markets, not only the users draw utility from the rankings, but the rankings also determine the utility (...
Marginal-Certainty-Aware Fair Ranking Algorithm
WSDM '23: Proceedings of the Sixteenth ACM International Conference on Web Search and Data Mining

Ranking systems are ubiquitous in modern Internet services, including online marketplaces, social media, and search engines. Traditionally, ranking systems only focus on how to get better relevance estimation. When relevance estimation is available, they ...

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Other conferences

FAccT '22: Proceedings of the 2022 ACM Conference on Fairness, Accountability, and Transparency

June 2022

2351 pages

ISBN:9781450393522

DOI:10.1145/3531146

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

ACM: Association for Computing Machinery

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 June 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Conference

FAccT '22

Sponsor:

ACM

FAccT '22: 2022 ACM Conference on Fairness, Accountability, and Transparency

June 21 - 24, 2022

Seoul, Republic of Korea

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

27
Total Citations
View Citations
753
Total Downloads

Downloads (Last 12 months)271
Downloads (Last 6 weeks)33

Reflects downloads up to 14 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Aird AFarastu PSun JStefancová EAll CVoida AMattei NBurke R(2024)Dynamic Fairness-aware Recommendation Through Multi-agent Social ChoiceACM Transactions on Recommender Systems10.1145/36906533:2(1-35)Online publication date: 28-Sep-2024
https://dl.acm.org/doi/10.1145/3690653
Lee JHarvey EZhou JGarg NJoachims TKizilcec R(2024)Ending Affirmative Action Harms Diversity Without Improving Academic MeritProceedings of the 4th ACM Conference on Equity and Access in Algorithms, Mechanisms, and Optimization10.1145/3689904.3694706(1-17)Online publication date: 29-Oct-2024
https://dl.acm.org/doi/10.1145/3689904.3694706
Aird AŠtefancová EAll CVoida AHomola MMattei NBurke R(2024)Social Choice for Heterogeneous Fairness in RecommendationProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3691706(1096-1101)Online publication date: 8-Oct-2024
https://dl.acm.org/doi/10.1145/3640457.3691706
Cachel KRundensteiner E(2024)PreFAIR: Combining Partial Preferences for Fair Consensus Decision-makingProceedings of the 2024 ACM Conference on Fairness, Accountability, and Transparency10.1145/3630106.3658961(1133-1149)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3630106.3658961
Cachel KRundensteiner ESerra ESpezzano F(2024)Wise Fusion: Group Fairness Enhanced Rank FusionProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679649(163-174)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679649
Cachel KRundensteiner ESerra ESpezzano F(2024)FairRankTune: A Python Toolkit for Fair Ranking TasksProceedings of the 33rd ACM International Conference on Information and Knowledge Management10.1145/3627673.3679238(5195-5199)Online publication date: 21-Oct-2024
https://dl.acm.org/doi/10.1145/3627673.3679238
Rampisela TRuotsalo TMaistro MLioma CHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Can We Trust Recommender System Fairness Evaluation? The Role of Fairness and RelevanceProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657832(271-281)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657832
Xu CYe XWang WPang LXu JChua THui Yang GWang HHan SHauff CZuccon GZhang Y(2024)A Taxation Perspective for Fair Re-rankingProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657766(1494-1503)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657766
Porcaro LGómez ECastillo C(2024)Assessing the Impact of Music Recommendation Diversity on Listeners: A Longitudinal StudyACM Transactions on Recommender Systems10.1145/36084872:1(1-47)Online publication date: 7-Mar-2024
https://dl.acm.org/doi/10.1145/3608487
Peng KRaghavan MPierson EKleinberg JGarg NChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Reconciling the Accuracy-Diversity Trade-off in RecommendationsProceedings of the ACM Web Conference 202410.1145/3589334.3645625(1318-1329)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589334.3645625
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents