[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
10.1145/3604915.3609498acmconferencesArticle/Chapter ViewAbstractPublication PagesrecsysConference Proceedingsconference-collections
tutorial

Recommenders In the wild - Practical Evaluation Methods

Published: 14 September 2023 Publication History

Abstract

The gap between training a recommender model and actually having a recommender system in production is a topic often neglected. A recommender system is far more than a model which produces good metrics in an offline evaluation. Specifically, the evaluation of various recommendation engines in production is often very different from offline evaluations on a laptop. This tutorial will go through many practical steps and focus on the development, evaluation and, in particular, metrics and A/B tests.

Cited By

View all
  • (2025)A survey on point-of-interest recommendations leveraging heterogeneous dataInformation Technology & Tourism10.1007/s40558-024-00301-3Online publication date: 4-Jan-2025
  • (2024)From Clicks to Carbon: The Environmental Toll of Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688074(580-590)Online publication date: 8-Oct-2024

Recommendations

Comments

Please enable JavaScript to view thecomments powered by Disqus.

Information & Contributors

Information

Published In

cover image ACM Conferences
RecSys '23: Proceedings of the 17th ACM Conference on Recommender Systems
September 2023
1406 pages
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2023

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. A/B testing
  2. Bayesian A/B testing
  3. Bayesian bandits
  4. Offline evaluation

Qualifiers

  • Tutorial
  • Research
  • Refereed limited

Conference

RecSys '23: Seventeenth ACM Conference on Recommender Systems
September 18 - 22, 2023
Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 254 of 1,295 submissions, 20%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)64
  • Downloads (Last 6 weeks)8
Reflects downloads up to 02 Mar 2025

Other Metrics

Citations

Cited By

View all
  • (2025)A survey on point-of-interest recommendations leveraging heterogeneous dataInformation Technology & Tourism10.1007/s40558-024-00301-3Online publication date: 4-Jan-2025
  • (2024)From Clicks to Carbon: The Environmental Toll of Recommender SystemsProceedings of the 18th ACM Conference on Recommender Systems10.1145/3640457.3688074(580-590)Online publication date: 8-Oct-2024

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media