Benchmark Overview

BARS-CTR: An Open Benchmark for CTR Prediction https://openbenchmark.github.io/BARS/CTR

Click-through rate (CTR) prediction (or user response prediction in general) is an important task in the ranking phase of recommender systems. The BARS project aims to build an open benchmark for CTR prediction, which consists of:

• A curated list of CTR prediction models which have been tagged into different topics, such as feature-interactions, behavior-sequence-modeling, multi-task learning, cross-domain modeling, AutoML, etc.

• A collection of open datasets for CTR prediction research, and unique dataset IDs to track specific data splits of each dataset.

• An open-source library for CTR prediction with stunning features in configurablity, tunablity, and reproduciblity.

• The most comprehensive benchmarking results on tens of SOTA models and datasets. For each result, the detailed reproducing step is available along with the open-source benchmarking scripts.