Work

Δ-OPE: Off-Policy Estimation with Pairs of Policies

Year: 2024
Type: conference-paper
Abstract: The off-policy paradigm casts recommendation as a counterfactual decision-making task, allowing practitioners to unbiasedly estimate online metrics using offline data. This leads to effective evaluation metrics, as well as learning procedures that directly optimise online success. Nevertheless, the high variance that comes with unbiasedness is typically the crux that complicates practical applications. An important insight is that the difference between policy values can often be estimated with significantly reduced variance, if said policies have positive covariance. This allows us to formulate a pairwise off-policy estimation task: Δ-OPE.
Language: English
Open Access status: bronze
OpenAlex ID: W4403222010
FWCI: 2.305
Cites: 33
Cited by: 6
Related to: 10