Work

Approximated Doubly Robust Search Relevance Estimation

Year: 2022
Type: conference-paper
Abstract: Extracting query-document relevance from the sparse, biased clickthrough log is among the most fundamental tasks in the web search system. Prior art mainly learns a relevance judgment model with semantic features of the query and document and ignores directly counterfactual relevance evaluation from the clicking log. Though the learned semantic matching models can provide relevance signals for tail queries as long as the semantic feature is available. However, such a paradigm lacks the capability to introspectively adjust the biased relevance estimation whenever it conflicts with massive implicit user feedback. The counterfactual evaluation methods, on the contrary, ensure unbiased relevance estimation with sufficient click information. However, they suffer from the sparse or even missing clicks caused by the long-tailed query distribution.
Institution: Baidu (China)
Language: English
Open Access status: green
OpenAlex ID: W4292217701
FWCI: 0.893
Cites: 53
Cited by: 4
Related to: 10