Work

Do LLMs Memorize Recommendation Datasets? A Preliminary Study on MovieLens-1M

Year: 2025
Type: conference-paper
Abstract: Large Language Models (LLMs) have become increasingly central to recommendation scenarios due to their remarkable natural language understanding and generation capabilities. Although significant research has explored the use of LLMs for various recommendation tasks, little effort has been dedicated to verifying whether they have memorized public recommendation dataset as part of their training data. This is undesirable because memorization reduces the generalizability of research findings, as benchmarking on memorized datasets does not guarantee generalization to unseen datasets. Furthermore, memorization can amplify biases, for example, some popular items may be recommended more frequently than others.
Language: English
Open Access status: hybrid
OpenAlex ID: W4412377138
FWCI: 20.99
Cites: 19
Cited by: 18
Related to: 10