Work

Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis

Year: 2025

Type: conference-paper

Abstract: Personalized AI assistants, a hallmark of the human-like capabilities of Large Language Models (LLMs), are a challenging application that intertwines multiple problems in LLM research.Despite the growing interest in the development of personalized assistants, the lack of an open-source conversational dataset tailored for personalization remains a significant obstacle for researchers in the field.To address this research gap, we introduce HiCU-PID, a new benchmark to probe and unleash the potential of LLMs to deliver personalized responses.

Source: Annual Meeting of the Association for Computational Linguistics (ACL)

DOI: 10.18653/v1/2025.acl-long.504

Authors: Jisoo Mok, Ik-hwan Kim, Sangkwon Park, Sungroh Yoon

Institution: Seoul National University

Language: English

Topic: Speech and dialogue systems

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid