Work

Balancing Privacy and Robustness in Prompt Learning for Large Language Models

Year: 2024
Type: article
Abstract: This paper tackles the critical issue of privacy in Natural Language Processing (NLP) systems that process sensitive data by introducing a novel framework combining differential privacy and adversarial training. The proposed solution ensures formal privacy guarantees by minimizing the influence of individual data points on the model’s behavior, effectively preventing information leakage. Simultaneously, adversarial training is applied to strengthen model robustness against privacy attacks by exposing it to adversarial examples during training. The framework is rigorously evaluated across various NLP tasks, demonstrating its capability to balance privacy preservation with high utility effectively. These results mark a significant advancement in developing secure and reliable NLP systems, particularly for applications requiring stringent data confidentiality, such as healthcare and finance.
Source: Mathematics
Language: English
Open Access status: gold
Estimated APC paid: $2,955
OpenAlex ID: W4403835813
FWCI: 0.442
Cites: 36
Cited by: 3
Related to: 10