Work

Adaptive English Translation Parameter Tuning via Particle Swarm Optimization and Attention Mechanism

Year: 2025
Type: article
Abstract: This paper proposes an English Translation Model Parameter Adaptive Tuning Method Integrating Particle Swarm Optimization (PSO) and Attention Mechanism. We encode key Neural Machine Translation (NMT) hyperparameters as particles and employ a specialized fitness function that rewards both conventional translation metrics and attention alignment quality. Furthermore, a dynamic feedback multiplier modulates PSO velocity updates in real time, incentivizing hyperparameter adjustments when attention scores deviate from predefined thresholds. Experimental evaluations on both IWSLT En–De and WMT En–De datasets demonstrate the effectiveness of this method, yielding improvements in BLEU and ROUGE-L scores relative to standard baselines. Ablation studies further confirm that both the attention alignment term in the fitness function and the dynamic attention feedback are indispensable for achieving superior translation quality and more coherent attention patterns.
Author: Zhigao Wei
Institution: Xinxiang University
Language: English
Open Access status: hybrid
OpenAlex ID: W4409391640
FWCI: 1.224
Cites: 29
Cited by: 3
Related to: 10