Work

Avoiding convergence in cooperative coevolution with novelty search

Year: 2014
Type: article
Abstract: Cooperative coevolution is an approach for evolving solu-tions composed of coadapted components. Previous research has shown, however, that cooperative coevolutionary algo-rithms are biased towards stability: they tend to converge prematurely to equilibrium states, instead of converging to optimal or near-optimal solutions. In single-population evo-lutionary algorithms, novelty search has been shown capa-ble of avoiding premature convergence to local optima — a pathology similar to convergence to equilibrium states. In this study, we demonstrate how novelty search can be applied to cooperative coevolution by proposing two new algorithms. The first algorithm promotes behavioural nov-elty at the team level (NS-T), while the second promotes novelty at the individual agent level (NS-I). The proposed algorithms are evaluated in two popular multiagent tasks: predator-prey pursuit and keepaway soccer. An analysis of the explored collaboration space shows that (i) fitness-based evolution tends to quickly converge to poor equilib-rium states, (ii) NS-I almost never reaches any equilibrium state due to constant change in the individual populations, while (iii) NS-T explores a variety of equilibrium states in each evolutionary run and thus significantly outperforms both fitness-based evolution and NS-I.
Language: English
Open Access status: green
OpenAlex ID: W2213389309
FWCI: 3.719
Cites: 27
Cited by: 30
Related to: 10