A Comparative Evaluation of Procedural Level Generators in the Mario AI Framework
Year: 2014
Type: conference-paper
Abstract: Evaluation is an open problem in procedural content generation research. The eld is now in a state where there is a glut of content generators, each serving di erent purposesand using a variety of techniques. It is difficult to understand, quantitatively or qualitatively, what makes one generator di erent from another in terms of its output. To remedy this, we have conducted a large-scale comparative evaluation of level generators for the Mario AI Benchmark, a research-friendly clone of the classic platform game Super Mario Bros. In all, we compare the output of seven different level generators from the literature, based on different algorithmic methods, plus the levels from the original Super Mario Bros game. To compare them, we have de ned six expressivity metrics, of which two are novel contributions in this paper. These metrics are shown to provide interestingly di erent characterizations of the level generators. The results presented in this paper, and the accompanying sourcecode, is meant to become a benchmark against which to test new level generators and expressivity metrics.
Language: English
Subfield: Artificial Intelligence
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W1541966139
