Work

QuixBugs: a multi-lingual program repair benchmark set based on the quixey challenge

Year: 2017

Type: conference-paper

Abstract: Recent years have seen an explosion of work in automated program repair. While previous work has focused exclusively on tools for single languages, recent work in multi-language transformation has opened the door for multi-language program repair tools. Evaluating the performance of such a tool requires having a benchmark set of similar buggy programs in different languages. We present QuixBugs, consisting of 40 programs translated to both Python and Java, each with a bug on a single line. The QuixBugs benchmark suite is based on problems from the Quixey Challenge, where programmers were given a short buggy program and 1 minute to fix the bug.

Source: ACM SIGPLAN International Conference on Systems, Programming, Languages, and Applications: Software for Humanity (SPLASH)

DOI: 10.1145/3135932.3135941

Authors: Derrick Lin, James Koppel, Angela Chen, Armando Solar-Lezama

Institutions: Massachusetts Institute of Technology, Google (United States)

Language: English

Topic: Software Testing and Debugging Techniques

Subfield: Software

Field: Computer Science

Domain: Physical Sciences

Open Access status: hybrid

Funder: National Science Foundation

Award: Graduate Research Fellowship Program