Work

Measuring non-native speakers' proficiency of English by using a test with automatically-generated fill-in-the-blank questions

Year: 2005

Type: conference-paper

Abstract: This paper proposes the automatic generation of Fill-in-the-Blank Questions (FBQs) together with testing based on Item Response Theory (IRT) to measure English proficiency. First, the proposal generates an FBQ from a given sentence in English. The position of a blank in the sentence is determined, and the word at that position is considered as the correct choice. The candidates for incorrect choices for the blank are hypothesized through a thesaurus. Then, each of the candidates is verified by using the Web. Finally, the blanked sentence, the correct choice and the incorrect choices surviving the verification are together laid out to form the FBQ. Second, the proficiency of non-native speakers who took the test consisting of such FBQs is estimated through IRT.

DOI: 10.3115/1609829.1609839

Authors: Eiichiro Sumita, Fumiaki Sugaya, Seiichi Yamamoto

Institutions: KDDI Research (Japan), Doshisha University

Language: English

Topic: Natural Language Processing Techniques

Subfield: Artificial Intelligence

Field: Computer Science

Domain: Physical Sciences

SDG: Quality education

Open Access status: gold

Funders: Ministry of Education, Culture, Sports, Science and Technology, Japan Society for the Promotion of Science

Award: Automatic Measuring of English Language Proficiency for Global Communications