Work

TurKit: human computation algorithms on mechanical turk

Year: 2010

Type: conference-paper

Abstract: Mechanical Turk (MTurk) provides an on-demand source of human computation. This provides a tremendous opportunity to explore algorithms which incorporate human computation as a function call. However, various systems challenges make this difficult in practice, and most uses of MTurk post large numbers of independent tasks. TurKit is a toolkit for prototyping and exploring algorithmic human computation, while maintaining a straight-forward imperative programming style. We present the crash-and-rerun programming model that makes TurKit possible, along with a variety of applications for human computation algorithms. We also present case studies of TurKit used for real experiments across different fields.

Source: ACM Symposium on User Interface Software and Technology (UIST)

DOI: 10.1145/1866029.1866040

Authors: Greg Little, Lydia B. Chilton, Max Goldman, Robert C. Miller

Institutions: Massachusetts Institute of Technology, University of Washington

Language: English

Topic: Mobile Crowdsensing and Crowdsourcing

Subfield: Computer Science Applications

Field: Computer Science

Domain: Physical Sciences

Open Access status: green

Funder: National Science Foundation

Award: CAREER: End-user Programming for Web Automation and Visualization