Soylent
Top Cited Papers
Open Access
- 3 October 2010
- proceedings article
- Published by Association for Computing Machinery (ACM)
- p. 313-322
- https://doi.org/10.1145/1866029.1866078
Abstract
This paper introduces architectural and interaction patterns for integrating crowdsourced human contributions directly into user interfaces. We focus on writing and editing, com-plex endeavors that span many levels of conceptual and pragmatic activity. Authoring tools offer help with prag-matics, but for higher-level help, writers commonly turn to other people. We thus present Soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand. To improve worker quality, we introduce the Find-Fix-Verify crowd programming pat-tern, which splits tasks into a series of generation and re-view stages. Evaluation studies demonstrate the feasibility of crowdsourced editing and investigate questions of relia-bility, cost, wait time, and work time for edits.National Science Foundation (U.S.) (Grant No. IIS-0712793Keywords
This publication has 19 references indexed in Scilit:
- Who are the crowdworkers?Published by Association for Computing Machinery (ACM) ,2010
- Financial incentives and the "performance of crowds"Published by Association for Computing Machinery (ACM) ,2009
- Coordinating tasks on the commonsPublished by Association for Computing Machinery (ACM) ,2009
- MySongPublished by Association for Computing Machinery (ACM) ,2008
- Crowdsourcing user studies with Mechanical TurkPublished by Association for Computing Machinery (ACM) ,2008
- KoalaPublished by Association for Computing Machinery (ACM) ,2007
- Labeling images with a computer gamePublished by Association for Computing Machinery (ACM) ,2004
- Summarization beyond sentence extraction: A probabilistic approach to sentence compressionArtificial Intelligence, 2002
- Techniques for automatically correcting words in textACM Computing Surveys, 1992
- Awareness and coordination in shared workspacesPublished by Association for Computing Machinery (ACM) ,1992