This repository was archived by the owner on May 24, 2019. It is now read-only.
Support for Batches and ReviewPolicies
MTurkR v0.5.5
This release includes several smaller bug fixes and a few larger enhancements, described below.
- MTurkR finally supports MTurk ReviewPolicies, which allows the MTurk system to automatically approve, reject, and extend assignments for HITs based on either "known answers" in workers' responses or "plurality" agreement across multiple workers' responses. To achieve this,
GenerateReviewPolicyis removed in lieu of two new functions:GenerateHITReviewPolicyandGenerateAssignmentReviewPolicy, both of which have a simplified function API and include extensive examples in the documentation. The use ofCreateHITremains unchanged. - Additional support for working with "batches" created via the online Requester User Interface (RUI) has been added. Specifically,
HITStatus,ApproveAllAssignments,ChangeHITType,DisposeHIT,DisableHIT,ExpireHIT,ExtendHIT,GetAssignment,GetBonuses,SetHITAsReviewingnow include an optionalannotationargument that can be used to apply the function to all HITs of a given batch. For example, to add two assignments to every HIT in a batch, simply find the batch number from the RUI and pass it as follows:ExtendHIT(annotation = "BatchId:78382;", add.assignments = 2). - A substantial effort has been made to improve and expand documentation for the package. As part of this, examples in package documentation for all functions have been substantially expanded and checked for accuracy. And, the MTurkR wiki now includes numerous updated code examples, including full documentation for both the text-based
wizard.simpleand graphicalmturkr.wizardinteractive interfaces for MTurkR. - All functions should now return type-consistent responses. This replaces the previous behavior of returning
NULLon certain failures where dataframes have always been returned on successes.
See NEWS and GitHub commit logs for full details.