General
-
One-time demographic questionnaire that we all have access to
Have Turkers take a fairly comprehensive demographic questionnaire once and consent to letting all future researchers see it. That way we don't need to ask them for their gender/age/income every time we survey them. Asking these things can activate psychological processes that can affect results (see: research on priming) so it would be great if we could ask them less frequently.
28 votes -
Allow users to sort their HITs
Currently HITs are in the order in which they were created. In order to facilitate easier navigation perhaps allow users to sort (1) alphabetically, (2) date created, (3) date completed, (4) latest activity (such as timed out, worker submission, etc.)
22 votes -
Edit survey landing page
I’d like to be able to edit the final html survey landing page:
1) its content. For example, before step “7. Approve”, there could be an overview page where it is possible to see and edit the final survey page (like we do on mturk). One may want to change the background color, how the title is displayed, font type and style, drop the TurkPrime logo, etc.
2) its “Frame Height” (Height in pixels of the frame your HIT will be displayed in to Workers. Adjust the height appropriately to minimize scrolling for Workers.). This can be edited in the…
21 votes -
Connect with Mturk account information on prior HITS and Worker IDs to facilitate exclusion
Currently, it is possible to exclude all workers who took a particular HIT by excluding that entire HIT ID, as long as the HIT was launched via TurkPrime. As many researchers flocking to TurkPrime have been using MTurk for years, it would be a huge benefit to be able to exclude HIT IDs retroactively, i.e., to be able to exclude an entire HIT that was originally launched via MTurk. Otherwise researchers are basically losing the capacity to capitalize on their cumulative use of Mturk when transferring to Turkprime.
18 votesThis feature request has been approved and work will commence on it shortly.
Thank you for your feedback and suggestions!
For now, you can create reusable worker groups and exclude and include lists by specifying the WorkerId’s that you wish to either exclude or target for your survey. You can copy the WorkerId’s from the MTurk generated CSV of any of your previous HITs
-
Add a feature to allow us to track emails to workers (e.g., a "sent" folder)
Notifying workers of studies and then sending reminders can help reduce attrition in longitudinal studies - so glad you have this feature available! Adding a feature that records our messages (e.g., a sent folder) can help researchers better manage this process (e.g., send enough messages without harassing participants; determine how many contacts are necessary to get good attrition rates). We can of course keep track of our participant contacts separately from TurkPrime (or include ourselves as workers to receive and save the emails), but including this feature in the system would be efficient. Thanks!
16 votes -
Enable reposting HITs individually due to rejections
Enable reposting HITs when workers are rejected, just like MTurk has, i.e. posting only one more HIT per rejection. This should probably by default exclude all Worker IDs that have already come in for that HIT.
12 votes -
8 votes
-
add a feature also excluding participants who have seen half the survey but not completed it.
As of now Turk Prime only excludes participants who complete the study but not those who did not complete the study but attempted bits of it. Technically, these participants have seen the study or survey protocol and if they attempt a similar study again, their responses would not be original and might be influenced by their participation before. Hence, it is important to exclude these participants.
8 votes -
Approve, reject, pay bonus using csv file
I’d like to approve/reject HITs, provide feedback in case of rejection, and pay bonuses using the csv output file - similarly to what we do in mturk, where we upload the csv output file to approve/reject and provide feedback, but here I would also add the option of paying bonuses.
8 votes -
Allow time restrictions on HITs
I really dislike the idea that some users are completing my HITS at 3 am in the morning. It's not representative of any actual behavior, and may lead to distorted data. Would it be possible to allow users to set restrictions on the time of day their HITs would be available for user?
6 votes -
Allow download .csv file of submitted HITs and codes
Allow downloading of .csv files including Worker (or Turk Prime) ID number, and secret key. It doesn't have to be uploadable to accept or reject like on MTurk, but to be able to tell the difference between the set of Worker IDs you got data from vs. the set of Worker IDs you got HITs submitted for is important.
5 votes -
Start at Dashboard
When you login to TurkPrime it would be more convenient for the default home page to be the Dashboard.
5 votes -
4 votes
-
automatically send an invitation to Part 2 of study upon completion of Part 1
I would like to be able to send a worker an invitation to Part 2 of a study immediately upon their completion of Part 1. I have been waiting until I am finished with collection and then sending a mass email, but I lose a lot of people this way.
4 votes -
..provide better invoices
The invoiced you provide cause problems for me to get my research reimbursed. I need clear succinct invoices that summarize all costs of one particular study with the following details:
- Costs per participant (INCLUDING TurkPrime fees, my dashboard only summarizes Amazon's costs)
- how I paid for them (my credit card transactions for both my MTurk and my TurkPrime account that was used for this study)
- When participants completed the study exactlyIf not all of these points can be summarized in one page (e.g., the credit card transactions), any summary that is better, more succinct, and better…
4 votes -
add microbatch calculator
you should add a batch calculator to estimate the time to run the entire study and to model how much time in between it could take.
3 votes -
Manage Workers - Show All Workers on One Page for Easier Management
I have list of MTurkers who failed the attention checks for my survey. Thus, I am looking to "Approve" all workers but only "Reject" (and send message to) those workers who failed the checks.
The issue is that the list of workers in TurkPrime under the "Review Workers" section spans over 10 pages (it was a survey with 300 participants). Thus, when I try to Ctrl + Find the ID of any one particular worker, I have to do this over 10 times (for each of the 10+ pages), and then go back to page 1 to do it all…
3 votes -
Allow researcher to email only included workers who have not completed the HIT
When emailing included workers, it would be nice if there is an option to only email workers that have not completed the HIT (or have, both options would be nice). I often want to send "reminder" emails to workers I've included in the HIT but have not completed it. Right now included worker emails go to all workers and it confuses the ones that already completed the survey.
3 votes -
Allow automatic restart
In some cases, such as a HIT which is limited to a certain group of workers (for instance - ones who took a previous HIT), the low flow of participants makes the survey appear as unpopular to workers, and is shoved to the bottom of their lists, which further reduces participation rate. The known cure against this is to restart the survey every once in a while, so it jumps back to the top of peoples list. It would be nice if instead of getting in every couple of hours to restart the survey so it doesn't die out -…
3 votes -
Add sort functions to the columns on the "review pending" workers screen (e.g., sort by worker ID)
I am manually approving payment and noticed that I cannot sort by worker ID on the "review pending" screen. This function would be extremely useful in identifying a number of participants that I need to reject from my study.
3 votes
- Don't see your idea?