General

I suggest you ...

You've used all your votes and won't be able to post a new idea, but you can still search and comment on existing ideas.

There are two ways to get more votes:

  • When an admin closes an idea you've voted on, you'll get your votes back from that idea.
  • You can remove your votes from an open idea you support.
  • To see ideas you have already voted on, select the "My feedback" filter and select "My open ideas".
(thinking…)

Enter your idea and we'll search to see if someone has already suggested it.

If a similar idea already exists, you can support and comment on it.

If it doesn't exist, you can post your idea so others can support it.

Enter your idea and we'll search to see if someone has already suggested it.

  1. One-time demographic questionnaire that we all have access to

    Have Turkers take a fairly comprehensive demographic questionnaire once and consent to letting all future researchers see it. That way we don't need to ask them for their gender/age/income every time we survey them. Asking these things can activate psychological processes that can affect results (see: research on priming) so it would be great if we could ask them less frequently.

    28 votes
    Vote
    Sign in
    Check!
    (thinking…)
    Reset
    or sign in with
    • facebook
    • google
      Password icon
      I agree to the terms of service
      Signed in as (Sign out)
      You have left! (?) (thinking…)
      1 comment  ·  Admin →
    • Allow users to sort their HITs

      Currently HITs are in the order in which they were created. In order to facilitate easier navigation perhaps allow users to sort (1) alphabetically, (2) date created, (3) date completed, (4) latest activity (such as timed out, worker submission, etc.)

      22 votes
      Vote
      Sign in
      Check!
      (thinking…)
      Reset
      or sign in with
      • facebook
      • google
        Password icon
        I agree to the terms of service
        Signed in as (Sign out)
        You have left! (?) (thinking…)
      • Edit survey landing page

        I’d like to be able to edit the final html survey landing page:

        1) its content. For example, before step “7. Approve”, there could be an overview page where it is possible to see and edit the final survey page (like we do on mturk). One may want to change the background color, how the title is displayed, font type and style, drop the TurkPrime logo, etc.

        2) its “Frame Height” (Height in pixels of the frame your HIT will be displayed in to Workers. Adjust the height appropriately to minimize scrolling for Workers.). This can be edited in the…

        21 votes
        Vote
        Sign in
        Check!
        (thinking…)
        Reset
        or sign in with
        • facebook
        • google
          Password icon
          I agree to the terms of service
          Signed in as (Sign out)
          You have left! (?) (thinking…)
        • Connect with Mturk account information on prior HITS and Worker IDs to facilitate exclusion

          Currently, it is possible to exclude all workers who took a particular HIT by excluding that entire HIT ID, as long as the HIT was launched via TurkPrime. As many researchers flocking to TurkPrime have been using MTurk for years, it would be a huge benefit to be able to exclude HIT IDs retroactively, i.e., to be able to exclude an entire HIT that was originally launched via MTurk. Otherwise researchers are basically losing the capacity to capitalize on their cumulative use of Mturk when transferring to Turkprime.

          18 votes
          Vote
          Sign in
          Check!
          (thinking…)
          Reset
          or sign in with
          • facebook
          • google
            Password icon
            I agree to the terms of service
            Signed in as (Sign out)
            You have left! (?) (thinking…)
            1 comment  ·  Admin →

            This feature request has been approved and work will commence on it shortly.

            Thank you for your feedback and suggestions!

            For now, you can create reusable worker groups and exclude and include lists by specifying the WorkerId’s that you wish to either exclude or target for your survey. You can copy the WorkerId’s from the MTurk generated CSV of any of your previous HITs

          • Add a feature to allow us to track emails to workers (e.g., a "sent" folder)

            Notifying workers of studies and then sending reminders can help reduce attrition in longitudinal studies - so glad you have this feature available! Adding a feature that records our messages (e.g., a sent folder) can help researchers better manage this process (e.g., send enough messages without harassing participants; determine how many contacts are necessary to get good attrition rates). We can of course keep track of our participant contacts separately from TurkPrime (or include ourselves as workers to receive and save the emails), but including this feature in the system would be efficient. Thanks!

            15 votes
            Vote
            Sign in
            Check!
            (thinking…)
            Reset
            or sign in with
            • facebook
            • google
              Password icon
              I agree to the terms of service
              Signed in as (Sign out)
              You have left! (?) (thinking…)
            • Enable reposting HITs individually due to rejections

              Enable reposting HITs when workers are rejected, just like MTurk has, i.e. posting only one more HIT per rejection. This should probably by default exclude all Worker IDs that have already come in for that HIT.

              12 votes
              Vote
              Sign in
              Check!
              (thinking…)
              Reset
              or sign in with
              • facebook
              • google
                Password icon
                I agree to the terms of service
                Signed in as (Sign out)
                You have left! (?) (thinking…)
              • Support a Screener

                A screener which only allows qualified Workers as determined by passing some screning questions would be extremenly helpful in finding the workers who fit the survey needs of the Requesters.

                I would gladly pay for such a service

                12 votes
                Vote
                Sign in
                Check!
                (thinking…)
                Reset
                or sign in with
                • facebook
                • google
                  Password icon
                  I agree to the terms of service
                  Signed in as (Sign out)
                  You have left! (?) (thinking…)
                • 8 votes
                  Vote
                  Sign in
                  Check!
                  (thinking…)
                  Reset
                  or sign in with
                  • facebook
                  • google
                    Password icon
                    I agree to the terms of service
                    Signed in as (Sign out)
                    You have left! (?) (thinking…)
                  • add a feature also excluding participants who have seen half the survey but not completed it.

                    As of now Turk Prime only excludes participants who complete the study but not those who did not complete the study but attempted bits of it. Technically, these participants have seen the study or survey protocol and if they attempt a similar study again, their responses would not be original and might be influenced by their participation before. Hence, it is important to exclude these participants.

                    8 votes
                    Vote
                    Sign in
                    Check!
                    (thinking…)
                    Reset
                    or sign in with
                    • facebook
                    • google
                      Password icon
                      I agree to the terms of service
                      Signed in as (Sign out)
                      You have left! (?) (thinking…)
                    • Approve, reject, pay bonus using csv file

                      I’d like to approve/reject HITs, provide feedback in case of rejection, and pay bonuses using the csv output file - similarly to what we do in mturk, where we upload the csv output file to approve/reject and provide feedback, but here I would also add the option of paying bonuses.

                      8 votes
                      Vote
                      Sign in
                      Check!
                      (thinking…)
                      Reset
                      or sign in with
                      • facebook
                      • google
                        Password icon
                        I agree to the terms of service
                        Signed in as (Sign out)
                        You have left! (?) (thinking…)
                        started  ·  0 comments  ·  Admin →
                      • allow a permanent exclusion/ban list instead of manually needing to exclude specific user IDs each time.

                        Often there are participants who do not do my task correctly, who skip the task entirely, or who enter gibberish or other useless information. I notice that some users do this on many surveys. Because of ethics board and IRB requirements, I cannot withold payment for these participants. However, I would like to be able to exclude certain users from participating in my study by clicking a 'permanent ban' feature instead of having to manually update an exclusion list and enter it each time.

                        7 votes
                        Vote
                        Sign in
                        Check!
                        (thinking…)
                        Reset
                        or sign in with
                        • facebook
                        • google
                          Password icon
                          I agree to the terms of service
                          Signed in as (Sign out)
                          You have left! (?) (thinking…)
                        • Allow time restrictions on HITs

                          I really dislike the idea that some users are completing my HITS at 3 am in the morning. It's not representative of any actual behavior, and may lead to distorted data. Would it be possible to allow users to set restrictions on the time of day their HITs would be available for user?

                          6 votes
                          Vote
                          Sign in
                          Check!
                          (thinking…)
                          Reset
                          or sign in with
                          • facebook
                          • google
                            Password icon
                            I agree to the terms of service
                            Signed in as (Sign out)
                            You have left! (?) (thinking…)
                          • 4 votes
                            Vote
                            Sign in
                            Check!
                            (thinking…)
                            Reset
                            or sign in with
                            • facebook
                            • google
                              Password icon
                              I agree to the terms of service
                              Signed in as (Sign out)
                              You have left! (?) (thinking…)
                            • Allow download .csv file of submitted HITs and codes

                              Allow downloading of .csv files including Worker (or Turk Prime) ID number, and secret key. It doesn't have to be uploadable to accept or reject like on MTurk, but to be able to tell the difference between the set of Worker IDs you got data from vs. the set of Worker IDs you got HITs submitted for is important.

                              4 votes
                              Vote
                              Sign in
                              Check!
                              (thinking…)
                              Reset
                              or sign in with
                              • facebook
                              • google
                                Password icon
                                I agree to the terms of service
                                Signed in as (Sign out)
                                You have left! (?) (thinking…)
                                1 comment  ·  Admin →
                              • Start at Dashboard

                                When you login to TurkPrime it would be more convenient for the default home page to be the Dashboard.

                                4 votes
                                Vote
                                Sign in
                                Check!
                                (thinking…)
                                Reset
                                or sign in with
                                • facebook
                                • google
                                  Password icon
                                  I agree to the terms of service
                                  Signed in as (Sign out)
                                  You have left! (?) (thinking…)
                                • Add personality scales to MTurk panels, so researchers could study the relationship between these and various DVs by targeting the extremes.

                                  Add various personality traits and scales to MTurk panels, so researchers could study the relationship between these and various DVs by targeting the extremes of the scales. This could greatly increase power and make the process efficient, in times like these where much more power and significance are called upon.

                                  3 votes
                                  Vote
                                  Sign in
                                  Check!
                                  (thinking…)
                                  Reset
                                  or sign in with
                                  • facebook
                                  • google
                                    Password icon
                                    I agree to the terms of service
                                    Signed in as (Sign out)
                                    You have left! (?) (thinking…)
                                  • add microbatch calculator

                                    you should add a batch calculator to estimate the time to run the entire study and to model how much time in between it could take.

                                    3 votes
                                    Vote
                                    Sign in
                                    Check!
                                    (thinking…)
                                    Reset
                                    or sign in with
                                    • facebook
                                    • google
                                      Password icon
                                      I agree to the terms of service
                                      Signed in as (Sign out)
                                      You have left! (?) (thinking…)
                                    • Manage Workers - Show All Workers on One Page for Easier Management

                                      I have list of MTurkers who failed the attention checks for my survey. Thus, I am looking to "Approve" all workers but only "Reject" (and send message to) those workers who failed the checks.

                                      The issue is that the list of workers in TurkPrime under the "Review Workers" section spans over 10 pages (it was a survey with 300 participants). Thus, when I try to Ctrl + Find the ID of any one particular worker, I have to do this over 10 times (for each of the 10+ pages), and then go back to page 1 to do it all…

                                      3 votes
                                      Vote
                                      Sign in
                                      Check!
                                      (thinking…)
                                      Reset
                                      or sign in with
                                      • facebook
                                      • google
                                        Password icon
                                        I agree to the terms of service
                                        Signed in as (Sign out)
                                        You have left! (?) (thinking…)
                                      • automatically send an invitation to Part 2 of study upon completion of Part 1

                                        I would like to be able to send a worker an invitation to Part 2 of a study immediately upon their completion of Part 1. I have been waiting until I am finished with collection and then sending a mass email, but I lose a lot of people this way.

                                        3 votes
                                        Vote
                                        Sign in
                                        Check!
                                        (thinking…)
                                        Reset
                                        or sign in with
                                        • facebook
                                        • google
                                          Password icon
                                          I agree to the terms of service
                                          Signed in as (Sign out)
                                          You have left! (?) (thinking…)
                                        • Allow automatic restart

                                          In some cases, such as a HIT which is limited to a certain group of workers (for instance - ones who took a previous HIT), the low flow of participants makes the survey appear as unpopular to workers, and is shoved to the bottom of their lists, which further reduces participation rate. The known cure against this is to restart the survey every once in a while, so it jumps back to the top of peoples list. It would be nice if instead of getting in every couple of hours to restart the survey so it doesn't die out -…

                                          3 votes
                                          Vote
                                          Sign in
                                          Check!
                                          (thinking…)
                                          Reset
                                          or sign in with
                                          • facebook
                                          • google
                                            Password icon
                                            I agree to the terms of service
                                            Signed in as (Sign out)
                                            You have left! (?) (thinking…)
                                          ← Previous 1 3
                                          • Don't see your idea?

                                          General

                                          Feedback and Knowledge Base