Saturday, June 22, 2013

How to Manage Your Reputation

Image from http://www.brandguardsoftware.com/An important part of doing research on MTurk is managing your reputation.  If your reputation is positive, then Workers are more likely to complete your HITs.  This in turn can enhance the speed and cost at which you collect data as well as the quality of the data you collect.  A bad reputation, on the other hand, can seriously hinder your ability to recruit Workers.  

How do you develop a reputation on MTurk?  Workers can post and gather information about your HITs (and you) on websites frequently visited by other Workers (e.g., www.mturkforum.com, www.turkernation.com, www.reddit.com, www.cloudmebaby.com).  There are even browser extensions that allow Workers to quickly and easily view your reputation as they search for HITs (e.g., turkopticon).  Fortunately for Requesters, there are a few things you can do to manage your reputation: 



Pay fair wages!  It's the right thing to do.  According to most sources, 10 cents per minute is the current standard.  In a recent survey of MTurk Workers, one person described the benefits of paying fair wages like this:  "If you pay enough, you'll get more attention on your HITs, a better feedback score on TurkOpticon and more accurate results".


Use other websites!  There are many websites dedicated to helping Workers share information about MTurk, including information about Requesters and their HITs. Visit these websites, search for information about you and your HITs, and browse some of the other posts. Use the information to identify your strengths and opportunities for improvement.  When a Worker posts a question about your HITs, make an attempt to post a reply.  When a Worker recommends one of your HITs, post a note of appreciation.

Use add-ons!  Download Turkopticon's add-on to quickly and conveniently view your reviews from the MTurk website.  Put yourself in the Workers' shoes.  What do they see about you?


Ask for feedback!  At the very end of your HITs, include an optional item in the form of a text box.  Ask Workers to give suggestions, ask questions, express concerns, and/or report any issues.  


Follow the Tips from Workers!  To help you build a network of Workers, follow their suggestions regarding HIT design properties, HIT design layout, and managing HITs.

Do Not Retaliate!  Use people's feedback to help you improve.  Don't take it personal, and don't get angry with people.  Be very careful about how you respond to Workers' posts about you.  Remember, the whole world can read what you write.

No comments:

Post a Comment