Transcription Updates - FAQ

1. What's new on the CrowdSurf Mturk HITs?

2. Where did the Beta Qualification go?

3. What does Variable Pricing mean?

4. Where can I get automatic feedback on HITs?

5. What does my HIT score mean?

1. What's new on the CrowdSurf Mturk HITs?

We have rebuilt CrowdSurf HITs on MTurk and CrowdSurfWork. You will experience an updated interface with faster load times, variable pricing, and access to new statistics and feedback. See additional details on all the changes here.

2. Where did the Beta Qualification go?

The Beta Qualification is reserved for internal testing purposes and a small group of CrowdSurf workers. Now that the features have been released to all CrowdSurfers, there's no need for a Beta Qualification. We hope you enjoy the new features! And thank you to the beta test team! If you are still interested in providing feedback, please use the Suggestion Box.

3. What does Variable Pricing mean?

Variable pricing means that your payment will be proportional to the length of each HIT that you work on. Previously, you were paid the same reward for a 16 second HIT as you were for a 25 second HIT. 

For each HIT you will earn a base reward plus a 'variable' reward dependent upon the length of the HIT.  

You will see the base reward on every HIT listed on the queue. You will see the total reward for the HIT is viewable once you preview the HIT. 

See additional details on all the changes here.

4. Where can I get automatic feedback on HITs?

On your New Dashboard! To help you keep track of the HITs you’ve worked and your total earnings we’ve created a Payment and Review History dashboard, accessible on the “Stats” tab once you’ve accepted a HIT in MTurk.

Just click on the "Review your Payment and Work History" link to open the dashboard. (Hint: You may want to bookmark the dashboard page.) This link takes you to your individualized dashboard where you can find information on all of your transcription and review HITs. 

To see feedback on scoring on individual HITs click on the QC score of a HIT listed in your dashboard.

5. What does my HIT score mean?

Anonymous workers just like you review your transcripts. Based on the corrections and errors that they mark, our sophisticated scoring algorithm will calculate a QC score for your HIT. Based on the QC score awarded the HIT, your Qualification Score for CrowdSurf transcription HITs will change.

Here is a breakdown of scoring:

Quality Level	QC Score	Qualification Score Change	Status
Fraud	1	-40	Rejected
Poor	2	-20	Approved
Fair	3	0 - no change	Approved
Perfect	4	+20	Approved

Maintain a minimum of a 3.85 average QC score, and a minimum of 900 Qualification Score to continue working with CrowdSurf.

Achieve a 3.8+ average QC score, and a 980+ Qualification Score on at least 100 HITs to be eligible for a CrowdSurf Promotion.

Back to top