A Secure and Reusable Software Architecture for Supporting Online Data Harmonization

2021 ◽  
Author(s):  
Zlatan Feric ◽  
Nicolas Bohm Agostini ◽  
Daniel Beene ◽  
Antonio J. Signes-Pastor ◽  
Yuliya Halchenko ◽  
...  
Keyword(s):  
Software Architecture ◽  
Online Data ◽  
Reusable Software ◽  
Data Harmonization

Reliability of MTurk Data From Masters and Workers

2020 ◽  
Vol 41 (1) ◽  
pp. 30-36
Author(s):  
Steven V. Rouse
Keyword(s):  
Cognitive Abilities ◽  
Online Survey ◽  
Quality Data ◽  
Standard Samples ◽  
Online Data ◽  
Approval Ratings ◽  
Cognitive Abilities Test ◽  
Elite Status ◽  
Master Status ◽  
Amazon's Mechanical Turk

Abstract. Previous research has supported the use of Amazon’s Mechanical Turk (MTurk) for online data collection in individual differences research. Although MTurk Masters have reached an elite status because of strong approval ratings on previous tasks (and therefore gain higher payment for their work) no research has empirically examined whether researchers actually obtain higher quality data when they require that their MTurk Workers have Master status. In two different online survey studies (one using a personality test and one using a cognitive abilities test), the psychometric reliability of MTurk data was compared between a sample that required a Master qualification type and a sample that placed no status-level qualification requirement. In both studies, the Master samples failed to outperform the standard samples.

Sign in / Sign up

Export Citation Format

Share Document