Evaluating the Construct Validity of Objective Personality Tests Using a Multitrait-Multimethod-Multioccasion-(MTMM-MO)-Approach

2014 ◽  
Vol 30 (3) ◽  
pp. 208-230 ◽  
Author(s):  
Tobias Koch ◽  
T. M. Ortner ◽  
M. Eid ◽  
J. Caspers ◽  
M. Schmitt

Although Objective Personality Tests (OPTs) have a long history in psychology and the field of psychological assessment, their validity, and reliability have not yet been sufficiently studied. In this study, we examined the convergent and discriminant validity of objective (personality) tests, Implicit Association Tests (IATs), and self-report measures for the assessment of conscientiousness and intelligence. Moreover, the convergent and discriminant validity of these measures was assessed on the trait (stable) and occasion specific (momentary) level by using the multimethod latent state-trait (MM-LST) model proposed by Courvoisier, Nussbeck, Eid, and Cole (2008) which allows for the decomposition of different sources of variance. Data from 367 students assessed on three different measurement occasions was incorporated. Results indicate generally low convergence of OPTs with data gained by other approaches. Additional analyses revealed that the OPTs used assess stable rather than momentary components of the constructs. Reliabilities of different tests ranged from .54 to .95. Furthermore, a substantial amount of trait method specificity revealed that different methods assess trait components that are not shared between OPTs and other measures. Data on the criterion validity of the objective conscientiousness test revealed that it is related to the punctuality of test takers in the laboratory.

Author(s):  
Anthony G. Greenwald ◽  
Brian A. Nosek

Abstract. Since its first publication in 1998, the Implicit Association Test (IAT) has been used repeatedly to measure implicit attitudes and other automatic associations. Although there have also been a few studies critical of the IAT, there now exists substantial evidence for the IAT's convergent and discriminant validity, including new evidence reported in several of the articles in this special issue. IAT attitude measures have often correlated only weakly with explicit (self-report) measures of the same associations. It therefore seems appropriate to conclude that the IAT assesses constructs that are often (but not always) distinct from the corresponding constructs measured by self-report.


2014 ◽  
Author(s):  
Rezvan Ameil ◽  
David A Luckenbaugh ◽  
Neda F Gould ◽  
M. Kathleen Holmes ◽  
Níall Lally ◽  
...  

Anhedonia, a diminished or lack of ability to experience and anticipate pleasure represents a core psychiatric symptom in depression. Current clinician assessment of anhedonia is generally limited to one or two all-purpose questions and most well-known psychometric scales of anhedonia are relatively long, self-administered, typically not state sensitive, and are unsuitable for use in clinical settings. A user-friendly tool for a more in-depth clinician assessment of hedonic capacity is needed. The present study assessed the validity and reliability of a clinician administered version of the Snaith-Hamilton Pleasure Scale, the SHAPS-C, in 34 depressed subjects. We compared total and specific item scores on the SHAPS-C, SHAPS (self-report version), Montgomery-Åsberg Depression Rating Scale (MADRS), and the Inventory of Depressive Symptomatology-Self Rating version (IDS-SR). We also examined construct, content, concurrent, convergent, and discriminant validity, internal consistency, and split-half reliability of the SHAPS-C. The SHAPS-C was found to be valid and reliable. The SHAPS and the SHAPS-C were positively correlated with one another, with levels of depression severity, as measured by the MADRS, and the IDS-SR total scores, and with specific items of the MADRS and IDS-SR sensitive to measuring hedonic capacity. Our investigation indicates that the SHAPS-C is a user friendly, reliable, and valid tool for clinician assessment of hedonic capacity in depressed bipolar and unipolar patients.


Assessment ◽  
2021 ◽  
pp. 107319112110386
Author(s):  
Martin Sellbom ◽  
Jaiden S. Butler ◽  
Tayla T. C. Lee ◽  
Andrea M. Loucaides ◽  
Tracy L. Masterson ◽  
...  

The Expanded–Levenson Self-Report Psychopathy Scale (E-LSRP) was developed by Christian and Sellbom to improve on the psychometric properties of scores on the Levenson Self-Report Psychopathy Scale. The current study investigated the construct validity of scores on the E-LSRP in 393 male inmates. Results provided support for the reliability and construct validity of E-LSRP scores. Specifically, confirmatory factor analysis results demonstrated support for a three-factor model. Additionally, correlation and multiple regression results provided evidence supporting the convergent and discriminant validity of E-LSRP scores against scores on measures assessing psychopathy-related personality traits (e.g., antagonism, disinhibition) and symptoms of internalizing disorders, respectively. Overall, these findings extend those of previous research by establishing that E-LSRP scores demonstrate validity in assessing psychopathy in correctional settings and thus, may be a useful tool for the assessment of psychopathy in these settings.


2014 ◽  
Author(s):  
Rezvan Ameil ◽  
David A Luckenbaugh ◽  
Neda F Gould ◽  
M. Kathleen Holmes ◽  
Níall Lally ◽  
...  

Anhedonia, a diminished or lack of ability to experience and anticipate pleasure represents a core psychiatric symptom in depression. Current clinician assessment of anhedonia is generally limited to one or two all-purpose questions and most well-known psychometric scales of anhedonia are relatively long, self-administered, typically not state sensitive, and are unsuitable for use in clinical settings. A user-friendly tool for a more in-depth clinician assessment of hedonic capacity is needed. The present study assessed the validity and reliability of a clinician administered version of the Snaith-Hamilton Pleasure Scale, the SHAPS-C, in 34 depressed subjects. We compared total and specific item scores on the SHAPS-C, SHAPS (self-report version), Montgomery-Åsberg Depression Rating Scale (MADRS), and the Inventory of Depressive Symptomatology-Self Rating version (IDS-SR). We also examined construct, content, concurrent, convergent, and discriminant validity, internal consistency, and split-half reliability of the SHAPS-C. The SHAPS-C was found to be valid and reliable. The SHAPS and the SHAPS-C were positively correlated with one another, with levels of depression severity, as measured by the MADRS, and the IDS-SR total scores, and with specific items of the MADRS and IDS-SR sensitive to measuring hedonic capacity. Our investigation indicates that the SHAPS-C is a user friendly, reliable, and valid tool for clinician assessment of hedonic capacity in depressed bipolar and unipolar patients.


2016 ◽  
Author(s):  
Anthony G. Greenwald ◽  
Brian A. Nosek

Since its first publication in 1998, the Implicit Association Test (IAT) has been used repeatedly to measure implicit attitudes and other automatic associations. Although there have also been a few studies critical of the IAT, there now exists substantial evidence for the IAT=s convergent and discriminant validity, including new evidence reported in several of the articles in this special issue. IAT attitude measures have often correlated only weakly with explicit (self-report) measures of the same associations. It therefore seems appropriate to conclude that the IAT assesses constructs that are often (but not always) distinct from the corresponding constructs measured by self-report.


Author(s):  
Bertram Gawronski

Abstract. Drawing on recent criticism of the Implicit Association Test (IAT), the present study tested the convergent and discriminant validity of two prejudice-related IATs to corresponding explicit prejudice measures in a German student sample (N = 61). Confirming convergent validity, (a) an IAT designed to assess negative associations related to Turkish people was significantly related to the explicit endorsement of prejudiced beliefs about Turkish people, and (b) an IAT designed to assess negative associations related to East Asians was significantly related to explicit prejudice against East Asians. Moreover, confirming discriminant validity, (c) the Asian IAT was unrelated to the explicit endorsement of prejudiced beliefs about Turkish people, and (d) the Turkish IAT was unrelated to explicit prejudice against Asian people. These results further corroborate the assumption that the IAT is a valid method to assess the strength of evaluative associations in the domain of prejudice and stereotypes.


2018 ◽  
Vol 34 (6) ◽  
pp. 367-375 ◽  
Author(s):  
Laura D. Seligman ◽  
Erin F. Swedish ◽  
Jason P. Rose ◽  
Jessica M. Baker

Abstract. The current study examined the validity of two self-report measures of social anxiety constructed using social comparative referent points. It was hypothesized that these comparison measures would be both reliable and valid. Results indicated that two different comparative versions – one invoking injunctive norms and another invoking descriptive norms – showed good reliability, excellent internal consistency, and acceptable convergent and discriminant validity. The comparative measures also predicted positive functioning, some aspects of social quality of life, and social anxiety as measured by an independent self-report. These findings suggest that adding a comparative reference point to instructions on social anxiety measures may aid in the assessment of social anxiety.


2012 ◽  
Author(s):  
Elysse B. Arnold ◽  
Jeffrey J. Wood ◽  
Jill Ehrenreich May ◽  
Anna M. Jones ◽  
Jennifer M. Park ◽  
...  

2021 ◽  
pp. 1-9
Author(s):  
Hamid Sharif Nia ◽  
Mobin Mohammadinezhad ◽  
Kelly A. Allen ◽  
Christopher Boyle ◽  
Saeed Pahlevan Sharif ◽  
...  

Abstract Objective The spiritual well-being scale (SWBS) is a widely used clinical scale which should be evaluated for Iranian patients with cancer. The aim of this study is to evaluate the psychometric properties of the Persian version of the SWBS in Iranian patients with cancer. Method This cross-sectional, methodological study was conducted among Iranian patients with cancer (n = 400). The participants were recruited using convenience sampling. The content, construct, convergent and discriminant validity, and reliability of the Persian version of the SWBS were evaluated. Results A two-factor structure for the scale was indicated with the factors being: connecting with God and meaningless life that explained 54.18% of the total variance of the concept of spiritual well-being. The results demonstrated the model had a good fit. Cronbach's alpha, McDonald's omega, and the inter-item correlation values of the factors indicated good internal consistency of the scale. Significance of results These results suggest that the Persian version of the SWBS is a reliable and valid measure to assess the spiritual well-being of patients with cancer through 16 items related to connecting with God and meaningless life.


Author(s):  
Mihyeon Seong ◽  
Juyoung Park ◽  
Soojin Chung ◽  
Sohyune Sok

This study aimed to develop an instrument for measuring the attitudes that reflect the characteristics of the pandemic (Adult Pandemic Attitude Scale (A-PAS)) and verifying its validity and reliability. This study used a methodological research design and was conducted with a development step and an evaluation step. The development step included development of preliminary items, content validity, face validity, and preliminary investigation. The evaluation step included item analysis, construct validity, convergent validity, discriminant validity, criterion validity, factor naming, reliability, and completion of the final instrument. The A-PAS developed in this study consisted of a total of 20 items in five dimensions. The internal consistency of 20 items of the A-PAS, Cronbach’s α was 0.92 for 20 items, Cronbach’s α for each factor, a subscale of instrument, was 0.61~0.87 and Raykov’s p coefficient of each factor, which is a subscale of the tool, was found to be 0.60 to 0.88. Analysis of construct validity showed the results as follows: χ2 (p) = 134.05 (p < 0.001), RMSEA = 0.02, RMR = 0.02, GFI = 0.94, CFI = 0.99. The study findings suggest that the developed instrument can be utilized to measure the attitudes of adults toward pandemics, and reflect the reality of the pandemic situation. The outcomes can be used as valuable data for intervention, prevention activities, and policy preparation. The instrument will be applied in the event of a pandemic, such as COVID-19, and will be helpful in promoting the health of the people.


Sign in / Sign up

Export Citation Format

Share Document