Bias Effect on Validity and Reliability of a Rating Scale

1970 ◽  
Vol 3 (2) ◽  
pp. 70-75
Author(s):  
James A. Bitter
Keyword(s):  
Rating Scale ◽  
Validity And Reliability ◽  
Bias Effect

Using the Rating Scale Model to Examine the Psychometric Properties of the Self-Efficacy Scale for Driver Competence

2011 ◽  
Vol 27 (3) ◽  
pp. 164-170 ◽  
Author(s):  
Anna Sundström
Keyword(s):  
Psychometric Properties ◽  
Self Efficacy ◽  
Rating Scale ◽  
Measurement Precision ◽  
The Self ◽  
Test Theory ◽  
Self Report ◽  
Scale Model ◽  
Validity And Reliability ◽  
Two Samples

This study evaluated the psychometric properties of a self-report scale for assessing perceived driver competence, labeled the Self-Efficacy Scale for Driver Competence (SSDC), using item response theory analyses. Two samples of Swedish driving-license examinees (n = 795; n = 714) completed two versions of the SSDC that were parallel in content. Prior work, using classical test theory analyses, has provided support for the validity and reliability of scores from the SSDC. This study investigated the measurement precision, item hierarchy, and differential functioning for males and females of the items in the SSDC as well as how the rating scale functions. The results confirmed the previous findings; that the SSDC demonstrates sound psychometric properties. In addition, the findings showed that measurement precision could be increased by adding items that tap higher self-efficacy levels. Moreover, the rating scale can be improved by reducing the number of categories or by providing each category with a label.

Convergent and Discriminant Validity and Reliability of the Pediatric Anxiety Rating Scale in ASD

2012 ◽  
Author(s):  
Elysse B. Arnold ◽  
Jeffrey J. Wood ◽  
Jill Ehrenreich May ◽  
Anna M. Jones ◽  
Jennifer M. Park ◽  
...  
Keyword(s):  
Discriminant Validity ◽  
Rating Scale ◽  
Validity And Reliability ◽  
Pediatric Anxiety ◽  
Convergent And Discriminant Validity

The Clinician’s Subjective Experience during the Interaction with Adolescent Psychiatric Patients: Validity and Reliability of the Assessment of Clinician’s Subjective Experience

2021 ◽  
pp. 1-8
Author(s):  
Angelo Picardi ◽  
Sara Panunzi ◽  
Sofia Misuraca ◽  
Chiara Di Maggio ◽  
Andrea Maugeri ◽  
...  
Keyword(s):  
Clinical Examination ◽  
Subjective Experience ◽  
Rating Scale ◽  
Mood State ◽  
Psychiatric Patients ◽  
Temporal Stability ◽  
Young Patients ◽  
Reliability And Validity ◽  
Mental States ◽  
Validity And Reliability

<b><i>Introduction:</i></b> The last decade has witnessed a resurgence of interest in the clinician’s subjectivity and its role in the diagnostic assessment. Integrating the criteriological, third-person approach to patient evaluation and psychiatric diagnosis with other approaches that take into account the patient’s subjective and intersubjective experience may bear particular importance in the assessment of very young patients. The ACSE (Assessment of Clinician’s Subjective Experience) instrument may provide a practical way to probe the intersubjective field of the clinical examination; however, its reliability and validity in child and adolescent psychiatrists seeing very young patients is still to be determined. <b><i>Methods:</i></b> Thirty-three clinicians and 278 first-contact patients aged 12–17 years participated in this study. The clinicians completed the ACSE instrument and the Brief Psychiatric Rating Scale after seeing the patient, and the Profile of Mood State (POMS) just before seeing the patient and immediately after. The ACSE was completed again for 45 patients over a short (1–4 days) retest interval. <b><i>Results:</i></b> All ACSE scales showed high internal consistency and moderate to high temporal stability. Also, they displayed meaningful correlations with the changes in conceptually related POMS scales during the clinical examination. <b><i>Discussion:</i></b> The findings corroborate and extend previous work on adult patients and suggest that the ACSE provides a valid and reliable measure of the clinician’s subjective experience in adolescent psychiatric practice, too. The instrument may prove to be useful to help identify patients in the early stages of psychosis, in whom subtle alterations of being with others may be the only detectable sign. Future studies are needed to determine the feasibility and usefulness of integrating the ACSE within current approaches to the evaluation of at-risk mental states.

Objective structured assessment of technical skill in temporal bone dissection: validation of a novel tool

2021 ◽  
pp. 1-11
Author(s):  
M Stavrakas ◽  
G Menexes ◽  
S Triaridis ◽  
P Bamidis ◽  
J Constantinidis ◽  
...  
Keyword(s):  
Temporal Bone ◽  
Rating Scale ◽  
Assessment Tool ◽  
Three Dimensional ◽  
Technical Skills ◽  
Technical Skill ◽  
Global Rating Scale ◽  
Global Rating ◽  
Validity And Reliability ◽  
Cortical Mastoidectomy

Abstract Objective This study developed an assessment tool that was based on the objective structured assessment for technical skills principles, to be used for evaluation of surgical skills in cortical mastoidectomy. The objective structured assessment of technical skill is a well-established tool for evaluation of surgical ability. This study also aimed to identify the best material and printing method to make a three-dimensional printed temporal bone model. Methods Twenty-four otolaryngologists in training were asked to perform a cortical mastoidectomy on a three-dimensional printed temporal bone (selective laser sintering resin). They were scored according to the objective structured assessment of technical skill in temporal bone dissection tool developed in this study and an already validated global rating scale. Results Two external assessors scored the candidates, and it was concluded that the objective structured assessment of technical skill in temporal bone dissection tool demonstrated some main aspects of validity and reliability that can be used in training and performance evaluation of technical skills in mastoid surgery. Conclusion Apart from validating the new tool for temporal bone dissection training, the study showed that evolving three-dimensional printing technologies is of high value in simulation training with several advantages over traditional teaching methods.

Psychometric evaluation of the Relative Mastery Scale: An Occupational Adaptation instrument

2021 ◽  
pp. 153944922110608
Author(s):  
Lorrie George-Paschal ◽  
Nancy E. Krusen ◽  
Chia-Wei Fan
Keyword(s):  
Rating Scale ◽  
Classical Test Theory ◽  
Correlation Coefficients ◽  
Measurement Model ◽  
Community Dwelling ◽  
Test Theory ◽  
Partial Credit Model ◽  
Validity And Reliability ◽  
Occupational Adaptation ◽  
Scale Properties

This study evaluated the psychometric properties of the Relative Mastery Scale (RMS). Valid and reliable client-centered instruments support practice in value-based health care and community-based settings. Participants were 368 community-dwelling adults aged 18 to 95 years. Researchers conducted validity and reliability examinations of the RMS using classical test theory and Rasch measurement model. A partial credit model allowed exploration of individual scale properties. Spearman’s correlation coefficients between items were statistically significant at the .01 level. Cronbach’s alpha coefficient was .94 showing strong internal consistency. In exploratory factor analysis, Factor 1 accounted for 71% of variance with an eigenvalue of 4.26. In Rasch analysis, the 5-point rating scale demonstrated adequate functioning, confirmed unidimensionality, and person/item separation. The RMS instrument demonstrates sound psychometric characteristics. A valid and reliable measure of internal occupational adaptation supports application to monitor progress of internal occupational adaptation across a variety of individuals.

scholarly journals Tswana speaking South Africans’ understanding of pain scales

2009 ◽  
Vol 65 (1) ◽  
Author(s):  
M. Yazbek ◽  
A. Stewart ◽  
P. Becker
Keyword(s):  
Visual Analogue Scale ◽  
Analogue Scale ◽  
Rating Scale ◽  
Pain Scale ◽  
Pain Tolerance ◽  
Future Research ◽  
Validity And Reliability ◽  
Cross Sectional ◽  
Pressure Threshold ◽  
Pain Scales

Aim: The aim of this study was to establish the validity and reliability of the Tswanatranslations of three pain scales.Design: This was a cross–sectional study to validate and test the reliability of threepain scales.Participants:   One hundred subjects participated in the study. They were selectedfrom the back schools of five hospitals in the North -West Province of South A frica andfrom workers in these hospitals who were employed as kitchen workers, laundryworkers and cleaners.Method: Translation of the pain scales and the stages of cross-cultural adaptation were followed as recommended byBeaton et al (2000). Pain tolerance of the subjects was measured using a P.T.M. (pressure threshold meter). The painscales used were the V.A .S. (visual analogue scale) one (nought and ten only), the V.A .S. (visual analogue scale) two(nought through to ten), the W.B.F. (Wong-Baker Faces pain measure) and the V.R.S. (verbal rating scale).  The V.R.S.used came in two forms. The first form was written on cue cards which the subjects arranged in order and the second form was the questionnaire version of the V.R.S.The subjects were interviewed and asked five questions relating to their back pain. Upon completion of the interviewthe pressure threshold of the painful area (back) was tested. Subjects then filled in the three pain scales, namely the (V.A .S. one, V.A .S. two, the V.R.S. and lastly the W.B.F. pain scale). Approximately a third of the sample (37) was retested the following day following the same procedure asdescribed above. Results: There was no correlation between the pressure threshold meter readings and the pain scale measurements.  Conclusion: From the statistical analysis of the results, it became apparent that the subjects tested did not have anunderstanding of any of the three pain scales. Future research needs to be done in developing entirely different scales for peoples of low literacy and differentlanguage and cultural groups in South Africa.

Poster 273 Validity and Reliability of the Pictorial Spasmodic Torticollis Rating Scale

PM&R ◽  
2011 ◽  
Vol 3 ◽  
pp. S266-S266
Author(s):  
Spyridon Papapetropoulos ◽  
Lee Ming Boo ◽  
Mitchell F. Brin ◽  
Cynthia Comella
Keyword(s):  
Rating Scale ◽  
Spasmodic Torticollis ◽  
Validity And Reliability

The Client-Clinician Assessment Protocol (C-CAP): Evaluation of its Psychometric Properties for Use with People Aging with Disabilities in Need of Home Modifications

2007 ◽  
Vol 27 (4) ◽  
pp. 140-148 ◽  
Author(s):  
Ingela Petersson ◽  
Anne G. Fisher ◽  
Helena Hemmingsson ◽  
Margareta Lilja
Keyword(s):  
Rating Scale ◽  
Daily Life ◽  
Self Report ◽  
Scale Model ◽  
Validity And Reliability ◽  
Assessment Protocol ◽  
Rasch Rating Scale Model ◽  
Home Modifications ◽  
Life Tasks ◽  
Clinician Assessment

The objective of this study was to evaluate aspects of the validity and reliability of the Client-Clinician Assessment Protocol (C-CAP) Part I. C-CAP data for 103 people aging with disabilities in need of home modification services were analyzed using the Rasch rating scale model. The C-CAP Part I consists of a client self-report of ability in daily life tasks comprising three scales (independence, difficulty, and safety). The analysis demonstrated support for internal scale validity, person response validity, and person separation reliability of the C-CAP Part I, although the results differed among the three scales. The results of this study indicated that the C-CAP Part I has psychometric strengths and limitations. The instrument has the potential to be used in the home environment with people who are aging with disabilities. The C-CAP could complement already existing tools that are used to assess functioning in activities of daily living, especially regarding the focus on the clients' self-report of difficulty and safety in daily life at home and in the community.

scholarly journals Developing an instrument for measuring the faith of the students of Islamic senior high school

2016 ◽  
Vol 2 (2) ◽  
pp. 181
Author(s):  
Shodiq Shodiq ◽  
Zamroni Zamroni ◽  
Kumaidi Kumaidi
Keyword(s):  
Rating Scale ◽  
Model Fit ◽  
P Value ◽  
Validity And Reliability ◽  
Chi Square ◽  
Instrument Validity ◽  
Confirmatory Factor ◽  
Summated Rating Scale ◽  
Islamic Faith ◽  
Instrument Reliability

The study aims to develop an instrument used to measure  faith of the students of Islamic senior high schools. The study was a research and development study consisting of three steps: pre development, development process, and presentation. The quantitative data analysis was to test the validity and reliability of the instrument and to test the model fit through the Confirmatory Factor Analysis (CFA) using LISREL 8.80 Program. The results of the study show that: (1) the faith instrument of the study is an inventory model of summated rating scale containing 113 items named as Islamic Faith Scale; (2) the instrument validity is considered as the loading factor value (the lowest loading factor value is 0.47 and the highest is 0.89). The instrument reliability regarded as the coefficient of the construct reliability is > 0.7, (the coefficient of reliability construct of tashdiq al-qalb is 0.847, and the coefficient of the construct reliability of amal al-qalb is 0.999); (3) the overall model fit produces a fit model indicated by Chi Square (χ2) = 48.23, df = 64, p-value = 0.929 (p > 0.05), and Root Mean Square Error of Approximation = 0.000 (< 0.08).

Sign in / Sign up

Export Citation Format

Share Document