Validation of the Suicide Counseling Skills Inventory

Crisis ◽  
2021 ◽  
pp. 1-13
Author(s):  
Carol Coohey ◽  
Keri Neblett ◽  
Sara Knox
Keyword(s):  
Internal Consistency ◽  
Skills Training ◽  
The Self ◽  
Self Report ◽  
Counseling Skills ◽  
Training Models ◽  
Suicide Intervention ◽  
Counseling Competency ◽  
Scenario Method ◽  
Test Retest Reliability

Abstract. Background: The self-report measures used in evaluations of the Applied Suicide Intervention Skills Training (ASIST) program have tended not to detect an improvement in a broad range of suicide counseling skills from pre- to posttraining or among trainees with better skills at pretraining. Aims: The purpose of this study was to develop and validate the Suicide Counseling Skills Inventory (SCSI), which included ten brief counselor–client scenarios and three counselor responses to each scenario. Method: Data were collected from several samples to develop and evaluate the SCSI. Trainee scores were subtracted from criterion expert scores to create discrepancy scores. Results: The SCSI detected an improvement in skills from pre- to posttraining across samples, including among trainees with better skills at pretraining. Internal consistency and test–retest reliability were good. Limitations: The results may not generalize across different training models. Conclusion: Trainee scores were more like expert scores at posttraining. The SCSI may be useful in evaluating suicide counseling competency.

Developing a measure to assess clinicians’ ability to reflect on key staff–patient dynamics in forensic settings

2021 ◽  
Vol ahead-of-print (ahead-of-print) ◽  
Author(s):  
Adam Polnay ◽  
Helen Walker ◽  
Christopher Gallacher
Keyword(s):  
Reflective Practice ◽  
Factor Structure ◽  
Internal Consistency ◽  
Self Report ◽  
Face Validity ◽  
Good Test ◽  
Data Set ◽  
Retest Reliability ◽  
Content Type ◽  
Test Retest Reliability

Purpose Relational dynamics between patients and staff in forensic settings can be complicated and demanding for both sides. Reflective practice groups (RPGs) bring clinicians together to reflect on these dynamics. To date, evaluation of RPGs has lacked quantitative focus and a suitable quantitative tool. Therefore, a self-report tool was designed. This paper aims to pilot The Relational Aspects of CarE (TRACE) scale with clinicians in a high-secure hospital and investigate its psychometric properties. Design/methodology/approach A multi-professional sample of 80 clinicians were recruited, completing TRACE and attitudes to personality disorder questionnaire (APDQ). Exploratory factor analysis (EFA) determined factor structure and internal consistency of TRACE. A subset was selected to measure test–retest reliability. TRACE was cross-validated against the APDQ. Findings EFA found five factors underlying the 20 TRACE items: “awareness of common responses,” “discussing and normalising feelings;” “utilising feelings,” “wish to care” and “awareness of complicated affects.” This factor structure is complex, but items clustered logically to key areas originally used to generate items. Internal consistency (α = 0.66, 95% confidence interval (CI) = 0.55–0.76) demonstrated borderline acceptability. TRACE demonstrated good test–retest reliability (intra-class correlation = 0.94, 95% CI = 0.78–0.98) and face validity. TRACE indicated a slight negative correlation with APDQ. A larger data set is needed to substantiate these preliminary findings. Practical implications Early indications suggested TRACE was valid and reliable, suitable to measure the effectiveness of reflective practice. Originality/value The TRACE was a distinctive measure that filled a methodological gap in the literature.

scholarly journals Psychometric properties of a self-report version of the Sexual Interest and Desire Inventory for Women (SIDI-F-SR)

2020 ◽  
Author(s):  
Julia Velten ◽  
Gerrit Hirschfeld ◽  
Milena Meyers ◽  
Jürgen Margraf
Keyword(s):  
Psychometric Properties ◽  
Internal Consistency ◽  
Sexual Interest ◽  
Intraclass Correlation ◽  
Self Report ◽  
Clinical Psychologist ◽  
Retest Reliability ◽  
Absolute Agreement ◽  
Test Retest Reliability ◽  
Restriction Of Range

Background: The Sexual Interest and Desire Inventory Female (SIDI-F) is a clinician-administered scale that allows for a comprehensive assessment of symptoms related to Hypoactive Sexual Desire Dysfunction (HSDD). As self-report questionnaires may facilitate less socially desirable responding and as time and resources are scarce in many clinical and research settings, a self-report version was developed (SIDI-F-SR). Aim: To investigate the agreement between the SIDI-F and a self-report version (SIDI-F-SR) and assess psychometric properties of the SIDI-F-SR. Methods: A total of 170 women (Mage=36.61, SD=10.61, range=20-69) with HSDD provided data on the SIDI-F, administered by a clinical psychologist via telephone, and the SIDI-F-SR, delivered as an Internet-based questionnaire. A subset of 19 women answered the SIDI-F-SR twice over a period of 14 weeks. Outcomes: Intraclass correlation as well as predictors of absolute agreement between SIDI-F and SIDI-F-SR, as well as internal consistency, test-retest reliability, and criterion-related validity of the SIDI-F-SR were examined. Results: There was high agreement between SIDI-F and SIDI-F-SR (ICC=.86). On average, women scored about one point higher in the self-report vs. the clinician-administered scale. Agreement was higher in young women and those with severe symptoms. Internal consistency of the SIDI-F-SR was acceptable (α=.76) and comparable to the SIDI-F (α=.74). When corrections for the restriction of range were applied, internal consistency of the SIDI-F-SR increased to .91. Test-retest-reliability was good (r=.74). Criterion-related validity was low but comparable between SIDI-F and SIDI-F-SR.

scholarly journals A brief, patient- and proxy-reported outcome measure in advanced illness: Validity, reliability and responsiveness of the Integrated Palliative care Outcome Scale (IPOS)

2019 ◽  
Vol 33 (8) ◽  
pp. 1045-1057 ◽  
Author(s):  
Fliss EM Murtagh ◽  
Christina Ramsenthaler ◽  
Alice Firth ◽  
Esther I Groeneveld ◽  
Natasha Lovell ◽  
...  
Keyword(s):  
Palliative Care ◽  
Internal Consistency ◽  
Outcome Measure ◽  
Self Report ◽  
Advanced Illness ◽  
Proxy Report ◽  
Palliative Care Outcome Scale ◽  
Test Retest Reliability ◽  
Care Outcome ◽  
Responsiveness To Change

Background: Few measures capture the complex symptoms and concerns of those receiving palliative care. Aim: To validate the Integrated Palliative care Outcome Scale, a measure underpinned by extensive psychometric development, by evaluating its validity, reliability and responsiveness to change. Design: Concurrent, cross-cultural validation study of the Integrated Palliative care Outcome Scale – both (1) patient self-report and (2) staff proxy-report versions. We tested construct validity (factor analysis, known-group comparisons, and correlational analysis), reliability (internal consistency, agreement, and test–retest reliability), and responsiveness (through longitudinal evaluation of change). Setting/participants: In all, 376 adults receiving palliative care, and 161 clinicians, from a range of settings in the United Kingdom and Germany Results: We confirm a three-factor structure (Physical Symptoms, Emotional Symptoms and Communication/Practical Issues). Integrated Palliative care Outcome Scale shows strong ability to distinguish between clinically relevant groups; total Integrated Palliative care Outcome Scale and Integrated Palliative care Outcome Scale subscale scores were higher – reflecting more problems – in those patients with ‘unstable’ or ‘deteriorating’ versus ‘stable’ Phase of Illness (F = 15.1, p < 0.001). Good convergent and discriminant validity to hypothesised items and subscales of the Edmonton Symptom Assessment System and Functional Assessment of Cancer Therapy–General is demonstrated. The Integrated Palliative care Outcome Scale shows good internal consistency (α = 0.77) and acceptable to good test–retest reliability (60% of items kw > 0.60). Longitudinal validity in form of responsiveness to change is good. Conclusion: The Integrated Palliative care Outcome Scale is a valid and reliable outcome measure, both in patient self-report and staff proxy-report versions. It can assess and monitor symptoms and concerns in advanced illness, determine the impact of healthcare interventions, and demonstrate quality of care. This represents a major step forward internationally for palliative care outcome measurement.

Test-Retest Reliability of the Holyoake Codependency Index with Australian Students

2004 ◽  
Vol 94 (2) ◽  
pp. 482-484 ◽  
Author(s):  
Greg E. Dear
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Internal Validity ◽  
Self Report ◽  
Full Scale Test ◽  
Retest Reliability ◽  
External Focus ◽  
Scale Test ◽  
Test Retest Reliability ◽  
Report Measure

The Holyoake Codependency Index is a 13-item self-report measure of three aspects of codependency: External Focus, Self-sacrifice, and a sense of being overwhelmed by another person's problematic behavior (termed Reactivity). Previous studies have supported internal validity and the internal consistency and construct validity of the subscales. The present scores for 59 students indicate full scale test-retest reliability of .88 and for subscales (.76 to .82) over a 3-wk. interval.

scholarly journals Validation of the Strengths and Difficulties Self-Report in Norwegian Sign Language

2019 ◽  
Vol 25 (1) ◽  
pp. 91-104 ◽  
Author(s):  
Chris Margaret Aanondsen ◽  
Thomas Jozefiak ◽  
Kerstin Heiling ◽  
Tormod Rimehaug
Keyword(s):  
Mental Health ◽  
Sign Language ◽  
Internal Consistency ◽  
Mental Health Problems ◽  
Health Problems ◽  
Self Report ◽  
Equation Modeling ◽  
Retest Reliability ◽  
Strengths And Difficulties ◽  
Test Retest Reliability

Abstract The majority of studies on mental health in deaf and hard-of-hearing (DHH) children report a higher level of mental health problems. Inconsistencies in reports of prevalence of mental health problems have been found to be related to a number of factors such as language skills, cognitive ability, heterogeneous samples as well as validity problems caused by using written measures designed for typically hearing children. This study evaluates the psychometric properties of the self-report version of the Strengths and Difficulties Questionnaire (SDQ) in Norwegian Sign Language (NSL; SDQ-NSL) and in written Norwegian (SDQ-NOR). Forty-nine DHH children completed the SDQ-NSL as well as the SDQ-NOR in randomized order and their parents completed the parent version of the SDQ-NOR and a questionnaire on hearing and language-related information. Internal consistency was examined using Dillon–Goldstein’s rho, test–retest reliability using intraclass correlations, construct validity by confirmatory factor analysis (CFA), and partial least squares structural equation modeling. Internal consistency and test–retest reliability were established as acceptable to good. CFA resulted in a best fit for the proposed five-factor model for both versions, although not all fit indices reached acceptable levels. The reliability and validity of the SDQ-NSL seem promising even though the validation was based on a small sample size.

scholarly journals The Modified Gait Efficacy Scale: Establishing the Psychometric Properties in Older Adults

2012 ◽  
Vol 92 (2) ◽  
pp. 318-328 ◽  
Author(s):  
Alaina M. Newell ◽  
Jessie M. VanSwearingen ◽  
Elizabeth Hile ◽  
Jennifer S. Brach
Keyword(s):  
Older Adults ◽  
Correlation Coefficient ◽  
Internal Consistency ◽  
Intraclass Correlation ◽  
Community Dwelling ◽  
Self Report ◽  
Retest Reliability ◽  
And Performance ◽  
Test Retest Reliability ◽  
Community Dwelling Older Adults

BackgroundPerceived ability or confidence plays an important role in determining function and behavior. The modified Gait Efficacy Scale (mGES) is a 10-item self-report measure used to assess walking confidence under challenging everyday circumstances.ObjectiveThe purpose of this study was to determine the reliability, internal consistency, and validity of the mGES as a measure of gait in older adults.DesignThis was a cross-sectional study.MethodsParticipants were 102 community-dwelling older adults (mean [±SD] age=78.6±6.1 years) who were independent in ambulation with or without an assistive device. Participants were assessed using the mGES and measures of confidence and fear, measures of function and disability, and performance-based measures of mobility. In a subsample (n=26), the mGES was administered twice within a 1-month period to establish test-retest reliability through the intraclass correlation coefficient (ICC [2,1]). The standard error of measure (SEM) was determined from the ICC and standard deviation. The Cronbach α value was calculated to determine internal consistency. To establish the validity of the mGES, the Spearman rank order correlation coefficient was used to examine the association with measures of confidence, fear, gait, and physical function and disability.ResultsThe mGES demonstrated test-retest reliability within the 1-month period (ICC=.93, 95% confidence interval=.85, .97). The SEM of the mGES was 5.23. The mGES was internally consistent across the 10 items (Cronbach α=.94). The mGES was related to measures of confidence and fear (r=.54–.88), function and disability (Late-Life Function and Disability Instrument, r=.32–.88), and performance-based mobility (r=.38–.64).LimitationsThis study examined only community-dwelling older adults. The results, therefore, should not be generalized to other patient populations.ConclusionThe mGES is a reliable and valid measure of confidence in walking among community-dwelling older adults.

Validity, Internal Consistency, and Test/Retest Reliability of a Localization Disabilities and Handicaps Questionnaire

2005 ◽  
Vol 16 (08) ◽  
pp. 585-595 ◽  
Author(s):  
Melissa N. Ruscetta ◽  
Catherine V. Palmer ◽  
John D. Durrant ◽  
Judith Grayhack ◽  
Carey Ryan
Keyword(s):  
Construct Validity ◽  
Hearing Impairment ◽  
Internal Consistency ◽  
Normal Hearing ◽  
The Self ◽  
Cronbach’S Alpha ◽  
Retest Reliability ◽  
Cronbach's Alpha ◽  
Test Retest Reliability

Psychometric evaluations were performed on a self-perceived localization disabilities and handicaps questionnaire. Twenty individuals with normal hearing bilaterally, twenty with profound unilateral hearing impairment (UHI), and ten with any degree of bilateral hearing impairment participated. Each subject completed the questionnaire. Comparisons of the responses of the subjects with normal hearing and those with UHI revealed significant differences among the groups for both disabilities and handicaps, establishing construct validity. Cronbach's Alpha correlational analyses of the responses of all subjects with hearing impairment revealed correlations of .900 (disabilities) and .800 (handicaps), establishing internal consistency. Each participant with hearing impairment was asked to complete the questionnaire again after three weeks. Pearson's correlational analyses of the responses at time one versus time two revealed correlations of .900 (disabilities) and .700 (handicaps), establishing test/retest reliability. This questionnaire is an appropriate tool for investigating the self-perceived localization disabilities and handicaps of individuals with hearing impairment.

scholarly journals Reliability and Construct Validity of Self-Report Questionnaires for Patients With Pelvic Girdle Pain

2012 ◽  
Vol 92 (1) ◽  
pp. 111-123 ◽  
Author(s):  
Margreth Grotle ◽  
Andrew M. Garratt ◽  
Hanne Krogstad Jenssen ◽  
Britt Stuge
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Discriminant Validity ◽  
Pelvic Girdle ◽  
Self Report ◽  
Pelvic Girdle Pain ◽  
Consistency Test ◽  
Retest Reliability ◽  
Sf 36 ◽  
Test Retest Reliability

Background There is little evidence for the measurement properties of instruments commonly used for women with pelvic girdle pain. Objective The aim of this study was to examine the internal consistency, test-retest reliability, and construct validity of instruments used for women with pelvic girdle pain. Design This was a cross-sectional methodology study, including test-retest reliability assessment. Methods Women with pelvic girdle pain in pregnancy and after delivery participated in a postal survey that included the Pelvic Girdle Questionnaire (PGQ), Oswestry Disability Index (ODI), Disability Rating Index (DRI), Fear-Avoidance Beliefs Questionnaire (FABQ), Pain Catastrophizing Scale (PCS), and 8-item version of the Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire (SF-36). Test-retest reliability was assessed with a random subsample 1 week later. Internal consistency was assessed with the Cronbach alpha, and test-retest reliability was assessed with the intraclass correlation coefficient (ICC) and minimal detectable change (MDC). Construct validity based on hypotheses was assessed by correlation analysis. Discriminant validity was assessed with the area under the receiver operating characteristic curve. Results All participants responded to the main (N=87) and test-retest (n=42) surveys. Cronbach alpha values ranged from .88 to .94, and ICCs ranged from .78 to .94. The MDC at the individual level constituted about 7% to 14% of total scores for the 8-item version of the SF-36, ODI, and PGQ activity subscale; about 18% to 22% for the DRI, PGQ symptom subscale, and PCS; and about 25% for the FABQ. Hypotheses were mostly confirmed by correlations between the instruments. The PGQ was the only instrument that significantly discriminated participants who were pregnant from participants who were not pregnant as well as pain locations. Limitations A comparison of responsiveness to change of the various instruments used in this study was not undertaken, but will be carried out in a future study. Conclusions Self-report instruments for assessing health showed good internal consistency, test-retest reliability, and construct validity for women with pelvic girdle pain. The PGQ was the only instrument with satisfactory discriminant validity, thus, it is recommended for evaluating symptoms and disability in patients with pelvic girdle pain.

The Iowa Personality Disorder Screen

2010 ◽  
Vol 26 (1) ◽  
pp. 11-18 ◽  
Author(s):  
Sara Germans ◽  
Guus L. Van Heck ◽  
Douglas R. Langbehn ◽  
Paul P.G. Hodiamont
Keyword(s):  
Personality Disorder ◽  
Internal Consistency ◽  
Gold Standard ◽  
Self Report ◽  
Psychiatric Outpatients ◽  
Consistency Test ◽  
Predictive Values ◽  
Retest Reliability ◽  
Screening Measure ◽  
Test Retest Reliability

The internal consistency, test-retest reliability, and predictive validity of the Iowa Personality Disorder Screen (IPDS) as a screening instrument for personality disorders (PDs) were studied in 195 Dutch psychiatric outpatients, using the SCID-II as the gold standard. All patients completed a self-administered version of the IPDS. Internal consistency was moderate (0.64), and the test-retest reliability was good (0.87). According to the SCID-II, 97 patients (50%) had at least one personality disorder (PD). The IPDS correctly classified 81.0 percent of all participants in the category PD present/absent. The sensitivity and specificity were 77% and 88%, respectively. Positive and negative predictive values were 83% and 79%. Test-retest reliability after a 2-week interval was 0.87. These results are comparable with those reported in earlier studies with respect to the interview version of the IPDS and more promising than previously reported results obtained with a self-report version of the IPDS. Therefore, it is concluded that a self-report version of the IPDS may be useful as a screening measure for determining the presence/absence of PD in a population of psychiatric outpatients.

Sign in / Sign up

Export Citation Format

Share Document