Test-Retest Reliability and Criterion Validity of a Motion Video, CD-ROM Program Designed to Allow Youth with Disabilities to Select Preferred Jobs

2003 ◽  
Vol 26 (1) ◽  
pp. 67-84 ◽  
Author(s):  
Robert L. Morgan
Keyword(s):  
Criterion Validity ◽  
Youth With Disabilities ◽  
Retest Reliability ◽  
Cd Rom ◽  
Test Retest Reliability ◽  
Motion Video

scholarly journals Formative Evaluation of Consumer-Grade Activity Monitors Worn by Older Adults: Test-Retest Reliability and Criterion Validity of Step Counts (Preprint)

2019 ◽  
Author(s):  
Stephanie A Maganja ◽  
David C Clarke ◽  
Scott A Lear ◽  
Dawn C Mackey
Keyword(s):  
Older Adults ◽  
Activity Monitor ◽  
Criterion Validity ◽  
Step Count ◽  
Retest Reliability ◽  
Activity Monitors ◽  
Limited Mobility ◽  
Step Counts ◽  
Test Retest Reliability ◽  
Mobility Status

BACKGROUND To assess whether commercial-grade activity monitors are appropriate for measuring step counts in older adults, it is essential to evaluate their measurement properties in this population. OBJECTIVE This study aimed to evaluate test-retest reliability and criterion validity of step counting in older adults with self-reported intact and limited mobility from 6 commercial-grade activity monitors: Fitbit Charge, Fitbit One, Garmin vívofit 2, Jawbone UP2, Misfit Shine, and New-Lifestyles NL-1000. METHODS For test-retest reliability, participants completed two 100-step overground walks at a usual pace while wearing all monitors. We tested the effects of the activity monitor and mobility status on the absolute difference in step count error (%) and computed the standard error of measurement (SEM) between repeat trials. To assess criterion validity, participants completed two 400-meter overground walks at a usual pace while wearing all monitors. The first walk was continuous; the second walk incorporated interruptions to mimic the conditions of daily walking. Criterion step counts were from the researcher tally count. We estimated the effects of the activity monitor, mobility status, and walk interruptions on step count error (%). We also generated Bland-Altman plots and conducted equivalence tests. RESULTS A total of 36 individuals participated (n=20 intact mobility and n=16 limited mobility; 19/36, 53% female) with a mean age of 71.4 (SD 4.7) years and BMI of 29.4 (SD 5.9) kg/m<sup>2</sup>. Considering test-retest reliability, there was an effect of the activity monitor (<i>P</i>&lt;.001). The Fitbit One (1.0%, 95% CI 0.6% to 1.3%), the New-Lifestyles NL-1000 (2.6%, 95% CI 1.3% to 3.9%), and the Garmin vívofit 2 (6.0%, 95 CI 3.2% to 8.8%) had the smallest mean absolute differences in step count errors. The SEM values ranged from 1.0% (Fitbit One) to 23.5% (Jawbone UP2). Regarding criterion validity, all monitors undercounted the steps. Step count error was affected by the activity monitor (<i>P</i>&lt;.001) and walk interruptions (<i>P</i>=.02). Three monitors had small mean step count errors: Misfit Shine (−1.3%, 95% CI −19.5% to 16.8%), Fitbit One (−2.1%, 95% CI −6.1% to 2.0%), and New-Lifestyles NL-1000 (−4.3%, 95 CI −18.9% to 10.3%). Mean step count error was larger during interrupted walking than continuous walking (−5.5% vs −3.6%; <i>P</i>=.02). Bland-Altman plots illustrated nonsystematic bias and small limits of agreement for Fitbit One and Jawbone UP2. Mean step count error lay within an equivalence bound of ±5% for Fitbit One (<i>P</i>&lt;.001) and Misfit Shine (<i>P</i>=.001). CONCLUSIONS Test-retest reliability and criterion validity of step counting varied across 6 consumer-grade activity monitors worn by older adults with self-reported intact and limited mobility. Walk interruptions increased the step count error for all monitors, whereas mobility status did not affect the step count error. The hip-worn Fitbit One was the only monitor with high test-retest reliability and criterion validity.

Test-retest reliability and criterion validity of a new Taekwondo Anaerobic Intermittent Kick Test

2019 ◽  
Vol 59 (2) ◽  
Author(s):  
Amel Tayech ◽  
Mohamed A. Mejri ◽  
Helmi Chaabene ◽  
Mehdi Chaouachi ◽  
David G. Behm ◽  
...  
Keyword(s):  
Criterion Validity ◽  
Retest Reliability ◽  
Test Retest Reliability

Examining the Technical Adequacy of the Social, Academic, and Emotional Behavior Risk Screener

2019 ◽  
Vol 46 (1) ◽  
pp. 67-75 ◽  
Author(s):  
Samuel F. Whitley ◽  
Yojanna Cuenca-Carlino
Keyword(s):  
Elementary School ◽  
Convergent Validity ◽  
Pearson Correlation ◽  
Ethnically Diverse ◽  
Criterion Validity ◽  
Emotional Behavior ◽  
Retest Reliability ◽  
Urban Elementary School ◽  
The Social ◽  
Test Retest Reliability

Many schools attempt to identify and service students at risk for poor mental health outcomes within a multi-tiered system of support (MTSS). Universal screening within a MTSS requires technically adequate tools. The Social, Academic, and Emotional Behavior Risk Screener (SAEBRS) has been put forth as a technically adequate screener. Researchers have examined the factor structure, diagnostic accuracy, criterion validity, and internal consistency of SAEBRS data. However, previous research has not examined its temporal stability or replicated the criterion validity results with a racially/ethnically diverse urban elementary school sample. This study examined the test–retest reliability, convergent validity, and predictive validity of teacher-completed SAEBRS ratings with racially/ethnically diverse group students enrolled in first through fifth grade in an urban elementary school. Reliability analyses resulted in significant test–retest reliability coefficients across four weeks for all SAEBRS scales. Furthermore, nonsignificant paired samples t tests were observed with the exception of the third-grade Emotional subscale. Validity analyses yielded significant concurrent and predictive Pearson correlation coefficients between SAEBRS ratings, oral reading fluency, and office discipline referrals. Limitations and implications of the results are discussed.

scholarly journals The test-retest reliability and criterion validity of a high-intensity, netball-specific circuit test: The Net-Test

2018 ◽  
Vol 21 (12) ◽  
pp. 1268-1273 ◽  
Author(s):  
Sean F. Mungovan ◽  
Paula J. Peralta ◽  
Gregory C. Gass ◽  
Aaron T. Scanlan
Keyword(s):  
High Intensity ◽  
Criterion Validity ◽  
Retest Reliability ◽  
Test Retest Reliability

Validity and Reliability of Question 8 of the Paffenbarger Physical Activity Questionnaire Among Healthy Adults

2015 ◽  
Vol 12 (1) ◽  
pp. 116-123 ◽  
Author(s):  
Kathleen Simpson ◽  
Beth Parker ◽  
Jeffrey Capizzi ◽  
Paul Thompson ◽  
Priscilla Clarkson ◽  
...  
Keyword(s):  
Physical Activity ◽  
Predictive Validity ◽  
Repeated Measures ◽  
Criterion Validity ◽  
Analysis Of Covariance ◽  
Retest Reliability ◽  
Physical Activity Questionnaire ◽  
Complete Representation ◽  
Test Retest Reliability ◽  
Activity Questionnaire

Background:Little information exists regarding the psychometric properties of question 8 (Q8) of the Paffenbarger Physical Activity Questionnaire (PPAQ) to assess exercise. Thus, we conducted 2 studies to assess the validity and test–retest reliability of Q8 among adults.Methods:Study 1 participants (n = 419) were 44.1 ± 16.1 years of age. Validity was determined by comparing self-reported hr·d−1 in sedentary, light, moderate, and vigorous intensity physical activity (PA) and MET-hr·wk−1 on Q8 at baseline to accelerometer and health/fitness measurements using Spearman rank-order correlations. Study 2 participants (n = 217) were 44.7 ± 16.3 years of age and completed Q8 at baseline, 3 months, and 6 months. Test–retest reliability was determined using repeated measures analysis of covariance, intraclass correlations (ICCs), and standard error of the measurement (SEM).Results:Q8 displayed good criterion validity compared with accelerometer measurements (r = .102 to .200, P < .05) and predictive validity compared with health/fitness measurements (r = –.272 to .203, P < .05). No differences were observed in self-reported hr·d−1 in any of the PA categories at baseline, 3 months, and 6 months (ICC: 0.49 to 0.68; SEM: 1.0 to 2.0; P > .05), indicating good reliability.Conclusion:Q8 demonstrates adequate criterion validity, acceptable predictive validity, and satisfactory test–retest reliability and can be used in conjunction with other components of the PPAQ to provide a complete representation of exercise.

Lifestyle Exercise Inventory: Preliminary Development

1993 ◽  
Vol 77 (3_suppl) ◽  
pp. 1066-1066 ◽  
Author(s):  
Bradley J. Cardinal ◽  
Marita K. Cardinal
Keyword(s):  
Physical Activity ◽  
Internal Consistency ◽  
Criterion Validity ◽  
Activity Model ◽  
Retest Reliability ◽  
Theoretical Pattern ◽  
Test Retest Reliability

Drawing from the Theoretical Pattern of Physical Activity Model of Blair, Kohl, and Gordon, a Lifestyle Exercise Inventory was developed. The internal consistency (.69, n = 178), test-retest reliability (.77), and criterion validity (−.27, .29, .32, and .32) of the measure are reported for 178 women.

scholarly journals Reliability and Validity of the German Version of the Emotional Style Questionnaire

2021 ◽  
Vol 12 ◽  
Author(s):  
Darko Jekauc ◽  
Lea Mülberger ◽  
Susanne Weyland ◽  
Fabienne Ennigkeit ◽  
Kathrin Wunsch ◽  
...  
Keyword(s):  
Construct Validity ◽  
Internal Consistency ◽  
Online Survey ◽  
Reliability And Validity ◽  
Criterion Validity ◽  
German Version ◽  
Personality Psychology ◽  
Retest Reliability ◽  
Test Retest Reliability ◽  
Emotional Style

Until recently, emotional processes have played little role in personality psychology. Based on neuroscientific findings, Davidson and colleagues proposed a theory of emotional styles, postulating six dimensions of emotional life: outlook, resilience, social intuition, self-awareness, sensitivity to context, and attention. Recently, an English version of the Emotional Style Questionnaire (ESQ) was developed and tested for reliability and validity. The aim of the present work was to test the test–retest reliability, internal consistency, construct validity, and criterion validity of the German version of the ESQ. Two separate samples consisting of 365 and 344 subjects took part in an online survey. The results of the two studies indicated satisfactory test–retest reliability and internal consistency. Regarding the construct validity, the results from Study 1 to Study 2 indicate good model fit indices. Although there was a high correlation between the subscales outlook and resilience, the analyses supported the six-factor structure postulated by Davidson and colleagues. Substantial correlations were found between the dimensions of the ESQ and other validated scales, confirming the criterion validity of the questionnaire. Our results suggest that the German version of the ESQ is a reliable and valid measurement of emotional styles. It is a feasible and economical questionnaire that can be applied in various psychology disciplines, such as personality psychology, clinical psychology, industrial psychology or sport and exercise psychology.

scholarly journals Development, reliability and validity of the Safe Use of Mobility Aids Checklist (SUMAC) for 4-wheeled walker use in people living with dementia

2020 ◽  
Author(s):  
Susan Hunter ◽  
Alison Divine ◽  
Humberto Omana ◽  
Edward Madou ◽  
Jeffrey Holmes
Keyword(s):  
Focus Groups ◽  
Physical Function ◽  
Assessment Tool ◽  
Rank Order ◽  
Criterion Validity ◽  
Minimal Detectable Change ◽  
Retest Reliability ◽  
People With Dementia ◽  
Mobility Aid ◽  
Test Retest Reliability

Abstract Background: Balance and gait problems are common and progressive in dementia. Mobility aid use in people with dementia increases the likelihood of falls three-fold. An assessment tool to quantify mobility aid safety in people with dementia does not currently exist. The objectives of this study were: 1) to develop a tool for the evaluation of physical function and safety with use of a 4-wheeled walker in people with dementia, and 2) to evaluate its construct and criterion validity, inter-rater and test-retest reliability and minimal detectable change.Methods: Healthcare professionals (HCP) experienced in care and rehabilitation of people with dementia participated in focus groups for item generation of the new tool, entitled The Safe Use of Mobility Aid Checklist (SUMAC). The SUMAC evaluates physical function (PF) and safe use of the equipment (EQ) on nine tasks of daily life. Ten individuals with dementia using a 4-wheeled walker were recorded performing the tasks within the SUMAC. Reliability was evaluated by having five HCP score participant videos on two occasions. Inter-rater and test-retest reliability was assessed using intra-class correlation coefficients (ICC). Construct validity was evaluated using scores determined by a consensus panel compared to the individual HCP scores using Spearman’s rank-order correlations. Criterion validity was assessed between SUMAC-PF and the Performance-Oriented Mobility Assessment (POMA) gait subscale using Spearman’s rank-order correlations. Results: Three focus groups (n=17) were completed and these generated a tool comprised of nine tasks and the components within each task that the clinicians would observe for physical function and safe use. Inter-rater reliability was statistically significant for the SUMAC-PF (ICC=0.92, 95%CI (0.81, 0.98), p<0.001) and SUMAC-EQ (ICC=0.82, 95%CI (0.54, 0.95), p<0.001). Test-retest reliability was also statistically significant for the SUMAC-PF (ICC=0.89, 95%CI (0.81, 0.94), p<0.001) and SUMAC-EQ (ICC=0.88, 95%CI (0.79, 0.93), p<0.001). The POMA gait subscale correlated strongly with the SUMAC-PF (r=0.84), but not EQ (r=0.39).Conclusions: Each of the scores of the SUMAC, physical function and safe use of the equipment, demonstrated content validity, strong inter-rater and test-retest reliability and strong criterion and concurrent validity for the assessment of mobility aid safety in people with dementia.

scholarly journals Development, reliability and validity of the Safe Use of Mobility Aids Checklist (SUMAC) for 4-wheeled walker use in people living with dementia

2020 ◽  
Author(s):  
Susan Hunter ◽  
Alison Divine ◽  
Humberto Omana ◽  
Edward Madou ◽  
Jeffrey Holmes
Keyword(s):  
Focus Groups ◽  
Physical Function ◽  
Assessment Tool ◽  
Rank Order ◽  
Criterion Validity ◽  
Minimal Detectable Change ◽  
Retest Reliability ◽  
People With Dementia ◽  
Mobility Aid ◽  
Test Retest Reliability

Abstract Background Balance and gait problems are common and progressive in dementia. Mobility aid use in people with dementia increases the likelihood of falls three-fold. An assessment tool to quantify mobility aid safety in people with dementia does not currently exist. The objectives of this study were: 1) to develop a tool for the evaluation of physical function and safety with use of a 4-wheeled walker in people with dementia, and 2) to evaluate its construct and criterion validity, inter-rater and test-retest reliability and minimal detectable change. Methods Healthcare professionals (HCP) experienced in care and rehabilitation of people with dementia participated in focus groups for item generation of the new tool, entitled The Safe Use of Mobility Aid Checklist (SUMAC). The SUMAC evaluates physical function (PF) and safe use of the equipment (EQ) on nine tasks of daily life. Ten individuals with dementia using a 4-wheeled walker were recorded performing the tasks within the SUMAC. Reliability was evaluated by having five HCP score participant videos on two occasions. Inter-rater and test-retest reliability was assessed using intra-class correlation coefficients (ICC). Construct validity was evaluated using scores determined by a consensus panel compared to the individual HCP scores using Spearman’s rank-order correlations. Criterion validity was assessed between SUMAC-PF and the Performance-Oriented Mobility Assessment (POMA) using Spearman’s rank-order correlations. Results Three focus groups (n=17) were completed and these generated a tool comprised of nine tasks and the components within each task that the clinicians would observe for physical function and safe use. Inter-rater reliability was statistically significant for the SUMC-PF (ICC=0.72, 95%CI (0.33-0.92), p<0.001) and SUMAC-EQ (ICC=0.40, 95%CI (0.03-0.78), p=0.020). Test-retest reliability was also statistically significant for the SUMAC-PF (ICC=0.69, 95%CI (0.45-0.83), p<0.001) and SUMAC-EQ (ICC=0.73, 95%CI (0.53,0.85), p<0.001). The POMA correlated strongly with the SUMAC-PF (r=0.84), but not EQ (r=0.39). Conclusions Each of the scores of the SUMAC, physical function and safe use of the equipment, demonstrated content validity, strong inter-rater and test-retest reliability and strong criterion and concurrent validity for the assessment of mobility aid safety in people with dementia.

Preliminary Study of the Bilingual Version of Creative Motivation Inventory

1994 ◽  
Vol 79 (1) ◽  
pp. 393-394
Author(s):  
Ananda Kumar Palaniappan
Keyword(s):  
Criterion Validity ◽  
Self Report ◽  
Retest Reliability ◽  
False Self ◽  
Preliminary Study ◽  
Test Retest Reliability ◽  
Malaysian Students ◽  
High Test ◽  
True False

A bilingual version of Torrance's Creative Motivation Inventory was administered to 64 Malaysian students. The 28-item true-false self-report was found to have moderate to high test-retest reliability and criterion validity. Replication with other groups is recommended.

Sign in / Sign up

Export Citation Format

Share Document