NIH Toolbox Cognitive Battery (NIHTB-CB): The NIHTB Pattern Comparison Processing Speed Test

AbstractThe NIH Toolbox (NIHTB) Pattern Comparison Processing Speed Test was developed to assess processing speed within the NIHTB for the Assessment of Neurological Behavior and Function Cognition Battery (NIHTB-CB). This study highlights validation data collected in adults ages 18–85 on this measure and reports descriptive data, test–retest reliability, construct validity, and preliminary work creating a composite index of processing speed. Results indicated good test–retest reliability. There was also evidence for both convergent and discriminant validity; the Pattern Comparison Processing Speed Test demonstrated moderate significant correlations with other processing speed tests (i.e., WAIS-IV Coding, Symbol Search and Processing Speed Index), small significant correlations with measures of working memory (i.e., WAIS-IV Letter-Number Sequencing and PASAT), and non-significant correlations with a test of vocabulary comprehension (i.e., PPVT-IV). Finally, analyses comparing and combining scores on the NIHTB Pattern Comparison Processing Speed Test with other measures of simple reaction time from the NIHTB-CB indicated that a Processing Speed Composite score performed better than any test examined in isolation. The NIHTB Pattern Comparison Processing Speed Test exhibits several strengths: it is appropriate for use across the lifespan (ages, 3–85 years), it is short and easy to administer, and it has high construct validity. (JINS, 2014,20, 1–12)

Download Full-text

Reliability and Validity of Turkish Myasthenia Gravis-Activities of Daily Living Scale

OTJR Occupation Participation and Health ◽

10.1177/1539449220961077 ◽

2020 ◽

pp. 153944922096107

Author(s):

Ecem Karanfil ◽

Yeliz Salcı ◽

Ayla Fil-Balkan ◽

Can Ebru Bekircan-Kurt ◽

Sevim Erdem Özdamar ◽

...

Keyword(s):

Construct Validity ◽

Myasthenia Gravis ◽

Activities Of Daily Living ◽

Daily Living ◽

Intraclass Correlation ◽

Reliability And Validity ◽

Life Questionnaire ◽

Good Test ◽

Retest Reliability ◽

Test Retest Reliability

Linguistic, reliable, and valid secondary efficacy measures are important in clinical settings and studies. The aim of the study is to report test–retest reliability and construct validity of Turkish version of Myasthenia Gravis-Activities of Daily Living Scale (MG-ADL-T) in Myasthenia Gravis (MG) patients. Fifty-two ocular and generalized individuals with MG, applying to rehabilitation center, were included in the study. MG-ADL-T, MG quality-of-life questionnaire (MG-QoL), MG composite (MGC), quantitative MG score (QMGS), and pulmonary function test were administered. Reliability was assessed with intraclass correlation coefficient (ICC) and Cronbach’s alpha. Spearman correlation test and receiver operating characteristic (ROC) analysis were performed for construct validity. MG-ADL-T had fair internal consistency (Cronbach’s α = .67), excellent test–retest reliability (ICC = 0.96) and moderate construct validity (MG-QoL, r = 0.59; QMGS, r = .58; MGC, r = .68). MG-ADL, a unique scale that evaluates activities of daily living (ADL), has good test–retest reliability and construct validity in Turkish MG patients.

Download Full-text

Reliability and Construct Validity of Self-Report Questionnaires for Patients With Pelvic Girdle Pain

Physical Therapy ◽

10.2522/ptj.20110076 ◽

2012 ◽

Vol 92 (1) ◽

pp. 111-123 ◽

Cited By ~ 55

Author(s):

Margreth Grotle ◽

Andrew M. Garratt ◽

Hanne Krogstad Jenssen ◽

Britt Stuge

Keyword(s):

Construct Validity ◽

Internal Consistency ◽

Discriminant Validity ◽

Pelvic Girdle ◽

Self Report ◽

Pelvic Girdle Pain ◽

Consistency Test ◽

Retest Reliability ◽

Sf 36 ◽

Test Retest Reliability

Background There is little evidence for the measurement properties of instruments commonly used for women with pelvic girdle pain. Objective The aim of this study was to examine the internal consistency, test-retest reliability, and construct validity of instruments used for women with pelvic girdle pain. Design This was a cross-sectional methodology study, including test-retest reliability assessment. Methods Women with pelvic girdle pain in pregnancy and after delivery participated in a postal survey that included the Pelvic Girdle Questionnaire (PGQ), Oswestry Disability Index (ODI), Disability Rating Index (DRI), Fear-Avoidance Beliefs Questionnaire (FABQ), Pain Catastrophizing Scale (PCS), and 8-item version of the Medical Outcomes Study 36-Item Short-Form Health Survey questionnaire (SF-36). Test-retest reliability was assessed with a random subsample 1 week later. Internal consistency was assessed with the Cronbach alpha, and test-retest reliability was assessed with the intraclass correlation coefficient (ICC) and minimal detectable change (MDC). Construct validity based on hypotheses was assessed by correlation analysis. Discriminant validity was assessed with the area under the receiver operating characteristic curve. Results All participants responded to the main (N=87) and test-retest (n=42) surveys. Cronbach alpha values ranged from .88 to .94, and ICCs ranged from .78 to .94. The MDC at the individual level constituted about 7% to 14% of total scores for the 8-item version of the SF-36, ODI, and PGQ activity subscale; about 18% to 22% for the DRI, PGQ symptom subscale, and PCS; and about 25% for the FABQ. Hypotheses were mostly confirmed by correlations between the instruments. The PGQ was the only instrument that significantly discriminated participants who were pregnant from participants who were not pregnant as well as pain locations. Limitations A comparison of responsiveness to change of the various instruments used in this study was not undertaken, but will be carried out in a future study. Conclusions Self-report instruments for assessing health showed good internal consistency, test-retest reliability, and construct validity for women with pelvic girdle pain. The PGQ was the only instrument with satisfactory discriminant validity, thus, it is recommended for evaluating symptoms and disability in patients with pelvic girdle pain.

Download Full-text

Validity and Reliability of the Italian Version of the Functioning Assessment Short Test (FAST) in Bipolar Disorder

Clinical Practice and Epidemiology in Mental Health ◽

10.2174/1745017901208010067 ◽

2012 ◽

Vol 8 (1) ◽

pp. 67-73 ◽

Cited By ~ 8

Author(s):

Maria Francesca Moro ◽

Francesc Colom ◽

Francesca Floris ◽

Elisa Pintus ◽

Mirra Pintus ◽

...

Keyword(s):

Internal Consistency ◽

Discriminant Validity ◽

Validity And Reliability ◽

Italian Version ◽

Good Test ◽

Retest Reliability ◽

Short Test ◽

Bipolar Patients ◽

Test Retest Reliability ◽

Functioning Assessment

Background:Functioning Assessment Short Test (FAST) is a brief instrument designed to assess the main functioning problems experienced by psychiatric patients, specifically bipolar patients. It includes 24 items assessing impairment or disability in six domains of functioning: autonomy, occupational functioning, cognitive functioning, financial issues, interpersonal relationships and leisure time. The aim of this study is to measure the validity and reliability of the Italian version of this instrument.Methods:Twenty-four patients with DSM-IV TR bipolar disorder and 20 healthy controls were recruited and evaluated in three private clinics in Cagliari (Sardinia, Italy). The psychometric properties of FAST (feasibility, internal consistency, concurrent validity, discriminant validity (patients vs controls and eutimic patients vs manic and depressed), and test-retest reliability were analyzed.Results:The internal consistency obtained was very high with a Cronbach's alpha of 0.955. A highly significant negative correlation with GAF was obtained (r = -0.9; p < 0.001) pointing to a reasonable degree of concurrent validity. FAST show a good test-retest reliability between two independent evaluation differing of one week (mean K =0.73). The total FAST scores were lower in controls as compared with Bipolar Patients and in Euthimic patients compared with Depressed or Manic.Conclusion:The Italian version of the FAST showed similar psychometrics properties as far as regard internal consistency and discriminant validity of the original version and show a good test retest reliability measure by means of K statistics.

Download Full-text

Reliability and Structural and Construct Validity of the Functional Strength Measurement in Children Aged 4 to 10 Years

Physical Therapy ◽

10.2522/ptj.20140018 ◽

2016 ◽

Vol 96 (6) ◽

pp. 888-897 ◽

Cited By ~ 13

Author(s):

Wendy F.M. Aertssen ◽

Gillian D. Ferguson ◽

Bouwien C.M. Smits-Engelsman

Keyword(s):

Factor Analysis ◽

Muscle Strength ◽

Construct Validity ◽

Exploratory Factor Analysis ◽

Convergent Validity ◽

Discriminant Validity ◽

Structural Validity ◽

Strength Measurement ◽

Retest Reliability ◽

Test Retest Reliability

Background Adequate muscle strength, power, and endurance are important in children's daily activities and sports. Various instruments have been developed for the assessment of muscle function; each measures different aspects. The Functional Strength Measurement (FSM) was developed to measure performance in activities in which strength is required. Objective The study objective was to establish the test-retest reliability and structural and construct validity of the FSM. Design A cross-sectional descriptive study was conducted. Methods The performance of 474 children with typical development on the FSM was examined. Test-retest reliability (n=47) was calculated with the intraclass correlation coefficient (2.1A) for agreement. Structural validity was examined with exploratory factor analysis, and internal consistency was established with the Cronbach alpha. Construct validity was determined by calculating correlations between FSM scores and scores obtained with a handheld dynamometer (HHD) (n=252) (convergent validity) and between FSM scores and scores on the Movement Assessment Battery for Children–2 (MABC-2) (n=77) (discriminant validity). Results The test-retest reliability of the FSM total score ranged from .91 to .94. The structural validity revealed one dimension, containing all 8 FSM items. The Cronbach alpha was .74. The convergent validity with the HHD ranged from .42 to .74. The discriminant validity with MABC-2 items revealed correlations that were generally lower than .39, and most of the correlations were not significant. Exploratory factor analysis of a combined data set (FSM, HHD, and MABC-2; n=77) revealed 2 factors: muscle strength/power and muscle endurance with an agility component. Limitations Discriminant validity was measured only in children aged 4 to 6 years. Conclusions The FSM, a norm-referenced test for measuring functional strength in children aged 4 to 10 years, has good test-retest reliability and good construct validity.

Download Full-text

Psychometric properties of the perceived stress scale (PSS): measurement invariance between athletes and non-athletes and construct validity

10.7287/peerj.preprints.2268v2 ◽

2016 ◽

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

Background: Although Perceived Stress Scale (PSS, Cohen, Kamarack, Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices. Purpose: The purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts. Methods: Study 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males=124; females=118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57, Mage =19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS. Results: Results found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r=.66 and r=.50). Discussion: It is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Turkish Version of the Cognitive Distortions Questionnaire: Psychometric Properties

Depression Research and Treatment ◽

10.1155/2015/694853 ◽

2015 ◽

Vol 2015 ◽

pp. 1-8 ◽

Cited By ~ 2

Author(s):

Sedat Batmaz ◽

Sibel Kocbiyik ◽

Ozgur Ahmet Yuncu

Keyword(s):

Psychometric Properties ◽

Internal Consistency ◽

Discriminant Validity ◽

Cognitive Distortions ◽

Pearson Correlation ◽

Turkish Version ◽

Oblique Rotation ◽

Good Test ◽

Retest Reliability ◽

Test Retest Reliability

Cognitive distortions are interrelated with all layers of cognitions, and they may be part of the treatment once they are accessed, identified, labeled, and changed. From both a research and a clinical perspective, it is of utmost importance to disentangle cognitive distortions from similar constructs. Recently, the Cognitive Distortions Questionnaire (CD-Quest), a brief and comprehensive measure, was developed to assess both the frequency and the intensity of cognitive distortions. The aim of the present study was to assess the psychometric properties of the Turkish version of the CD-Quest in a psychiatric outpatient sample. Demographic and clinical data of the participants were analyzed by descriptive statistics. For group comparisons, Student’st-test was applied. An exploratory principal components factor analysis was performed, followed by an oblique rotation. To assess the internal consistency of the scale Cronbach’sαwas computed. The correlation coefficient was calculated for test-retest reliability over a 4-week period. For concurrent validity, bivariate Pearson correlation analyses were conducted with the measures of mood severity and negatively biased cognitions. The results revealed that the scale had excellent internal consistency, good test-retest reliability, unidimensional factor structure, and evidence of concurrent and discriminant validity.

Download Full-text

E-Cigarette Demand: Impact of Commodity Definitions and Test–Retest Reliability

Nicotine & Tobacco Research ◽

10.1093/ntr/ntaa139 ◽

2020 ◽

Author(s):

Justin C Strickland ◽

Olga A Vsevolozhskaya ◽

William W Stoops

Keyword(s):

Effect Size ◽

Discriminant Validity ◽

Good Test ◽

Retest Reliability ◽

Cigarette Demand ◽

Convergent And Discriminant Validity ◽

Human Participants ◽

Puff Intensity ◽

Test Retest Reliability

Abstract Introduction Behavioral economic demand provides a multidimensional understanding of reinforcement. Commodity purchase tasks are an efficient method for measuring demand in human participants. One challenge in translating these procedures to electronic nicotine delivery systems (ENDS or e-cigarettes) is defining commodity units given the lack of standardization in the e-cigarette marketplace. Aims and Methods The purpose of this study was to directly compare methods of operationalizinge-cigarette purchases, puffs, cartridges, and mLs liquid, using a within-subject design. Participants (N = 132) reporting past week e-cigarette use were recruited using crowdsourcing. Purchase tasks were completed operationalizing e-cigarette units as puffs or cartridges at baseline and puffs or mLs liquid at a 3-month follow-up. Results Bivariate associations supported convergent and discriminant validity with the largest effect size correlations for intensity and elasticity observed for the puff version. Interaction models suggested that product preferences moderated the relationship between time-to-first use and cartridge demand with larger effect size correlations among persons reporting a preference for JUULs, but weaker relationships among persons reporting other device preferences. Puff intensity (rxx = .61) and elasticity (rxx = .62) showed good test–retest reliability for participants reporting stable consumption, but poor test–retest reliability for individuals with changed consumption levels (intensity rxx = −.08; elasticity rxx = −.10). Conclusions This study highlights the relevance of commodity definitions in the e-cigarette purchase task. Puffs as an experimental commodity may provide flexibility for studying e-cigarette demand in heterogenous or unknown populations, whereas more tailored or personalized approaches like cartridge or mL-based tasks will likely be helpful when studying known subgroups. Implications The commodity purchase task procedure is widely used for understanding cigarette and e-cigarette demand in nicotine dependence research. This study evaluates the importance of operational definitions of e-cigarette commodities in the purchase task (ie, puffs, cartridges, or mLs liquid). Puffs may provide a more flexible commodity unit when evaluating e-cigarette demand in general or heterogenous populations, whereas device-specific units may prove more valuable when studying populations with consistent and known product use.

Download Full-text

Psychometric properties of the Perceived Stress Scale (PSS): measurement invariance between athletes and non-athletes and construct validity

PeerJ ◽

10.7717/peerj.2790 ◽

2016 ◽

Vol 4 ◽

pp. e2790 ◽

Cited By ~ 9

Author(s):

Yi-Hsiang Chiu ◽

Frank Jing-Horng Lu ◽

Ju-Han Lin ◽

Chiao-Lin Nien ◽

Ya-Wen Hsu ◽

...

Keyword(s):

Construct Validity ◽

Measurement Invariance ◽

Perceived Stress ◽

Convergent Validity ◽

Student Athletes ◽

Discriminant Validity ◽

Perceived Stress Scale ◽

Retest Reliability ◽

Stress Scale ◽

Test Retest Reliability

BackgroundAlthough Perceived Stress Scale (PSS, Cohen, Kamarack & Mermelstein, 1983) has been validated and widely used in many domains, there is still no validation in sports by comparing athletes and non-athletes and examining related psychometric indices.PurposeThe purpose of this study was to examine the measurement invariance of PSS between athletes and non-athletes, and examine construct validity and reliability in the sports contexts.MethodsStudy 1 sampled 359 college student-athletes (males = 233; females = 126) and 242 non-athletes (males = 124; females = 118) and examined factorial structure, measurement invariance and internal consistency. Study 2 sampled 196 student-athletes (males = 139, females = 57,Mage = 19.88 yrs, SD = 1.35) and examined discriminant validity and convergent validity of PSS. Study 3 sampled 37 student-athletes to assess test-retest reliability of PSS.ResultsResults found that 2-factor PSS-10 fitted the model the best and had appropriate reliability. Also, there was a measurement invariance between athletes and non-athletes; and PSS positively correlated with athletic burnout and life stress but negatively correlated with coping efficacy provided evidence of discriminant validity and convergent validity. Further, the test-retest reliability for PSS subscales was significant (r = .66 andr = .50).DiscussionIt is suggested that 2-factor PSS-10 can be a useful tool in assessing perceived stress either in sports or non-sports settings. We suggest future study may use 2-factor PSS-10 in examining the effects of stress on the athletic injury, burnout, and psychiatry disorders.

Download Full-text

Multimodal immersive trail making – virtual reality paradigm to study cognitive-motor interactions

10.1101/2020.05.27.118760 ◽

2020 ◽

Author(s):

Meir Plotnik ◽

Oran Ben-Gal ◽

Glen M. Doniger ◽

Amihai Gottlieb ◽

Yotam Bahat ◽

...

Keyword(s):

Virtual Reality ◽

Executive Function ◽

Construct Validity ◽

Repeated Measures ◽

Discriminant Validity ◽

Middle Aged ◽

Retest Reliability ◽

Pencil And Paper ◽

Test Retest Reliability ◽

Completion Times

ABSTRACTBackgroundNeuropsychological tests of executive function have limited real-world predictive and functional relevance. An emerging solution for this limitation is to adapt the tests for implementation in virtual reality (VR). We thus developed two VR-based versions of the classic Color-Trails Test (CTT), a well-validated pencil-and-paper executive function test assessing sustained (Trails A) and divided (Trails B) attention - one for a large-scale VR system (DOME-CTT) and the other for a portable head-mount display VR system (HMD-CTT). We then evaluated construct validity, test-retest reliability, and age-related discriminant validity of the VR-based versions and explored effects on motor function.MethodsHealthy adults (n=147) in three age groups (young: n=50; middle-aged: n=80; older: n=17) participated. All participants were administered the original CTT, some completing the DOME-CTT (14 young, 29 middle-aged) and the rest completing the HMD-CTT. Primary outcomes were Trails A and B completion times (tA, tB). Spatiotemporal characteristics of upper-limb reaching movements during VR test performance were reconstructed from motion capture data. Statistics included correlations and repeated measures analysis of variance.ResultsConstruct validity was substantiated by moderate correlations between the ‘gold standard’ pencil-and-paper CTT and the VR adaptations (DOME-CTT: tA 0.58, tB 0.71; HMD-CTT: tA 0.62, tB 0.69). VR versions showed relatively high test-retest reliability (intraclass correlation; VR: tA 0.60-0.75, tB 0.59-0.89; original: tA 0.75-0.85, tB 0.77-0.80) and discriminant validity (area under the curve; VR: tA 0.70-0.92, tB 0.71-0.92; original: tA 0.73-0.95, tB 0.77-0.95). VR completion times were longer than for the original pencil-and-paper test; completion times were longer with advanced age. Compared with Trails A, Trails B target-to-target VR hand trajectories were characterized by delayed, more erratic acceleration and deceleration, consistent with the greater executive function demands of divided vs. sustained attention; acceleration onset later for older participants.ConclusionsThe present study demonstrates the feasibility and validity of converting a neuropsychological test from two-dimensional pencil-and-paper to three-dimensional VR-based format while preserving core neuropsychological task features. Findings on the spatiotemporal morphology of motor planning/execution during the cognitive tasks may lead to multimodal analysis methods that enrich the ecological validity of VR-based neuropsychological testing, representing a novel paradigm for studying cognitive-motor interactions.

Download Full-text

Validation of the Pain Beliefs and Perceptions Inventory

Pain Research and Management ◽

10.1155/1996/134982 ◽

1996 ◽

Vol 1 (1) ◽

pp. 31-38

Author(s):

Samuel F Mikail ◽

Joyce L D'Eon ◽

Théo A De Gagné

Keyword(s):

Construct Validity ◽

Pain Clinic ◽

Mcgill Pain Questionnaire ◽

Factor Solution ◽

Good Test ◽

Initial Development ◽

Retest Reliability ◽

Pain Beliefs ◽

Self Blame ◽

Test Retest Reliability

OBJECTIVE:To examine the test-retest reliability, construct validity and factor structure of the Pain Beliefs and Perceptions Inventory (PBPI).DESIGN:A sample of 195 individuals attending a chronic pain clinic completed the PBPI along with a preclinic assessment battery. A subset of this sample completed the assessment package two to four weeks and four to six months later in order to examine the test-retest reliability of the PBPI.RESULTS:Confirmatory factor analysis revealed a four-factor solution: pain constancy, self-blame, mystery and understanding of chronicity. Internal consistency estimates ranged from 0.63 to 0.75. Pain constancy and understanding of chronicity had good test-retest reliability, while test-retest reliability of the remaining subscales was not adequate. These results differ from those reported in the initial development of the PBPI. Construct validity was determined through examination of correlations between the PBPI and the Beck Depression Inventory, the McGill Pain Questionnaire, the Multidimensional Pain Inventory and a self-blame questionnaire.CONCLUSIONS:The results of this investigation are consistent with the findings of recent investigations that revealed a four-factor solution to the PBPI. However, the subscales of this instrument were not found to be uniformly stable over time. These results suggest that further examination and refinement of item content for two of the subscales are required before the instrument is suitable for clinical use.

Download Full-text