scholarly journals Reliability and Construct Validity of the Leipzig Short Scale of Sense of Coherence (SOC-L9) in Japanese Sample: The Rasch Measurement Model and Confirmatory Factor Analysis

2020 ◽  
Vol 29 (2) ◽  
pp. 120-122
Author(s):  
Takayoshi Kase ◽  
Shintaro Endo
Author(s):  
Miftahuljanah Kamaruddin ◽  
Mohd Effendi Ewan Mohd Matore

Background: The International Baccalaureate Middle Years Programme (IBMYP) aims to produce a holistic transformation with creative and critically minded students. However, very little attention has been paid to the development of an instrument to measure the IB learner profile with good psychometric properties. Purpose: This study aims to develop an instrument with good psychometric properties, based on the Rasch measurement model and confirmatory factor analysis. Methods: The study consists of two phases of pilot and field studies involving 597 year four students from IBWS MOE. Results: The findings from the Rasch measurement model analysis have shown that 54 items meet the criteria of the item fit, unidimensionality, and reliability index. Meanwhile, confirmatory factor analysis found that 44 items have shown a valid item fit index. Conclusions: The combination of both analyses has shown the strength of 10IBLP-I psychometric properties that cover the aspects of validity and reliability. The findings also provide an implication to the theory, with empirical evidence that the IB learner profile consists of 10 constructs. Besides, the evidenced 10IBLP-I comprises good psychometric properties, which can be used to measure the level of IB learner profile among IBWS MOE students to assess the effectiveness of the implementation of IBMYP in Malaysia.


2017 ◽  
Vol 60 (6) ◽  
pp. 1516-1534 ◽  
Author(s):  
Wolfram Ziegler ◽  
Anja Staiger ◽  
Theresa Schölderle ◽  
Mathias Vogel

Purpose Standardized clinical assessment of dysarthria is essential for management and research. We present a new, fully standardized dysarthria assessment, the Bogenhausen Dysarthria Scales (BoDyS). The measurement model of the BoDyS is based on auditory evaluations of connected speech using 9 scales (traits) assessed by 4 elicitation methods. Analyses of the BoDyS' reliability and construct validity were performed to test this model, with the aim of gauging the auditory dimensions of speech impairment in dysarthria. Method Interrater agreement was examined in 70 persons with dysarthria. Construct validity was examined in 190 persons with dysarthria using a multitrait-multimethod design with confirmatory factor analysis. Results Interrater agreement of < 1 on a 5-point scale was found in 91% of cases across listener pairs and scales. Average reliability was .85. Inspection of the multitrait-multimethod matrix pointed at a high convergent and discriminant validity. Modeling of the BoDyS trait and method factors using confirmatory factor analysis yielded high goodness of fit. Model coefficients confirmed high discriminant and convergent validity and revealed meaningful relationships between scales and methods. Conclusions The 9 auditory scales of the BoDyS provide a reliable and valid profile of dysarthric impairment. They permit standardized measurement of clinically relevant dimensions of dysarthric speech.


Author(s):  
Wanida Simpol ◽  
Phoom Praraksa ◽  
Siridej Sujiva

The sufficiency economy philosophy in King Bhumibol’s initiative is a principle for the development of people especially their ideas and the relationship of adequate living, that is providing guidance on appropriate conduct covering numerous aspects of life. This construct is a new model in educational measurement in Thailand. This study tried to examine the construct validity of the measurement model by using the sufficient life skill (SLS) scale. The scale was used to measure the SLS of 599 Thai students studying in basic education level and the lie scale was applied to detect faking of test takers. The confirmatory factor analysis was utilised for comparing the two different models, holistic and specific models. The result showed consequence of construct validity of the better model. In addition, findings also supported the importance of applying lie scale for detecting faking responses. Theoretical implications are discussed. Keywords: Construct validity, confirmatory factor analysis, sufficient life skill, sufficiency economy philosophy.


Author(s):  
Mi Kyoung Yim ◽  
Yoon Hee Kim

Confirmatory factor analysis based on a measurement model of a structural equation model was used to test the construct validity of 13 subjects in the Korean Dental Licensing Examination (KDLE). The results of 1,086 examinees who wrote the KDLE in 2004 were analyzed. The thirteen subjects were classified into 62 major categories and 122 intermediate categories. There were 364 items. A hierarchical model was constructed, including major and intermediate categories. The impact of the variables was determined by the standardized regression coefficient that related latent and measured variables in the measurement model. The KDLE showed a high goodness-of-fit with a root mean square error of approximation of 0.030 and a non-normed fit index of 0.998. When the latent variables for the major and intermediate categories were analyzed, the standardized regression coefficients of all of the subjects, with the exception of Health and Medical Legislation, were significant. From the result, we concluded that the 13 subjects showed constructive validity. In addition, the study model and data were very compatible. The subject Health and Medical Legislation had a low explanatory impact with respect to testing the ability of dentists to perform their jobs. This study suggests that similar psychometric studies are needed before integrating or deleting subjects on the KDLE, and to improve item development.


2021 ◽  
Vol 6 (2) ◽  
pp. 133-155
Author(s):  
Riyan Hidayat ◽  
Hilman Qudratuddarsi ◽  
Nurul Hijja Mazlan ◽  
Mohd Zaidi Mohd Zeki

Background and Purpose: Mathematical modelling competency is one of the vital characteristics in mathematics education. Educational researchers have updated the benefit of modelling as key factor to the study of complexity and modern science. Since many scholars frequently adopt instrument from one cultural background to another, they also offer proof on the issue of validity and reliability. The present paper aimed at validating a mathematical modelling test for secondary prospective mathematics teachers.   Methodology: We utilized a survey approach to examine the factor structure of mathematical modelling test for 202 secondary prospective mathematics teachers, selected by cluster random sampling. Mathematical modeling test was adapted to measure the desired constructs. More importantly, we used exploratory factor analysis (EFA), confirmatory factor analysis (CFA) using AMOS 18 and Rasch measurement model with Winstep version 3.73 to analyze the data.   Findings: The EFA and CFA technique verified that a mathematical modelling test was acceptable for Indonesian prospective mathematics teachers. In addition, Rasch analysis also confirmed that all items fit the criteria well and implied that all items are valid in measuring student mathematical modelling competency. This finding concludes that the mathematical modelling test of Indonesian prospective mathematics teachers have an eight-dimension structure.    Contributions: This present research contributes towards psychometric measure on the reliability and validity of a mathematical modelling test in mathematics education programs.   Keywords: Confirmatory factor analysis, mathematical modelling competency, Rasch measurement model.   Cite as: Hidayat, R., Qudratuddarsi, H., Mazlan, N. H., & Mohd Zeki, M. Z. (2021). Evaluation of a test measuring mathematical modelling competency for Indonesian college students.  Journal of Nusantara Studies, 6(2), 133-155. http://dx.doi.org/10.24200/jonus.vol6iss2pp133-155


2021 ◽  
Vol 11 (4) ◽  
pp. 320
Author(s):  
Siddharthan Selvaraj ◽  
Nyi Nyi Naing ◽  
Nadiah Wan-Arfah ◽  
Somasundaram Prasadh

Background: Oral health-related conditions are among the common conditions seen in adults in India. The usage of inappropriate measurement tools that are unvalidated may result in deceptive and imprecise findings that might lead to substandard plans for cessation programs and ineffectiveness. This study was conducted to validate a questionnaire that can assess the factor structure of knowledge, attitude, and behaviour towards oral health among adults in India by confirmatory factor analysis. Methods: Simple random sampling was conducted among adults in India. A total of 260 adults participated in this study. The knowledge, attitude, and behaviour (KAB) questionnaire on oral health was circulated among the adults who were willing to participate in the study after it was explained to them, and the questionnaires were retrieved once they completed. Software R version 3.6 was used to analyse the data of this study. Robust maximum likelihood was utilized for the assessment due to the violation of multivariate normality assumption. For attitude and behaviour domain, a three-factor model was used for measurement model validity and construct validity. Results: The confirmatory factor analysis of the three-factor model for the 26-item KAB questionnaire on oral health gave sufficient goodness-of-fit values and the measurement model exhibited ideal convergent and discriminant validity following model re-specification. The three-factor model was tested to obtain measurement model validity and construct validity for attitude and behaviour domains. The results of this study gave a statistically significant value (p < 0.001), with χ2 (df) values of 39 (7) and 28 (11) for attitude and behaviour domains, respectively. Conclusions: The KAB oral health questionnaire used in this study has a valid measurement model and reliable constructs. It was found to be an ideal tool to measure the KAB towards oral health among adults in India.


SLEEP ◽  
2021 ◽  
Vol 44 (Supplement_2) ◽  
pp. A201-A202
Author(s):  
Kristina Puzino ◽  
Susan Calhoun ◽  
Allison Harvey ◽  
Julio Fernandez-Mendoza

Abstract Introduction The Sleep Inertia Questionnaire (SIQ) was developed and validated in patients with mood disorders to evaluate difficulties with becoming fully awake after nighttime sleep or daytime naps in a multidimensional manner. However, few data are available regarding its psychometric properties in clinical samples with sleep disorders. Methods 211 patients (43.0±16.4 years old, 68% female, 17% minority) evaluated at the Behavioral Sleep Medicine (BSM) program of Penn State Health Sleep Research & Treatment Center completed the SIQ. All patients were diagnosed using ICSD-3 criteria, with 111 receiving a diagnosis of chronic insomnia disorder (CID), 48 of a central disorder of hypersomnolence (CDH), and 52 of other sleep disorders (OSD). Structural equation modelling was used to conduct confirmatory factor analysis (CFA) of the SIQ. Results CFA supported four SIQ dimensions of “physiological”, “cognitive”, “emotional” and “response to” (RSI) sleep inertia with adequate goodness-of-fit (TLI=0.90, CFI=0.91, GFI=0.85, RMSEA=0.08). Internal consistency was high (α=0.94), including that of its dimensions (physiological α=0.89, cognitive α=0.94, emotional α=0.67, RSI α=0.78). Dimension inter-correlations were moderate to high (r=0.42–0.93, p&lt;0.01), indicating good construct validity. Convergent validity showed moderate correlations with Epworth sleepiness scale (ESS) scores (r=0.38) and large correlations with Flinders fatigue scale (FFS) scores (r=0.65). Criterion validity showed significantly (p&lt;0.01) higher scores in subjects with CDH (69.0±16.6) as compared to those with CID (54.4±18.3) or OSD (58.5±20.0). A SIQ cut-off score ≥57.5 provided a sensitivity/specificity of 0.77/0.65, while a cut-off score ≥61.5 provided a sensitivity/specificity of 0.71/0.70 to identify CDH vs. ESS&lt;10 (AUC=0.76). Conclusion The SIQ shows satisfactory indices of reliability and construct validity in a clinically-diverse sleep disorders sample. Its criterion validity is supported by its divergent association with hypersomnia vs. insomnia disorders, as well as its adequate sensitivity/specificity to identify patients with CDH. The SIQ can help clinicians easily assess the complex dimensionality of sleep inertia and target behavioral sleep treatments. Future studies should confirm the best SIQ cut-off score by including good sleeping controls, while clinical studies should determine its minimal clinically important difference after pharmacological or behavioral treatments. Support (if any):


Sign in / Sign up

Export Citation Format

Share Document