Psychometric analysis of a Malay language version of the Principal Instructional Management Rating Scale

Author(s):  
Lei Mee Thien

The extent to which the Principal Instructional Management Rating Scale (PIMRS) is sensitive and appropriate to be used in different cultural contexts remains underexplored in the literature. To address this research gap, this study attempts to validate a Malay language version of PIMRS by assessing convergent, discriminant, and criterion validity from a hierarchical perspective. Data were collected from 375 primary school teachers from 30 selected schools in Penang and Kedah, Malaysia. Data were analysed using partial least squares structural equation modelling approach with SmartPLS 3.2.9 software. Findings revealed that four items had to be excluded to ensure the construct validity of the third-, second-, and first-order constructs. Convergent validity and discriminant validity were established for all the second- and first-order constructs with the statistic estimates exceeding the respective threshold. Redundancy analysis confirmed the establishment of the convergent validity of instructional leadership as a formative third-order construct. Criterion validity was established with the significant and positive effect of instructional leadership on collective teacher efficacy (CTE) ( β = 0.578, t = 14.206). Local and international educational researchers could replicate the current validation approach in future psychometric PIMRS validation studies in a different research context.

2022 ◽  
Vol 12 ◽  
Author(s):  
Carolyn M. Youssef-Morgan ◽  
Llewellyn E. van Zyl ◽  
Barbara L. Ahrens

This study explores gratitude as a multidimensional and work-specific construct. Utilizing a sample of 625 employees from a variety of positions in a medium-sized school district in the United States, we developed and evaluated a new measure, namely the Work Gratitude Scale (WGS), which encompasses recognized conative (intentional), cognitive, affective, and social aspects of gratitude. A systematic, six-phased approach through structural equation modeling (SEM) was used to explore and confirm the factorial structure, internal consistency, measurement invariance, concurrent, convergent, and discriminant validity of the WGS. The results supported a 10-item measure with three dimensions: “grateful appraisals” (three items), “gratitude toward others” (four items), and “intentional attitude of gratitude” (three items). Thereafter, first-order, second-order, and bifactor confirmatory models were estimated and compared. Work gratitude was found to be best described by a second-order construct with three underlying first-order dimensions. Measurement invariance was supported in relation to gender. Concurrent validity was supported in relation to two existing dispositional gratitude scales, namely the Gratitude Questionnaire and the Gratitude, Resentment, and Appreciation Scale (GRAT). Convergent validity was supported in relation to the Core Self-Evaluations Scale (CSES) and the Psychological Capital Questionnaire. Discriminant validity was supported in relation to various demographic factors such as age, gender, occupation, and tenure. The findings support the WGS as a multidimensional measure that can be used in practice to measure overall work-related gratitude and to track the effectiveness of gratitude-related workplace interventions.


1998 ◽  
Vol 10 (4) ◽  
pp. 421-433 ◽  
Author(s):  
Jane McCusker ◽  
Martin Cole ◽  
François Bellavance ◽  
François Primeau

The objective of this study was to assess the psychometric properties of a new instrument, the Delirium Index (DI), to measure changes in the severity of the symptoms of delirium among patients previously diagnosed with delirium. Subjects were medical inpatients aged 65 and over diagnosed with delirium by the Confusion Assessment Method. Interrater reliability of the DI was .78 between research assistants (concordence coefficient) and was .88 between research assistants and geriatric psychiatrists. Criterion validity, assessed by the correlation between DI and Delirium Rating Scale scores (Spearman's correlation coefficient, r), was .84. Construct validity was assessed using correlations of the DI with two measures of current function for convergent validity (r = −.60, −.70) and two measures of function before admission for discriminant validity (r = .26, −.42). We conclude that the DI has acceptable levels of interrater reliability, criterion validity, and construct validity.


Assessment ◽  
2017 ◽  
Vol 26 (6) ◽  
pp. 1128-1141 ◽  
Author(s):  
Stephen P. Becker ◽  
G. Leonard Burns ◽  
Aidan P. Schmitt ◽  
Jeffery N. Epstein ◽  
Leanne Tamm

Despite increasing interest in sluggish cognitive tempo (SCT) in children, the field is stymied by the lack of a standard symptom set that can be used across studies. Without a standard symptom set, it is difficult to determine if differences across studies are due to methodological or sample differences, or simply the way SCT was measured. To move the field toward a standard symptom set, this study evaluates a teacher-report rating scale of SCT revised based on recent meta-analytic findings that identified optimal items for distinguishing SCT from attention-deficit/hyperactivity disorder inattention (ADHD-IN). Participants were 1,349 students (50.7% male) from grades 2 to 5. Teachers provided ratings of SCT, ADHD-IN, academic impairment, and social impairment. Exploratory structural equation modeling found 15 of the 16 SCT items to demonstrate excellent convergent validity and discriminant validity with ADHD-IN. The measurement properties of the SCT construct were also invariant across sex. SCT was uniquely associated with both academic and social impairment above and beyond ADHD-IN and sex. Although replication and extension is needed, the current study provides the strongest evidence to date of a possible standard symptom set that can be used across studies examining SCT in children.


Author(s):  
Karla Gallo-Giunzioni ◽  
María Prieto-Ursúa ◽  
Cristina Fernández-Belinchón ◽  
Octavio Luque-Reca

Given the scarcity of instruments in Spanish to measure forgiveness, two studies were conducted in this population to obtain validity evidence of the Heartland Forgiveness Scale (HFS), an instrument that measures dispositional forgiveness of self, others, and situations. In the first study, 203 students (65% women) participated. After ensuring the linguistic adequacy and clarity of the wording of the items, a lack of congruence was found between the factors obtained in the exploratory factor analysis and the original theoretical structure of the HFS. A sample of 512 participants (63.9% women) attended the second study. This study aimed to analyze the construct validity of the HFS using confirmatory factor analysis through structural equation modelling and to explore convergent, discriminant, and criterion validity. Of the different factorial configurations tested (including the original), only a scale reduction to eight items, grouped into three factors, showed an appropriate fit. The HFS eight-item version also showed acceptable internal consistency, adequate convergent and discriminant validity, and criterion validity with respect to related variables. These findings suggest that the eight-item version of the HFS may be a valid and reliable tool for assessing forgiveness for self, others, and situations in Spanish adults.


2020 ◽  
Vol 11 ◽  
Author(s):  
Xiaoyang Wang ◽  
Yilin Wang ◽  
Mingjie Zhou ◽  
Baobin Li ◽  
Xiaoqian Liu ◽  
...  

Background: Many methods have been proposed to automatically identify the presence of mental illness, but these have mostly focused on one specific mental illness. In some non-professional scenarios, it would be more helpful to understand an individual's mental health status from all perspectives.Methods: We recruited 100 participants. Their multi-dimensional psychological symptoms of mental health were evaluated using the Symptom Checklist 90 (SCL-90) and their facial movements under neutral stimulation were recorded using Microsoft Kinect. We extracted the time-series characteristics of the key points as the input, and the subscale scores of the SCL-90 as the output to build facial prediction models. Finally, the convergent validity, discriminant validity, criterion validity, and the split-half reliability were respectively assessed using a multitrait-multimethod matrix and correlation coefficients.Results: The correlation coefficients between the predicted values and actual scores were 0.26 and 0.42 (P < 0.01), which indicated good criterion validity. All models except depression had high convergent validity but low discriminant validity. Results also indicated good levels of split-half reliability for each model [from 0.516 (hostility) to 0.817 (interpersonal sensitivity)] (P < 0.001).Conclusion: The validity and reliability of facial prediction models were confirmed for the measurement of mental health based on the SCL-90. Our research demonstrated that fine-grained aspects of mental health can be identified from the face, and provided a feasible evaluation method for multi-dimensional prediction models.


2020 ◽  
Vol 3 (4) ◽  
pp. 489-505
Author(s):  
Chi Nguyen Thi Khanh ◽  
Le Thai Phong

PurposeThis study examines the direct and indirect impact of environmental belief, nature-based destination image and time perspective on tourist attitude towards ecotourism.Design/methodology/approachData was collected through a structured questionnaire survey conducted in Vietnam. The dataset consists of 479 valid responses by Vietnamese tourists. Correlation analysis and structural equation modeling (SEM) were used to test the causal relationships among time perspective, environmental belief, nature-based destination and ecotourism attitude. Confirmatory factor analysis (CFA) is conducted to verify the reliability and validity of each latent construct, and to evaluate the discriminant validity, convergent validity, composition reliability and average variance extracted (AVE) for the latent constructs.FindingsThis study finds statistically significant and positive effects of time perspective, environmental belief and nature-based destination image on ecotourism attitude. The results also indicate that environmental belief is found to have statistically significant effects both direct and indirect on ecotourism attitude; its indirect effect is transmitted through nature-based destination image. Our findings demonstrate empirically that tourists are mainly attracted by natural environment sites and that tourists having environmental beliefs are likely to engage in ecotourism than other types of tourism by first influencing their attitude.Research limitations/implicationsOne limitation is associated with our measurement method, which relies on respondents’ self-ratings of their activities. Second, our study is based on internal consistency assessments for establishing construct reliability and validity, which might be the problem of measurement misspecification in tourism research and hinder us to adequately capture the dynamic nature of the variables and the underlying relationships. Third, the survey is conducted in one specific ecotourism nation like Vietnam, and thus, the findings must also be explained in this case.Practical implicationsPolicymakers need to pay careful attention to the planning and conservation of local resources, as well as infrastructure, for ecotourism development. Moreover, the management of eco-site needs to maintain ecology properly, provide an authentic ecotourism experience to improve ecotourism destination. Otherwise, ecotourism operators should focus on marketing strategies to increase traditional and natural values and promote eco-friendly social standards for fostering demand.Originality/valueThis study examines an integrated model analyzing the impact of time perspective, environmental belief and nature-based destination on tourist attitude towards ecotourism. This study reveals the understanding of how individuals’ view towards belief in environment and location image, influences their attitude to engage in ecotourism. The study provides several implications for practice.


2020 ◽  
Vol 32 (8) ◽  
pp. 615-626
Author(s):  
Makoto Matsuo

Purpose Although positive psychology emphasizes the importance of reflecting on success in promoting strengths use and self-efficacy, no research has developed a measure of reflection on success. The purpose of this study is to develop and validate the scales for reflection on success and failures. Design/methodology/approach Study 1 was conducted to extract the dimensions of reflection on success and failures using survey data from nurses (n = 298), whereas Study 2 involved validation of the scales using a two-wave survey of physical therapists (n = 291). Findings In Study 1, the factors of “reflection on success” and “reflection on failures” were extracted by exploratory factor analysis. In Study 2, the discriminant validity of the two scales was established via confirmatory factor analyses. The structural equation modeling results indicated that reflection on success promoted work authenticity, work engagement and strengths use, while reflection on failures only promoted work engagement, indicating the convergent validity of the scales. Research limitations/implications As the research subjects were medical professionals in Japan, the scales need to be validated with samples from a wide range of occupations and cultural backgrounds, in future research. Originality/value The present research expands the literature on reflection and strengths-based approach by introducing the “success–failures” dimension based on positive psychology, broaden-and-build theory and job demands–resources theory.


2009 ◽  
Vol 15 (4) ◽  
pp. 558-569 ◽  
Author(s):  
KAREN L. SIEDLECKI ◽  
YAAKOV STERN ◽  
AARON REUBEN ◽  
RALPH L. SACCO ◽  
MITCHELL S.V. ELKIND ◽  
...  

AbstractCognitive reserve is a hypothetical construct that has been used to inform models of cognitive aging and is presumed to be indicative of life experiences that may mitigate the effects of brain pathology. The purpose of this study was to evaluate the construct validity of cognitive reserve by examining both its convergent and its discriminant validity across three different samples of participants using structural equation modeling. The cognitive reserve variables were found to correlate highly with one another (thereby providing evidence of convergent validity), but demanding tests of discriminant validity indicated that, in two of the samples, the cognitive reserve construct was highly related to an executive functioning construct. (JINS, 2009, 15, 558–569.)


2020 ◽  
Vol 10 (4) ◽  
pp. 100
Author(s):  
Siti Daleela Mohd Wahid ◽  
Siti Hajjar Mohd Amin ◽  
Abdul Jalil Mohamed Ali ◽  
Abdul Jalil Mohamed Ali ◽  
Aida Abdullah ◽  
...  

Citizen-centricity satisfaction is a recent phenomenon spreading around the world. It is of growing interest to scholars and many papers are focused on this area. This paper aims at revealing factor that predict a citizen satisfaction during pandemic outbreak in public service delivery. A massive number of theories and past scholars have carried out studies on the factors influencing citizen satisfaction, which resulted in a list containing large volume of variables. There was a need to generalize factors that capable to form a universal citizen satisfaction model. This research utilizing citizen-centric demands of transformational government model as the theoretical foundation in citizen satisfaction in public service context. 346 citizens conveniently were selected as respondents, at the same time as information become amassed via online surveys. The information become then analyzed via the use of AMOS software.  The structural equation modelling (SEM) was executed to develop the measurement model. The results exhibit that goodness of fit, construct reliability, convergent validity and discriminant validity achieved the overall fitness threshold to model citizen satisfaction. This research contributes to shed light on the literature via examining the elements of citizen-centric demands of transformational government model namely openness, responsiveness, transparency and participation in citizen satisfaction.


2019 ◽  
Vol 29 (4) ◽  
pp. 431-439
Author(s):  
Dana E. Harrison ◽  
O.C. Ferrell ◽  
Linda Ferrell ◽  
Joe F. Hair, Jr

Purpose The purpose of this paper is to theoretically develop and empirically validate separate scales that represent a consumer’s expectations of business ethics (BE) and corporate social responsibility (CSR). Design/methodology/approach A literature review and qualitative research were conducted to generate items for the scales. Initial item reduction was performed qualitatively based on a panel of experts. A follow-up quantitative assessment using an exploratory factor analysis further reduced the items. The scales were then validated using confirmatory composite analysis with partial least squares-structural equation modeling. Findings Separate scales representing consumers’ expectations of BE and CSR behaviors were developed. The scales exhibited reliability, convergent validity, discriminant validity and external validity. Practical implications The separation of these scales into two components will facilitate more precise examination of consumer perceptions of these two components of product and brand images, and how they may impact brand attitudes and brand trust. Originality/value This is the first effort to develop separate scales for consumer expectations of ethics and CSR, and assess their impact on brand outcomes.


Sign in / Sign up

Export Citation Format

Share Document