Early Intervention Orientation and Mobility: A Delphi Study of the Content of the Birth to 6 Orientation and Mobility Skills Inventory (B6OMSI)

2021 ◽  
pp. 0145482X2110476
Author(s):  
Sarahelizabeth Baguhn
Keyword(s):  
Early Intervention ◽  
Young Children ◽  
Content Validity ◽  
Delphi Study ◽  
Assessment Tool ◽  
Face Validity ◽  
Background Information ◽  
Future Research ◽  
Validity And Reliability ◽  
Orientation And Mobility

Introduction: The objective of this research was to identify the appropriate content for an orientation and mobility (O&M) assessment for young children. It is necessary to have a reliable and valid assessment tool to evaluate whether young children are making adequate gains in response to early intervention efforts in O&M. Very little literature exists on the O&M needs of children aged birth to 6 years because of the roots in adult rehabilitation of the field of O&M. Methods: A group of expert-level professionals in the field of early intervention O&M engaged in a consensus process to establish face validity and content validity of the assessment items, which was accomplished using a Delphi study to identify relevant topics for assessment as a first step in developing a research-based assessment tool. Cutoffs for agreement were established prior to analysis, with 90% consensus for face and content validity of a high-stakes assessment that allows the score on the assessment to serve as a snapshot of a child’s progress. Results: All skills and concepts on the assessment were validated, and seven new items were added. Discussion: The resultant assessment tool is comprehensive in measuring the areas of O&M for young children that specialists found useful for determining the need for services and monitoring progress, does not contain extraneous test questions, and can stand alone as a snapshot of student progress. One item was added to the background information portion of the assessment tool because of its usefulness to some practitioners despite a consensus level below 90%. Future research should seek to establish construct validity and reliability measures. Implications for practitioners: Orientation and mobility specialists can begin using the updated item tool with improved content validity available from the New Mexico School for the Blind website.

scholarly journals Ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) for trabeculectomy

2019 ◽  
Vol 4 (1) ◽  
pp. e000313 ◽  
Author(s):  
William H Dean ◽  
John Buchan ◽  
Fisseha Admassu ◽  
Min J Kim ◽  
Karl C Golnik ◽  
...  
Keyword(s):  
Content Validity ◽  
Assessment Tool ◽  
Interobserver Reliability ◽  
Glaucoma Surgery ◽  
Face Validity ◽  
Competency Assessment ◽  
Validity And Reliability ◽  
Wilcoxon Rank Sum Test ◽  
Better Than ◽  
Assessment Rubric

Background/aimsTo develop, test and determine whether a surgical-competency assessment tool for simulated glaucoma surgery is valid.MethodsThe trabeculectomy ophthalmic simulated surgical competency assessment rubric (Sim-OSSCAR) was assessed for face and content validity with a large international group of expert eye surgeons. Cohorts of novice and competent surgeons were invited to perform anonymised simulation trabeculectomy surgery, which was marked using the Sim-OSSCAR in a masked fashion by a panel of four expert surgeons. Construct validity was assessed using a Wilcoxon rank-sum test. Krippendorff’s alpha was calculated for interobserver reliability.ResultsFor the Sim-OSSCAR for trabeculectomy, 58 of 67 surgeons (86.6%) either agreed or strongly agreed that the Sim-OSSCAR is an appropriate way to assess trainees’ surgical skill. Face validity was rated as 4.04 (out of 5.00). Fifty-seven of 71 surgeons (80.3%) either agreed or strongly agreed that the Sim-OSSCAR contents represented the surgical technique of surgical trabeculectomy. Content validity was rated as 4.00. Wilcoxon rank-sum test showed that competent surgeons perform better than novices (p=0.02). Interobserver reliability was rated >0.60 (Krippendorff’s alpha) in 19 of 20 steps of the Sim-OSSCAR.ConclusionThe Sim-OSSCAR for trabeculectomy, a newly developed and validated assessment tool for simulation glaucoma surgery, has validity and reliability. It has the potential to play a useful role in ophthalmic surgical education.

scholarly journals Development and Content Validity of the Physical Activity Questionnaire-Young Children (PAQ-YC) to Assess Physical Activity in Children between 5 and 7 Years

Healthcare ◽  
2021 ◽  
Vol 9 (6) ◽  
pp. 655
Author(s):  
Marta Amor-Barbosa ◽  
Montserrat Girabent-Farrés ◽  
Ferran Rosés-Noguer ◽  
Anna Ortega-Martínez ◽  
Almudena Medina-Rincón ◽  
...  
Keyword(s):  
Physical Activity ◽  
Physical Education ◽  
Young Children ◽  
Content Validity ◽  
Delphi Study ◽  
Critical Period ◽  
Consensus Criterion ◽  
Physical Activity Questionnaire ◽  
Healthy Habits ◽  
Activity Questionnaire

Childhood is a critical period in the development and consolidation of healthy habits, such as the practice of physical activity (PA). It is essential to have valid instruments to measure PA from an early age. The aim of this study was to design and evaluate the content validity of the Physical Activity Questionnaire-Young Children (PAQ-YC) to measure the PA level in children aged 5–7 years. The first version of the questionnaire was tested by a 2-round Delphi study. It was established as a consensus criterion that the relative interquartile range (RIR) and/or the coefficient of variation (CV) were ≤20%. The most significant discrepancies in the Delphi survey (n = 11–13) were observed for items about hours of Physical Education or similar activities at school (item 7: RIR = 20, CV = 38.73) and for items about participation in Physical Education (item 8: RIR = 25, CV = 15.45). The cognitive interviews (n = 5) confirmed the version agreed by the experts. The results show that the PAQ-YC presents adequate content validity in terms of relevance, comprehensiveness and comprehensibility.

Psychometric Testing of the Health Care Evidence-Based Practice Assessment Tool

2015 ◽  
Vol 23 (3) ◽  
pp. 485-498
Author(s):  
Martha R. Sleutel ◽  
Celestina Barbosa-Leiker ◽  
Marian Wilson
Keyword(s):  
Health Care ◽  
Content Validity ◽  
Assessment Tool ◽  
Evidence Based Practice ◽  
Factor Model ◽  
Psychometric Testing ◽  
Evidence Based ◽  
Validity And Reliability ◽  
Health Care Outcomes ◽  
Optimal Health

Background and Purpose: Evidence-based practice (EBP) is essential to optimal health care outcomes. Interventions to improve use of evidence depend on accurate assessments from reliable, valid, and user-friendly tools. This study reports psychometric analyses from a modified version of a widely used EBP questionnaire, the information literacy for nursing practice (ILNP). Methods: After content validity assessments by nurse researchers, a convenience sam ple of 2,439 nurses completed the revised 23-item questionnaire. We examined internal consistency and used factor analyses to assess the factor structure. Results: A modified 4-factor model demonstrated adequate fit to the data. Cronbach’s alpha was .80–.92 for the subscales. Conclusions: The shortened ILNP (renamed Healthcare EBP Assessment Tool or HEAT) demonstrated adequate content validity, construct validity, and reliability.

Urdu Translation and Validation of Activities-Specific Balance Confidence (ABC) Scale

2021 ◽  
Vol 15 (12) ◽  
pp. 3505-3508
Author(s):  
Noor Ul Ain Fatima ◽  
Qurat-Ul- Ain ◽  
Fareeha Kausar ◽  
Mian Ali Raza ◽  
Misbah Waris ◽  
...  
Keyword(s):  
Older Adults ◽  
Construct Validity ◽  
Correlation Coefficient ◽  
Content Validity ◽  
Assessment Tool ◽  
Test Reliability ◽  
Validity And Reliability ◽  
A Value ◽  
Abc Scale ◽  
Translation And Validation

Objective: To translate and validate the ABC-Scale in Urdu language to predict risk of fall in older population. Study design: Cross-cultural Translation and validation Place and Duration: Study was conducted in older adult community of Sialkot from March 2020 to December 2020. Methodology: Translation of ABC in Urdu was conducted by using Beaton et al guidelines. Two bilingual translators translated the original version into Urdu language step wise, correction process was followed. Then two backward translations were done by language expert. After all this process, the translated version was reviewed by the professionals and the final version was applied on 15 individuals. Its reliability and validity was tested on 60 older adults. Results: For test re test reliability, intra class correlation coefficient ICC was measured with a value of 0.984 Which shows good test re-test reliability. The internal consistency and reliability of ABC was calculated by Cronbach’s alpha for total score with a value of 0.985. Content validity was good with values of CVI ranging from 0.767 to 0.955. To test the discriminative validity, independent t test was used to show the difference between the healthy and unhealthy adults. Factor analysis of UABC showed total variance 81.277 and cumulative variance was also 81.277. To calculate construct validity of U-ABC Pearson’s correlation coefficient was used and measured as 0.558. Conclusion: It was concluded that Urdu version of UABC is a valid assessment tool for older adults with fear of fall. It has good content validity, construct validity and reliability. Keywords: activities specific balance scale, validation, Urdu translation, reliability, tool translation

scholarly journals Validity and Reliability of the Scale, Role Taking in Caregivers of People with Chronic Disease, ROL

10.3823/2575 ◽  
2018 ◽  
Vol 11 ◽  
Author(s):  
Mauricio Arias ◽  
Sonia Carreño ◽  
Lorena Chaparro
Keyword(s):  
Factor Analysis ◽  
Chronic Disease ◽  
Construct Validity ◽  
Internal Consistency ◽  
Content Validity ◽  
Three Dimensions ◽  
Face Validity ◽  
Validity And Reliability ◽  
Role Taking ◽  
Phase Study

Objective: To determine face, content, and construct validity, and internal consistency of ROL scale. Methods and Findings: A three-phase study was conducted. First, content analysis of the scale was carried out consulting 10 professional experts. Then, face validity was analyzed with 60 caregivers. Finally, construct validity was evaluated by performing an exploratory factor analysis (EFA) with 110 participants. Internal consistency of ROL scale was also assessed. Face validity of ROL scale reached a high acceptance index in three dimensions: role performance (0.97), role organization (0.98), and response to the role (0.98). Content validity showed coherence, clarity, and relevance of the scale. From factor analysis, three components emerged and were grouped in the same manner for varimax, quartimax, and equimax rotations. Cronbach's alpha was 0.816, which is an acceptable overall value. Conclusion: ROL scale makes objective the concept of role taking in family caregivers of people with chronic disease. It demonstrated to have acceptable reliability, and construct, face, and content validity to be used in the Colombian context. Keywords: Validation Study, Caregivers, Health Transitions, Chronic Disease.

Validity and Reliability of Mathematical Visual Literacy Skills Based on Avgerinou’s Vilual Literacy Index

2021 ◽  
Vol 12 (3) ◽  
pp. 1102-1121
Author(s):  
Raja Lailatul Zuraida Et.al
Keyword(s):  
Content Validity ◽  
Visual Literacy ◽  
Early Stage ◽  
Reliability And Validity ◽  
Principal Component ◽  
Literacy Skills ◽  
Face Validity ◽  
Validity And Reliability ◽  
Principal Component Axis ◽  
Bartlett’S Test

There is much literature on visual literacy across different fields of knowledge. Even so, generally there is a gap of literature that deals with measuring mathematical visual literacy skills. The objective of this paper is to produce empirical data on reliability and validity of mathematical visual literacy skills instrument. The development of items was based on the skills outlined Avgerinou’s VL Index (2007. The early stage in validating the instrument required researchers to seek face validity and content validity from panels of experts. Face validity was based on subjective judgements of the items. Meanwhile, content validity was determined by Content Validity Index (CVI) which is computed using Item-CVI (I-CVI) and Scale-CVI (S-CVI). Each mathematical visual literacy skills had accepted S-CVI values ranging from 0.86 to 1.00 but items with low I-CVI values were deleted. Next, construct validity and reliability was determined by using Exploratory Factor Analysis (EFA) and Cronbach’s alpha respectively. The instrument, consisting of 43 items was assessed on 428 pre-university students. Students’ responses were scored using analytical rubric developed by researchers. Using Principal Component Axis (PCA) and varimax rotation, EFA was carried out where 40 retaining items were extracted to 7 factors, representing each visual literacy skills. Kaiser-Meyer-Olkin (KMO) of 0.721, significant Bartlett’s Test of Sphericity (BTS), communalities anti images ranging between 0.308-0.721 and 0.503-0.835 respectively, 7 extracted factors explaining 53.685% of the total variance, factor loadings of ±0.520 and more, and overall Cronbach’s alphas of instrument recorded at 0.82, explained the complete validity and reliability of the instrument.

Behavioural couple therapy: measuring therapist competence

2020 ◽  
Vol 13 ◽  
Author(s):  
I. Rudolf von Rohr ◽  
S. Corrie ◽  
M.S. Fischer ◽  
D.H. Baucom ◽  
M. Worrell ◽  
...  
Keyword(s):  
Psychometric Properties ◽  
Content Validity ◽  
Couple Therapy ◽  
Formative Feedback ◽  
Face Validity ◽  
Future Research ◽  
List Type ◽  
Self Reflection ◽  
Therapist Competence ◽  
Two Stages

Abstract This paper outlines a pilot validation study of the newly developed Behavioural Couple Therapy Scale for Depression (BCTS-D). The BCTS-D aims to assess therapist competence in delivering behavioural couple therapy (BCT) and provide therapists with summative and formative feedback on their performance. Completed by both therapist and supervisor, this will aid therapists’ reflection on practice and improve performance. This paper will report on two stages in the development of the BCTS-D: (a) a study evaluating content validity, face validity and usability and (b) a focus group examining usability and utility. Both parts of the study were conducted in the context of a BCT training course and included 20 participants who were either BCT supervisors or BCT trainees. Results suggest that the BCTS-D has good face validity, content validity and usability, and provides a useful tool for promoting self-reflection and providing formative feedback. The studies also provided insight into the strengths of the scale and into areas of refinement, and a number of modifications were undertaken to improve the BCTS-D in response to feedback collected. Future research will need to focus on evaluating the psychometric properties of the BCTS-D and continue to adapt the scale to its users’ needs. Key learning aims (1) Readers will understand the importance of measuring therapists’ competence to improve practice. (2) Readers will understand the development of the BCTS-D scale and its initial psychometric properties. (3) Readers will know how to use the BCTS-D in everyday clinical practice. (4) Readers will know about the challenges of developing a therapist competence measure within a real-world clinical context.

scholarly journals Validity and Reliability of the Treatment Adherence Questionnaire for Patients with Hypertension

2019 ◽  
Vol 37 (3) ◽  
Author(s):  
Natalia Esquivel Garzón ◽  
Luz Patricia Díaz Heredia
Keyword(s):  
Treatment Adherence ◽  
Content Validity ◽  
Statistical Tests ◽  
Spanish Version ◽  
Face Validity ◽  
Validity And Reliability ◽  
Cronbach’S Alpha ◽  
Validity Index ◽  
Content Validity Index ◽  
Cronbach's Alpha

Objective. To determine the validity and reliability of the Treatment Adherence Questionnaire for Patients with Hypertension (TAQPH), Spanish version, designed by Chunhua Ma et al.Methods. This study was carried out in the city of Ibagué (Colombia)  and the test validation determined validity (face, content, and construct) and reliability. Face and content validity were conducted through expert judgment, using Fleiss’ Kappa Coefficient statistical tests and modified Lawshe’s content validity index. The construct validity and the reliability test had the participation of 220 people with diagnosis of primary hypertension. Reliability was calculated through Cronbach’s alpha statistical test.Results. In the face validity, the instrument reported a Fleiss’ Kappa index was 0.68 in comprehension, 0.76 in clarity, and 0.64 in accuracy, interpreted as a substantial agreement. The content validity index was satisfactory with 0.91; el exploratory factor analysis reported six factors with a total variance explained of 54%. Cronbach’s alpha for the total scale was 0.74.Conclusion. The Spanish version of the TAQPH is a valid and reliable scale to evaluate adherence to treatment in patients with primary hypertension.Descriptors: essential hypertension; treatment adherence and compliance; surveys and questionnaires; psychometrics; validation studies.How to cite this article: Esquivel N, Díaz LP. Validity and Reliability of the Treatment Adherence Questionnaire for Patients with Hypertension. Invest. Educ. Enferm. 2019; 37(3):e09.

scholarly journals Social entrepreneurship orientation: development of a measurement scale

2017 ◽  
Vol 23 (6) ◽  
pp. 977-997 ◽  
Author(s):  
Sascha Kraus ◽  
Thomas Niemand ◽  
Jantje Halberstadt ◽  
Eleanor Shaw ◽  
Pasi Syrjä
Keyword(s):  
Social Entrepreneurship ◽  
Delphi Study ◽  
Quantitative Methods ◽  
Social Enterprises ◽  
Face Validity ◽  
Measurement Scale ◽  
Future Research ◽  
Social Entrepreneurs ◽  
Content Type ◽  
First Time

Purpose Despite growing scholarly interest in social entrepreneurs and the social enterprises (SE) they create, few studies have examined the hybridity of SE including, surprisingly, whether they adopt an entrepreneurial orientation (EO). One explanation for this may be the continuing lack of an appropriate scale measuring social entrepreneurship orientation (SEO). The purpose of this paper is to address this research gap by proposing an initial SEO scale based on input from scholars in the fields of entrepreneurship and social entrepreneurship. Design/methodology/approach This study employed mixed methods and a two stage design. In stage 1, a Delphi study with 18 researchers with expertise of investigating entrepreneurship and social entrepreneurship was used to generate constructs combining aspects of both social and EOs. In stage 2, the authors assessed the face validity of the derived items from the Delphi study by conducting a survey with 82 such experts. Findings This paper provides fresh empirical insights into how SEO can be measured by proposing, for the first time, a 12 item scale with four dimensions for the first time. Research limitations/implications The authors recommend that future studies employ quantitative methods, particularly with firms exhibiting differing levels of the “socialness” dimension which the authors propose and that such studies involve a variety of research informants. Statistical analysis of data collected across large sample sizes will help evaluate the reliability and validity of the scale which the authors propose. Practical implications This paper includes implications for future research based on the proposed SEO measurement scale. Originality/value This paper develops the first SEO scale based on empirical data collected from experts in the fields of entrepreneurship and social entrepreneurship.

Prodigality in Islamic lifestyle: a new scale development

2015 ◽  
Vol 6 (2) ◽  
pp. 188-208 ◽  
Author(s):  
hossein emari
Keyword(s):  
Content Validity ◽  
Reliability And Validity ◽  
Measurement Scale ◽  
Dimensional Structure ◽  
Future Research ◽  
Validity And Reliability ◽  
Content Type ◽  
Islamic Schools ◽  
Structure Reliability ◽  
Item Scale

Purpose – This study aims to propose a new construct – prodigality and develop a measurement scale to support the construct. Design/methodology/approach – Combining the paradigms of Churchill, Malhotra and Birks, the item generation and content validity yielded the development of a modified scale. Three main steps in assessment of the scale: dimensional structure, reliability and validity led to the development of a prodigality scale. A total of 32 items were generated, through assessing Qur’anic verses that are related to Muslim consumption patterns linked to in Islam. Findings – In total, 23 items remained after content validity. A pre-test using exploratory factor analysis on the 23-item scale created a two-factor scale. According to extracted validity and reliability scores, prodigality scale was statistically supported. A pool of nine items is proposed for the eventual measurement of the prodigality. Research limitations/implications – The proposed measurement scale warrants further exploratory study. Future research should assess the validity across different Muslim geographies and Islamic schools of thought and practice. Originality/value – Prodigality is proposed as a new construct that focuses primarily on the Qur’an and seeks to achieve relevance and acceptance by both Sunni and Shia denominations. The measurement scale is believed to extend the existing body of literature and contribute new knowledge on Muslim consumption.

Sign in / Sign up

Export Citation Format

Share Document