scholarly journals Development of Questionnaire on Students' Perceptions of STEM and Problem-solving (SPSP): a Rasch Modelling Approach

2021 ◽  
Vol 14 (1) ◽  
pp. 34-43
Author(s):  
Eis Nurzakiyah ◽  
Ghina Aghnia Nur Assyifaa ◽  
Ida Kaniawati ◽  
Irma Rahma Suwarma
Keyword(s):  
High School ◽  
Problem Solving ◽  
Product Development ◽  
Rasch Model ◽  
High Reliability ◽  
Development Model ◽  
Validity And Reliability ◽  
Rasch Modelling ◽  
The Rasch Model ◽  
Modelling Approach

This study aims to prove empirically the validity and reliability of Questionnaire on Students' Perceptions of STEM and Problem-solving (SPSP) in learning physics using Rasch model. The questionnaire was disseminated to 59 (N=59) students class XI MIPA in one of Senior High School in Kuningan Regency. Development of SPSP Questionnaire using procedure of product development model 4-D. The stages that will be used consists of four stages, namely: a) define, b) design, c) development, and disseminate. The data obtained were analyzed by means of the Rasch Model. Based on the result of the study, it shows that the SPSP questionnaire had high reliability that 0.90. So, it can be concluded that SPSP questionnaire is reliable and acceptable. While the item validity analysis shows that there are 8 valid items and 1 item does not match the MNSQ benchmark. Outfit value lies between 0.5 <MNSQ <1.5 and also does not meet the ZSTD Outfit criteria (-2.0 <ZSTD <2, 0). Meanwhile, the students' responses indicate that learning in school has not supported STEM activities and problem solving. So it is necessary to develop learning in schools that can support STEM activities and students' problem solving abilities

scholarly journals Evaluation of Hajj Instrument (HAJI) Psychometric Properties Using Rasch Measurement

2016 ◽  
Vol 12 (8) ◽  
pp. 212
Author(s):  
Muhammad Iqbal Tariq Idris ◽  
Abdul Hafidz Omar ◽  
Dayang Hjh Tiawa Awang Hj Hamid ◽  
Fahmi Bahri Sulaiman
Keyword(s):  
Physical Activity ◽  
Psychometric Properties ◽  
Healthy Eating ◽  
Rasch Model ◽  
Rasch Measurement ◽  
Mental Toughness ◽  
Validity And Reliability ◽  
Item Fit ◽  
The Rasch Model ◽  
Physical Care

<p>Hajj Instrument (HAJI) was developed to determine hajj pilgrim’s wellness. This study used Rasch measurement to evaluate the psychometric properties including validity and reliability of the HAJI. The respondents involved in this study were 300 comprised of Malaysian hajj pilgrims. HAJI consists of eight constructs namely physical care, physical activity, healthy eating, knowledge, mental toughness, intrapersonal, interpersonal and relationship with Creator and natures. Validity of each construct and content was determined through dimensionality, item fit and item polarity while the reliability was achieved by administered person and item separation. The results showed that the reliability for both item and person were 0.99 and 0.96 respectively. Besides, there were no items need to be dropped based on PTMEA CORR and INFIT MNSQ results. The study revealed that the items of HAJI fit the Rasch model as well as able to measure hajj pilgrim’s wellness. </p>

scholarly journals THE USE OF THE RASCH MODEL IN ANALYSING THE VALIDITY AND RELIABILITY OF STUDENTS’ COPING STRATEGY SCALE

2021 ◽  
Vol 7 (2) ◽  
pp. 110-119
Author(s):  
Maya Oktaviani ◽  
Uswatun Hasanah ◽  
Muhammad Faesal ◽  
Elmanora ◽  
Vania Zulfa
Keyword(s):  
Coping Strategy ◽  
Rasch Model ◽  
Content Validity ◽  
Three Dimensions ◽  
Validity And Reliability ◽  
Empirical Validity ◽  
Validity Analysis ◽  
Validity Coefficient ◽  
The Rasch Model ◽  
Model Approach

This research is part of the standardization of the Students' Coping Strategy Scale (SCSS). This study aims to reveal the content validity, empirical validity, and reliability of the SCSS. The non-test instrument consisting of 42 statements from three dimensions: problem-focused coping, emotion-focused coping, and seeking social support. Content validity analysis was carried out by experts to obtain Gregory's content validity coefficient, while the empirical validity and reliability analysis by empirically testing the instrument on 211 respondents and analyzed using the Rasch model approach. The results show that Gregory's content validity coefficient is 0.714, so it needs improvement on some items that are considered unsuitable. Empirical validity analysis using WINSTEPS software shows that three items do not fit the model. The reliability coefficient of the SCSS is 0.99. Thus, the remaining 39 items are appropriate to be used to measure students' coping strategies.

scholarly journals The direction of the response scale matters – accounting for the unit of measurement

2019 ◽  
Vol 53 (5) ◽  
pp. 871-891
Author(s):  
Thomas Salzberger ◽  
Monika Koller
Keyword(s):  
Rasch Model ◽  
Measurement Theory ◽  
Measurement Precision ◽  
Spatial Proximity ◽  
Validity And Reliability ◽  
Measurement Instruments ◽  
Response Scale ◽  
Content Type ◽  
Unit Of Measurement ◽  
The Rasch Model

Purpose Psychometric analyses of self-administered questionnaire data tend to focus on items and instruments as a whole. The purpose of this paper is to investigate the functioning of the response scale and its impact on measurement precision. In terms of the response scale direction, existing evidence is mixed and inconclusive. Design/methodology/approach Three experiments are conducted to examine the functioning of response scales of different direction, ranging from agree to disagree versus from disagree to agree. The response scale direction effect is exemplified by two different latent constructs by applying the Rasch model for measurement. Findings The agree-to-disagree format generally performs better than the disagree-to-agree variant with spatial proximity between the statement and the agree-pole of the scale appearing to drive the effect. The difference is essentially related to the unit of measurement. Research limitations/implications A careful investigation of the functioning of the response scale should be part of every psychometric assessment. The framework of Rasch measurement theory offers unique opportunities in this regard. Practical implications Besides content, validity and reliability, academics and practitioners utilising published measurement instruments are advised to consider any evidence on the response scale functioning that is available. Originality/value The study exemplifies the application of the Rasch model to assess measurement precision as a function of the design of the response scale. The methodology raises the awareness for the unit of measurement, which typically remains hidden.

scholarly journals A Competency-Based Approach to Pass/Fail Decisions: An Observational Study

2021 ◽  
Author(s):  
Nazdar E. Alkhateeb ◽  
Ali Al-Dabbagh ◽  
Yaseen Mohammed ◽  
Mohammed Ibrahim
Keyword(s):  
Observational Study ◽  
Rasch Model ◽  
Standard Setting ◽  
Careful Consideration ◽  
Validity And Reliability ◽  
High Stakes ◽  
High Stakes Assessment ◽  
Sufficient Degree ◽  
Competency Based ◽  
The Rasch Model

Any high-stakes assessment that leads to an important decision requires careful consideration in determining whether a student passes or fails. Despite the implementation of many standard-setting methods in clinical examinations, concerns remain about the reliability of pass/fail decisions in high stakes assessment, especially clinical assessment. This observational study proposes a defensible pass/fail decision based on the number of failed competencies. In the study conducted in Erbil, Iraq, in June 2018, results were obtained for 150 medical students on their final objective structured clinical examination. Cutoff scores and pass/fail decisions were calculated using the modified Angoff, borderline, borderline-regression, and holistic methods. The results were compared with each other and with a new competency method using Cohen’s kappa. Rasch analysis was used to compare the consistency of competency data with Rasch model estimates. The competency method resulted in 40 (26.7%) students failing, compared with 76 (50.6%), 37 (24.6%), 35 (23.3%), and 13 (8%) for the modified Angoff, borderline, borderline regression, and holistic methods, respectively. The competency method demonstrated a sufficient degree of fit to the Rasch model (mean outfit and infit statistics of 0.961 and 0.960, respectively). In conclusion, the competency method was more stringent in determining pass/fail, compared with other standard-setting methods, except for the modified Angoff method. The fit of competency data to the Rasch model provides evidence for the validity and reliability of pass/fail decisions.

scholarly journals Pengembangan media pembelajaran berbasis GEO-SEARCH pada materi Geografi pokok bahasan sebaran dan pemanfaatan sumber daya alam

2021 ◽  
Vol 1 (5) ◽  
pp. 628-638
Author(s):  
Fawaz Sani R ◽  
Djoko Soelistijo ◽  
Satti Wagistina
Keyword(s):  
High School ◽  
Product Development ◽  
Research And Development ◽  
Natural Resources ◽  
Development Model

The purpose of this development is to produce learning media based on GEO-SEARCH. The resulting geo-search learning media is used to support learning in geography subjects. The material chosen for geography is the distribution and utilization of natural resources for class XI high school 1 Tumpang. This research uses the Research and Development (R&D) method of the ADDIE development model. ADDIE development procedures consisting of 5 steps of development, namely: (1) Analysis (Analyze), (2) Design (Design), (3) Product Development (Development), (4) Product Implementation (Implementation), (5) Evaluation (Evaluation). Tujuan dari pengembangan ini adalah menghasilkan media pembelajaran berbasis GEO-SEARCH. Media pembelajaran geo-search yang dihasilkan digunakan untuk menunjang pembelajaran pada mata pelajaran geografi. Materi yang dipilih pada mata pelajaran geografi adalah materi Sebaran dan Pemanfaatan Sumber Daya Alam untuk kelas XI SMAN 1 Tumpang. Penelitian ini menggunakan metode penelitian dan pengembangan (R&D) dari model pengembangan ADDIE. Prosedur pengembangan ADDIE yang terdiri dari 5 langkah pengembangan yaitu: (1) Analisis (Analyze), (2) Desain (Design), (3) Pengembangan Produk (Development), (4) Implementasi Produk (Implementation), (5) Evaluasi (Evaluation).

scholarly journals Assessment Instrument Development for a Chronological Thinking Skills with the Rasch Model

2021 ◽  
Vol 13 (2) ◽  
pp. 1160-1166
Author(s):  
Ofianto Ofianto ◽  
Tri Zahra Ningsih
Keyword(s):  
Rasch Model ◽  
Preliminary Investigation ◽  
Sampling Technique ◽  
Thinking Skills ◽  
Assessment Instrument ◽  
Development Model ◽  
Partial Credit Model ◽  
Learning History ◽  
Instrument Reliability ◽  
The Rasch Model

Chronological thinking skills are one of the most critical goals in learning history, distinguishing it from other sciences. This skill is not a natural skill that already exists in students but is a skill that needs to be developed in students, especially in studying history. This study aims to develop an instrument for assessing chronological thinking skills with the Rasch model.  The development model adopted the Gall Borg development model by adjusting to the research objectives and needs. The adaptation of the Borg Gall model resulted in four stages in this study: (1) needs analysis and preliminary investigation, (2) planning and preparation of product development, (3) expert validation, and (4) instrument implementation. This research was conducted in Senior High School (SMA), involving 120 students from three schools. Sampling was carried out employing the proportional sampling technique. The data was collected using validation sheets, tests, and assessment sheets (scoring rubric). Data analysis was then performed with the Quest Program utilizing the Partial Credit Model (PCM). The results showed that the chronological thinking skills assessment instrument with the Rasch model was valid and reliable. The validity value of items that fit the model ranged from 0.77 to 1.30, and the instrument reliability value of 0.76 was in the high category. Therefore, it could be concluded that the assessment instrument developed can measure students' chronological thinking skills.

scholarly journals Application rasch model using R program in analyze the characteristics of chemical items

2019 ◽  
Vol 5 (2) ◽  
pp. 147-157
Author(s):  
Untung Desy Purnamasari ◽  
Badrun Kartowagiran
Keyword(s):  
High School ◽  
Data Collection ◽  
Rasch Model ◽  
Item Bank ◽  
Good Question ◽  
R Program ◽  
Tenth Grade ◽  
The Subject ◽  
Level Of Difficulty ◽  
The Rasch Model

Chemistry is one of the subjects taught in high school. To find out and assess students' understanding regarding chemistry subjects in one semester can be proven by a test. The tests used must have good quality. This study aims to provide information about the characteristics of chemical items test using the Rasch model. Descriptive explorative was used in this study. The subject of the study were tenth grade students in Xaverius Senior High School taken the final semester examination on chemistry subject. The object of this research were  the form of item tests and student answer sheets. Data collection techniques used documentation. Student answer sheets were analyzed using the R program. The results showed that the reliability of the item tests was 0.3 to 0.54 or medium category. Subsequently acquired a good level of difficulty about which amounted to 28 items. In addition, the average student ability is 0.008 with a minimum ability of -2.309 and a maximum of 2.233. ICC and IIC obtained are very accurate in predicting students' abilities. Chemicals items used in the final semester examination  can be used by teachers as a item bank for use in the evaluation of students' abilities. However, there are two items that need to be revised level of difficulty to produce a good question.

scholarly journals APPLICATION OF RASCH MODEL IN TESTING FORCE CONCEPT INVENTORY

2020 ◽  
Vol 2 (6) ◽  
pp. 14-27
Author(s):  
Afiqah Basran ◽  
Denis Lajium
Keyword(s):  
Rasch Model ◽  
Physics Education ◽  
High Reliability ◽  
Test Theory ◽  
Concept Inventory ◽  
School Students ◽  
Force Concept Inventory ◽  
Force And Motion ◽  
The Rasch Model ◽  
Force Concept

Inventori Konsep Daya is an instrument that is adapted from the Force Concept Inventory (FCI). It is an instrument consisting of 30 diagnostic items related to the concept of force and motion. This instrument is widely used in physics education. However, the validity of this instrument in Bahasa Malaysia is not well studied to ensure that the items in the instrument function properly. Based on previous research, one of the major issues that are often questioned in the FCI is the reliability of the instrument when administered to different groups. When studies conducted in this country, researchers often use the reliability analysis under the Classical Test Theory. Various weaknesses are identified when evaluating using the analysis under the theory. Therefore, the purpose of this study is to apply the Rasch model under Item Response Theory in analyzing the items in Inventori Konsep Daya. Several analyzes were selected to determine the validity of the items and instruments. This study will be conducted on three levels of students involved in the learning of force and motion concepts. 300 samples will be taken from school students, elementary or matriculation students as well as undergraduate students who have studied this topic. The data will be analyzed using Windstep software. The results showed that Inventori Konsep Daya was a good instrument with high reliability and separation index, positive polarity value for every item, and fit the Rasch model. However, the instrument was quite difficult for the respondents in this study. This study is important in providing information to other researchers who will use FCI as an instrument in their study. In addition, the findings of this study can also be used to compare with the previous studies to draw more accurate conclusions.

PENGUJIAN CIRI PSIKOMETRIK ITEM USMEQ-I DALAM KALANGAN PELAJAR POLITEKNIK MENGGUNAKAN MODEL RASCH

2015 ◽  
Vol 75 (1) ◽  
Author(s):  
Mohd Effendi @ Ewan Mohd Matore ◽  
Ahmad Zamri Khairani
Keyword(s):  
Emotional Intelligence ◽  
Rasch Model ◽  
Significant Contribution ◽  
High Reliability ◽  
Sampling Technique ◽  
Local Independence ◽  
Purposive Sampling ◽  
Item Fit ◽  
Emotional Intelligence Inventory ◽  
The Rasch Model

This study aimed to investigate the characteristics of the psychometric items from Emotional Intelligence Inventory USM or USMEQ-i using the Rasch model in the context of the polytechnic. A total of 151 students from the Polytechnic Sultan Azlan Shah, Perak selected using purposive sampling technique. The results show that as many as three items have been dropped. A total of 36 items were fulfilled the Rasch model main assumptions such as item fit, unidimensionality and local independence. USMEQ-i was found to have a high reliability and separation index. Thus, this study provides a significant contribution in evaluating EQ items using Rasch model for use in the context of the polytechnic in Malaysia.

Sign in / Sign up

Export Citation Format

Share Document