Using Forest Plots to Present the Performance Sheets Provided to OSCE Examinees Using Rasch Analysis (Preprint)

2021 ◽  
Author(s):  
Jui-Chung John Lin ◽  
Yu-Tsen Yeh ◽  
CHIEN WEI ◽  
Hsien-Yi Wang

BACKGROUND Objective structured clinical examination (OSCE) has become an acceptable method for evaluating clinical skills in healthcare settings. However, none of the current literature has used visualization plots to compare individual OSCE performances. OBJECTIVE This study uses the Rasch model to (1) compare two other scenarios composed of binary scores and mixed binary and percentage responses; (2) draw a forest plot to visualize students’ performance; and (3) observe the comparison of OCSE scores among subgroups (e.g., schools) using real data.. METHODS We obtained data from 29 medical students who participated in OSCE examinations at 12 stations in 2018. The continuous Rasch model (CRM) was applied to estimate person measures and standard errors (SEs). The characteristics of the percentage CRM were interpreted in comparison to the other two counterparts (i.e., binary and mixed scenarios). Forest plots frequently used in meta-analysis were drawn to display those 29 examinees and five subgroups. RESULTS We used online CRM to draw forest plots and observed that (1) the binary scenario had a wider range of measures, followed by the mixed scenario. The percentage mode as expected has narrower ranges in person abilities(from -0.42 to 0.38) and item difficulties(from -0.48 to 0.41) owing to smaller total raw scores when compared to the other two counterparts;(2) all OSCE performances of medical students do not deviate from the middle line with zero logits; (3) The students in Taipei Medical University outperformed other schools among the five subgroups. CONCLUSIONS We designed two online computer modules for (1) estimating person measures and SEs and (2) drawing forest plots to display the OSCE performance sheets for Taiwanese medical students, which helps hospitals evaluate OSCE performances for students efficiently and objectively, but such results are not limited to medical students in the future.

2021 ◽  
Vol 10 (4) ◽  
pp. 124
Author(s):  
Nooreen Noordin ◽  
Laleh Khojasteh

This study was designed to see whether electronic feedback positively affects medical students’ academic writing performance. Two groups of medical university students were randomly selected and participated in this study. In order to see whether the provision of electronic feedback for the compulsory academic writing course for medical students is effective, the researchers divided 50 medical students to the traditional (n=25) and intervention groups (n=25). Pre-test and post-test were conducted at the beginning and at the end of the semester. Electronic feedback was given to the medical students in the intervention group, while the medical students in the traditional group received the traditional pen and paper feedback. By comparing the scores of two written assignments at the beginning and the end of the semester, regarding the application of electronic feedback, the results showed that not only medical students’ overall writing performance improved after providing them electronic feedback, but every single writing component was also enhanced after the intervention. There was a significant difference in the post-test academic writing scores between the traditional and intervention groups (P < 0.001). This difference was not significant in our control group who was given pen-and-paper feedback. In terms of specific writing components, the most affected components in this approach were content followed by organization, language use, vocabulary, and sentence mechanics, respectively. Although this study focused on medical students’ academic writing ability and reported the effect of electronic feedback on medical students’ writing performance, electronic feedback can be equally beneficial for enhancing student-practitioners’ practical clinical skills.


BMJ Open ◽  
2021 ◽  
Vol 11 (8) ◽  
pp. e047004
Author(s):  
Zain Hussain ◽  
Dominic Mark Ng ◽  
Nouf Alnafisee ◽  
Zakariya Sheikh ◽  
Nathan Ng ◽  
...  

IntroductionVirtual reality (VR) and augmented reality (AR) technologies are increasingly being used in undergraduate medical education. We aim to evaluate the effectiveness of VR and AR technologies for improving knowledge and skills in medical students.Methods and analysisUsing Best Evidence in Medical Education (BEME) collaboration guidelines, we will search MEDLINE (via PubMed), Education Resources Information Center, PsycINFO, Web of Knowledge, Embase and the Cochrane Central Register of Controlled Trials for English-language records, from January 1990 to March 2021. Randomised trials that studied the use of VR or AR devices for teaching medical students will be included. Studies that assessed other healthcare professionals, or did not have a comparator group, will be excluded. The primary outcome measures relate to medical students’ knowledge and clinical skills. Two reviewers will independently screen studies and assess eligibility based on our prespecified eligibility criteria, and then extract data from each eligible study using a modified BEME coding form. Any disagreements will be resolved by discussion or, if necessary, the involvement of a third reviewer. The BEME Quality Indicators checklist and the Cochrane Risk of Bias Tool will be used to assess the quality of the body of evidence. Where data are of sufficient homogeneity, a meta-analysis using a random-effects model will be conducted. Otherwise, a narrative synthesis approach will be taken and studies will be evaluated based on Kirkpatrick’s levels of educational outcomes and the Synthesis Without Meta-analysis guidelines.Ethics and disseminationEthical approval is not required for this systematic review as no primary data are being collected. We will disseminate the findings of this review through scientific conferences and through publication in a peer-reviewed journal.


2010 ◽  
Vol 20 (2) ◽  
pp. 64-70 ◽  
Author(s):  
Mary Pat McCarthy

This article details the process of self-reflection applied to the use of traditional performance indicator questionnaires. The study followed eight speech-language pathology graduate students enrolled in clinical practicum in the university, school, and healthcare settings over a period of two semesters. Results indicated when reflection was focused on students' own clinical skills, modifications to practice were implemented. Results further concluded self-assessment using performance indicators paired with written reflections can be a viable form of instruction in clinical education.


Author(s):  
Stefan Krause ◽  
Markus Appel

Abstract. Two experiments examined the influence of stories on recipients’ self-perceptions. Extending prior theory and research, our focus was on assimilation effects (i.e., changes in self-perception in line with a protagonist’s traits) as well as on contrast effects (i.e., changes in self-perception in contrast to a protagonist’s traits). In Experiment 1 ( N = 113), implicit and explicit conscientiousness were assessed after participants read a story about either a diligent or a negligent student. Moderation analyses showed that highly transported participants and participants with lower counterarguing scores assimilate the depicted traits of a story protagonist, as indicated by explicit, self-reported conscientiousness ratings. Participants, who were more critical toward a story (i.e., higher counterarguing) and with a lower degree of transportation, showed contrast effects. In Experiment 2 ( N = 103), we manipulated transportation and counterarguing, but we could not identify an effect on participants’ self-ascribed level of conscientiousness. A mini meta-analysis across both experiments revealed significant positive overall associations between transportation and counterarguing on the one hand and story-consistent self-reported conscientiousness on the other hand.


2019 ◽  
Author(s):  
Shinichi Nakagawa ◽  
Malgorzata Lagisz ◽  
Rose E O'Dea ◽  
Joanna Rutkowska ◽  
Yefeng Yang ◽  
...  

‘Classic’ forest plots show the effect sizes from individual studies and the aggregate effect from a meta-analysis. However, in ecology and evolution meta-analyses routinely contain over 100 effect sizes, making the classic forest plot of limited use. We surveyed 102 meta-analyses in ecology and evolution, finding that only 11% use the classic forest plot. Instead, most used a ‘forest-like plot’, showing point estimates (with 95% confidence intervals; CIs) from a series of subgroups or categories in a meta-regression. We propose a modification of the forest-like plot, which we name the ‘orchard plot’. Orchard plots, in addition to showing overall mean effects and CIs from meta-analyses/regressions, also includes 95% prediction intervals (PIs), and the individual effect sizes scaled by their precision. The PI allows the user and reader to see the range in which an effect size from a future study may be expected to fall. The PI, therefore, provides an intuitive interpretation of any heterogeneity in the data. Supplementing the PI, the inclusion of underlying effect sizes also allows the user to see any influential or outlying effect sizes. We showcase the orchard plot with example datasets from ecology and evolution, using the R package, orchard, including several functions for visualizing meta-analytic data using forest-plot derivatives. We consider the orchard plot as a variant on the classic forest plot, cultivated to the needs of meta-analysts in ecology and evolution. Hopefully, the orchard plot will prove fruitful for visualizing large collections of heterogeneous effect sizes regardless of the field of study.


2018 ◽  
Vol 14 (2) ◽  
pp. 181-187
Author(s):  
Maciej Walkiewicz ◽  
Małgorzata Tartas

The goal of the paper is to describe the extent to which medical students and professionals are vulnerable to extreme stress. A select review of existing literature on this area has been undertaken, using the English-language online databases EBSCO, Medline and PubMed. The search has identified 36 citations relating to 6324 medical students and 28,285 medical staff (physicians, residents, nurses). The review indicates that merely beginning medical studies is a risk factor for stress, and that medical professionals, who are vulnerable to extreme work stress, say that they do not receive enough support from their co-workers. They are also often notably impulsive, introverted, neurotic and perfectionist, with low emotional intelligence and agreeableness, as well as low and external locus of control. Additionally, from longitudinal studies we have been able to identify psychological factors underpinning admission to a medical university that may be useful for predicting future stress in medical career. The results of this study may be taken into account when organizing psychological intervention programs targeted at educating future medical professionals. It seems that early identification of people at risk could reduce the impact of stress related to medical career and enhance the somatic and mental health of medical professionals.


2018 ◽  
Author(s):  
Amir Forouharfar

The paper was shaped around the pivotal question: Is SE a sound and scientific field of research? The question has given a critical tone to the paper and has also helped to bring out some of the controversial debates in the realm of SE. The paper was organized under five main discussions to be able to provide a scientific answer to the research question: (1)<b> </b>is “social entrepreneurship” an oxymoron?, (2) the characteristics of SE knowledge, (3) sources of social entrepreneurship knowledge, (4) SE knowledge: structure and limitations and (5) contributing epistemology-making concepts for SE.<b> </b>Based on the sections,<b> </b>the study relied on the relevant philosophical schools of thought in <i>Epistemology </i>(e.g. <i>Empiricism</i>, <i>Rationalism</i>, <i>Skepticism</i>, <i>Internalism</i> vs. <i>Externalism</i>,<i> Essentialism, Social Constructivism</i>, <i>Social Epistemology, etc.</i>) to discuss these controversies around SE and proposes some solutions by reviewing SE literature. Also, to determine the governing linguistic discourse in the realm of SE, which was necessary for our discussion,<i> Corpus of Contemporary American English (COCA)</i> for the first time in SE studies was used. Further, through the study, SE buzzwords which constitute SE terminology were derived and introduced to help us narrowing down and converging the thoughts in this field and demarking the epistemological boundaries of SE. The originality of the paper on one hand lies in its pioneering discussions on SE epistemology and on the other hand in paving the way for a construction of sound epistemology for SE; therefore in many cases after preparing the philosophical ground for the discussions, it went beyond the prevalent SE literature through meta-analysis to discuss the cases which were raised. The results of the study verified previously claimed embryonic pre-paradigmatic phase in SE which was far from a sound and scientific knowledge, although the scholarly endeavors are the harbingers of such a possibility in the future which calls for further mature academic discussion and development of SE knowledge by the SE academia.


2019 ◽  
Author(s):  
Konrad Bresin

Trait impulsivity has long been proposed to play a role in aggression, but the results across studies have been mixed. One possible explanation for the mixed results is that impulsivity is a multifaceted construct and some, but not all, facets are related to aggression. The goal of the current meta-analysis was to determine the relation between the different facets of impulsivity (i.e., negative urgency, positive urgency, lack of premeditation, lack of perseverance, and sensation seeking) and aggression. The results from 93 papers with 105 unique samples (N = 36, 215) showed significant and small-to-medium correlations between each facet of impulsivity and aggression across several different forms of aggression, with more impulsivity being associated with more aggression. Moreover, negative urgency (r = .24, 95% [.18, .29]), positive urgency (r = .34, 95% [.19, .44]), and lack of premeditation (r = .23, 95% [.20, .26]) had significantly stronger associations with aggression than the other scales (rs &lt; .18). Two-stage meta-analytic structural equation modeling showed that these effects were not due to overlap among facets of impulsivity. These results help advance the field of aggression research by clarifying the role of impulsivity and may be of interest to researchers and practitioners in several disciplines.


Author(s):  
Victoria Ruzhenkova ◽  
Irina Sheremet’eva ◽  
Viktor Ruzhenkov

Stress negatively affects the mental health of students, causes anxiety and depression, leads to poor academic performance, lowers level of professional training and success in the future. The purpose of the research is to study the state of mental health of medical students to develop recommendations for the prevention of maladaptation. Materials and methods. 252 5-year students aged 20–29 (22 ± 1,1) years, 168 (66,7 %) females and 84 (33,3 %) males (137 students of Belgorod State University and 115 of Altay State Medical University (ASMU)) were examined by medico-sociological and psychometric methods. Results. It was established that every fifth student of the Belgorod State University and every third of the ASMU did not enter the medical university on their own initiative. Less than half (43 %) of Belgorod State University students and 30.4 % of the ASMU ones are convinced that the choice of profession was correct, 35 and 37.4 % are, consequently, completely disappointed with it. Students of Belgorod State University dealt with training stress factors poorer and, as a result, have more pronounced mental symptoms of training stress, difficulties in organizing the daily regimen, irregular nutrition, and fear of the future. Regardless of the region of studying, the number of students not committed to the medical profession, after 5 years of study, is more than 3 times higher among those who enter the university not on their own initiative. Students of the ASMU hit substances, skipped classes, played computer games and took sedative drugs more often to overcome academic stress. The degree of anxiety before the exams in students of Belgorod State University was higher (9 points) than in their peers from the State Medical University (7 points). An extremely high (8–10 points) level of anxiety before exams was characteristic of 75,9 and 44,3 % of students, respectively. The former were more likely to experience clinically significant panic attacks: 27,7 and 6,1 %. Conclusion. Given the high incidence of social phobia (19,1–24,1 %), depression (22,6–32,2 %) and anxiety (21,9– 27,8 %) among medical students, the development and implementation of psycho-correctional programs aimed at the formation of adaptive ways to overcome stress, reduce anxiety and depression is required. This will prevent the development of psychosomatic disorders and addictions.


2021 ◽  
Vol 13 (6) ◽  
pp. 3572
Author(s):  
Lavinia-Maria Pop ◽  
Magdalena Iorga ◽  
Iulia-Diana Muraru ◽  
Florin-Dumitru Petrariu

A busy schedule and demanding tasks challenge medical students to adjust their lifestyle and dietary habits. The aim of this study was to identify dietary habits and health-related behaviours among students. A number of 403 students (80.40% female, aged M = 21.21 ± 4.56) enrolled in a medical university provided answers to a questionnaire constructed especially for this research, which was divided into three parts: the first part collected socio-demographic, anthropometric, and medical data; the second part inquired about dietary habits, lifestyle, sleep, physical activity, water intake, and use of alcohol and cigarettes; and the third part collected information about nutrition-related data and the consumption of fruit, vegetables, meat, eggs, fish, and sweets. Data were analysed using SPSS v24. Students usually slept M = 6.71 ± 1.52 h/day, and one-third had self-imposed diet restrictions to control their weight. For both genders, the most important meal was lunch, and one-third of students had breakfast each morning. On average, the students consumed 1.64 ± 0.88 l of water per day and had 220 min of physical activity per week. Data about the consumption of fruit, vegetables, meat, eggs, fish, sweets, fast food, coffee, tea, alcohol, or carbohydrate drinks were presented. The results of our study proved that medical students have knowledge about how to maintain a healthy life and they practice it, which is important for their subsequent professional life.


Sign in / Sign up

Export Citation Format

Share Document