Reliability and validity of an objective structured clinical examination for assessing the clinical performance of residents

1990 ◽  
Vol 150 (3) ◽  
pp. 573-577 ◽  
Author(s):  
E. R. Petrusa
Author(s):  
Andy Bell ◽  
Jennifer Kelly ◽  
Peter Lewis

Abstract:Purpose:Over the past two decades, the discipline of Paramedicine has seen expediential growth as it moved from a work-based training model to that of an autonomous profession grounded in academia.  With limited evidence-based literature examining assessment in paramedicine, this paper aims to describe student and academic views on the preference for OSCE as an assessment modality, the sufficiency of pre-OSCE instruction, and whether or not OSCE performance is a perceived indicator of clinical performance.Design/Methods:A voluntary, anonymous survey was conducted to examine the perception of the reliability and validity of the Objective Structured Clinical Examination (OSCE) as an assessment tool by students sitting the examination and the academics that facilitate the assessment. Findings:The results of this study revealed that the more confident the students are in the reliability and validity of the assessment, the more likely they are to perceive the assessment as an effective measure of their clinical performance.  The perception of reliability and validity differs when acted upon by additional variables, with the level of anxiety associated with the assessment and the adequacy of feedback of performance cited as major influencers. Research Implications:The findings from this study indicate the need for further paramedicine discipline specific research into assessment methodologies to determine best practice models for high quality assessment.Practical Implications:The development of evidence based best practice guidelines for the assessment of student paramedics should be of the upmost importance to a young, developing profession such as paramedicine.Originality/Value: There is very little research in the discipline specific area of assessment for paramedicine and discipline specific education research is essential for professional growth.Limitations:The principal researcher was a faculty member of one of the institutions surveyed.  However, all data was non identifiable at time of data collection.  Key WordsParamedic; paramedicine; objective structured clinical examinations; OSCE; education; assessment.


1987 ◽  
Vol 26 (1) ◽  
pp. 39-41
Author(s):  
Janet McKnight ◽  
Elizabeth Rideout ◽  
Barbara Brown ◽  
Donna Ciliska ◽  
Diane Patton ◽  
...  

2004 ◽  
Vol 28 (2) ◽  
pp. 62-65 ◽  
Author(s):  
Asim Naeem ◽  
Joan Rutherford ◽  
Chris Kenn

In line with the Royal College of Psychiatrists' commitment to improve its professional examinations based on the best current evidence, Spring 2003 has seen the introduction of the objective structured clinical examination (OSCE). This has replaced the individual patient assessment (IPA) in the MRCPsych Part I clinical examination. An OSCE consists of a series of time-limited clinical tasks that candidates have to perform in a consecutive series of ‘stations' or booths. They have the advantage of being able to test clinical competence using a number of different scenarios via a standardised format (Katona et al, 2000). Their use has become widespread over recent years, particularly in undergraduate psychiatry exams (Brewin & Cantwell, 1997), as they have good reliability and validity (Hodges et al, 1998). This was confirmed by the College's initial pilot OSCE, which had a κ score of around 0.8 for the examination as a whole (Oyebode, 2002).


Surgery ◽  
1998 ◽  
Vol 124 (2) ◽  
pp. 307-312 ◽  
Author(s):  
Richard W. Schwartz ◽  
Donald B. Witzke ◽  
Michael B. Donnelly ◽  
Terry Stratton ◽  
Amy V. Blue ◽  
...  

2017 ◽  
Vol 42 (2) ◽  
pp. 233-257 ◽  
Author(s):  
Chen-Yu Wang ◽  
Jen-De Chen ◽  
Chih-Hung Wang ◽  
Jong-Yi Wang ◽  
Chih-Jaan Tai ◽  
...  

Medical education faces challenges concerning job burnout and emotional labor among junior physicians, which poses a potential threat to the quality of medical care. Although studies have investigated job burnout and emotional labor among physicians, empirical research on the association between job burnout, emotional labor, and clinical performance is lacking. This study investigated the effects of job burnout and emotional labor on clinical performance by using the objective structured clinical examination (OSCE) scores of interns and residents. Specifically, this cross-sectional study utilized the Maslach Burnout Inventory and the Emotional Labor Questionnaire as measurement instruments. A total of 225 interns and residents in central Taiwan answered structured questionnaires before beginning their OSCE. The major statistical analysis method employed was logistic regression. After adjustment for covariates, first-year residents were less likely than other residents to obtain high OSCE scores. The odds of high OSCE performance among interns and residents with high interaction component scores in emotional labor were significantly higher than those with low interaction scores. A high score in the interaction dimension of emotional labor was associated with strong clinical performance. The findings suggest that interventions which motivate positive attitudes and increase interpersonal interaction skills among physicians should receive higher priority.


2014 ◽  
Vol 120 (1) ◽  
pp. 196-203 ◽  
Author(s):  
Maya Jalbout Hastie ◽  
Jessica L. Spellman ◽  
Parwane P. Pagano ◽  
Jonathan Hastie ◽  
Brian J. Egan

Abstract Since its description in 1974, the Objective Structured Clinical Examination (OSCE) has gained popularity as an objective assessment tool of medical students, residents, and trainees. With the development of the anesthesiology residents’ milestones and the preparation for the Next Accreditation System, there is an increased interest in OSCE as an evaluation tool of the six core competencies and the corresponding milestones proposed by the Accreditation Council for Graduate Medical Education. In this article the authors review the history of OSCE and its current application in medical education and in different medical and surgical specialties. They also review the use of OSCE by anesthesiology programs and certification boards in the United States and internationally. In addition, they discuss the psychometrics of test design and implementation with emphasis on reliability and validity measures as they relate to OSCE.


Author(s):  
Song Yi Park ◽  
Hyun-Hee Kong ◽  
Min-Jeong Kim ◽  
Yoo Sang Yoon ◽  
Sang-Hwa Lee ◽  
...  

This study assessed the clinical performance of 150 third-year medical students in a whole-task emergency objective structured clinical examination station that simulates a patient with palpitation visiting the emergency department from November 25 to 27, 2019. The clinical performance was as assessed by the frequency and percentage of students who performed history taking (HT), physical examination (PE), electrocardiography (ECG) study, patient education (Ed), and clinical reasoning (CR), which were items on the checklist. There were 18.0% of students checked the patient’s pulse, 51.3% completed an ECG study, and 57.9% explained the results to the patient. There were 38.0% of students who did not even attempt an ECG study. In a whole-task emergency station, students were good at r HT and CR but unsatisfactory to the PE, ECG study, and Ed. Clinical skill educational programs should focus on PE, timely diagnostic tests, and sufficient Ed.


Sign in / Sign up

Export Citation Format

Share Document