JRMS J Res Med Sci Journal of Research in Medical Sciences Journal of Research in Medical Sciences 1735-1995 1735-7136 Medknow Publications Pvt Ltd India JRMS-17-975 23826000 Educational Research Article Using TOSCE (Team Objective Structured Clinical Examination) in the second national medical sciences olympiad in Iran Amini Mitra Moghadami Mohsen Kojuri Javad Abbasi Hamidreza Abadi Ali Arhami D Molaee Nezar A Pishbin Elham Javadzade Hamid R Kasmaee Vahid M Vakili Mohsen Sadat Mohamad Ali R Akbari Roghaye Omidvar Bita Shafaghi Afshin Monajemi Alireza Arabshahi Kamran S Adibi Peyman Education Development and Research Center, Shiraz University of Medical Sciences, Shiraz, IranEducation Development and Research Center, Shiraz University of Medical Sciences, Shiraz, IranEducation Development and Research Center, Shiraz University of Medical Sciences, Shiraz, IranEducation Development and Research Center, Shiraz University of Medical Sciences, Shiraz, IranDepartment of Emam Hosien Hospital Emergency, Shahid Beheshti University of Medical Sciences, Tehran, IranInternal Medicine Aliebneabitaleb Hospital, Zahedan University of Medical Sciences, Zahedan, IranDepartment of Emam Reza Emergency Medicine, Mashhad University of Medical Sciences, Mashhad, IranDepartment of Emergency Medicine, Baghiatallah Hospital, Baghiatallah University of Medical Sciences, Tehran, IranDepartment of Gastroenterology, Guilan University of Medical Science, Rasht University of Medical Sciences, Rasht, IranDepartment of Internal Medicine, Babol University of Medical Sciences, Babol, IranPediatric General Surgery, Islamic Azad University, Mashhad Branch, Mashhad, IranDepartment of Internal Medicine, Babol University of Medical Sciences, Babol, IranDepartment of Internal Medicine, Ahwaz Hospital, Ahwaz University of Medical Sciences, Ahwaz, IranDepartment of Gastroenterology, Guilan University of Medical Science, Rasht University of Medical Sciences, Rasht, IranMedical Humanities Research Group, Tehran, Institute for Humanities and Cultural Studies, Tehran, IranFirozgar Hospital of Internal Medicine, Tehran University of Medical Sciences, Tehran, IranIntegrative Functional Gastroenterology Research Centers, Isfahan University of Medical Sciences, Isfahan, Iran Address for correspondence:Mohsen Moghadami, Department of Education Research Center and Internal Medicine, Shiraz University of Medical Sciences, Shiraz, Iran moghadami@sums.ac.ir October 2012 17 10 975 978 Copyright: © Journal of Research in Medical Sciences 2012

This is an open-access article distributed under the terms of the Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Introduction:

Second National Medical Sciences Olympiad was done in Shiraz in August 2010 with aim of indentifying scientifically talented individuals, motivating students and orienting extracurricular activities. This Olympiad was done in 3 areas, basic sciences, clinical sciences and management. In clinical sciences, we used TOSCE (Team Objective Structured Clinical Examination). In this article we report the details of this exam and participants′ satisfaction. Materials and Methods:

This Olympiad in Clinical Medical Sciences was held in 2 levels: Individual and team. In the team stage, 9 teams from 9 universities participated. We used TOSCE for measuring clinical competency of teams. Each team consisted of 3 students. We designed 12 stations based on emergency medicine in medical and surgical fields. The time considered for each station was 15 min, after doing this exam the view of students was measured using a valid and reliable questionnaire. Results:

Most of the students believed that TOSCE was a useful examination for measuring competency. More than 50% of students reported that success in this exam needs clinical competency, team work and problem solving ability. Nearly, half (48.1%) of students believed that 15 min is not enough for each station and they need more time. Conclusion:

The results of this study showed that this kind of exam is useful for measuring clinical competency from students′ viewpoint .

Materials and Methods:

This Olympiad in Clinical Medical Sciences was held in 2 levels: Individual and team. In the team stage, 9 teams from 9 universities participated. We used TOSCE for measuring clinical competency of teams. Each team consisted of 3 students. We designed 12 stations based on emergency medicine in medical and surgical fields. The time considered for each station was 15 min, after doing this exam the view of students was measured using a valid and reliable questionnaire. Results:

Most of the students believed that TOSCE was a useful examination for measuring competency. More than 50% of students reported that success in this exam needs clinical competency, team work and problem solving ability. Nearly, half (48.1%) of students believed that 15 min is not enough for each station and they need more time. Conclusion:

The results of this study showed that this kind of exam is useful for measuring clinical competency from students′ viewpoint .

Results:

Most of the students believed that TOSCE was a useful examination for measuring competency. More than 50% of students reported that success in this exam needs clinical competency, team work and problem solving ability. Nearly, half (48.1%) of students believed that 15 min is not enough for each station and they need more time. Conclusion:

The results of this study showed that this kind of exam is useful for measuring clinical competency from students′ viewpoint .

Conclusion:

The results of this study showed that this kind of exam is useful for measuring clinical competency from students′ viewpoint .

Medical students olympiad TOSCE
</sec><sec><title>Introduction

Background

The objective structured clinical examination (OSCE) was developed in 1975 by harden et al. 1 In OSCE, students move through stations in which they had to demonstrate multiple clinical skills. The OSCE is now regarded as the pioneer of competence assessment in medicine. 2 Many articles reported OSCE and discussed about its validity and reliability. 3,4,5,6 The team structured objective clinical examination (TOSCE) was planned as a variation of OSCE. The purpose of designing TOSCE was to measure students′ performance in a team. 7 It was also used to evaluate shared education between midwifery and medical students in one study. 8 In another study, the modified type of TOSCE named team objective structured bedside assessment (TOSBA) was described. 9

This paper describes the process and structure of a 12 station TOSCE exam in a competitive examination for medical students known as the National Medical Science Olympiad in Iran. The evaluation of TOSCE from participants′ viewpoint, its advantages and disadvantages will be discussed.

Materials and Methods

As we mentioned in our previous articles, 10,11 the aim of medical science Olympiad in Iran is to indentify scientifically talented individuals, to motivate students, orient extracurricular activities, and to foster their creativity. The first Olympiad was held in Isfahan in 2009 and the second in Shiraz 2010 in three areas: Health system management, basic science, and clinical science. In each area, Olympiad examination was held at two stages: Individual and group. In this article, we discuss about TOSCE as a part of group stage of clinical area of the second Olympiad.

Participants

One hundred and thirty five top ranked students as examinees came from 45 medical universities (3 examinees from each university), who were tested in individual stage of clinical science area. After individual stage the mean grade of each university team was calculated and the nine best university teams with higher scores were invited for the team exam. Only undergraduate students were allowed to participate in the Olympiad.

Structure of the TOSCE

An expert panel from all the medical universities in Iran participated in designing TOSCE questions. To ensure content validity of the exam, these experts designed an OSCE blueprint for each station based on the defined objectives in emergency medicine in medical and surgical fields. Each station comprised of three different elements and all the three members of a team should answer each element first and then decided on the whole station based on the group consensus. For example , at one station the first student should take history, the second should do the physical examination and the third should see laboratory data and then they should discuss about diagnosis based on the group consensus. The main aim for stations was to develop a team work toward management of an emergency medicine problem. Expert panel discussed about the time for each station and finally decided to consider 15 min for each station and 12 stations were designed to ensure exam reliability. 2 One facilitator was assigned to each TOSCE station. These facilitators were internist, general surgeons or emergency medicine specialists. The content validity of the stations was determined by content experts and using a blueprint based on important domains (such as cardiology, nephrology and etc). Reliability of each station′s checklist was measured after the exam by Cronbach′s alpha as a measure of internal consistency.

The performance of each group was evaluated by pre mentioned criteria agreed by expert committee.

Students′ viewpoints

Students completed a questionnaire at the end of the TOSCE. This questionnaire consisted of 11 items on the students′ opinion about this exam in a 5 point Likert scale and some open questions. Validity of the questionnaire was determined by medical education experts in the scientific Olympiad committee and the reliability was determined after a pilot study (r=8).

Analysis

We used descriptive statistics (mean and standard deviation) for analysis of questionnaire data. The participants′ answers to open-ended questions were categorized by grouping similar comments for each question.

Results

Nine teams from nine universities acquired the highest grades and participated in the TOSCE. Therefore, a total of 27 students participated in this one day exam. The results of reliability of stations are shown in Table 1.{Table 1}

Most students either agreed or strongly agreed that TOSCE was a useful examination for measuring competency. More than 50% of them reported this exam reinforces team work and problem solving ability. 48.1% of them believed that 15 min was not enough for each station and they needed more time for reaching team consensus and answering the questions. The results are shown in Table 2.{Table 2}

In open questions, the students mentioned that this kind of exam was new and exciting for them. Some of the students′ ideas are mentioned below:

The most significant aspect of this TOSCE format was promoting a team activity toward emergency medicine problem management;

Everyone was trying to do best in the team which was an important activity;

The best thing about this sharing activity was the fact that we learned to decide who does what and how to have a consensus in our team.

Discussion

The results of validity, reliability and participants′ satisfaction of the TOSCE described in this paper as a part of second national medical science Olympiad represented that this kind of exam was useful for measuring clinical competency and also team activity from students′ viewpoints.

Similar results reported in pervious articles. Brian reported a group OSCE (GOSCE) in 1991 that was performed for postgraduate assessment of general practitioners in United Kingdom and concluded that GOSCE is a good method for formative and self assessment. 12 Singleton and colleagues reported a TOSCE in St. George Hospital Medical School in London and concluded that this kind of exam is feasible, although, some students are unfamiliar with it. 7 Also, Elliot and colleagues stated a GOSCE for assessment of clinical and interpersonal skills in United States of America and reported that GOSCE influence curriculum, students and faculties well. 13

In the present study, the students were generally agreed that TOSCE gave them an opportunity to work with their peers well. Most students had not a classroom experience for working in teams. In some classes, the high rank students think that working in groups may lead to do more than their usual duties, otherwise, they should accept the risk of getting bad grades in group works due to difficult and lazy group members that do not want to do anything as a group member. 14 It seems necessary to empower our students in team activities and TOSCE exam seems to be useful for achieving this goal.

In our study near half of the participants believed that they needed more time in stations, especially for getting group consensus. The 5 min station is most frequently used in OSCEs, 15 but some articles reported that students may need more time. 16 In our TOSCE, the expert panel decided to consider 15 min for each three part station, although it seems that more time was needed as reported by half of the students.

The most important strength of this study was that participants were from nine different universities in Iran, besides an expert panel of teachers from different medical universities were selected based on their expertize.To our knowledge, this is the first report of a TOSCE in a norm reference competitive exam such as Olympiad. This TOSCE was used for the first time in the second national medical science Olympiad in Shiraz, while in the first Olympiad in Isfahan other kinds of exams were used to assess group dynamic and clinical competence. 17

The main limitation of this study was that examinees were the top ranked students and were not a good representative of all medical students, especially in team work. Future studies should be done on representative sample of medical students.

Conclusion

Good teamwork is an essential component of clinical performance. Although, further evidence is required on TOSCE effectiveness as a method for group clinical problem solving, we believe that the TOSCE is a useful tool. Most importantly it encourages a positive feeling to team work in our students.

Acknowledgment

We thank the Ministry of Health and Medical Education of Iran and the Vice-Chancellor for Educational and Students Affairs of Shiraz University of Medical Sciences for financial and scientific support for this project. We would like to express our gratitude to all the students who participated in the Olympiad and all of the medical university Education Development Center managers in Iran for coordinating the activities at the medical universities. We would like to give our special thanks to the staff of Shiraz Education Development Center. We express our appreciation to colleagues at Isfahan University of Medical Sciences and to the Olympiad Technical Committee, without their guidance the second Olympiad and this study would not have been possible.

Harden RM Stevenson M Downie WW Wilson GM Assessment of clinical competency using structured examinationBr Med J 1975 1 447 51 Dent JA Harden RM A practical guide for medical teachers.3 rd edShiraz Iran 9 A practical guide for medical teachers 3 rd ed Shiraz Iran 2009 Davis MH OSCE: The Dundee experienceMed Teach 2003 25 225 61 Patricio M Juliao M Falerira F Young M Norman G Carnerio AV A comprehensive checklist for reporting the use of OSCEMed Teach 2009 31 112 24 Ben David MF Life beyond OSCEMed Teach 2003 25 239 40 Hodgos B Validity and the OSCEMed Teach 2003 25 250 4 Singleton A Smth F Harris T Ross Harper R Hilton S An evaluation of Team Objective Clinical Examination(TOSCE)Med Educ 1999 33 34 41 Symonds I Cullen L Fraser D Evaluation of a formative interprofessional team objective structured clinical examination (ITOSCE): A method of shard learning in maternity educationMed Teach 2003 25 38 41 Miller SDW Butler MW Meagher F Costello RW Mcelvaney NG Team Objective Structured Bedside Assessment(TOSBA): A novel and feasible way of providing formative teaching and assessmentMed Teach 2007 29 156 9 Amini M Kojuri J Karimian Z Lotfi F Moghadami M Dehghani MR : Talents for future: Report of the second national medical science Olympiad in Islamic republic of IranIran Red Crescent Med J 2011 13 377 81 Amini M Moghadami M Kojuri J Abasi HR Arhami DoolatAbadi A Molaee NA An innovative method to assess clinical reasoning skills: Clinical reasoning tests in the second national medical science Olympiad in IranBMC Res Notes 2011 4 418 Biran LA Self assessment and learning through GOSCE (Group Objective Structured Clinical Examination) Med Edu 1991;25:475-80. Self assessment and learning through GOSCE (Group Objective Structured Clinical Examination) Med Edu 1991;25:475-80 Elliot DL Fields SA Keenan TL Jaffe AC Toffler WL Use of a group objective structured clinical examination with first year medical studentsAcad Med 1994 69 990 2 Parmelee DX Michaelsen LK Twelve tips for doing effective Team Based Learning(TBL)Med Teach 2010 32 118 22 Harden RM Twelve tips for organizing an Objective Structured Clinical Examination(OSCE)Med Teach 1999 12 259 64 Pell G Fuller R Homer M Roberts T How to measure the quality of the OSCE.A review of metricsAMEE guide no 9 How to measure the quality of the OSCE A review of metrics AMEE guide no 49 Med Teach 2010;32:802-11 Monajemi A Adibi P Soltani Arabshahi K Arbabi F Akbari R Custers E Hadadga RA The battery for assessment of clinical reasoning in the Olympiad for medical sciences studentsIran J Med Educ 2010 10 1056 67