Investigating the Impact of the Direct Observation of Procedural Skills Assessment on the Learning and Satisfaction of the Operating Room Students of Neyshabur University of Medical Sciences, Iran, in 2022

Hassan Ebrahimpour Sadagheyani1, Seyede M. Saadati, Farin Tatari

Abstract


Background: The assessment of learners is a fundamental element in medical science curricula. The Direct Observation of Procedural Skills (DOPS) exam is a valuable way to assess clinical skills. The present study aimed to assess the clinical skills of operating room students of Neyshabur University of Medical Sciences, Iran, using the DOPS exam, and determine the effect of the exam on the learning and satisfaction of the learners.

Materials and Methods: The current study was a semi‑experimental study that used a single‑group posttest study design. The statistical sample included 30 operating room students. The 5 skills were selected for assessment and the assessment checklist was designed by the researcher and approved by the expert panel. Moreover, 3 researcher‑made questionnaires were used to examine the students’ skills and opinions regarding facilitating learning and their satisfaction with the DOPS examination. Mann‑Whitney, Kruskal‑Wallis, and Wilcoxon tests were used to analyze the data.

Results: The results showed that there was a significant difference between the scores of the students in the first and second examinations (z = ‑4.243, p < 0.001), and the students› scores increased significantly on the second examination. The learners were satisfied with the way the DOPS exam was conducted, and their satisfaction score of this exam was 90.7 out of 120. Furthermore, students agreed that this exam affected learning facilitation. Their score on the effectiveness of this exam was 93.9/120.

Conclusions: Although the DOPS examination is one of the clinical assessment methods for learners, it can be used as an instructional tool in the learning process.



Keywords


Assessment, direct observation of procedural skills, learning, satisfaction

Full Text:

PDF

References


Asadi S, Latifi SM, Sheini Jaberi P. Effects of clinical education and evaluation with portfolio method on nursing students’ satisfaction: A clinical trial. J Clin Nurs Midwifery 2014;3:70 9.

Tyo MB, McCurry MK. An integrative review of clinical reasoning teaching strategies and outcome evaluation in nursing education. Nurs Educ Perspect. 2019;40:11 7.

Jalili M, Nejad MKM, Gandumkar R, Hejri SM. Principles and Methods of Student Assessment in Medical Sciences. Tehran: The Academy of Medical Sciences of Iran; 2017. p. 794.

Lotfi M, Zamanzadeh V, Abdollahzadeh F, Davoodi A, Roshangar F. The effect of using logbook on nursing students’ learning. Iran J Med Educ 2010;10:64 70.

Mirhosseini F, Manoochehri H, musavi S, Hasanshiri F, Bigdeli S, Moghadam ZR. Combining two performance based assessment methods of logbook and DOPS in field internship of BSc anesthesiology students. J Med Educ Dev 2018;10:46 56.

Association of American Medical Colleges. Medical school graduation questionnaire: 2016 all schools summary report. Association of American Medical Colleges 2016. Available from: https://www.aamc.org/media/8321/download. [Last accessed 2020 Feb 21].

Waqar SH. Students’perception of direct observation of procedural skills as workplace based assessment tool in general surgery. Pakistan Armed Forces Medical Journal 2016;66:731 7.

Sohrabi Z, Salehi K, Rezaie H, Haghani F. The implementation of direct observation of procedural skills (DOPS) in Iran’s Universities of medical sciences: A systematic review. Iran J Med Educ 2016;16:407 17.

Azizi M, Barati H, Khamse F, Barati M, Alizadeh A. The effect of log book design and implementation on students’ satisfaction and performance during a nursing internship course in a military

psychiatric hospital. Ebnesina IRIAF Health Adm 2016;18:58 63.

Lee K C, Ho C H, Yu C C, Chao Y F. The development of a six station OSCE for evaluating the clinical competency of the student nurses before graduation: A validity and reliability analysis. Nurse Educ Today 2020;84:104247. doi: 10.1016/j.nedt. 2019.104247.

Bari V. Updating teaching and learning methodologies in radiology. J Coll Physicians Surg Pak 2014;24:519 22.

Yan CC, Choo K. Designing direct observation of procedural skills (DOPS) for core competency skills at the primary care setting. Sci Talks 2023;5:100159. doi: 10.1016/j.sctalk. 2023.100159.

Loerwald AC, Lahner F M, Nouns ZM, Berendonk C, Norcini J, Greif R, et al. The educational impact of mini clinical evaluation exercise (Mini CEX) and direct observation of procedural skills (DOPS) and its association with implementation: A systematic review and meta analysis. PloS One 2018;13:1 15. doi: 10.1371/journal.pone.0198009.

Khanghahi ME, Azar FEF. Direct observation of procedural skills (DOPS) evaluation method: Systematic review of evidence. Med J Islamic Repub Iran 2018;32:45. doi: 10.14196/mjiri. 32.45.

Habibi H, Khaghanizade M, Mahmoodi H, Ebadi A. Comparison of the effects of modern assessment methods (DOPS and Mini CEX) with traditional method on nursing students’ clinical skills: A randomized trial. Iran J Med Educ 2013;13:364 72.

Kashan, Iran: Kashan University of Medical Sciences; 2021. Available from: http://nursing.kaums.ac.ir/Default. aspx?PageID=113. [Last accessed on 2022 Aug 18].

Singh G, Kaur R, Mahajan A, Thomas AM, Singh T. Piloting direct observation of procedural skills in dental education in India. Int J Appl Basic Med Res 2017;7:239 42.

Farajpour A, Amini M, Pishbin E, Arshadi H, Sanjarmusavi N, Yousefi J, et al. Teachers’ and students’ satisfaction with DOPS examination in Islamic Azad University of Mashhad, a study in year 2012. Iran J Med Educ 2014;14:165 73.

Alborzi R, Koohpayehzadeh J, Rouzbahani M. Validity and reliability of the persian version of direct observation of procedural skills tool in audiology. Sci J Rehabil Med 2021;10:346 57.

Tenzin K, Gyamtsho S, Wangdon T, Buttia PC, Chandan L, Rege N. Effect of use of direct observation of procedural skills for assessment for learning in obstetrics and Gynaecology postgraduate students at Medical University, Bhutan: A prospective study. Bhutan Health J 2019;5:9 14.

Azeem M, Usmani A, Ashar A. Effectiveness of direct observation of procedural skills (DOPS) for improving the mini implant insertion procedural skills of postgraduate orthodontic trainees. Impact of the DOPS Assessment on Students 2022;16:192 94.

Kamat C, Todakar M, Patil M, Teli A. Changing trends in assessment: Effectiveness of Direct observation of procedural skills (DOPS) as an assessment tool in anesthesiology postgraduate students. J Anaesthesiol Clin Pharmacol 2022;38:275 80.

Khoshrang H, Haghighi M, Taheri M, Nemati S, Erfani R. Assessment of direct objective procedural skill method by medical residents of GUMS. Res Med Educ 2010;2:40 5.

Mohamadirizi S, Mardanian F, Torabi F. The effect of direct observation of procedural skills method on learning clinical skills of midwifery students of medical sciences. J Educ Health Promot 2020;9:91.

Vergis A, Leung C, Roberston R. Rater training in medical education: A scoping review. Cureus 2020;12:e11363. doi: 10.7759/cureus. 11363.

Rehman I, Shah RA, Ahmed M, Kamal A, Riaz S. Using dops (directly observed procedural skills) for assessment of fluoroscopic proficiency of radiology residents: Initial experience. PJR 2020;30:41 5.

Rahimi F, Alizadeh M. What do students do after receiving feedback? J Growth Med Educ 2021;14:29 34.

Monadi Ziarat H, Hashemi M, Fakharzadeh L, Akbari Nasagi N, Khazni S. Assessment of efficacy of oral feedback on trainee’s satisfaction in nursing education. J Nurs Educ 2018;7:30 7.

Mbewe M, Mbewe N, Ngoma CM. Factors contributing to students’ satisfaction with direct observation of procedural skills in the school of nursing sciences at the University of Zambia. J Nurs Educ Pract 2020;10:47 56.

Liu Y C, Lee Y C, Huang P C, Lee I H, Lin K C. Perception of the use of the direct observation of procedural skills in occupational therapy postgraduate year training in Taiwan: Survey of the perspectives of trainees and supervisors. Occup Ther Int 2023;2023:1 7. doi: 10.1155/2023/8013086.

Lagoo JY, Joshi SB. Introduction of direct observation of procedural skills (DOPS) as a formative assessment tool during postgraduate training in anaesthesiology: Exploration of perceptions. Indian J Anaesth 2021;65:202 9.


Refbacks

  • There are currently no refbacks.