Validity of surgical simulation for the assessment of operative skill
- 1 November 2001
- journal article
- research article
- Published by Oxford University Press (OUP) in British Journal of Surgery
- Vol. 88 (11) , 1525-1532
- https://doi.org/10.1046/j.0007-1323.2001.01880.x
Abstract
Background: Surgical simulators are being promoted as a means of assessing a surgeon's technical skills. Little evidence exists that simulator performance correlates with actual technical ability. This study was undertaken to determine the criterion and construct validity of currently available surgical simulations in the evaluation of technical skill. Methods: Simulator assessment was carried out on 36 basic surgical trainees, 37 surgically naïve first-year medical students and 16 experienced general surgical consultants. Some 26 trainees and 36 students underwent repeat assessment after 6 months. A previously validated, 19-point technical skill assessment form, based on direct observation of trainee performance in the operating theatre, was also completed by each trainee's supervising consultant. Results: An insignificant or weak correlation was found between simulator performance and both duration of basic surgical experience and consultant assessment of technical skill. Six months of basic surgical training led to an improvement in performance, not seen in an untrained control group, in only one of the six simulations tested. Discrimination between surgically naïve and experienced subjects was only demonstrated, in part, for four of the six tasks. Conclusion: The assessment of technical skill needs to be improved. Work is needed to establish the reliability and validity of currently available simulation models before they are formally introduced for high-stakes assessment.Keywords
This publication has 30 references indexed in Scilit:
- Acquiring surgical skillsBritish Journal of Surgery, 2000
- EditorialJournal of the American College of Surgeons, 1999
- Measuring and developing suturing technique with a virtual reality surgical simulator11All authors, except Krummel, have an affiliation with Boston Dynamics Inc., an organization that has a financial interest in the editorial content discussed in the manuscript.Journal of the American College of Surgeons, 1999
- Virtual Reality Training in Laparoscopic Surgery: A Preliminary Assessment of Minimally Invasive Surgical Trainer Virtual Reality (MIST VR)Endoscopy, 1999
- A Portable Tensiometer for Assessing Surgeon's Knot Tying TechniqueGynecologic Oncology, 1993
- ANASTOMOSIS: A CRAFT WORKSHOP FOR SURGICAL TRAINEESAnz Journal of Surgery, 1990
- Simulation in surgical training.BMJ, 1990
- Halstedian Technique RevisitedAnnals of Surgery, 1989
- Accuracy of suture placementBritish Journal of Surgery, 1987
- Simulation in surgical training using freeze dried materialBritish Journal of Surgery, 1986