Interventional Pulmonology

Virtual Reality and Written Assessments Are of Potential Value to Determine Knowledge and Skill in Flexible Bronchoscopy
Stephen W. Crawford^a, Henri G. Colt<sup>b

a</sup>Naval Medical Center San Diego, Pulmonary Medicine, United States Navy Medical Corps, San Diego, Calif., and
^bPulmonary and Critical Care Medicine Division, University of California-Irvine, Irvine, Calif., USA

Address of Corresponding Author

Respiration 2004;71:269-275 (DOI: 10.1159/000077425)

  Key Words

• Flexible bronchoscopy
• Technical skills
• Virtual reality
• Education
• Training
• Computer simulation

  Abstract

Background: Technically challenging professions such as those of the defense and transportation industries increasingly use computer-based simulation and written self-learning instruments for education and to determine competency. A structured learning curriculum does not exist, however, for flexible bronchoscopy, a minimally invasive diagnostic procedure performed on thousands of patients by respiratory specialists, otolaryngologists, anesthesiologists, and surgeons worldwide. Objective: To explore an analogous strategy of measuring theoretical knowledge in flexible bronchoscopy and specific technical skills using written knowledge assessments and a virtual reality bronchoscopy simulator. Methods: Twelve trainees from a university pulmonary medicine training program were asked to identify and enter five specific bronchial segments on command using a virtual reality bronchoscopy skill station, and to complete a 50-question examination pertaining to bronchoscopy theory. Their performance scores and opinions pertaining to the use of these methods of assessment were then recorded. Results: Trainees correctly identified and entered 71% of the bronchial segments required on command (median 60%, range 40–100%). Fifty percent (3/6) of the trainees who had performed more than 200 flexible bronchoscopies successfully entered all segments required. None (0/6) of those who had performed less than 200 flexible bronchoscopies correctly located, identified and entered all required segments. Despite disparate performance, all trainees believed that technical skills could be improved through practice and instruction using computer-based simulation. On the written assessment, only 51% of questions were answered correctly (median 52%, range 32–60%). No relationship between technical skill and theoretical knowledge was noted. In addition, neither bronchoscopy skill nor theoretical knowledge were associated with years of training or number of bronchoscopies previously performed. Conclusions: Trainees concluded that (1) bronchoscopy simulation was realistic, (2) simulator-based practice would help improve technical skills, and (3) a written questionnaire would benefit theoretical knowledge acquisition if designed as a learning instrument. The wide variability noted in this study as well as the lack of a relationship between technical skill, knowledge of bronchoscopy theory, extent of training, and bronchoscopy experience suggest that competency should not be assumed based on years of bronchoscopy training or on an arbitrary number of procedures performed.

Copyright © 2004 S. Karger AG, Basel

  Author Contacts

Henri G. Colt, MD
Pulmonary and Critical Care Medicine, UCI Medical Center
101 The City Drive, Bldg 53, Rt 81
Orange, CA 92868 (USA)
Tel. +1 714 456 5150, Fax +1 714 456 8349, E-Mail hcolt@uci.edu

  Article Information

The opinions expressed are those of the authors and not necessarily those of the United States Navy or the United States Department of Defense.

Received: September 23, 2003
Accepted after revision: December 10, 2003
Number of Print Pages : 7
Number of Figures : 5, Number of Tables : 2, Number of References : 32