Evaluation of three sources of validity evidence for a synthetic thoracoscopic esophageal atresia/tracheoesophageal fistula repair simulator

Katherine A. Barsness*, Deborah M. Rooney, Lauren M. Davis, Ellie O'Brien

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

15 Scopus citations

Abstract

Purpose: Thoracoscopic esophageal atresia (EA)/tracheoesophageal fistula (TEF) repair is technically challenging. We have previously reported our experiences with a high-fidelity hybrid model for simulation-based educational instruction in thoracoscopic EA/TEF, including the high cost of the tissue for these models. The purposes of this study were (1) to create a low-cost synthetic tissue EA/TEF repair simulation model and (2) to evaluate the content validity of the synthetic tissue simulator. Materials and Methods: Review of the literature and computed tomography images were used to create computer-aided drawings (CAD) for a synthetic, size-appropriate EA/TEF tissue insert. The inverse of the CAD image was then printed in six different sections to create a mold that could be filled with platinum-cured silicone. The silicone EA/TEF insert was then placed in a previously described neonatal thorax and covered with synthetic skin. Following institutional review board-exempt determination, 47 participants performed some or all of a simulated thoracoscopic EA/TEF during two separate international meetings (International Pediatric Endosurgery Group [IPEG] and World Federation of Associations of Pediatric Surgeons [WOFAPS]). Participants were identified as "experts," having 6-50 self-reported thoracoscopic EA/TEF repairs, and "novice," having 0-5 self-reported thoracoscopic EA/TEF repairs. Participants completed a self-report, six-domain, 24-item instrument consisting of 23 5-point rating scales and one 4-point Global Rating Scale. Validity evidence relevant to test content and response processes was evaluated using the many-facet Rasch model, and evidence of internal structure (interitem consistency) was estimated using Cronbach's alpha. Results: A review of the participants' ratings indicates there were no overall differences across sites (IPEG versus WOFAPS, P=.84) or experience (expert versus novice, P=.17). The highest observed averages were 4.4 (Value of Simulator as a Training Tool), 4.3 (Physical Attributes - chest circumference, chest depth, and intercostal space), and 4.3 (Realism of Experience - fistula location). The lowest observed averages were 3.5 (Ability to Perform - closure of fistula), 3.7 (Ability to Perform - acquisition target trocar sites), 3.8 (Physical Attributes - landmark visualization), 3.8 (Ability to Perform - anastomosis and dissection of upper pouch), and 3.9 (Realism of Materials - skin). The Global Rating Scale was 2.9, coinciding with a response of "this simulator can be considered for use in neonatal TEF repair training, but could be improved slightly." Material costs for the synthetic EA/TEF inserts were less than $2 U.S. per insert. Conclusions: We have successfully created a low-cost synthetic EA/TEF tissue insert for use in a neonatal thoracoscopic EA/TEF repair simulator. Analysis of the participants' ratings of the synthetic EA/TEF simulation model indicates that it has value and can be used to train pediatric surgeons, especially those early in their learning curve, to begin to perform a thoracoscopic EA/TEF repair. Areas for model improvement were identified, and these areas will be the focus for future modifications to the synthetic EA/TEF repair simulator.

Original languageEnglish (US)
Pages (from-to)599-604
Number of pages6
JournalJournal of Laparoendoscopic and Advanced Surgical Techniques
Volume25
Issue number7
DOIs
StatePublished - Jul 1 2015

ASJC Scopus subject areas

  • Surgery

Fingerprint Dive into the research topics of 'Evaluation of three sources of validity evidence for a synthetic thoracoscopic esophageal atresia/tracheoesophageal fistula repair simulator'. Together they form a unique fingerprint.

Cite this