TY - JOUR
T1 - Combining Metrics From Clinical Simulators and Sensorimotor Tasks Can Reveal the Training Background of Surgeons
AU - Huang, Felix C.
AU - Mohamadipanah, Hossein
AU - Mussa-Ivaldi, Ferdinando A.
AU - Pugh, Carla M.
PY - 2019/9/1
Y1 - 2019/9/1
N2 - BACKGROUND: Skill assessment in surgery traditionally has relied on the expert observation and qualitative scoring. Our novel study design demonstrates how analysis of performance in sensorimotor tasks and bench-top surgical simulators can provide inferences about the technical proficiency as well as the training history of surgeons. METHODS: We examined metrics for basic sensorimotor tasks in a virtual reality interface as well as motion metrics in clinical scenario simulations. As indicators of the training level, we considered survey responses from surgery residents, including the number of postgraduation years (PGY, four levels), research years (RY, three levels), and clinical years (CY, three levels). Next, we performed a linear discriminant analysis with cross-validation (90% training, 10% testing) to relate the training levels to the selected metrics. RESULTS: Using combined metrics from all stations, we found greater than chance predictions for each survey category, with an overall accuracy of 43.4 ± 2.9% for identifying the level for post-graduate years, 79.1 ± 1.0% accuracy for research training years, and 64.2 ± 1.0% for clinical training years. Our main finding was that combining metrics from all stations resulted in more accurate predictions than using only sensorimotor or clinical scenario tasks. In addition, we found that metrics related to the ability to cope with changes in the task environment were the most important predictors of training level. CONCLUSIONS: These results suggest that each simulator-type provided crucial information for evaluating surgical proficiency. The methods developed in this paper could improve evaluations of a surgeon's clinical proficiency as well as training potential in terms of basic sensorimotor ability.
AB - BACKGROUND: Skill assessment in surgery traditionally has relied on the expert observation and qualitative scoring. Our novel study design demonstrates how analysis of performance in sensorimotor tasks and bench-top surgical simulators can provide inferences about the technical proficiency as well as the training history of surgeons. METHODS: We examined metrics for basic sensorimotor tasks in a virtual reality interface as well as motion metrics in clinical scenario simulations. As indicators of the training level, we considered survey responses from surgery residents, including the number of postgraduation years (PGY, four levels), research years (RY, three levels), and clinical years (CY, three levels). Next, we performed a linear discriminant analysis with cross-validation (90% training, 10% testing) to relate the training levels to the selected metrics. RESULTS: Using combined metrics from all stations, we found greater than chance predictions for each survey category, with an overall accuracy of 43.4 ± 2.9% for identifying the level for post-graduate years, 79.1 ± 1.0% accuracy for research training years, and 64.2 ± 1.0% for clinical training years. Our main finding was that combining metrics from all stations resulted in more accurate predictions than using only sensorimotor or clinical scenario tasks. In addition, we found that metrics related to the ability to cope with changes in the task environment were the most important predictors of training level. CONCLUSIONS: These results suggest that each simulator-type provided crucial information for evaluating surgical proficiency. The methods developed in this paper could improve evaluations of a surgeon's clinical proficiency as well as training potential in terms of basic sensorimotor ability.
UR - http://www.scopus.com/inward/record.url?scp=85071441108&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85071441108&partnerID=8YFLogxK
U2 - 10.1109/TBME.2019.2892342
DO - 10.1109/TBME.2019.2892342
M3 - Article
C2 - 30629489
SN - 0018-9294
VL - 66
SP - 2576
EP - 2584
JO - IEEE transactions on bio-medical engineering
JF - IEEE transactions on bio-medical engineering
IS - 9
ER -