Tag Archive for: robotic simulation

Posts

Article of the Week: Performance of robotic simulated skills tasks is positively associated with clinical robotic surgical performance

Every Week the Editor-in-Chief selects an Article of the Week from the current issue of BJUI. The abstract is reproduced below and you can click on the button to read the full article, which is freely available to all readers for at least 30 days from the time of this post.

In addition to the article itself, there is an accompanying editorial written by a prominent member of the urological community. This blog is intended to provoke comment and discussion and we invite you to use the comment tools at the bottom of each post to join the conversation.

Finally, the third post under the Article of the Week heading on the homepage will consist of additional material or media. This week we feature a video from Alvin Goh, discussing his paper.

If you only have time to read one article this week, it should be this one.

Performance of robotic simulated skills tasks is positively associated with clinical robotic surgical performance

 

Monty A. Aghazadeh*,, Miguel A. Mercado*,, Michael M. Pan, Brian J. Miles
‡ and Alvin C. Goh*,

 

*Methodist Institute for Technology, Innovation, and Education (MITIE), Houston Methodist Hospital, Scott Department of Urology, Baylor College of Medicine, and Department of Urology, Houston Methodist Hospital, Houston, TX, USA

 

Objective

To compare user performance of four fundamental inanimate robotic skills tasks (FIRST) as well as eight da Vinci Skills Simulator (dVSS) virtual reality tasks with intra-operative performance (concurrent validity) during robot-assisted radical prostatectomy (RARP) and to show that a positive correlation exists between simulation and intra-operative performance.

Materials and Methods

A total of 21 urological surgeons with varying robotic experience were enrolled. Demographics were captured using a standardized questionnaire. User performance was assessed concurrently in simulated (FIRST exercises and dVSS tasks) and clinical environments (endopelvic dissection during RARP). Intra-operative robotic clinical performance was scored using the previously validated six-metric Global Evaluative Assessment of Robotic Skills (GEARS) tool. The relationship between simulator and clinical performance was evaluated using Spearman’s rank correlation.

dffdbd

Results

Performance was assessed in 17 trainees and four expert robotic surgeons with a median (range) number of previous robotic cases (as primary surgeon) of 0 (0–55) and 117 (58–600), respectively (P = 0.001). Collectively, the overall FIRST (ρ = 0.833, P < 0.001) and dVSS (ρ = 0.805, P < 0.001) simulation scores correlated highly with GEARS performance score. Each individual FIRST and dVSS task score also demonstrated a significant correlation with intra-operative performance, with the exception of Energy Switcher 1 exercise (P = 0.063).

Conclusions

This is the first study to show a significant relationship between simulated robotic performance and robotic clinical performance. Findings support implementation of these robotic training tools in a standardized robotic training curriculum.

Editorial: Robotic simulation: are we ready to go?

In a study in this issue of BJUI, Aghazadeh et al. [1] were able to show that there was a significant relationship between simulated robotic performance and robotic clinical performance. The authors conclude that this supports the implementation of such robotic training tools in a standardized robotic training curriculum. Evidently, particularly in minimally invasive surgery, we must assess and learn from our surgical errors in order to prevent them in future [2]. For this, the dream scenario would be the ability to simulate a surgical procedure before being allowed to perform the real operation on the patient, similarly to pilots being trained on a flight simulator [3]. A robotic (virtual) simulator would be the ideal way to provide training on the respective robot-assisted procedure [1].

The authors are to be congratulated in their effort to prove the transfer validity of their training model using 12 previously validated robotic skill tasks consisting of four inanimate models and eight selected virtual reality tasks on the da Vinci Skills Simulator [1]. Endopelvic fascial dissection during robot-assisted radical prostatectomy was chosen to assess clinical robotic performance. Trainees were evaluated using the Global Evaluative Assessment of Robotic Skills (GEARS) scoring system, which distinguishes among depth perception, bimanual dexterity, efficiency, force sensitivity, autonomy, robotic control in relationship to the case difficulty using scores ranging from 1 to 5.

Nevertheless, there is still a long way to go! The authors have already conceded that there are some limitations to their study. It involved a small cohort of urological surgeons of different levels of expertise. It was not a randomized study comparing the impact of virtual simulator training on the surgical outcome, therefore, the authors could only show that they might be able to predict a surgeon’s performance during a real case based on his/her performance at the simulator. Based on this, the simulator training could theoretically pre-assess surgeon’s quality in robot-assisted surgery.

The authors probably chose endopelvic dissection because it represents a relatively easy part of robot-assisted radical prostatectomy. Accordingly, it remains unclear whether such basic tasks are really the best models to prepare a surgeon for this operation. Using low-fidelity training models, including vesico-urethral anastomosis, we were able to demonstrate the transfer validity of a six-step training programme [4]. It would be interesting to see the impact of the simulator training on clinical performance of robot-assisted vesico-urethral anastomosis because a valuable exercise for this already exists on the da Vinci Skills Simulator.

Despite this progress, we must recognize that we are far away from equalling the simulator training of pilots [3]. It is much easier to simulate turbulence during a flight than significant bleeding during robot-assisted surgery. Trials in simulating a complete laparoscopic procedure are still in their infancy [5]. This may differ with regard to other minimally invasive procedures such as ureteroscopy, where sophisticated trainer exercises exist; however, even in this field there is actually no proven evidence of the significant impact of simulators on shortening the learning curve. For all ‘hands-on’ simulation there will be always the problem of soft-tissue engineering and navigation [6]. Robotic simulators have the advantage compared with laparoscopy of three-dimensional video technology and the fact that there is no tactile feedback for the surgeon.

Evidently, information technology is continuously advancing and we may one day have a robotic simulator that can compare with the flight simulators used in aviation; however, to date, only training on basic skills can be provided and evaluated using the existing simulation systems in urology.

Jens Rassweiler
Department of Urology, SLK Kliniken Heilbronn, University of Heidelberg, Heidelberg , Germany

 

1 Aghazadeh MA, Mercado MA, Pan MM, Miles BJ, Goh AC.

 

2 Rassweiler MC, Mamoulakis C, Kenngott HG et al. Classication and
171321

 

3 Sommer KJ. Pilot training: what can surgeons learn from it? Arab J Urol 2014; 12: 325

 

5 Shamim Khan M, Ahmed K, Gavazzi A et al. Development and
51823

 

6 Baumhauer M, Feuerstein M, Meinzer HP, Rassweiler J. Navigation in

 

Video: Performance of robotic simulated skills tasks is positively associated with clinical robotic surgical performance

Performance of robotic simulated skills tasks is positively associated with clinical robotic surgical performance

Monty A. Aghazadeh*,, Miguel A. Mercado*,, Michael M. Pan, Brian J. Miles
‡ and Alvin C. Goh*,

 

*Methodist Institute for Technology, Innovation, and Education (MITIE), Houston Methodist Hospital, Scott Department of Urology, Baylor College of Medicine, and Department of Urology, Houston Methodist Hospital, Houston, TX, USA

 

Objective

To compare user performance of four fundamental inanimate robotic skills tasks (FIRST) as well as eight da Vinci Skills Simulator (dVSS) virtual reality tasks with intra-operative performance (concurrent validity) during robot-assisted radical prostatectomy (RARP) and to show that a positive correlation exists between simulation and intra-operative performance.

Materials and Methods

A total of 21 urological surgeons with varying robotic experience were enrolled. Demographics were captured using a standardized questionnaire. User performance was assessed concurrently in simulated (FIRST exercises and dVSS tasks) and clinical environments (endopelvic dissection during RARP). Intra-operative robotic clinical performance was scored using the previously validated six-metric Global Evaluative Assessment of Robotic Skills (GEARS) tool. The relationship between simulator and clinical performance was evaluated using Spearman’s rank correlation.

dffdbd

Results

Performance was assessed in 17 trainees and four expert robotic surgeons with a median (range) number of previous robotic cases (as primary surgeon) of 0 (0–55) and 117 (58–600), respectively (P = 0.001). Collectively, the overall FIRST (ρ = 0.833, P < 0.001) and dVSS (ρ = 0.805, P < 0.001) simulation scores correlated highly with GEARS performance score. Each individual FIRST and dVSS task score also demonstrated a significant correlation with intra-operative performance, with the exception of Energy Switcher 1 exercise (P = 0.063).

Conclusions

This is the first study to show a significant relationship between simulated robotic performance and robotic clinical performance. Findings support implementation of these robotic training tools in a standardized robotic training curriculum.

© 2020 BJU International. All Rights Reserved.