Operator performance
An important element of simulator performance is the capacity of simulators to distinguish operator expertise. Most studies on operator performance have utilized “metrics.” 1) 2) 3) 4) 5) 6) 7) 8) 9) 10) 11).
Tool acceleration 12) , applied forces 13) 14) 15) 16) 17) 18) 19) have all been studied. An operator’s performance metrics can be compared with previously defined proficiency benchmarks. The operator could then be placed into 1 of 2 or more groups with specific levels of psychomotor expertise 20) 21).
1)
Choudhury N, Gelinas-Phaneuf N, Delorme S, Del Maestro R
(2013) Fundamentals of neurosurgery: virtual reality tasks for training and evaluation of technical skills. World Neurosurg 80(5):e9–e19
2)
Gelinas-Phaneuf N, Del Maestro RF (2013) Surgical expertise in
neurosurgery: integrating theory into practice. Neurosurgery
73(suppl_1):S30–S38
3)
Gelinas-Phaneuf N, Choudhury N, Al-Habib AR, Cabral A,
Nadeau E, Mora V et al (2014) Assessing performance in brain
tumor resection using a novel virtual reality simulator. Int J
Comput Assist Radiol Surg 9(1):1–9
4)
, 13)
Azarnoush H, Alzhrani G, Winkler-Schwartz A, Alotaibi F,
Gelinas-Phaneuf N, Pazos V, Choudhury N, Fares J, DiRaddo R,
del Maestro R (2015) Neurosurgical virtual reality simulation metrics to assess psychomotor skills during brain tumor resection. Int J Comput Assist Radiol Surg 10(5):603–618
5)
Cline BC, Badejo AO, Rivest II, Scanlon JR, Taylor WC, Gerling
GJ (2008) Human performance metrics for a virtual reality simulator to train chest tube insertion. IEEE SIEDS :168–173
6)
Kazemi H, Rappel JK, Poston T, Hai Lim B, Burdet E, Leong TC (2010) Assessing suturing techniques using a virtual reality surgical simulator. Microsurgery. 30(6):479–486
7)
Trejos AL, Patel RV, Malthaner RA, Schlachta CM (2014)
Development of force-based metrics for skills assessment in minimally invasive surgery. Surg Endosc 28(7):2106–2119
8)
Kovac ERA, Azhar A, Quirouet J, Delisle, Anidjar M (2012)
Construct validity of the lapSim virtual reality laparoscopic simulator within a urology residency program. CUAJ 6(4):253
9)
Alotaibi FE, Al Zhrani G, Bajunaid K, Winkler-Schwartz A,
Azarnoush H et al (2015) Assessing neurosurgical psychomotor
performance: role of virtual reality simulators, current and future
potential. SOJ Neurol 2(1):1–7
10)
Alotaibi FE, AlZhrani GA, Mullah MA, Sabbagh AJ, Azarnoush H,
Winkler-Schwartz A et al (2015) Assessing bimanual performance
in brain tumor resection with NeuroTouch, a virtual reality simulator. Oper Neurosurg 11(1):89–98
11)
Alotaibi FE, AlZhrani GA, Sabbagh AJ, Azarnoush H, WinklerSchwartz A, Del Maestro RF (2015) Neurosurgical assessment of
metrics including judgment and dexterity using the virtual reality
simulator NeuroTouch (NAJD Metrics). Surg Innov 22(6):636–642
12)
Jensen Ang WJ, Hopkins ME, Partridge R, Hennessey I, Brennan
PM, Fouyas I, Hughes MA (2013) Validating the use of
smartphone-based accelerometers for performance assessment in a
simulated neurosurgical task. Oper Neurosurg 10(1):57–65
14)
Azarnoush H, Siar S, Sawaya R, Zhrani GA, Winkler-Schwartz A,
Alotaibi FE, Bugdadi A, Bajunaid K, Marwa I, Sabbagh AJ, del
Maestro R (2017) The force pyramid: a spatial analysis of force
application during virtual reality brain tumor resection. J
Neurosurg 127(1):171–181
15)
Sawaya R, Bugdadi A, Azarnoush H, Winkler-Schwartz A,
Alotaibi FE, Bajunaid K, AlZhrani GA, Alsideiri G, Sabbagh AJ,
Del Maestro RF (2017) Virtual reality tumor resection: the force
pyramid approach. Operative Neurosurgery. 14(6):686–696
16)
Bugdadi A, Sawaya R, Olwi D, AlZahrani G, Azarnoush H,
Sabbagh A et al (2018) Automaticity of force application during
simulated brain tumor resection: testing the Fitts and Posner model.
J Surg Educ 75(1):104–115
17)
Sawaya R, Alsidieri G, Bugdadi A, Winkler-Schwartz A,
Azarnoush A, Bajunaid K, AJ JS, Del Maestro R (2018)
Development of a performance model for virtual reality tumor resections. J Neurosurg 1(aop):1–9
18)
Winkler-Schwartz A, Bajunaid K, Mullah MA, Marwa I, Alotaibi
FE, Fares J et al (2016) Bimanual psychomotor performance in, bimanual dexterity, and the effect of stress neurosurgical resident applicants assessed using NeuroTouch, a virtual reality simulator. J Surg Educ 73(6):942–953
19)
Bajunaid K, Mullah MA, Winkler-Schwartz A, Alotaibi FE, Fares
J, Baggiani M et al (2017) Impact of acute stress on psychomotor
bimanual performance during a simulated tumor resection task. J
Neurosurg 126(1):71–80
20)
Alzhrani G, Del Maestro RF (2014) A validation study of
NeuroTouch in neurosurgical training. LAP LAMBERT
Academic Publishing, Saarbrücken
21)
Alzhrani G, Alotaibi F, Azarnoush H, Winkler-Schwartz A,
Sabbagh A, Bajunaid K et al (2015) Proficiency performance
benchmarks for removal of simulated brain tumors using a virtual
reality simulator NeuroTouch. Journal of Surgical Education 72(4):
685–696