The effect of using Enhanced Visual Representation (EVR) of Procedure Based Assessment (PBA) on the process of surgical training and feedback
Introduction: Procedure Based Assessment (PBA) is a structured method of assessing surgical Trainees’ performance and skills in the UK and is a valuable tool for trainers in the Annual Review of Competence Progression. Trainers can view PBA’s on the online-based Intercollegiate Surgical Curriculum Programme (ISCP) individually in a long-form format with no visual representation.
Aim: To assess the effect of an originally devised EVR tool of PBA’s in the context of ARCP
Methodology: PBA data collected for three volunteered orthopaedic trainees (ST4, ST5 & ST6), over a six-month period. An EVR was generated using Tableau® Desktop software, and two other EVR’s originally devised to visually represent the trainees’ PBA’s and integrated into three interactive PDF files. Twelve trainer consultants, randomised into two equal groups, participated in a mock ARCP. Group A used the ISCP website followed by the EVR tool & Group B started with the EVR. Trainers then rated their experience on three surveys.
Results: The trainers rated using the EVR significantly higher (p < 0.001) than the ISCP website in the 10 aspects assessed by the questionnaires. Strong agreement to develop the EVR tool and have incorporated into the ISCP website have been demonstrated (p < 0.001). Comparison of total responses showed no significant statistical difference between group A and B.
Conclusion: The project shows that the EVR tool has the potential to be a positive addition to the ISCP website to improve the process of surgical training and feedback.
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.