Evaluation of the assessment methods in pre-clinical operative techniques training

Objectives: To examine the opinions of 3rd year dental students in regard to their assessment in pre-clinical operative techniques. Additionally, to evaluate the method of assessment by comparing self, peer and tutor grading of procedures using the current rubric. Methods: 30 participants were recruited from the 3rd year Bachelor of Dental Surgery class on a voluntary basis. Phase 1 of the study consisted of 43 questions, with Likert scale answer options. The assessment section posed questions involving the assessment methods, students understanding of the assessment criteria, if they received their expected grade and if they believed they were graded consistently throughout the course. Phase 2 asked participants to complete a cavity preparation on an upper molar in a mannequin head. They were instructed to self-assess their preparation by grading it from 1-4 using the rubric currently in use. The prepared teeth were then randomly redistributed to the participants, who graded the work of their peer. This allowed for a peer assessment of each preparation as well as the self-assigned grade. The 30 prepared teeth were then distributed between 5 OTL instructors for grading using the same criteria. Data analysis was then performed on all grading results collected. Results: 75% of participants report receiving the grade they expected from assessments and 40% believe they can accurately assess their work using the rubric most of the time. Interestingly, tutors awarded the most grade 4’s in Phase 2, while students never awarded themselves a level 1. Wilcoxon Signed Ranks Test revealed an equal median score between all three groups. Conclusions: Overall, this study demonstrates that the current method of pre-clinical assessment is effective however, establishing a more clearly defined rubric may facilitate increased accuracy in self-assessment by students. Further research could explore how the current rubric performs when compared with an updated rubric with clearer criteria.