GRADING OF THE THEORETICAL EXAMINATION
The MCQ and Slide Recognition test are scored digitally through the Examsoft system and total scores for all questions are generated. Slide questions that require open answers are manually scored and the scores discussed by members of the examination committee.
The passing point for the Written and Image Recognition Tests are determined through a criterion referenced method as modified by Angoff. This technique is considered by most experts as one of the most reliable and defensible methods available of setting passing points. It relies on the pooled judgments of content experts. For example, in this approach, a group of experts is asked to judge each item on the test. The criterion used is formed into a question: "what is the probability that a ‘minimally acceptable’ candidate will answer this item correctly?" This question prompts the judges to consider a group of minimally acceptable candidates and what proportion of that group will answer an item correctly. The average of the proportions, or probabilities, is multiplied by the total number of questions in the test. The result then represents the minimally acceptable score. Since the ECVO exams are revised regularly, with some items being replaced by newly developed ones, the content and difficulty level of the examination changes. These changes usually affect the score necessary to pass. As a result, the passing point for each examination is unique. Once the Angoff raw passing point (PP) has been determined, the passing point minus one, two and three standard deviations (PP-1, PP-2, PP-3) are calculated. When the examination results are collated, one of these passing points, or an intermediate passing point, is then selected as the final passing point. The decision as to which is chosen (PP, PP-1, PP-2, PP-3, or an intermediate passing point) is dependent on the phenomenon of clustering (i.e., if a number of candidate results are clustered around a passing point, a passing point below that cluster may be chosen as the final passing point).
GRADING OF THE PRACTICAL EXAMINATION
For each station within the practical examination, at least two examiners observe and independently score the surgical or examination techniques of the candidate on separate components of the procedure, including appropriate instrumentation and proficiency in the technique itself.
The passing point at each of the three practical stations is 6.5/10. Each station is independent of the other stations (i.e., if the candidate passes a station and fails one or two others, this candidate will only need to sit the previously failed station(s) at a following attempt). However, in order to pass the full practical examination, candidates must pass all three stations.
The examiners will use OSCE-style marking sheets and the clinical examination sheet (applicable to the clinical examination station only) to score the candidate’s performance and competency. Examples of OSCE-style marking sheets can be found on the ECVO website under the Exam instructions for candidates-tab.