Markers

Markers with any marking related system role can score candidate responses. In marking teams, Markers with basic marking permissions are usually the ones responsible for scoring responses.

If standardisation 3 (S3) is active in the marking project, Markers will go through a training phase before they commence marking.

Marking may also be monitored for quality but this happens in the background, there will be no indication in the system interface that your marking is being monitored.

Quality control monitoring features include blind quality monitoring, sampling and double marking.

Undertake Marker training (S3)

The responses assigned to you for marking have already been scored by a Chief Marker who has expertise in the particular field of testing. They have set a tolerance and if your scores fall within that tolerance, you will pass training.

If your scores fall outside of the tolerance, the system will flag this to the Chief Marker. They may contact you to discuss the discrepancy or pause your marking account. This ensures consistency across Markers so that candidates are not advantaged or disadvantaged regardless of which examiner marks their work.

S3 is completed from the My Marking Taskboard.

To do this:

1. From the Standardisation 3 – Marking section, select the Mark More! button next to the question you’d like to mark.
   
2. Complete the following:
   1. Review the candidate’s response and add annotations if required.
   2. Review the benchmark scores under the Benchmark Scores expandable section (optional). See below for further details on how to do this.
   3. Enter the necessary scoring in the Scoring Pane.
   4. Enter any comments (optional) in the Comments field.
   
3. Select the Finish button to finish the training, or select Mark next to move to the next script (if applicable).
4. Select the Confirm button to confirm you have finished scoring the response. Selecting the Don’t show this message again checkbox will ensure you don’t see the message for the rest of the responses you are scoring
   
5. Repeat this process until you have met your quota. When you have done this, the system will notify you.
   

   Tip

   If you have failed standardisation, the system will notify you.

   
6. Select the My Marking Taskboard button to return to the taskboard where you can complete this standardisation process for other questions.
   

   Once you have completed S2, you will receive notification that you can begin marking.

   

View benchmark scores

Benchmark scores give you an understanding of what responses of a particular score look like. For example, what a response with a score of 2/10 or 7/10 look like. A score is similar when it is within 10% of the question’s available score (above or below) the selected score.

Mark candidate responses

Once you have completed S3 training and the marking project has been moved to a status of ‘Marking’, you will see the Main Marking Phase – Marking section on the My Marking Taskboard.

To complete marking:

1. Select the Mark More! button next to the question you’d like to mark.
   
2. Complete the following:
   1. Review the candidate’s response and add annotations if required.
   2. Review the benchmark scores under the Benchmark Scores expandable section (optional). See below for further details on how to do this.
   3. Enter the necessary scoring in the Scoring Pane.
   4. Enter any comments (optional) in the Comments field.
   
3. Select the Escalate, Finish or Mark button as follows:

   Option	Description
   Escalate	This will send the script with your scores to the Senior Marker. They will receive an email notification with a link to review the score.
   Finish	This will save your scores and take you back to the marking taskboard.
   Mark next	This will save your scores and take you to the next question to score.

   Important

   Once a Marker has viewed a candidate answer, the script needs to be marked. If not, the script will move into Requires Action (My scores) tab of the My scoring so far section. See the Requires action section for more information.

   
4. Repeat until you have marked all scripts.

View benchmark scores

Benchmark scores give you an understanding of what responses of a particular score look like. For example, what a response with a score of 2/10 or 7/10 look like. A score is similar when it is within 10% of the question’s available score (above or below) the selected score.

Mark composite questions

The way composite questions display in the My Marking Taskboard will depend on the settings configured in Marking Extended Settings > Marking Project Settings > Allow markers to mark multiple interactions of a composite item simultaneously.

With this setting disabled, the interactions of composite questions display as separate questions and the Marker will mark each interaction separately.

With this setting enabled, the composite questions display as one question and the Marker will mark both interactions from the same marking button.

View scoring so far

At the bottom of a Marker’s taskboard is the My scoring so far expandable section. This is where Markers can view their progress.

The different tabs will display different items as follows: