Welcome to the Janison Insights help portal
Welcome to the Janison Insights help portal
Marking
Janison Insights has optional marking features designed to train Markers and monitor their quality to ensure accurate and reliable marking.
These features ensure accurate and reliable marking so that candidates are not advantaged or disadvantaged regardless of who marks their work.
Tip
To learn more about setting up these features, see the Setting up marking projects section.
You can also read more about what these features look like to Markers holding different levels of authority in the Marking teams section.
Janison Insights training and quality control methods include standardisation, blind quality monitoring, double marking and sampling. Quality controls can be turned on or off.
Important
Marker training and blind quality monitoring are only available if standardisation (S1) is active in a marking project. Double marking and sampling do not require standardisation (S1) to be active.
Standardisation is a set of quality control features within Janison Insights which allows you to standardise your Markers work, ensuring fair and equitable marking during examinations, especially high stakes-assessments.
Standardisation improves marking accuracy for both new and experienced markers by building a common understanding of the marking rubrics.
Tip
Standardisation is optional, if you decide not to use standardisation, the project can be moved straight to marking.
There are three types of standardisation in the system:
| Method | Description |
|---|---|
| Standardisation 1 (S1) | The most senior members of the marking team, usually the Chief Markers, select, mark and categorise a number of candidate responses in order to yield model scores which are used for the purpose of training (S1 and S2) and blind quality monitoring. |
| Standardisation 2 (S2) |
Training for Senior MarkersSenior Markers score a number of candidate responses, and the system checks if their scores align closely enough to the scores standardised by the Chief Marker. If the scores fall out of the permitted tolerance, they will be flagged to the Chief Markers. |
| Standardisation 3 (S3) |
Training for MarkersMarkers score a number of candidate responses, and the system checks if their scores align closely enough to the scores standardised by the Senior Markers. If the scores fall out of the permitted tolerance, they will be flagged to the Senior Markers. |
Senior Markers monitor the consistency of Markers by randomly presenting a Marker with a candidate response which has been standardised during S1, and then monitoring any errors or discrepancies.
Markers are unaware they are being monitored.
When double marking is active, more than one Marker scores a single candidate response. If the scores assigned by the different Markers fall out of the permitted tolerance, a conflict occurs.
This conflict will be flagged to a Senior Marker or Chief Marker who can either accept one of the scores or override with their own mark.
Senior Markers randomly check marked responses to ensure consistency and marker accuracy. They can agree with the score assigned by the Marker, or they can disagree and add what they think is a more accurate score.
1300 857 687 (Australia)
+61 2 6652 9850 (International)
ACN 091 302 975
ABN 35 081 897 494
© 2024 Janison
Janison acknowledges the traditional owners of the land on which we work and meet. We acknowledge the continuous care of the land, animals and waterways. We pay our respects to Elders past, present and emerging.