Introduction to blueprints

A test blueprint is a template you can develop, and then use for creating future tests quickly and efficiently. The tests you create from the blueprint are called ‘blueprinted tests’ and inherit the settings configured in the blueprint.

The Janison Insights blueprint autofill tool uses a powerful matching engine to automatically add questions to the test which meet the specifications you have configured in the blueprint. For example, the number of questions you want added, the question types and the specified tags.

Setting up blueprints

There is some setting up in the system which needs to be completed before you will be able to create blueprints.

Enable test blueprints

• Select Settings from the Menu, then select Test Desighner Settings.
  
• Select the Test Authoring Settings expandable section to open it.
  

• Complete the following:

  1. Select the Enable test blueprints checkbox to enable.
  2. Select the Blueprint Item Approval States field, and select any test states you would like to add.

     Tip

     When the system autofills blueprinted tests, it will only add items matching the workflow states selected here. For example, if you don’t select ‘retired’, the system won’t add any items in the workflow state of retired to the blueprinted test.

  3. Enter a number into the Blueprint Health Status Multiplier field. This number is used to calculate the required number of items for the health status indicator. The module will inherit this number, but you can override it at a module level in the blueprint settings section.
  

Configure role permissions

Role permissions will need to be configured to allow the necessary roles to create the blueprint questions and tests.

To do this:

1. Select Settings from the Menu, then selecting Roles.
   
2. Select the Author role (or applicable role) to open.
   
3. Select the Edit icon next to the Securable areas of the application expandable section.
   
4. Enter ‘blueprint’ into the Search field, then select Enter on the keyboard to bring up the relevant areas.
   

There are two roles to update:

Question Designer

Enable the Blueprint Component and Blueprint Component Open Modules areas.

Test Designer

Enable Export Blueprint Details to allow the export as a report. Enable Get Blueprint Details, Get Blueprint Pnps and Save Blueprint Details.

Blueprint pre-requisites

There are a couple of pre-requisite setup steps to complete before you can begin creating your blueprint.

Define tag types

The first thing we need to do is create tag types with attached tags in order to define the knowledge areas within your test. These are then used to tag questions so they can be characterised into the different knowledge areas. For example, for a Small Animal Medicine test, you may set a tag type of ‘knowledge category’ with tags of ‘anatomy’, ‘medication’ ‘diagnosis’ and ‘treatment’.

Configure blueprint settings in the module

The system uses modules to categorise topics or knowledge areas. You will need to select the tag types that are relevant to your module in order to be able to use them in that module.

To do this:

• Select Author from the Menu, then select Modules.
  
• Select the relevant module to open it.
  
• Select the Edit icon next to the Blueprint Settings expandable section.
  
• Select the relevant tag type from the Tag types drop-down list, then select the + icon to add it.
  

  The added tag type will display below. Repeat for all tag types you want to add to the module.

• Enter a number in the Test Blueprint Health Status Multiplier field.

  Tip

  This is the content laying inside tip box

  
• Select the Save Blueprint Settings button to save.

Create a blueprint

Once you have completed the setting up process, you are ready to create a test blueprint.

Blueprints are created and managed by selecting Author from the Menu, then selecting Tests and Surveys.

To create a test blueprint:

• Select Add Test Blueprint from the Actions drop-down button.
  

• Complete the following:

  1. Select the discipline from the Discipline drop-down field.
  2. Select the module from the Module drop-down field.
  3. Enter a name for the new test blueprint in the Name field.
  4. Enter an identifier for the test blueprint in the Identifier field.
  5. Enter the title you would like candidates to see in the Display Title field (optiona This has a maximum of 128 characters but should be limited to 20 if it’s to be displayed in the test header. If left blank, the system displays the test Name in the Test Player.
  6. Select a Delivery Mode. This will be set to Electronic by default.
  7. Select a Marking Mode. This will be set to Mixed by default.
  8. Select the Set a pass/fail outcome checkbox to make the test scorable. Then enter the passing mark in the Pass-mark, % field.
  
• Enter a description for the test blueprint (optional). This is for your reference only, candidates will not see the description added.
• Select the Save Test Blueprint button to save.

When you save the test blueprint, it displays with the details and several expandable sections for additional settings and options. See the next section, Additional test settings and options for more information.

Additional blueprint settings

Once you have created a test blueprint, there are some additional settings you can configure, along with other various options for the test. There are two ways to access these:

• Directly after saving your new test, the test and the settings will be displayed
• By going to Author > Tests and Surveys and selecting your test blueprint to open it

Resit settings

In this section, you can set the number of attempts candidates are allowed for the test, as well as the questions they will be able to reattempt and the feedback they will receive before resitting.

Settings in this section are optional.

To configure these settings:

1. Select the Edit icon next to the Resit Settings expandable section.
   

2. Complete the following:

   1. Enter a number into the Number of attempts allowed field.
   2. If you would like candidates to only be presented with the items they got incorrect on the previous attempt, select the Resit incorrect questions only checkbox.
   3. For automatically marked items, you can select feedback for the candidates from the Feedback drop-down list.
   
3. Select the Save button to save your changes.

Timing options

In this section, you can set the length of time candidates have to sit the test. If a time is entered here, the candidates will have only that specified time to complete the test and they will see a timer displaying the remaining time throughout the test.

Settings in this section are optional.

To configure these settings:

1. Select the Edit icon next to the Timing Options expandable section.
   
2. Enter a time in minutes in the Duration field. The value must be greater between 1 and 1440 (24 hours).
   
3. Select the Save Timing Options button to save your changes.

Blueprint components

Only question test sections have the blueprint section, from here you can configure the components which determine the questions the system will add to the blueprinted test during the autofill process.

When you first open the section, it won’t contain any components, but you will see the tag types you set at the module level. In this example it’s SAM – Knowledge category

Components get added at a test section level. Once set in the test sections, you can come back to this screen and add the components.

To do this:

1. Select the Edit icon next to the Blueprint expandable section.
   
2. Select the Add component button.
   
3. Complete the following:
   1. Select the first tag type field (in this case it is SAM – Knowledge Category), then select one of the tags you previously set up.
   2. Enter the number of marks each question will be worth in the Marks per Item field.
   3. Enter the number of questions that should be auto filled in the Number of Questions field.
   4. Select which question types should be auto filled from the Question Types field.
   
4. Repeat for each component you wish to add.
5. Select the Save button to save your changes.

Read the blueprint components

In the following blueprint example, we are saying that we want the autofill process to do the following:

• Add two multiple choice and text entry questions (total of four questions) which have the tag ‘anatomy’ associated with them
• Add three multiple choice, multiple choices and text entry questions which have the tag ‘medication’ associated with them
• Add three multiple choice, multiple choices and text entry questions which have the tag ‘diagnosis’ associated with them
• Add three multiple choice, multiple choices and text entry questions which have the tag ‘treatment’ associated with them

All questions will be in English and be worth one mark each.

We can also see from this image that the status for the ‘anatomy’ component has a status of a thumbs up. There are five questions available in the module which match this tag type, so the system will be able to select two of these to add to the blueprinted test.

The remaining components all show a status of a red warning sign. This is because there are not enough questions for the component requirement to be met.

Sections

To learn more about the various types of sections, see the Test section types section.

Create a new test section in the blueprint

To do this:

1. Select the + icon next to the Sections expandable section.
   
2. The New Test Section screen displays with the same Discipline and Module selected as the test.
   

3. Complete the following:

   1. Enter a name for the new test section in the Name field.
   2. The Identifier field will automatically populate with a suggested identifier. You can leave this as is, or edit to one of your choosing.
   3. Select a test section type from the Type drop-down.

   4. Select a Navigation Type as follows:

      Navigation type	Description
      Linear	Candidates must answer the questions in order and cannot skip ahead without answering the current question.
      Nonlinear	Candidates can skip a question to answer the next question. They can go back and change their answers.

   5. Add a description in the Description field (optional).
   6. If you have selected an Introduction test section type, you will have a checkbox option Cannot Skip. Check this option if you would like candidates to be required to complete this section.
   
4. Select the Save Test Section button to save.

When you save the test section, it displays with the details and several expandable sections for additional settings and options. The layout of the different sections differs depending on the type created.

Question test sections contain the additional expandable section Blueprint, which is where components are set. This is not found on the other test section types.

Add existing test sections to a blueprint

You can also add existing sections (all except question test sections) to the blueprint.

1. Select the Edit icon next to the Sections expandable section.
   

   Sections already existing in the blueprint will display above the search bar. They also display in the search section, but show as inactive. Sections available to add to the test blueprint are displayed in an active state.

2. Use the search functionality to locate test sections, or locate them manually in the list, then select the + icon to add the test section to the test.
   

   The test section will be added to the list of sections within the test.

3. Select the Save button to save your changes.

Add new test sections from the Author menu

While you can add new test sections from within the blueprint, you can also add sections from the Author Menu.

Create blueprint questions

Now that the test blueprint has been created and you have updated the additional settings, it’s time to create the questions. There are a few ways to create questions to add to your test blueprint.

From a test section

For introduction, instruction, survey and exit test section types, questions can be added from the test section.

To create questions from a test section:

1. From within your test blueprint, select the Sections expandable section to open it.
   
2. Select the test section to open the Test Section Details screen.
   
3. Select the Questions expandable section to open it.
   

   Scroll down to the Add Questions expandable section and select the Create a new Question button.

   

   Select Yes on the notification to leave the page and the New Test Question screen displays.

   
4. Complete the form as required.

   Tip

   The steps to create a question differ depending on the question type you create. To learn more about question types and creating a question, see the Questions section.

5. Select the Save Test Question button to save.

From the author menu

To add questions to the bank for question test sections, you need to create questions from the Author Menu.

To create questions from the Author Menu:

1. Select Author from the Menu, then select Questions.
   
2. Select the Add Test Question from the Actions drop-down button.
   
3. Complete the form as required. Remember to select the relevant tag in the Tag Type field (the name of this field will reflect the tag type you set up).

   Tip

   The steps to create a question differ depending on the question type you create. To learn more about question types and creating a question, see the Questions section.

4. Select the Save Test Question button to save.

Add existing questions to sections

For question test sections, you won’t need to add questions to the section as this will be completed during the autofill process in the blueprinted test.

For other section types, you can add existing question from within the Test Section Details screen.

To do this:

1. Select the Edit icon next to the Questions expandable section.
   
2. Scroll down to Option 2 – Add existing questions in the Add Questions expandable section, then select the + icon next to any question you wish to add.
   
3. Select the Save button to save your changes.

Create a blueprinted test

Once you have completed the set-up of your test blueprint, including the creation of sufficient questions to meet the blueprint components you set, you are ready to create one or more blueprinted tests. Once created, these can be added to your assessment events for delivery to candidates.

To create a blueprinted test:

1. Select the relevant test blueprint in the Tests and Surveys list to open it.
   
2. Select Create Blueprinted Test from the Actions drop-down button.
   

   The system creates a blueprinted test with limited ability to make edits.

   

   Tip

   The system suffixes the Identifier with -copy. If you make more than one copy, the system suffixes a number, -copy1, -copy2, etc.

The additional settings and options in a blueprinted test are mainly the same as a regular test, with the addition of the Blueprint option.

Autofill test sections

Autofill will randomly select questions from the question bank for the question test section(s). Introduction and instruction sections do not need to be auto filled as they have no blueprint components and already have questions added.

To autofill question test sections from within the blueprinted test:

1. Select the Sections expandable section to open.
   
2. Select the question test section to open it.
   
3. Select the Edit icon next to the Blueprint expandable section.
   
4. Select the Yes button to complete the process.
   

The system attaches the relevant questions matching the component criteria to the section. You can view the questions by selecting the links in the Attached column. The Status changes from the red warning to a tick to indicate enough questions have been added to the test for each component.

Edit the question bank after auto filling

There are several manual configurations you can make to edit the test after the auto filling process has occurred.

This can be done from within the blueprinted test section, by selecting the Edit icon next to the Questions expandable section.

The editing options available are:

Randomisation and optional questions

There are several randomisation and optional question settings available:

Setting	Description
Don’t use optional questions or random selection	The system will add all questions to the test and the candidate will be required to respond to all questions.
This section has random question selection	If selected, a second field displays to set the number of random questions which the system will link to the section.
This section has subsections that use random question selection	If selected, a field displays under each section where you can set the number of random questions which the system will link to each section. Each row of the blueprint components becomes a subsection in the questions test section.
This section has optional questions	If selected, a field displays where you can set the number of optional questions which the system will link to each section.
Randomise Question Order	If selected, the system will randomise the question order.

You can now add the test to an assessment event for candidates to undertake.