Test Library

The Test Library is the repository of pre-made tests that Employers can add to their assessments. Tests can be categorized and you can also use AI to generate multiple-choice question tests.

To manage the Test Library, click on the 'Manage Tests' menu option. Your list of tests will be displayed:


Each test can belong to one or more categories. The 'Filter' button allows you to easily sort your tests using different criteria. Test can also be assigned to specific plans. This allows you to control who can use the tests.

Creating a test

To create a new test, click on the 'Add New' button. This will bring up the test creation screen:


The following fields are available:

  1. Name: This is the name of the test
  2. Description: This should be a detailed description of the test and who it is meant for
  3. Categories: Select the categories the test should belong to
  4. Pass score: This is the minimum score thecandidate should have in order to successfully pass the test
  5. Minutes:this is the number of minutes that the candidates is allowed to have to take the test
  6. Enabled:use this to make the test available or on available for employers to add to assessments
  7. All Plans:use this to specify if the test shouldbe available to all subscription plans.If you set this to 'No', then the 'Plans' select box will appear underneath.
  8. Plans: Select the plans that this test should be available for.

Once you have filled in all the fields and you click submit, the test will be created and you will be redirected to the question management page for that test.


On the question management page, you will see the add question button. This button gives you multiple options to create different types of test questions. The different test question types are

  1. Multiple choice: this allows a candidate select just one option out of many
  2. Multiple responses:this allows the candidate to select multiple options out of many
  3. True or false: this allows the candidate to select true or false as their response
  4. Short text: this allows the candidates to enter a short text that must be an exact match to the answer expected
  5. Long text: this allows the candidates to enter long text that can be evaluated manually or by AI
  6. Coding: this allows the candidate to enter programming source code that can be evaluated by AI. TalentScreen supports many popular programming languages.

Multiple Choice

The multiple-choice creation page is divided into two sections.

Image

The first section on the left-hand side contains a text box for creating the test question. On the right-hand side, there is a button for adding an option. Clicking on the button will create a new text box and a drop-down beneath it. The option textbox can be used for adding an option to the question. Once you have typed your option, you can then select if it is correct or not using the 'Is Correct' drop-down.

Multiple response

Adding a multiple-response question is identical to adding a multiple-choice question. The only difference is that when you select an option as a correct option for a multiple-choice question, then all the previous options are marked as incorrect. On the other hand for the multiple-response questions, you can set multiple options as correct.

True or False

The true or false question type allows you to simply specify if the question is true or false.

Image

Simply type in the question on the left hand text box and then select if it is true or false using the buttons on the right hand side.

Short text

Creating a short text is used for questions where the candidates should impute the exact answer that you are expecting.



Image

Enter your question in the left-hand text box, and then in the right-hand box enter either just one word or phrase or a list of, separated words or phrases. Your answer is case-insensitive. The question will be correct for the candidates if they match at least one of the words or phrases that you enter.

Long text

The long text question type is usually evaluated using AI. Here candidates can answer your question in a detailed manner without needing to be an exact match to an answer. If you do not select AI for evaluating the question response, then the employer will need to manually grade the question response.

Image

Once you've entered the question on the left-hand side textbox, then simply put in a sample answer in the sample answer text box on the right side. This is mandatory for the AI model to be able to determine if the candidate's response is correct. If you have additional instructions for the AI model please put it in the Additional instructions for AI model box. You can use this to fine-tune the behavior of the AI model. There is a Test AI button located beneath that box. You can use this to easily test if your configuration is working as you expect.

Image

When you click on the test AI button, a side panel will open containing the text box. Enter a response that the typical candidates will enter for a correct response and then click the Run Test button. You'll get an indication specifying if the answer is correct or not.

Coding

The source code test question type allows candidates to submit source code responses for a test question. Multiple languages are supported


Image

AI is used to evaluate the source code responses. Type in the problem you would like the candidate to solve in the question box. The 'All supported languages' checkbox allows you to provide all the languages supported on the system to the candidates to choose from. If you would like to restrict the programming languages a candidate can use, then un-check the checkbox. A select drop-down will appear which would allow you to select the different types of languages that should be available.

The 'AI evaluated checkbox' ensures that the question is processed by AI. If you would like it to be graded manually by the employer, then you can uncheck that option.

The 'Additional instructions for AI model' text box allows you to provide specific instructions to the AI model on how you would like the question response to be graded.

For each code question, you can create code templates. Code templates are the initial code that candidates are presented with when the code editor loads. You can specify a template for each programming language supported by your question.

There is also an AI-powered template generator that can help you easily create your code templates. It receives a primary language and then attempts to translate that code into different programming languages supported by the question. Click on the generate template button in order to start using this feature. You'll be presented with a drop-down that lets you specify the primary language. Once you select your primary language, a text box for that language will open. Type in the source code and then click on the generate button in order to generate the templates for all the remaining languages

Image


The AI Test Generator

The AI test generator is a tool that you can use to automatically generate multiple-choice question tests. Click on the 'AI Generator' link under the 'Test Library' menu option. The following form will be displayed:


Image

The following fields are as described:

  1. Job role description: Specify the job role you would like to test for. Please be as detailed as possible. e.g. "PHP web developer proficient in Laravel, Javascript, Tailwind CSS, and Agile software development techniques".
  2. Number of tests to generate: Specify the total number of tests you want the AI model to generate
  3. Questions per test: Specify the total number of questions each generated test should have.
  4. Options per question: Specify the total number of options each question should have.
  5. Categories: Choose which category the created tests should belong to
  6. Passmark: Specify the pass mark for each test.
  7. Minutes: Specify the time limit for each generated test

Click on the 'Next' button. Wait for a short while for the test topics to be generated.


Image

Once the topics have been generated, you will be able to review them. Click on the edit button if you would like to change any of the entries. You can use this screen to change specific details about a test.

Once you have finished reviewing the tests, click on the 'Generate Tests' button to begin generating your tests!

The Test Question Generator

The Test AI generator is used to generate tests from scratch. However, you can use AI to add questions to an existing test. In order to do so, go to the test on the Test listing page and click on the 'Question Generator' link


You will see a page similar to this:

The title and description are pre-populated based on the existing test information. You can modify the title and description specifically for the AI engine. The existing information of the test will not be affected. Click on 'Start' and your questions will be generated


Image

The next screen will list all the questions that have been generated. You can review all the questions and delete any you do not like. Click the Save button to finally add the questions to the test.

Trying a test

The Actions button on the test listing page contains a link to try the test. Clicking on the link will allow you to go through all the test questions in a manner similar to a candidate. However the try test option is not timed and the test questions and question options are not randomized the way and actual test will be presented to a candidate.


Image
2024 © Intermatics Software Services.