Assessment of Test Results

Last modified by Carina Enke on 13.01.2024

 

For the course element Test, the assessment depends on the included question types. Most question types are automatically assessable. The final result of an attempt can then, depending on the configuration of the results view, be displayed to the participant immediately after submitting the test.

In contrast, question types that cannot be assessed automatically are manually assessable. A tutor with appropriate rights must perform this kind of assessment in the assessment tool to complete the calculation of the final result.

A manual reassessment can always be performed for all task types.

For more information about available question types and their assessment options, see the help page Task types in the ONYX manual.

Content

Related topics

Assessment forms

The manual (re)assessment can be user-related or task-based:

The user-related assessment is about assessing all test questions of an individual user.

  • Perform a user-related individual assessment of ONYX test tasks

The task-based assessment is about assessing all user answers to one and the same test question. In this case, the assessor will not be displayed any user names. The assessment is therefore anonymous.

  • Perform an anonymous and task-based assessment of ONYX test tasks

 

User-related individual assessment of ONYX test questions

The assessment of ONYX test results can be performed in a user-related way. In the first step, the assessor selects a user to be assessed and then opens the assessment view of a test attempt. Here the assessor will be given an overview of all questions the user has been asked to answer in the test attempt. For each question, they can see the user’s comments and answers, which can now be (re)assessed.

Step 1: Select a participant

To manually assess a test attempt made by a specific user, first open the Detailed view of assessment with the overview of all test results for the corresponding course element for this participant.

The individual areas of the assessment tool provide various navigation options to do this.

Bewertungswerkzeug - Übersicht aller Versuche eines Teilnehmers_en.png

One way to open this view is described here...

1

Open the assessment tool and select the As per user entry from the menu on the left.  

Bewertungswerkzeug - Nach Benutzer_en.png

2

This will open an overview of all users enrolled in the course. Select the desired user.

Bewertungswerkzeug - Benutzer auswählen_en.png

3

Subsequently, a compilation of all assessable course elements of this course will be shown. Click on the Select link in the Details column of a test course element.

Bewertungswerkzeug - Kursbaustein Test auswählen_en.png

4

This will open the detailed view of the user’s assessment with a list of all test attempts.

The info icon indicates that there are still open assessments.

Bewertungswerkzeug - Detailansicht aller Testversuche eines Nutzers_en.png

Step 2: Open the detailed view of a test attempt

Select the attempt to be assessed from the table. To do this, click on the Show entry to open the detailed view of the test attempt.

Bewertungswerkzeug - Testversuch öffnen_en.png

The detailed view of the selected test attempt opens.  

This view contains the following information areas...

Bewertungswerkzeug - Übersicht geöffneter Onyxtestversuch_en.png

1

The header area of the detailed view contains general data on the participant’s test attempt as well as notification messages.

2

Below the header area, there is a list of the test questions included in the test. Click on a question title to scroll to the detailed view of the selected question. The icons in front of the question titles indicate the question type.

For more information on all ONYX question types, see the Question types help page in the ONYX help.

3

The area on the right shows the status of the assessment and provides information on the user who performed it.

Overview of possible assessment icons...

Unknown macro: includeplus. Click on this message for details.

Reporter - Detailansicht eines Testversuchs_en.png

Step 3: Perform a user-related assessment  

From this question overview, you can now start the manual assessment or reassessment:  

Select a question to be assessed by clicking on its title.  

Reporter - Aufgabe auswählen_en.png

The view switches to the question's detailed view. This view shows the question, the maximum achievable score for the question and the response given by the user.  

Click on the Assessment entry to open the assessment area for this question.  

Reporter - Aufgabenbewertung starten_en.png

To perform an assessment, proceed as follows:  

  1. Enter the score achieved and fill in the comment fields if necessary.

  2. Click on Save to store the assessment of the candidate’s response.

  3. Navigate back to the question overview or scroll through more questions.

Reporter - Aufgabe bewerten_en.png

 

Anonymous and question-based assessment of ONYX test questions

For an anonymised and question-related assessment, a special assessment view is provided. In the first step, the question to be assessed is selected, and then all participant responses are displayed in an anonymised way. The assessor can use filter settings to configure whether all answers, only answers with open assessments and/or incorrect answers should be shown.

Step 1: Open overview of all test results  

To assess question solutions of several users manually, first open the overview of all test results of a course element, which also includes a list of all test questions.

This assessment function can only be accessed by one assessor per test. Any further assessor will be notified that this function is currently blocked by another user.

Bewertungswerkzeug - Beispiel Gesamtauswertung_en.png

To open this view, perform the following steps ...

1

Switch to the assessment tool and select the entry As per course structure on the left.

Bewertungswerkzeug - Nach Kursstruktur öffnen_en.png

2

This will open an overview of all assessable course elements of the course. Select the relevant Test course element. Click on the associated Assess link in the Answers column to open the overview of the question-based overall assessment.

Bewertungswerkzeug - Onyxtest zum Bewerten öffnen_en.png

3

You will now see the overview of the question-based overall assessment of all participants' results.  

This view contains the following information areas ...

Bewertungswerkzeug - Übersicht Gesamtauswertung_en.png

1

Filter area: Restrict the number of displayed results if necessary.

2

Overview of performed test attempts and general statistics on the results as well as notifications.

3

List of questions included in the test. The question titles work as links to the detailed view of the respective question.

4

Evaluation status overview.

Unknown macro: includeplus. Click on this message for details.

5

Statistical overview: Shows the number of available answers and their percentage distribution to the areas.

 

Bewertungswerkzeug - Beispiel Gesamtauswertung_en.png

Step 2: Open detailed view of a question

In this overview, you can select any question by clicking on the question title. This will open the detailed view of the question and the corresponding answers of the participants will be shown in random order.  

If necessary, you can also restrict the number and display of answers using filters.  

Bewertungswerkzeug - Beispiel Bewertung einer Aufgabe_en.png

The detailed view of a question contains the following information areas ...

1

In the header area, you can see the title of the opened question, general statistical information and filter options to restrict the number of displayed answers as needed.  

Available filters include:  

  • Filter: All responses, Open manual assessments, Wrong responses (< max. score), Wrong responses (0 points)
  • Display: One response, all responses

Bewertungswerkzeug - Übersicht Bewertung einer Aufgabe_en.png

2

Navigate between different participant responses to the desired question.

3

The following section shows the question, the maximum achievable score for the question and the response given by the user. Click on Assessment at the bottom of this area to start the assessment.

Step 3: Perform assessment  

Start the manual assessment or reassessment by clicking on the Assessment link at the bottom of the page. The assessment area will open below the participant response.

To perform an assessment, proceed as follows:  

1

Enter the score achieved and fill in the comment fields for the assessment if necessary.

Bewertungswerkzeug - Bewertung durchführen_en.png

2

Click on Save to store the assessment of the participant’s response.

3

Navigate to the next participant response. The answer will open up automatically so that you can directly carry out the next assessment. Like this, you can assess all of the participant responses one after the other. Make sure to save each assessment.