Anonymous and Question-based Assessment of ONYX Test Questions

Last modified by Carina Enke on 12.01.2024

 

Anonymous and question-based assessment of ONYX test questions

For an anonymised and question-related assessment, a special assessment view is provided. In the first step, the question to be assessed is selected, and then all participant responses are displayed in an anonymised way. The assessor can use filter settings to configure whether all answers, only answers with open assessments and/or incorrect answers should be shown.

Step 1: Open overview of all test results  

To assess question solutions of several users manually, first open the overview of all test results of a course element, which also includes a list of all test questions.

This assessment function can only be accessed by one assessor per test. Any further assessor will be notified that this function is currently blocked by another user.

Bewertungswerkzeug - Beispiel Gesamtauswertung_en.png

To open this view, perform the following steps ...

1

Switch to the assessment tool and select the entry As per course structure on the left.

Bewertungswerkzeug - Nach Kursstruktur öffnen_en.png

2

This will open an overview of all assessable course elements of the course. Select the relevant Test course element. Click on the associated Assess link in the Answers column to open the overview of the question-based overall assessment.

Bewertungswerkzeug - Onyxtest zum Bewerten öffnen_en.png

3

You will now see the overview of the question-based overall assessment of all participants' results.  

This view contains the following information areas ...

Bewertungswerkzeug - Übersicht Gesamtauswertung_en.png

1

Filter area: Restrict the number of displayed results if necessary.

2

Overview of performed test attempts and general statistics on the results as well as notifications.

3

List of questions included in the test. The question titles work as links to the detailed view of the respective question.

4

Evaluation status overview.

Unknown macro: includeplus. Click on this message for details.

5

Statistical overview: Shows the number of available answers and their percentage distribution to the areas.

 

Bewertungswerkzeug - Beispiel Gesamtauswertung_en.png

Step 2: Open detailed view of a question

In this overview, you can select any question by clicking on the question title. This will open the detailed view of the question and the corresponding answers of the participants will be shown in random order.  

If necessary, you can also restrict the number and display of answers using filters.  

Bewertungswerkzeug - Beispiel Bewertung einer Aufgabe_en.png

The detailed view of a question contains the following information areas ...

1

In the header area, you can see the title of the opened question, general statistical information and filter options to restrict the number of displayed answers as needed.  

Available filters include:  

  • Filter: All responses, Open manual assessments, Wrong responses (< max. score), Wrong responses (0 points)
  • Display: One response, all responses

Bewertungswerkzeug - Übersicht Bewertung einer Aufgabe_en.png

2

Navigate between different participant responses to the desired question.

3

The following section shows the question, the maximum achievable score for the question and the response given by the user. Click on Assessment at the bottom of this area to start the assessment.

Step 3: Perform assessment  

Start the manual assessment or reassessment by clicking on the Assessment link at the bottom of the page. The assessment area will open below the participant response.

To perform an assessment, proceed as follows:  

1

Enter the score achieved and fill in the comment fields for the assessment if necessary.

Bewertungswerkzeug - Bewertung durchführen_en.png

2

Click on Save to store the assessment of the participant’s response.

3

Navigate to the next participant response. The answer will open up automatically so that you can directly carry out the next assessment. Like this, you can assess all of the participant responses one after the other. Make sure to save each assessment.