Test Procedure Configuration
Formative assessments, such as lecture-related training scenarios, differ significantly from summative assessments, such as tests and midterm exams, when it comes to how feedback and assessment information is displayed to test participants. To adapt the test procedure to the respective application scenario, the ONYX Testsuite provides various test procedure configuration options.
The tutor defines the set parameters in advance of the test run. If the ONYX Testsuite is used within the learning platform OPAL, the configuration is done via the settings in the course editor for the respective test or self-test course element.
In the ONYX Editor, it is also possible to adapt the test and question preview to the desired scenario using the preview configuration.
Configuration Parameters
Show navigation tree
| By default, the navigation tree is displayed in the left pane when performing a test. Participants can see the total number of questions included in the test and how far they have already proceeded. Moreover, they can learn from the navigation tree which questions they have not yet opened (no marking), which questions they have already opened but for which they have not yet entered a valid answer (red marking), and which questions they have already answered (green marking). In the case of a non-linear navigation, participants can directly jump to selected questions using the navigation tree. Particularly in the case of dynamic tests with a linear navigation, it might be desirable that the navigation tree is not visible. This means that participants taking the test cannot see the total number of questions included in the test right away. |
Show question titles
| The author specifies a title for each question. By default, this title will also be displayed when running the test. If the display of the question titles is disabled, all questions included in the test will be numbered in ascending order. Deactivating this option is especially recommended for tests with a random question arrangement and selection, as all questions will be numbered consecutively by hiding the question titles. |
After submitting the question: Show question feedback
| If there is feedback stored for a question, it will be displayed to the participant after submitting the question. In test scenarios, the feedback display can be disabled. As a result, participants will not receive feedback after submitting their answers. If both the feedback and the assessment display are disabled at question level, the "Submit answer" button will also be hidden. The participant's answers are saved at all times and can be changed by the participant (in the case of a non-linear navigation) throughout the entire duration of the test. Upon test submission, the answers will be assessed. |
After submitting the question: Show question assessment
| Depending on the application scenario, various assessment information can be made accessible to participants during the test after they submit an answer. The assessment display can be completely disabled. In this case, the maximum score and the points achieved for the question will not be displayed. There will also be no right/wrong display (red/green marking), and the solution will not be shown. Individual assessment texts can be enabled in such a way as to complement and build upon the previous assessments. Please note that, in the case of some question types, the right/wrong marking might also give a lead to the correct solution. If participants are allowed multiple attempts, simple feedback or assessment information should be displayed to them. However, showing the correct solution only makes sense for multiple question attempts if the question is parameterised and new question parameters will be displayed to the user for each of their attempts. |
After submitting the test: Show test feedback
| In addition to question feedback, it is also possible to store feedback for the participant at test level. If the "Show test feedback" option is enabled, the test feedback will be displayed to the participant in an overlay window after submitting the test. |
After submitting the test: Show test assessment
| Various assessment data can be determined for a test. For example, the author can define a passing level in addition to the total score, and the points achieved can be assessed per test section. If the "Show test assessment" option is enabled, the determined result values will be displayed to the participant. Please note that the result data for questions which need to be manually assessed will not be fully available right after submitting the test. A corresponding note will be displayed to the participant on the assessment page. |
Allow for interruptions | If the "suspend" option is enabled, the test process can be interrupted by the participant and continued at a later point in time. |
More test control settings can be configured in the embedding system. For example, the maximum number of test attempts or test-specific workflows for the test procedure can be defined in OPAL.
To enable tutors and, if necessary, participants to view the test results, the ONYX Reporter provides various assessment views. Besides, it is also possible to reassess the participants' results manually.