Guide: Worst-case Scenarios in E-exams
Scenario 1: Client PC failure
Description: | Faults at a learner’s workstation (client PC) occur during the test. |
Action: | Technical faults at individual workstations should not cause any disadvantages to the students. The test system will ensure a smooth continuation of the test at a replacement computer, crediting the elapsed time since the last question was accessed. |
Necessary precautions: | The PC pool, where the test takes place, provides free workstations (client PCs). To perform tests, the examiner needs to adapt the configuration of the course element in the learning platform accordingly. Both the exam mode and exam control must be enabled. |
Workflow: | cf. procedures guide for the failure of a client PC |
Scenario 2: Power failure
Description: | A power failure occurs in the PC pool before or during the test. |
Action: | Necessary actions depend on the time and duration of the failure. The following matrix lists suitable actions, along with corresponding dependencies. An individual or global extension of the test processing time is possible. In the event of major faults (e. g. persistent power failure), the examination board may decide to retake the test. |
Time / Duration | Failure < 15 min | Failure > 15 min |
|---|---|---|
Before test | No restriction | Switch to pen & paper exam |
During test (< 15 min) | Continue e-test, credit time | Switch to pen & paper exam, credit time |
During test (> 15 min) | Continue e-test, credit time | Cancel e-test |
Necessary precautions: | Provide the test as a pen & paper exam. The ONYX help authoring tool offers a PDF export of the created test. To continue the e-test, the examiner needs to adapt the configuration of the course element in the learning platform accordingly. Both the exam mode and exam control must be enabled. |
Workflow “Switch to pen & paper exam”: | Export the test as a PDF file using the ONYX Editor before the test start time. Make sure that the “Show solution” option is disabled (default setting). Print out the documents for each participant. If you switch to a pen & paper exam, the test must be assessed manually. Test results may also be entered in the assessment view for the e-test. The result data can then be further processed electronically. The system operator must be informed immediately to secure the responses already entered by the participants. |
Workflow: “Continue e-test”: | After the power failure, the PCs must be restarted. All participants must log back into the learning platform and reopen the test. The rest of the procedure is analogous to the workflow in the event of a client PC failure (cf. procedures guide for the failure of a client PC). The test automatically opens where the learner left off. It will be displayed in the exact same way as before the interruption. This includes dynamically generated test data (e. g. if the options shuffle and random selection or the use of parameters had been enabled) as well as all of the learner’s responses. |
Scenario 3: Network failure
Description: | A failure of the PC pool network occurs during the test. An Internet connection is no longer possible, or only to a very limited extent. |
Action: | cf. power failure |
Necessary precautions: | cf. power failure |
Workflow “Continue e-test”: | As soon as faults occur in the network, all participants should be asked to interrupt processing the test. Only then it can be guaranteed that the exam situation will be the same for all participants. During the network failure, the currently displayed page can be further processed. However, it will not be possible to open new test pages (e. g. navigation via the navigation tree, next or previous buttons) or to finish the test. In contrast to a power failure, the participant will remain logged in to the system (learning platform / ONYX) and does not have to reopen the test. As soon as the network is available again, the participant can continue to work on the active test. If the exam is limited in processing time, the participant must be credited for the processing time lost due to the network failure. To do this, select all participants using the exam control and choose the option “Continue”. Set the additional processing time in the “Continue test” dialogue and confirm your settings with “Yes”. The test does not have to be restarted. |
Scenario 4: ONYX failure
Description: | A failure of the ONYX server occurs during the test. |
Note: | The servers of the used systems ONYX and the learning platform are professionally operated and continuously monitored in the data centre. A connection to the German Gigabit university network and the use of fail-safe technology (e. g. L4 switch) ensure both a high-performance and fail-safe operation. |
Action: | cf. power failure |
Necessary precautions: | cf. power failure |
Workflow: | cf. power failure |
Scenario 5: Learning platform failure
Description: | A failure of the learning platform server occurs during the test. Processing the test will still be possible without any restrictions. However, it will not be possible to submit the test electronically while the server is down. |
Note: | The servers of the used systems ONYX and the learning platform are professionally operated and continuously monitored in the data centre. A connection to the German Gigabit university network and the use of fail-safe technology (e. g. L4 switch) ensure both a high-performance and fail-safe operation. |
Action: | The learning platform cannot be reached during downtime. Therefore, the test results cannot be submitted. If the learning platform for the test system (ONYX server) is not accessible, the participant will be informed accordingly when submitting the test. The transfer of results can be repeated later. If the fault persists, the results can be downloaded by the participant and sent manually to the tutor. In this case, the test must also be assessed manually. Test results may also be entered in the assessment view for the e-test. The result data can then be further processed electronically. |
