Skip to Content

Wiki source code of Expertenbewertung

Last modified by Hendrik Zschocke on 11.01.2024
Show last authors
1 {{layout}}
2 {{layout-section ac:type="two_right_sidebar"}}
3 {{layout-cell}}
4 In addition to the configurable assessment options in the Assessment tab, extensive analyses can be used to assess participant responses via expert functions. Their application allows, for example, the implementation of adaptive question formats with individual error analyses and, based on this, individualised user feedback.
5 {{/layout-cell}}
6
7 {{layout-cell}}
8 {{panel borderColor="#ddd" bgColor="#f0f0f0" borderStyle="solid" title="Content"}}
9 {{toc maxLevel="2" minLevel="2"/}}
10 {{/panel}}
11
12 {{panel title="Related topics"}}
13 * [[Variables>>doc:ONYX.Erstellung von Testinhalten.Aufgaben.Variablen verwenden.WebHome]]
14 * [[Set feedback>>doc:ONYX.Erstellung von Testinhalten.Aufgaben.Feedback festlegen.WebHome]]
15 {{/panel}}
16
17 {{panel title="Example resources"}}
18 * [[attach:MAXIMA-functions_for_LR-Processing.zip]]
19 {{/panel}}
20 {{/layout-cell}}
21 {{/layout-section}}
22
23 {{layout-section ac:type="single"}}
24 {{layout-cell}}
25 == Access to answer options ==
26
27 Access to the answer selected by the participant and the correct solution to the question can be realised, for example, through Maxima queries in the Variables tab. For more information on how to create and use variables, see the [[Variables>>doc:ONYX.Erstellung von Testinhalten.Aufgaben.Variablen verwenden.WebHome]] help page.
28
29 [[image:attach:Beispiel - LR und CR per MAXIMA_de.png||height="263" width="453"]]
30
31 === Return values of answer options ===
32
33 (% class="auto-cursor-target" %)
34 The return values type of the answer options and thus of the system variables LEARNERRESPONSE and CORRECTRESPONSE depends on the question type:
35
36 (% class="wrapped" %)
37 |=(((
38 Question type
39 )))|=(((
40 Type
41 )))|=(((
42 Example return value
43 )))|=(((
44 System variable
45 )))
46 |(((
47 * Choice interaction, hotspot interaction, hottext interaction – one answer can be selected (single choice)
48 )))|(% rowspan="2" %)(% rowspan="2" %)
49 (((
50 single ID
51 )))|(((
52 ID_1
53 )))|(((
54 LEARNERRESPONSE
55
56 CORRECTRESPONSE
57 )))
58 |(((
59 * Inline choice (one text box)
60 )))|(((
61 ID_1
62 )))|(((
63 LEARNERRESPONSE_GAP_1 CORRECTRESPONSE_GAP_1
64 )))
65 |(((
66 * Choice interaction, hotspot interaction, hottext interaction – more than one answer can be selected (multiple choice)
67 * Order interaction
68 )))|(((
69 list of IDs
70 )))|(((
71 ID_1, ID_2, ID_3
72 )))|(((
73 LEARNERRESPONSE
74
75 CORRECTRESPONSE
76 )))
77 |(((
78 * Match interaction, matrix interaction
79 )))|(((
80 ID value pairs in a list
81 )))|(((
82 [ID_1, IDT_1], [ID_2, IDT_2], [ID_3, IDT_3]
83 )))|(((
84 LEARNERRESPONSE
85
86 CORRECTRESPONSE
87 )))
88 |(% colspan="1" %)(% colspan="1" %)
89 (((
90 * Text entry interaction (all formats)
91 * Extended text interaction
92 * Programming interaction
93 )))|(% colspan="1" %)(% colspan="1" %)
94 (((
95 specific values
96 )))|(% colspan="1" %)(% colspan="1" %)
97 (((
98
99 )))|(% colspan="1" %)(% colspan="1" %)
100 (((
101
102 )))
103 {{/layout-cell}}
104 {{/layout-section}}
105
106 {{layout-section ac:type="single"}}
107 {{layout-cell}}
108 == ID display in the editor ==
109
110 The **identifiers of the answers to a question** can be displayed in the editor. Activate this function in your [[user profile settings>>doc:ONYX.Anmeldung.Benutzerprofil.WebHome]].
111
112 [[image:attach:Editor - Anzeige der IDs_de.png||height="258" width="451"]]
113 {{/layout-cell}}
114 {{/layout-section}}
115
116 {{layout-section ac:type="single"}}
117 {{layout-cell}}
118 == Return value preparation with auxiliary functions ==
119
120 The functions shown below are used to prepare LEARNERRESPONSES and CORRECTRESPONSES in the MAXIMA backend if the identifiers are each present in the form of ID_x (or IDT_y) with a natural number x.
121
122 (% class="wrapped" %)
123 |=(((
124 SimpleLR({LEARNERRESPONSE})
125 )))|(((
126 * The ID_ and IDT_ strings are removed, i. e. each ID is reduced to the numerical values x,y.
127 * If LEARNERRESPONSE is a list of IDs (single/multiple choice, hotspot interaction, order interaction, etc.), the output is a corresponding list of numerical IDs, e. g. NumLR(ID_3,ID_4,ID_2) -> [3,4,2].
128 * If LEARNERRESPONSE is a list of ID pairs (matrix interaction, match interaction, etc.), the output consists of the list of source elements and the list of associated target elements, e. g. NumLR([ID_3,IDT_1],[ID_4,IDT_3],[ID_2,IDT_2]) -> ~[~[3,4,2], [1.3,2]].
129 )))
130 |=(((
131 SimpleLR(0,{LEARNERRESPONSE})
132 )))|(((
133 * Like SimpleLR({LEARNERRESPONSE}), but the output is sorted in ascending order by (source) IDs.
134 )))
135 |=(((
136 SimpleLR(n,{LEARNERRESPONSE})
137 )))|(((
138 * If LEARNERRESPONSE is a list of ID pairs: Output is sorted in ascending order by (source) IDs. Additionally, for missing source IDs 1<=x<=n, the pairs [x,0] are added, completing the list for 1<=x<=n.
139 )))
140 |=(((
141 Choices(LR)
142 )))|(((
143 * Input: LR – the LEARNERRESPONSE simplified by SimpleLR
144 * Output: LEARNERRESPONSE as a binary matrix, rows=source elements, columns=target elements
145 )))
146 |=(((
147 Choices(m,LR), Choices (0,n,LR), Choices(m,n,LR)
148 )))|(((
149 * Like Choices(LR), additionally filled up with or reduced to m rows or m columns if necessary.
150 )))
151
152 **Additional auxiliary functions:**
153
154 (% class="wrapped" %)
155 |=(((
156 List2Matrix(LR)
157 )))|(((
158 Converts the list simplified by NumLR into a one- or two-line matrix
159 )))
160 |=(((
161 Matrix2List(M)
162 )))|(((
163 Converts matrix to list
164 )))
165 |=(((
166 ransposeList(LR)
167 )))|(((
168 Switches between the list displays
169
170 * Two lists: ~[~[source elements], [target elements]]
171 * List of pairs: ~[~[source1, target1], [souce2, target2], …]
172 )))
173 {{/layout-cell}}
174 {{/layout-section}}
175
176 {{layout-section ac:type="single"}}
177 {{layout-cell}}
178 == Function to assess a formula comparison ==
179
180 The following standard comparison is used when assessing formula gaps:
181
182 {{code}}
183 is(equal(ev({LEARNERRESPONSE}),ev({CORRECTRESPONSE})))
184 {{/code}}
185
186 However, it has several disadvantages:
187
188 * mandatory use of decimal point instead of comma
189 * rounding/tolerance cannot be adjusted
190 * mandatory use of MAXIMA syntax, especially %e, %pi, %i and log instead of ln
191
192 The comparison can be extended using the function
193
194 {{code}}
195 CompareLR(”{LEARNERRESPONSE}“,“{CORRECTRESPONSE}“)
196 {{/code}}
197
198 (% class="auto-cursor-target" %)
199 or
200
201 {{code}}
202 CompareLR(”{LEARNERRESPONSE}“,“{CORRECTRESPONSE}“,tol)
203 {{/code}}
204
205 This offers the following advantages:
206
207 * also accepts e, pi, i, j, ln
208 * accepts both decimal point and comma
209 * performs the comparison "abs(LR-CR)<=tol" if tol>0 is specified
210 * otherwise performs the comparison "is(equal(ev(LR),ev(CR~)~)~)" and if necessary (i. e. if the result is //unknown//) additionally the checks/formula comparisons using radcan and trigsimp
211
212 {{info}}
213 Note: {LEARNERRESPONSE} and {CORRECTRESPONSE} must be committed in quotation marks (""), i. e. as strings!
214 {{/info}}
215
216 (% class="auto-cursor-target" %)
217 [[image:attach:Testdurchführung - Beispiel Formelvergleich_de.png||height="279" width="535"]]
218 {{/layout-cell}}
219 {{/layout-section}}
220
221 {{layout-section ac:type="single"}}
222 {{layout-cell}}
223 == (% class="sv-ti-title-text" %)Example using the auxiliary functions(%%) ==
224
225 (% class="sv-ti-title-text" %)All described auxiliary functions are shown in the attached(%%) (% class="sv-ti-title-text" %)[[attach:MAXIMA-functions_for_LR-Processing.zip]] example test. Download the file and import it into your question bank to reproduce the examples.
226
227 (% class="sv-ti-title-text" %)In the example test, you will find the auxiliary functions in the Variables tab under "Post-processed variables".
228
229 (% class="sv-ti-title-text" %)[[image:attach:Variablen - Maxima ID Beispiele_de.png||height="334" width="428"]]
230
231 The variables created in this way can be used in the question feedback (among others).
232
233 [[image:attach:Feedback - Übergabe der Maxima ID Beispiele_de.png||height="298" width="433"]]
234
235 The feedback can be displayed directly in the test run or the assessment documents.
236
237 [[image:attach:Testdurchführung - Beispiel_de.png||height="450" width="431"]]
238 {{/layout-cell}}
239 {{/layout-section}}
240 {{/layout}}