Wiki source code of 03 Peer Review

Last modified by Moritz Baumgarten on 11.01.2024

version	line-number	content
411.1	1	{{layout}}
	2	{{layout-section ac:type="two_right_sidebar"}}
	3	{{layout-cell}}
	4	A peer review allows an anonymous review of submitted tasks by peer participants. From these participant reviews, an overall assessment of each submitted task may be generated.
410.11	5
411.1	6	Depending on the configuration, the peer review may include the following steps:
405.1	7
411.1	8	* Step 1: Review of other task solutions
	9	* Step 2: Provision of feedback on existing reviews of your own task solutions
	10	* Step 3: Display of the overall assessment obtained
405.1	11
411.1	12	Find out more below about the
405.1	13
411.1	14	* [[configuration from an author's point of view>>doc:\|\|anchor="authors"]] to start configuring these steps.
	15	* [[usage from a learner's point of view>>doc:\|\|anchor="information"]] to learn more about how the review process works from a user’s perspective and what actions are expected of participants in this process.
405.1	16
411.1	17	{{id name="information"/}}
	18	{{/layout-cell}}
405.1	19
411.1	20	{{layout-cell}}
	21
	22	{{/layout-cell}}
	23	{{/layout-section}}
405.1	24
411.1	25	{{layout-section ac:type="single"}}
	26	{{layout-cell}}
	27	(% style="margin-left: 0.0cm;" %)
	28	== (% style="color:#3f4444" %)Usage: Learners' View(%%) ==
405.1	29
135.1	30
411.1	31	(% class="wrapped" %)
405.1	32	\|(((
411.1	33	If the course author has enabled an assessment for a task course element in the form of a peer review procedure, the section Information for the procedure of the peer review will appear in the task element.
405.1	34	)))\|(((
	35	(% class="content-wrapper" %)
	36	(((
411.1	37	[[image:attach:Kursrun - Aufgabe mit PeerReview_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	38	)))
	39	)))
	40	\|(((
411.1	41	Open this section to find out more about the individual peer review steps and what other settings have been configured.
405.1	42	)))\|(((
	43	(% class="content-wrapper" %)
	44	(((
411.1	45	[[image:attach:Kursrun - Ablauf PeerReview_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	46	)))
	47	)))
	48	\|(((
	49	(% class="content-wrapper" %)
	50	(((
411.1	51	The review process usually begins after submitting your own solution. Therefore, start by uploading or creating your own response to a question in the Submit solution area.
135.1	52
405.1	53	{{info}}
411.1	54	If an anonymous review is desired, please make sure that the file titles and properties as well as the file content do not allow any direct conclusions about the creator.
405.1	55	{{/info}}
	56	)))
	57	)))\|(((
	58	(% class="content-wrapper" %)
	59	(((
411.1	60	[[image:attach:Kursrun - Lösung abgeben_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	61	)))
	62	)))
135.1	63
411.1	64	=== ===
135.1	65
	66
411.1	67	=== 1. Review of other task solutions ===
410.4	68
	69
411.1	70	If the review area is accessible, a corresponding request will appear, and you will be able to see the Submit reviews for other participants area. To start the review process, click on Start review.
410.4	71
411.1	72	[[image:attach:Kursrun - Review vergeben_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	73
	74	{{expand title="Start the review process ..."}}
	75	(% class="wrapped" %)
405.1	76	\|(% colspan="2" %)(% colspan="2" %)
	77	(((
	78	(% class="content-wrapper" %)
	79	(((
411.1	80	Clicking on the Start review button will open the review form. Fill in the form to review the task solution of another user according to the review specifications of your supervisor. The form contains the following information:
135.1	81
411.1	82	(% class="wrapped" %)
405.1	83	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	84	(((
	85	1
	86	)))\|(((
411.1	87	An indication of how many reviews you need to submit.
405.1	88	)))\|(% rowspan="5" %)(% rowspan="5" %)
	89	(((
	90	(% class="content-wrapper" %)
	91	(((
411.1	92	[[image:attach:Kursrun - Reviewformular füllen_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
135.1	93	)))
405.1	94	)))
	95	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	96	(((
	97	2
	98	)))\|(((
411.1	99	The just opened review.
405.1	100	)))
	101	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	102	(((
	103	3
	104	)))\|(((
411.1	105	The file you should review. Access the file by clicking on the file name.
405.1	106	)))
411.1	107	\|(% class="numberingColumn" colspan="1" %)(% class="numberingColumn" colspan="1" %)
405.1	108	(((
	109	4
	110	)))\|(% colspan="1" %)(% colspan="1" %)
	111	(((
411.1	112	Fill in the fields configured by the course author and award points if required.
405.1	113	)))
411.1	114	\|(% class="numberingColumn" colspan="1" %)(% class="numberingColumn" colspan="1" %)
405.1	115	(((
	116	5
	117	)))\|(% colspan="1" %)(% colspan="1" %)
	118	(((
411.1	119	Save your review and carry out further reviews if necessary (Submit and next button). Once all currently available reviews have been completed, close the dialogue (Submit and close button). Alternatively, you can pause the review editing process with Suspend.
405.1	120	)))
135.1	121
411.1	122	{{note title="Please note!"}}
	123	(% style="letter-spacing: 0.0px;" %)Users will not be able to see the name of the creator, solution, or reviewer. These will remain completely anonymous and will not be visible to users.
367.1	124
411.1	125	Attention: The platform cannot affect properties or content in files or form fields. For example, if usernames are stored or hinted at in the file title, file properties, file content or form fields, they will be displayed accordingly.
405.1	126	{{/note}}
	127	)))
	128	)))
411.1	129	\|(((
	130	The course creator may allow the assignment of additional reviews. In this case, more than one solution will be available to you for review.
	131	)))\|(((
405.1	132	(% class="content-wrapper" %)
	133	(((
411.1	134	[[image:attach:Kursrun - Reviewdialog Mindestanzahl_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	135	)))
	136	)))
411.1	137	\|(((
	138	Once a review has been submitted, it can no longer be edited (at this point). However, being the review creator, you can view your submitted reviews at any time by clicking on the Show review button.
367.1	139
411.1	140	The creator of the reviewed solution can access the review from the optional feedback session or the assessment area. A course owner has access to all assessment data in the assessment tool.
	141	)))\|(((
405.1	142	(% class="content-wrapper" %)
	143	(((
411.1	144	[[image:attach:Kursrun - vergebene Review einsehen_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	145	)))
	146	)))
411.1	147	\|(((
	148	The next steps in the review process can be obtained from the information section.
	149	)))\|(((
	150	(% class="content-wrapper" %)
405.1	151	(((
411.1	152	[[image:attach:Kursrun - Ablauf PeerReview2_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	153	)))
	154	)))
	155	{{/expand}}
135.1	156
411.1	157	=== ===
405.1	158
410.4	159
411.1	160	=== 2. Provision of feedback on existing reviews of your own task solutions ===
410.4	161
405.1	162
411.1	163	The course creator can allow you to comment on reviews that you have received for your own task solutions. In this case, you will be able to see the Submit feedback for received reviews area. To run this function, click on the Submit feedback button.
405.1	164
411.1	165	[[image:attach:Kursrun - Feedback vergeben_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	166
411.1	167	{{expand title="Start feedback process ..."}}
	168	The feedback form opens. Fill in the form to assess the review received according to the specifications of your supervisor. The form contains the following information:
	169
	170	(% class="wrapped" %)
405.1	171	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	172	(((
	173	1
	174	)))\|(((
411.1	175	An indication of how much feedback you need to give.
405.1	176	)))\|(% rowspan="6" %)(% rowspan="6" %)
	177	(((
	178	(% class="content-wrapper" %)
	179	(((
411.1	180	[[image:attach:Kursrun - Feedback Formular_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	181	\\\\
135.1	182	)))
405.1	183	)))
	184	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	185	(((
	186	2
411.1	187	)))\|(((
	188	The just opened feedback.
405.1	189	)))
	190	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	191	(((
	192	3
411.1	193	)))\|(((
	194	The review you received and on which you should leave a comment now.
405.1	195	)))
411.1	196	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
405.1	197	(((
	198	4
411.1	199	)))\|(((
	200	If you think that the review you received might be inappropriate, you can use the Report inappropriate review option. Clicking on the button will open another window where you can describe the points of criticism aimed at the review, depending on the course author's configuration. After the supervisor has been informed, they will check the review and either refuse or accept it.
405.1	201	)))
	202	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	203	(((
	204	5
411.1	205	)))\|(((
	206	Fill in the text fields configured by the course author with your feedback and award points for the received review if required.
405.1	207	)))
411.1	208	\|(% class="numberingColumn" colspan="1" %)(% class="numberingColumn" colspan="1" %)
405.1	209	(((
	210	6
	211	)))\|(% colspan="1" %)(% colspan="1" %)
	212	(((
411.1	213	Save your feedback and give more feedback if necessary (Submit and continue button). Once all currently available feedback requests have been completed, close the dialogue (Finish button).
405.1	214	)))
135.1	215
411.1	216	If the course author has not enabled a feedback round, you will see any reviews you might have received only with the activation of the overall results.
135.1	217
411.1	218	{{tip title="View feedback for created reviews"}}
	219	The feedback you have received on your submitted reviews can be found in the review section (submit reviews for other participants) by clicking on the Show review button. You will see an overview of all the reviews you have given there. If the entry Show feedback for this review is available for a review, you can view the feedback you have received by clicking on this entry.
405.1	220	{{/tip}}
	221	{{/expand}}
135.1	222
411.1	223	=== 3. Display of the overall assessment obtained ===
135.1	224
411.1	225	The course creator has a great deal of freedom in calculating and displaying the overall assessment. You can check the time frames and the selected configuration at any time in the [[Information on the peer review process>>doc:\|\|anchor="information"]] section.
135.1	226
411.1	227	If the assessment is already available, it will be displayed in the upper section of the page. With the Show evaluation button, you can open a detailed overview of the assessment.
135.1	228
411.1	229	[[image:attach:Kursrun - Auswertung anzeigen_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
135.1	230
411.1	231	{{expand title="View assessment ..."}}
	232	(% class="wrapped" %)
405.1	233	\|(((
411.1	234	Clicking on the Show evaluation button will open a dialogue box where the assessment for all received reviews and any given feedback is displayed in a tabular overview.
135.1	235
411.1	236	Below the table is the Show reviews button. Click this button to open the detailed view.
405.1	237	)))\|(((
	238	(% class="content-wrapper" %)
	239	(((
411.1	240	[[image:attach:Kursrun - Auswertung öffnen_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	241	)))
	242	)))
	243	\|(((
411.1	244	The detailed view shows all received reviews and offers the possibility to report inappropriate reviews (even if the course author has not enabled a feedback round).
405.1	245	)))\|(((
	246	(% class="content-wrapper" %)
	247	(((
411.1	248	[[image:attach:Kursrun - Auswertung Detailansicht_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	249	)))
	250	)))
411.1	251	\|(((
	252	(% class="content-wrapper" %)
405.1	253	(((
411.1	254	The following entries are possible in the Status column:
399.1	255
411.1	256	(% class="wrapped" %)
405.1	257	\|(((
	258	(% class="content-wrapper" %)
	259	(((
411.1	260	[[image:attach:Icon_Expertenreview_en.png]]
405.1	261	)))
	262	)))\|(((
411.1	263	This review was written by a course owner. Expert reviews cannot be reported as inappropriate.
405.1	264	)))
411.1	265	\|(((
405.1	266	(% class="content-wrapper" %)
	267	(((
411.1	268	[[image:attach:Icon_Prüfung ausstehend_en.png]]
405.1	269	)))
411.1	270	)))\|(((
	271	The review process is actively accompanied by a course owner. They moderate the final scoring and have not yet checked on this review or completed the overall assessment.
405.1	272	)))
	273	\|(((
	274	(% class="content-wrapper" %)
	275	(((
411.1	276	[[image:attach:Icon_akzeptiert_en.png]]
405.1	277	)))
	278	)))\|(((
411.1	279	The review process is actively accompanied by a course owner. They moderate the final scoring and have confirmed this review as part of the assessment. Therefore, it will also be considered in the overall assessment.
405.1	280	)))
	281	\|(((
411.1	282	(% class="content-wrapper" %)
	283	(((
	284	[[image:attach:Icon_abgelehnt_en.png]]
	285	)))
405.1	286	)))\|(((
411.1	287	The review process is actively accompanied by a course owner. They moderate the final scoring and have refused this review as part of the assessment. Therefore, it will not be included in the overall assessment.
405.1	288	)))
411.1	289	\|(% colspan="1" %)(% colspan="1" %)
	290	(((
405.1	291	(% class="content-wrapper" %)
	292	(((
411.1	293	[[image:attach:Icon_Gemeldet_en.png]]
405.1	294	)))
411.1	295	)))\|(% colspan="1" %)(% colspan="1" %)
	296	(((
	297	You have reported this review as inappropriate. However, no course owner has taken action yet.
405.1	298	)))
	299	\|(% colspan="1" %)(% colspan="1" %)
	300	(((
411.1	301	(% class="content-wrapper" %)
	302	(((
	303	[[image:attach:Icon_wird ignoriert_en.png\|\|data-xwiki-image-style="img-icon"]]
	304	)))
405.1	305	)))\|(% colspan="1" %)(% colspan="1" %)
	306	(((
411.1	307	You have reported this review as inappropriate. A course owner has accepted your appeal. Therefore, this review will not be included in the overall assessment.
405.1	308	)))
411.1	309	\|(% colspan="1" %)(% colspan="1" %)
	310	(((
	311	(% class="content-wrapper" %)
	312	(((
	313	[[image:attach:Icon_wird akzeptiert_en.png]]
405.1	314	)))
	315	)))\|(% colspan="1" %)(% colspan="1" %)
	316	(((
411.1	317	You have reported this review as inappropriate. A course owner has dismissed your appeal. Therefore, this review will be considered in the overall assessment.
	318	)))
	319	)))
	320	)))\|(((
405.1	321	(% class="content-wrapper" %)
	322	(((
411.1	323	[[image:attach:Kursrun - Status zu Reviews_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	324	)))
	325	)))
	326	{{/expand}}
411.1	327	{{/layout-cell}}
	328	{{/layout-section}}
135.1	329
411.1	330	{{layout-section ac:type="single"}}
	331	{{layout-cell}}
	332	{{id name="authors"/}}
410.11	333
411.1	334	== ==
405.1	335
	336
411.1	337	== Configuration: Authors' View ==
410.4	338
405.1	339
411.1	340	=== Configuration of the peer review in the course editor ===
405.1	341
	342
411.1	343	In the course element task, authors can enable the assessment by peer review. To do this, switch to the Assessment tab and select the checkbox Activate peer review.
405.1	344
411.1	345	[[image:attach:Editor - PeerReview aktivieren_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	346
411.1	347	This will open additional configuration sections including the review steps:
405.1	348
411.1	349	* (% style="letter-spacing:0.0px" %)Step 1: Review
	350	* (% style="letter-spacing:0.0px" %)Step 2(%%) (% style="letter-spacing:0.0px" %): Feedback (optional)
	351	* (% style="letter-spacing:0.0px" %)Step 3: Result display
410.4	352
411.1	353	(% style="letter-spacing:0.0px" %)[[image:attach:Editor - PeerReview Abschnitte_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	354
411.1	355	After enabling the peer review function for your task, you can customise the settings to suit your needs.
410.4	356
405.1	357
411.1	358	=== Configuration of step 1: Review ===
410.12	359
411.1	360
	361	In the first section, you can define basic conditions for the review assignment.
	362
	363	{{expand title="Configuration in the review section ..."}}
	364	(% class="wrapped" %)
405.1	365	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	366	(((
	367	1
	368	)))\|(((
411.1	369	Time frame for review: Set a time frame for users to submit reviews. Within this time frame, submitted reviews can still be changed by the creator.
405.1	370	)))\|(% rowspan="4" %)(% rowspan="4" %)
	371	(((
	372	(% class="content-wrapper" %)
	373	(((
411.1	374	[[image:attach:Editor - Peer Review Reviewvergabe konfigurieren_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	375	\\\\\\
	376
	377
405.1	378	)))
	379	)))
	380	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	381	(((
	382	2
	383	)))\|(((
	384	(% class="content-wrapper" %)
	385	(((
411.1	386	Set a required number of reviews every user has to submit. Optionally, you can also allow additional reviews. If you select this checkbox, each user can voluntarily create more reviews than the required minimum number.
405.1	387
411.1	388	{{note title="Number of reviews falls short of the set minimum number"}}
	389	We recommend a minimum of three reviews. If you fall below this number, please refer to the help section on the [[Impact of falling below the minimum number>>doc:\|\|anchor="minimum number"]].
135.1	390	{{/note}}
	391
411.1	392	Regardless of the reviews by the participants, authorised users (e. g. course authors) can write their own reviews on participant solutions in the assessment tool. These will be marked as expert reviews. For more information, see the section [[Create expert review>>doc:\|\|anchor="expert review"]].
405.1	393	)))
	394	)))
	395	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	396	(((
	397	3
	398	)))\|(((
411.1	399	Configure the template review form:
135.1	400
411.1	401	* Optionally, you can enter review hints in the text field.
	402	* Select the desired scoring. You can choose from the options //Overall score //and //Score per text field//.
	403	* Enter the maximum score that reviewers may award.
	404	* Optionally, add more free text fields.
	405	* Select the option //Documents – Reviewers may upload files// if the participants should be able to add files to the review.
135.1	406	)))
405.1	407	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	408	(((
	409	4
	410	)))\|(((
411.1	411	Save your entries.
405.1	412	)))
135.1	413
411.1	414	{{info title="Note"}}
	415	To ensure an even distribution of reviews, we recommend specifying specific time frames for the submission of the task, the review phase and the feedback phase. The restriction of the period for submitting the tasks can be set in the Access tab of the task course element (access>drop box>depending on date). This prevents the submission of tasks when the review phase has already begun.
405.1	416	{{/info}}
	417	{{/expand}}
135.1	418
411.1	419	=== ===
135.1	420
	421
411.1	422	=== Configuration of step 2: Feedback (optional) ===
135.1	423
	424
411.1	425	Optionally, you can also allow your users to provide feedback on received reviews. Select the checkbox The participant can give feedback on received reviews to configure the feedback process.
	426
	427	[[image:attach:Editor - Peer Review Feedbackvergabe aktivieren_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	428
	429	{{expand title="Configuration in the feedback section ..."}}
	430	Activating this option will open further configuration options.
	431
	432	(% class="wrapped" %)
405.1	433	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	434	(((
	435	1
411.1	436	)))\|(((
	437	Time frame: Set a time frame for users to give feedback on reviews of their solution. Within this time frame, submitted feedback can still be changed by the creator.
405.1	438	)))\|(% rowspan="3" %)(% rowspan="3" %)
	439	(((
	440	(% class="content-wrapper" %)
	441	(((
411.1	442	[[image:attach:Editor- Peer Review Feedbackvergabe konfigurieren_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	443	\\
405.1	444	)))
	445	)))
	446	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	447	(((
	448	2
411.1	449	)))\|(((
	450	Configure the template feedback form:
135.1	451
411.1	452	* Optionally, you can enter feedback hints in the text field.
	453	* Select the desired scoring. You can choose from the options //Overall score //and //Score per text field//. The scoring within feedback serves the qualitative assessment of reviews.
	454	* Optionally, add more free text fields.
135.1	455	)))
405.1	456	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	457	(((
	458	3
	459	)))\|(((
411.1	460	Save your entries.
405.1	461	)))
	462	{{/expand}}
135.1	463
411.1	464	=== ===
135.1	465
	466
411.1	467	=== Configuration of step 3: Result display ===
410.12	468
411.1	469
	470	Here you can define the settings for displaying the overall results to the participants.
	471
	472	{{expand title="Configuration in the result view section ..."}}
	473	(% class="wrapped" %)
405.1	474	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	475	(((
	476	1
	477	)))\|(((
411.1	478	Set a time frame for users to view the overall results. If you leave both fields empty, the user will not see their results before the conditions are met.
405.1	479	)))\|(% rowspan="2" %)(% rowspan="2" %)
	480	(((
	481	(% class="content-wrapper" %)
	482	(((
411.1	483	[[image:attach:Editor - Ergebninsanzeige konfigurieren_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	484	)))
	485	)))
	486	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	487	(((
	488	2
	489	)))\|(((
	490	(% class="content-wrapper" %)
	491	(((
411.1	492	Define the conditions for displaying the results. All defined conditions must always be met for the results to be displayed to the users. (The conditions are linked by AND.)
135.1	493
411.1	494	Choose between:
135.1	495
411.1	496	* Only show results once the task
	497	** has the minimum number of reviews present (i. e. if the user has received the defined minimum number of reviews for their solution)
	498	** has its performance results approved by the supervisor (i. e. a peer review with active moderation by the supervisor)
	499	* Only show results once the participant
	500	** has completed the minimum number of reviews
	501	** has given feedback for all received reviews
405.1	502
411.1	503	{{expand title="Excursion into the review with moderation ..."}}
	504	{{info title="Review with moderation"}}
	505	The peer review function can be performed with and without active support by the supervisor.
405.1	506
411.1	507	For a peer review with moderation, select the checkbox Only show results once the task has its performance results approved by the supervisor. This means that all reviews and feedback must be individually reviewed and approved or refused by the supervisor. There is no automated result analysis, and the results will be available to users only after approval by the supervisor. For more information, see the section [[Peer review with moderation>>doc:\|\|anchor="Peer review with moderation"]].
405.1	508
411.1	509	In any case, participants always have the option to report reviews as inappropriate to the supervisor, who will then be informed to check on these reviews separately. For more information, see the section [[Edit inappropriate review>>doc:\|\|anchor="Edit inappropriate review"]].
405.1	510	{{/info}}
	511	{{/expand}}
	512	)))
	513	)))
	514
411.1	515	{{note title="Disabled feedback option"}}
	516	In the assessment tool, authorised users (e. g. course owners) can view all proposed solutions and related reviews as well as feedback at any time.
405.1	517
411.1	518	In contrast, course users can – with a disabled feedback option – see the reviews they received for their solution only in the specified time frame for the overall result display. (This also goes for reporting an inappropriate review.)
135.1	519	{{/note}}
405.1	520	{{/expand}}
411.1	521	{{/layout-cell}}
	522	{{/layout-section}}
135.1	523
411.1	524	{{layout-section ac:type="single"}}
	525	{{layout-cell}}
	526
	527	{{/layout-cell}}
	528	{{/layout-section}}
135.1	529
411.1	530	{{layout-section ac:type="single"}}
	531	{{layout-cell}}
	532	== ==
135.1	533
	534
411.1	535	== Overall results to the review process ==
135.1	536
411.1	537
	538	By using the assessment tool, authors may always access an overview of which user has (been assigned which task), delivered a solution, submitted a review or provided feedback.
	539
	540	[[image:attach:Bewertungswerkzeug - Übersicht zum Peer Review_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	541
	542	In this table, you can also view the reviews (and their statuses) given by the displayed users, or switch to the assessment view as per user.
	543
405.1	544	{{info}}
411.1	545	However, the assignment of usernames to solutions, reviews or feedback is only visible to authors in the assessment tool, but not to the participants in the course view, or in the dialogues for providing reviews or feedback.
405.1	546	{{/info}}
135.1	547
411.1	548	=== ===
410.5	549
135.1	550
411.1	551	=== Open overview in the assessment tool ===
405.1	552
	553
411.1	554	To open the status of the review process in the assessment tool, proceed as follows:
410.11	555
411.1	556	{{expand title="Open overview in the assessment tool ..."}}
	557	(% class="wrapped" %)
405.1	558	\|(((
411.1	559	Go to the assessment tool of the desired course.
405.1	560	)))\|(((
	561	(% class="content-wrapper" %)
	562	(((
411.1	563	[[image:attach:LMS.Benutzerhandbuch OPAL.Teaching.Bewertung.Peer Review.Bewertungswerkzeug.WebHome@Kursrun - Bewertungswerkzeug öffnen_en.png]]
405.1	564	)))
	565	)))
	566	\|(((
411.1	567	In the left menu, click on the entry As per course structure.
405.1	568	)))\|(((
	569	(% class="content-wrapper" %)
	570	(((
411.1	571	[[image:attach:Bewertungswerkzeug - Nach Kursstruktur_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	572	)))
	573	)))
	574	\|(((
411.1	575	Select the desired task course element and, if necessary, a course group.
405.1	576	)))\|(((
	577	(% class="content-wrapper" %)
	578	(((
411.1	579	[[image:attach:Bewertungswerkzeug - Gruppenauswahl_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	580	)))
	581	)))
	582	\|(((
411.1	583	The displayed table includes information on the reviews carried out by other participants. In addition to the names of the users who created the review, the total score and indications on the review status can be inferred. Using the links, you can display all review content together with the corresponding feedback, if any.
405.1	584	)))\|(((
	585	(% class="content-wrapper" %)
	586	(((
411.1	587	[[image:attach:Bewertungswerkzeug - Übersicht zum Peer Review_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	588	)))
	589	)))
	590	{{/expand}}
	591
411.1	592	The opened table contains information about the status of the review process of all users in the selected group.
405.1	593
411.1	594	{{expand title="Information in the detailed view ..."}}
	595	(% class="wrapped" %)
405.1	596	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	597	(((
	598	1
	599	)))\|(((
411.1	600	Name of the user with a link to the detailed assessment
405.1	601	)))\|(((
411.1	602	Click on a displayed username. This will open the course element’s detailed assessment view for the selected user.
405.1	603	)))\|(% rowspan="5" %)(% rowspan="5" %)
	604	(((
	605	(% class="content-wrapper" %)
	606	(((
411.1	607	[[image:attach:Bewertungswerkzeug - Informationen der Tabelle_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
	608	\\
405.1	609	)))
	610	)))
	611	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	612	(((
	613	2
	614	)))\|(((
411.1	615	Given reviews
405.1	616	)))\|(((
411.1	617	The link on the entry opens a dialogue with the reviews submitted by the user.
405.1	618	)))
	619	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	620	(((
	621	3
	622	)))\|(((
	623	(% class="content-wrapper" %)
	624	(((
411.1	625	[[image:attach:Icon_Warnung.png\|\|data-xwiki-image-style="img-icon"]]Reported reviews
405.1	626	)))
	627	)))\|(((
	628	(% class="content-wrapper" %)
	629	(((
411.1	630	The icon[[image:attach:Icon_Warnung.png\|\|data-xwiki-image-style="img-icon"]]indicates that at least one review of this user has been reported as inappropriate. Details will be displayed when clicking on the link.
405.1	631	)))
	632	)))
	633	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	634	(((
	635	4
411.1	636	)))\|(((
405.1	637	(% class="content-wrapper" %)
	638	(((
411.1	639	[[image:attach:Icon_Reviewanzahl reicht nicht aus_de.png\|\|data-xwiki-image-style="img-icon"]]Insufficient number of reviews
405.1	640	)))
411.1	641	)))\|(((
	642	The number of reviews received so far for this user is below the configured minimum number of reviews. If the period for the submission of reviews has already expired and the minimum number has not been reached, you should check the assessment of the affected user, write an expert review if necessary and adjust the assessment form.
405.1	643	)))
	644	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	645	(((
	646	5
	647	)))\|(((
	648	(% class="content-wrapper" %)
	649	(((
411.1	650	[[image:attach:Icon_Tabelle anpassen_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	651	)))
	652	)))\|(((
411.1	653	If not all required columns are displayed, you can change the column configuration by clicking on this icon.
405.1	654	)))
	655	{{/expand}}
	656
411.1	657	If you instead open the detailed assessment view of a user, you will receive information about the review process of that user's solution.
405.1	658
411.1	659	{{expand title="Information in the detailed view ..."}}
	660	(% class="wrapped" %)
405.1	661	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	662	(((
	663	1
	664	)))\|(((
411.1	665	Selected course element
405.1	666	)))\|(% rowspan="3" %)(% rowspan="3" %)
	667	(((
411.1	668	(% class="content-wrapper" %)
	669	(((
	670	[[image:attach:Bewertungswerkzeug - Detailansicht1_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]]]
405.1	671	)))
411.1	672	)))
	673	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
405.1	674	(((
	675	2
411.1	676	)))\|(((
	677	Selected user
405.1	678	)))
411.1	679	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
405.1	680	(((
	681	3
411.1	682	)))\|(((
	683	Task and solution of the user
405.1	684	)))
	685	\|(% class="numberingColumn" %)(% class="numberingColumn" %)
	686	(((
	687	4
	688	)))\|(((
411.1	689	Reviews received and status of the reviews
405.1	690	)))\|(% rowspan="4" %)(% rowspan="4" %)
	691	(((
411.1	692	(% class="content-wrapper" %)
	693	(((
	694	[[image:attach:Bewertungswerkzeug - Detailansicht2_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]]]
405.1	695	)))
411.1	696	)))
	697	\|(% class="numberingColumn" colspan="1" %)(% class="numberingColumn" colspan="1" %)
405.1	698	(((
	699	5
411.1	700	)))\|(% colspan="1" %)(% colspan="1" %)
	701	(((
	702	Possibility to give an expert review
405.1	703	)))
411.1	704	\|(% class="numberingColumn" colspan="1" %)(% class="numberingColumn" colspan="1" %)
405.1	705	(((
	706	6
411.1	707	)))\|(% colspan="1" %)(% colspan="1" %)
	708	(((
	709	Assessment form with overall score
405.1	710	)))
411.1	711	\|(% class="numberingColumn" colspan="1" %)(% class="numberingColumn" colspan="1" %)
405.1	712	(((
	713	7
411.1	714	)))\|(% colspan="1" %)(% colspan="1" %)
	715	(((
	716	Show log file
405.1	717	)))
	718	{{/expand}}
	719
135.1	720
	721
	722
411.1	723	{{id name="inappropriate"/}}
135.1	724
411.1	725	=== Edit inappropriate review ===
135.1	726
411.1	727
	728	A user has reported a review that they considered to be inappropriate. Now you have to check and accept or refuse this reported review. Depending on your choice, the review will then be included in the overall result or discarded.
	729
	730	{{expand title="How to deal with reported reviews ..."}}
405.1	731	(% class="wrapped" %)
	732	\|(((
	733	(% class="content-wrapper" %)
	734	(((
411.1	735	[[image:attach:Icon_Gemeldet_en.png\|\|data-xwiki-image-style="img-icon"]]
135.1	736	)))
405.1	737	)))\|(((
	738	(% class="content-wrapper" %)
	739	(((
411.1	740	If the user has reported a review as inappropriate, the entry “Reported” will appear in the Review status column. Now open the detailed view of the corresponding review. In the dialogue that opens, you can make a decision about the review. Choose between [[image:attach:Icon_Review ignorieren_en.png\|\|\|data-xwiki-image-style="img-icon"]] and [[image:attach:Icon_Review akzeptieren_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	741	)))
	742	)))
	743	\|(((
	744	(% class="content-wrapper" %)
	745	(((
411.1	746	[[image:attach:Icon_wird ignoriert_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	747	)))
	748	)))\|(((
411.1	749	By clicking on the Ignore review button, you agree to the user's objection, and the review that has been reported as inappropriate will not be included in the calculation of the overall score. The review status then changes from "Reported" to Reported (will be ignored). Discarding a review may lead to the number of the user’s reviews falling below the predetermined minimum number. Therefore, please check the entire assessment and adjust it if necessary, using the assessment form or by performing an expert review.
405.1	750	)))
411.1	751	\|(((
405.1	752	(% class="content-wrapper" %)
	753	(((
411.1	754	[[image:attach:Icon_wird akzeptiert_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	755	)))
411.1	756	)))\|(((
	757	By clicking on the Accept review button, you dismiss the user's objection, and the reported review will still be considered in the calculation of the overall score. The review status then changes from “Reported” to Reported (will be accepted).
405.1	758	)))
411.1	759	\|(((
405.1	760	(% class="content-wrapper" %)
	761	(((
411.1	762	[[image:attach:Icon_Expertenreview_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	763	)))
411.1	764	)))\|(((
	765	An [[expert review>>doc:\|\|anchor="expert review"]] has been performed and will be considered in the overall assessment.
405.1	766	)))
	767	{{/expand}}
135.1	768
405.1	769
	770
	771
411.1	772	{{id name="moderation"/}}
135.1	773
411.1	774	=== Peer review with moderation ===
135.1	775
405.1	776
411.1	777	If you wish to accompany the review process as a course supervisor and check on the assessments before they are released to the users, you can do so by enabling the option Only show results once the task has its performance results approved by the supervisor. Configure this option in the course editor in the result view section.
	778
	779	If the moderation function is enabled, this means that you will need to look into each review individually and accept or refuse it. Only when you are finished, the assessment can be adopted.
	780
	781	{{expand title="Moderate assessment process ..."}}
	782	(% class="wrapped" %)
	783	\|=(((
	784	Review status
	785	)))\|=(((
	786	Explanation
405.1	787	)))
	788	\|(((
	789	(% class="content-wrapper" %)
	790	(((
411.1	791	[[image:attach:Icon_Prüfung ausstehend_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	792	)))
	793	)))\|(((
	794	(% class="content-wrapper" %)
	795	(((
411.1	796	If a moderated peer review has not yet been checked, the entry Inspection pending will appear in the Review status column. Open the detailed view of the review by clicking on the entry “Display review” and pass your judgement by clicking on the [[image:attach:Icon_Review akzeptieren_en.png\|\|data-xwiki-image-style="img-icon"]] or [[image:attach:Icon_Review ablehnen_en.png\|\|data-xwiki-image-style="img-icon"]] button.
405.1	797	)))
	798	)))
	799	\|(((
	800	(% class="content-wrapper" %)
	801	(((
411.1	802	[[image:attach:Icon_akzeptiert_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	803	)))
	804	)))\|(((
411.1	805	Using the “Accept review" button, you will approve of the review, and it will be included in the overall assessment. The review status then changes from “Inspection pending” to Accepted.
405.1	806	)))
411.1	807	\|(((
405.1	808	(% class="content-wrapper" %)
	809	(((
411.1	810	[[image:attach:Icon_abgelehnt_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	811	)))
411.1	812	)))\|(((
	813	Using the “Refuse review” button, you will dismiss the review, and it will not be included in the calculation of the overall assessment. The review status then changes from “Inspection pending” to Refused.
405.1	814
411.1	815	Discarding a review may lead to the number of received reviews falling below the predetermined minimum number. Therefore, please check the entire assessment and adjust it if necessary, using the assessment form or by performing an [[expert review>>doc:\|\|anchor="expert review"]].
405.1	816	)))
	817	\|(% colspan="1" %)(% colspan="1" %)
	818	(((
	819	(% class="content-wrapper" %)
	820	(((
411.1	821	[[image:attach:Icon_Bewertung übernehmen_en.png\|\|data-xwiki-image-style="img-icon"]]
405.1	822	)))
	823	)))\|(% colspan="1" %)(% colspan="1" %)
	824	(((
411.1	825	The Apply review button does not become active until all existing reviews have been viewed and accepted or refused. Clicking on the button stores and transmits the average total score of all individual reviews to the total score field of the assessment form. Depending on the configuration, this will lead to passing the course element.
405.1	826	)))
	827	{{/expand}}
	828
411.1	829	(% class="auto-cursor-target" %)
	830	[[image:attach:Bewertungswerkzeug - Moderation_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	831
	832
135.1	833
	834
411.1	835	{{id name="expert review"/}}
135.1	836
411.1	837	=== Create expert review ===
135.1	838
411.1	839	Course supervisors may create a review for a participant’s solution in the assessment tool at any time. Depending on the configuration, this may even be necessary if a participant has received too few reviews for an assessment, other participants have not given enough reviews, or there have been inappropriate reviews.
135.1	840
411.1	841	{{expand title="Give expert review ..."}}
	842	(% class="wrapped" %)
405.1	843	\|(((
411.1	844	Switch to the detailed view of a user's assessment in the assessment tool.
405.1	845	)))\|(% rowspan="3" %)(% rowspan="3" %)
	846	(((
	847	(% class="content-wrapper" %)
	848	(((
411.1	849	[[image:attach:Bewertungswerkzeug - Expertenreview starten_en.png\|\|data-xwiki-image-style="img-screen" data-xwiki-image-style-border="true" width="500"]]
405.1	850	)))
	851	)))
	852	\|(((
411.1	853	In the Peer reviews received section, you will find the Give expert review button right underneath the table.
405.1	854	)))
	855	\|(((
411.1	856	Clicking on the button will open the review form, where you can now give a review for the participant. For the expert review, you will be provided with the same form as the participants for the regular review.
135.1	857
411.1	858	Submit the review with Save and close. Your review will then receive the status or addition expert review in the summary table and all user views.
405.1	859	)))
	860	{{/expand}}
135.1	861
405.1	862
	863
	864
411.1	865	{{id name="minimum number"/}}
405.1	866
411.1	867	=== Impact of falling below the minimum number ===
405.1	868
	869
411.1	870	The educational goal of the assessment form “peer review” is to enable a [[peer assessment>>url:https://de.wikipedia.org/wiki/Peer_Assessment\|\|shape="rect"]]. Therefore, in drafting this form of assessment, care has been taken to ensure a great many basic scenarios. In particular, the anonymity and randomness of the allocation of participants’ solutions for assessment have been determined as a target criterion.
405.1	871
411.1	872	If you have configured a low required number of reviews and disabled additional reviews in the basic settings, you should consider the following to optimise the assessment procedure:
	873
	874	{{expand title="Important information for an optimal assessment procedure ..."}}
	875	* Configure fixed, non-overlapping date restrictions: The submission of solutions should always be limited in time to make sure it takes place prior to the review phase (access>drop box>restricted by date until). Therefore, the number of solution files available at the start of the review phase will be fixed and will not change during the review phase.
	876	* With the start of the review phase, all available reviews will be randomly distributed among all users clicking on the “Start review” button. This means that the assignment of a review only takes place when the user selects the button and is not previously determined. In other scenarios, this guarantees a very open peer review process, which also optimally integrates subsequently submitted solutions.
	877	* Reducing the minimum number to 1 will result in each user receiving a review of their solution after all of the reviews have been completed.
	878	* [[image:attach:Icon_Warnung.png\|\|data-xwiki-image-style="img-icon"]]Only the last reviewer might not receive a peer review of their solution; in return, at most, one other user will receive two reviews. However, even with this configuration, it is almost impossible for more than one user to receive more than two reviews and becomes even less likely with an increasing number of users.
410.4	879	*
411.1	880	* {{expand title="Excursion into odd review numbers ..."}}The problem arises from "successively drawn" reviews. This approach was chosen to guarantee above all an equal distribution when there are multiple reviews, enabling the best possible anonymity and random distribution (even for subsequently submitted solutions).
405.1	881
411.1	882	However, if there are only three users (A, B, C) left, the following assignment may occur: (A:B means user A picks user B's solution for review and performs the review)
	883	A:B; B:C; C:A => All users have received and performed a review.
	884	A:C; B:A; C:B => All users have received and performed a review.
	885	A:B; B:A; C:? => In this case, C will randomly receive and review the solution of either A or B. Therefore, user A or B will receive two reviews and the previously mentioned expert review will become necessary for user C’s solution. However, if the option "Allow additional reviews" is enabled, the next respective review will be assigned to a user who has already given a review. Thus C will also receive a peer review.{{/expand}}If the exception described above occurs, you need to perform an [[expert review>>doc:\|\|anchor="expert review"]] for this user. To further minimize the chances for such a case, you may allow the assignment of additional reviews.
405.1	886	{{/expand}}
411.1	887	{{/layout-cell}}
	888	{{/layout-section}}
	889	{{/layout}}

Wiki source code of 03 Peer Review

Search

OPALGlobal

OPALMenü

Recently Visited