How to set up a Judgement Concordance question in Wooclap?
The University of Montreal describes the Judgement Concordance as an exercise which:
« presents the participant with cases in the form of short vignettes reflecting the complexity and ambiguity often encountered in professional practice. The participant's task is to evaluate the appropriateness or inappropriateness of behaviours related to professionalism or ethics.
The Judgement Concordance does not claim to show the ideal professional or ethical reasoning in a given situation. It provides an opportunity for repeated reflection in contexts that the participant is likely to encounter in their practice. »
The students' answers are compared to answers previously given by members of a panel of experts. Learners can then find out how their answers compare to those of the panel and explore the reasoning of the panel members using the justifications they gave for their answers.
Judgement Concordance on Wooclap
When you create a judgement concordance on Wooclap, there are two possibilities: (1) you already possess the experts panel's answers or (2) you are going to collect those answers using Wooclap.
1. You have already gathered the data from the panel of experts
Step 1: Create the question
Once you have selected the Judgement Concordance (as shown in the image above), fill in the required fields (i.e. the case description and the question) and specify how many experts have selected each answer on the Likert scale.
Step 2: Ask the question to your live audience
Use the "correct answer" button to display the experts' opinions alongside the students' answers.
2. You will gather the experts panel's answers using Wooclap
Step 1: Create the question
Unless you are going to ask the experts to answer this question during a live session, create the question in the "Participant pace" tab and fill in the required fields (i.e. the case description and the question).
Do not fill in the "Experts' opinion" section!
Step 2: Gather data from the experts panel
Place your questionnaire online and share your event code with the experts so they can select an answer on the Likert scale and add a short comment to support their reasoning.
Step 3: Import the question into the "Votes" tab
When you import a question, you duplicate that question in a new location (another event or questionnaire). In this case, you can import the question containing the experts' answers in another event, another questionnaire, or the "Votes" of the same event.
When you do, the experts' answers will be saved in the new question so you can do the exercise with the students. Here's how you can import a question:
Click on "Import questions"; (1) choose "Import from another event" and (2) select the event which contains the judgement concordance question. (3) In the right tab, marked "Questionnaires", (4) select your question.
Step 4: Ask the students the question in real-time.
The question you have imported contains the opinions of the experts. You can compare the students' answers to those of the experts by using the “correct answer” button.
Was this article helpful? Let us know below so we may better help you and other users!
The Wooclap Team