Things to know before you begin

The information below can only be seen by Administrative level users. 

What is a scoring rubric?

A Scoring evaluation/rubric is a type of evaluation that uses another evaluation as its base for grading. These are very flexible and can be used to effectively assign scores to evaluations that SimCapture cannot automatically score (like free-text questions) or as a supplement to a graded evaluation to give more context to that score.

Scoring evaluations are available for all Scenario evaluation types that learners complete. This currently includes the following evaluation types:

• Before Session
• After Session

Note: Scoring rubrics do not directly score their target evaluations and are treated separately in reports and releasing. This means that a student could receive a score for the target evaluation and the scoring rubric.

Creating a scoring rubric

1. Check the Scoring Rubric box from the Scenario Evaluation configuration screen under the evaluation you wish to attach the scoring rubric to and click Confirm.

2. Click Create Scoring Rubric in the Evaluations pod of your Scenario.

3. On the Scoring Rubric details page, click Add questions to create your evaluation.

Anonymous Scoring Evaluations

You can anonymize the scoring evaluation if you want to hide the participant's name when users complete scoring evaluations. This feature is available for all scoring evaluations and includes the following:

• When checked, the participant's name will be hidden when the scoring evaluation is being completed.
• The name will still be visible in course results and assignments, just not from the evaluation list or on the live evaluation.

Scoring Evaluations with Session Video

If associating a scoring rubric with and after session or exam flow evaluation, there will be an additional option to include session video. If selected, when the scoring rubric is being completed, the evaluator will have access to both the target evaluation and its associated session video.

Assigning scoring rubrics

Scoring rubrics are assigned by associating a grader with a Course Participant. This can be done at any time, and once the participant completes the associated evaluation, the grading rubric will be automatically assigned to the designated Scorer.

1. Click See Scoring Evaluation Assignments on the Scoring Rubric Status page.

2. A list of all Course Participants will be displayed. Users can be assigned individually or as a group. To associate a grader with an individual participant, click on Click to Assign next to the participant's name and select the Scorer. All Course users, including Admins and Participants, are eligible to score.

3. To associate multiple participants with a grader, select participants using the checkboxes to the left of their names and click Assign at the top right of the page.

All selected participants can be associated with the same grader for scoring or can be assigned to self-score their evaluations if desired.

4. Once assigned, the assignment list will display the status of the scoring rubric. The possible statuses are as follows:

• Waiting for participant: Waiting for the participant to complete the target evaluation.
• Assigned: The participant has completed their target evaluation, and the scoring rubric has been assigned to the Scorer to complete.
• In-progress: The Scorer has started grading the evaluation.
• Complete: The Scorer has submitted their evaluation.

Note: To re-assign a rubric, delete the rubric to be re-assigned and re-assign it to a new grader. 

Completing scoring rubrics

Scoring rubrics can be completed by either Administrators or other participants depending on the user assigned.

1. Administrators assigned scoring rubrics can complete them from a new pod on their homepage titled My Courses.

2. Clicking View Evals will direct the user to the list of all evaluations that need to be completed for that Course.

The list will display the evaluation title that needs to be scored. This learner completed the evaluation, the associated Scenario, the associated Session date and time (if applicable), and the date the evaluation was assigned, started, or completed.

3. Clicking on an evaluation will begin the completion of the rubric. The completion page will vary depending on if the evaluation has an associated session and if session videos were included as part of the scoring rubric.

Note: If session videos are included in the scoring rubric, they will only be visible while the rubric is being completed. Once the rubric is submitted, the user will need to have the session shared or released to view session videos moving forward.

Scoring rubric without session	Scoring rubric with session

Either option will include the target (learner) evaluation on the left and the scoring rubric that needs to be completed on the right. This allows the Scorer to complete their rubric while referencing the learner evaluation and session video if applicable.

4. Once complete, click Submit to submit the evaluation.

Releasing scoring rubrics

Once a scoring rubric is completed, it is released from the Course like any other evaluation and displayed indented under the evaluation to which it applies. When participants view their completed scoring rubric, they will see both the target and scoring rubric. They will not see the session video, even if it was included in the scoring rubric during completion.