What is a scoring rubric?

A Scoring evaluation/rubric is a type of evaluation that uses another evaluation as its base for grading. These are very flexible and can effectively assign scores to evaluations that SimCapture cannot automatically score (like free-text questions or EMR forms) or as a supplement to a graded evaluation to give more context to that score.

Scoring evaluations are available for all Scenario evaluation types that learners complete. This currently includes the following evaluation types:

• Before Session
• After Session
• Learner Exam Flow
• EMR

Note: Scoring rubrics do not directly score their target evaluations and are treated separately in reports and releasing. This means that a student could receive a score for the target evaluation and the scoring rubric.

Create a scoring rubric

1. Check the Scoring Rubric box from the Scenario Evaluation configuration screen under the evaluation you wish to attach the scoring rubric to and click Confirm.

2. Click on Create Scoring Rubric in the Evaluations pod of your Scenario.

3. On the Scoring Rubric details page, click Add questions to create your evaluation.

3A. If associating a scoring rubric with an after-session or exam flow evaluation, there will be additional options to include a session video or to make scoring anonymous. 

• If included session video is selected, when the scoring rubric is completed, the evaluator will have access to both the target evaluation and its associated session video.
• If anonymous is selected, it will hide the name of the learner being evaluated from the evaluation completion screen so the grader does not know the identity of the user being graded. This does not make the evaluation anonymous from the Course Administration screens - results will still be tied to the user who completed the evaluation. 

Assign a scoring rubric

Scoring rubrics are assigned by associating a grader with a Course Participant. This can be done at any time, and once the participant completes the associated evaluation, the grading rubric will be automatically assigned to the designated Scorer.

1. Click on See Scoring Evaluation Assignments on the Scoring Rubric Status page.

2. A list of all Course Participants will be displayed. Users can be assigned individually or as a group. 

2a. To associate a grader with an individual participant, click on Click to Assign next to the participant's name and select the Scorer. All Course users, including Admins and Participants, are eligible to score.

2b. To associate multiple participants with a grader, select participants using the checkboxes to the left of their names and click Assign at the top right of the page.

All selected participants can be associated with the same grader for scoring or assigned to self-score their evaluations if desired.

3. Once assigned, the assignment list will display the status of the scoring rubric. The possible statuses are as follows:

• Waiting for participant: Waiting for the participant to complete the target evaluation.
• Assigned: The participant has completed their target evaluation, and the scoring rubric has been assigned to the Scorer to complete.
• In progress: The Scorer has started grading the evaluation.
• Complete: The Scorer has submitted their evaluation.

Complete a scoring rubric

Scoring rubrics can be completed by either Administrators or other participants depending on the user assigned.

1. Administrators assigned scoring rubrics can complete them from a new pod on their homepage titled My Courses.

2. Clicking View Evals will direct the user to the list of all evaluations that need to be completed for that Course.

The list will display the evaluation title that needs to be scored. This learner completed the evaluation, the associated Scenario, the associated Session date, the time (if applicable), and the date the evaluation was assigned, started, or completed.

3. Clicking an evaluation will begin the completion of the rubric. The completion page will vary depending on whether the evaluation has an associated session and if session videos were included in the scoring rubric.

Note: If session videos are included in the scoring rubric, they will only be visible while the rubric is being completed. Once the rubric is submitted, the user will need to have the session shared or released to view session videos moving forward.

Scoring rubric without session	Scoring rubric with session

Either option will include the target (learner) evaluation on the left and the scoring rubric that needs to be completed on the right. If applicable, this allows the Scorer to complete their rubric while referencing the learner evaluation and session video.

4. Once complete, click Submit to submit the evaluation.

Release a scoring rubric

Once a scoring rubric is completed, it is released from the Course like any other evaluation and will be displayed indented under the evaluation to which it applies. When participants view their completed scoring rubric, they will see both the target and scoring rubric. They will not see the session video, even if it was included in the scoring rubric during completion.