The Course scores (Points) tab of the Gradebook report workbook will show the following:

Row 1: Contains the header labels Question Category and Scenario. 

Row 2: Contains the header labels Last Name, First Name, Email, User Number, Course Total, Possible Points, No Question Category, *All user defined question categories, *All scenarios in the course.

• Question Category columns should be sorted based on their sort values as defined in System Setup.
• Scenario columns should be sorted by their Course Item sort value, which is user defined.

Row 3: Contains Possible Points. Possible Points are the:

• Course total possible points.
• Total amount of points in each question category. This is the sum of the question values for each question in each evaluation template in the course per question category. This includes course and scenario evaluation templates.
• Total amount of points within each scenario.
• Sum of the question point values for each question in each evaluation template per scenario.

Row 4+: Contains the following:

• All rows from 3 and below will be an entry for one participant, sorted alphabetically by last name.
• Column A will be the participant's Last Name.
• Column B will be the participant's First Name.
• Column C will be the participant's Email.
• Column D will be the participant's User Number.
• Column E will be the participant's Course Total Points earned.
• Column F will be the participant's *Possible Points. 
• Column G will be the points earned by this User for the No Question Category.
• Column H onward will be the points earned by this User for each Question Category.

Columns immediately after the last Question Category will be points earned by this User for each scenario.

*Note: Possible points are defined as the sum of all question points values for all evaluation templates that this User has a submission for. For example, there is an evaluation (completed evaluation by the user or incomplete evaluation if the deadline for submission has passed). This value may not match other users' possible point values.

The Course scores (%) tab of the Gradebook report workbook will show the following:

Row 1: Contains the header labels Question Category and Scenario. 

Row 2: Contains the header labels Last Name, First Name, Email, User Number, Course Total, Possible Points, No Question Category, *All user defined question categories, *All scenarios in the course.

• Question Category columns should be sorted based on their sort values as defined in System Setup.
• Scenario columns should be sorted by their Course Item sort value, which is user defined with the exception that Scoring Rubrics will always be to the right of the parent evaluation.

Row 3+: Contains the following:

• All rows from 3 and below will be an entry for one participant, sorted alphabetically by last name.
• Column A will be the participant's Last Name.
• Column B will be the participant's First Name.
• Column C will be the participant's Email.
• Column D will be the participant's User Number.
• Column E will be the participant's Course Total percentage earned. This is defined as all points earned by the participant / all possible points that the individual participant could have earned.
• Column F will be the percentage score earned by this user for the No Question Category. This is defined as all points earned by the participant with No Question Category defined / all possible points the individual participant could have earned for No Question Category questions.
• Column G onward will be the percentage score earned by the participant in each Question Category / all possible points the individual participant could have earned for each Question category.

Columns immediately after the last Question Category will be the percentage score earned by this User for each scenario. This is defined as all points earned by the participant in each scenario/all possible points the individual participant could have earned for each scenario.

The Course stats tab of the Gradebook report workbook will show the following:

Row 1: Contains the header labels of Question Category, Course Evaluation, Scenario Items and Scenario.

• Course Evaluation is defined as all evaluations at the Course level not attached to a Scenario.
• Scenario Item is defined as all pre-evaluations, post evaluations, during session evaluations, monitor evaluations, standard patient evaluations, and scoring rubrics associated with a Scenario.

Row 2: Contains the header labels Stat, Course, No Question Category, All user defined question categories, *All Course evaluation templates in the course, and *All scenario evaluation templates in the course.

*Course evaluation columns should be sorted by their Course item sort value, which is user defined.

*Scenario evaluation template columns should be sorted by their scenario item sort value, which is user defined. Scoring rubrics should be moved to be in the column immediately to the right of their Target Evaluation template.

Non-scoring rubrics are sorted by their scenario item sort order and the scoring rubrics are then added into this order. The scoring rubrics order is not based on their own scenario item sort order in any way.

Row 3: Contains the following:

• Column A is the Mean (%).
• Column B is the mean of the Course.
• Column C is the mean score for the No Question Category.
• Column D+ is the mean score for the user defined question categories.
• Columns immediately after the last user defined question category will be the mean scores for all course evaluation templates in the course.
• Columns immediately after the last course evaluation templates will be the mean scores for all scenario evaluation templates in the course.

Mean Score

Mean score is the average percentage score for each user across a certain item.

• Example: Mean Score = SUM(user scores) / Number of Users
• This value is not in points but in percentages
• Each user's mean score should reflect their own total possible score which excludes evaluation templates for which they have no submitted evaluations.

Row 4: Contains the following:

• Column A is labeled Standard Deviation (%).
• Column B will be the standard deviation for the course. An example standard deviation calculation can be found in the Calculations section of the page.
• Column C will be the standard deviation for the No Question Category.
• Column D+ will be the standard deviation for user defined question categories.
• Columns immediately after the last user defined question category will be the standard deviation for course evaluation templates in the course.
• Columns immediately after the last course evaluation template will be the standard deviation for scenario templates in the course.

Row 5: Contains the following:

• Column A will be the Passing Cutoff (%).
• Column B will be the Passing Cutoff by percentage for the course.
• Column C will be N/A since the No Question Category cannot have a passing cutoff set.
• Column D+ will have the following for all user defined question categories:
  • A percentage value if one is set and non-zero.
  • N/A if one is not set or is 0 (zero).
• All columns after the last question category will be empty.
  • Evaluation templates cannot have a passing cutoff associated with them.

If passing cutoff is by standard deviation, stdev will be calculated and displayed as a percentage.

The Scenario stats tab of the Gradebook report workbook will show the following:

Row 1: Contains the header labels Question Category and Scenario Items.

Row 2: Contains the header labels Title, Stat, Scenario, Question Categories and Scenario Item titles.

• Column A: Contains the names of all scenarios in the course.
• Column B: Contains the stat (mean and stdev). Example calculations of mean and standard deviation are in the Calculations section of the page.
• Column C: Contains the mean and stdev for each scenario.
• Column D: Contains the mean and stdev for No Question Category applied.
• Column E onward: Contains the mean and stdev for each Question Category followed by the evaluation.

All numbers will be reported as percentages.

Note: Each scenario within the course will have its own tab within the Gradebook report.

The [Scenario Title] (Points) tab of the Gradebook report workbook will show the following:

Row 1: Contains the header labels Question Category and Scenario Items.

Row 2: Contains the header labels Last Name, First Name, Email, User Number, Scenario Total, Possible Points, followed by Question Category and Scenario Item Titles.

• Question Category columns should be sorted based on their sort value as defined in System Setup.
• Scenario evaluation template columns should be sorted by their scenario item sort value, which is user defined, and then scoring rubrics should be moved to be in the column immediately to the right of their Target Evaluation Template. 
• Non-scoring rubrics are sorted by their scenario item sort order and the scoring rubrics are then added into this order. The scoring rubrics order is not based on their own scenario item sort order in any way.

Row 3: Contains the possible points for the Scenario, each Question Category, and the Scenario Item. This is the total amount of points in each category.

Row 4: Contains the following: 

• Column A: Participant's Last Name. This information is sorted alphabetically.
• Column B: Participant's First Name.
• Column C: Participant's Email.
• Column D: Participant's usernumber (user number).
• Column E: Scenario Total:
  • Row 3 will be the total number of points in the scenario.
  • Row 4 and below will be the total number of points scored by that user.
• Column F: Possible Points
  • Row 3 will be the total number of points possible in the scenario.
  • Row 4 and below will be the total number of points that the user could possible score. This could be different if users were not assigned the same evaluations in the scenario.
• Column G onward: Contains question categories in that scenario.

The [Scenario Title] (%) tab of the Gradebook report workbook will show the following:

Row 1: Contains the header labels Question Category and Scenario Items.

Row 2: Contains the header labels Last Name, First Name, Email, User Number, Scenario Total, followed by Question Category and Scenario Item Titles.

• Question Category columns should be sorted based on their sort value as defined in System Setup.
• Scenario evaluation template columns should be sorted by their scenario item sort value, which is user defined, and then scoring rubrics should be moved to be in the column immediately to the right of their Target Evaluation Template. 
• Non-scoring rubrics are sorted by their scenario item sort order and the scoring rubrics are then added into this order. The scoring rubrics order is not based on their own scenario item sort order in any way.

Row 3: Contains the following:

• Column A: Participant's Last Name. This information is sorted alphabetically.
• Column B: Participant's First Name.
• Column C: Participant's Email.
• Column D: Participant's usernumber (user number).
• Column E: Scenario Total:
  • Row 3 will be the total percentage scored by that user.
• Column F onward: Contains question categories in that scenario.

The Report tab will be the final tab of the Gradebook report.

Row 1: Contains the report name.

Row 2: Contains the course name.

Row 3: Contains the number of participants in the Course.

Row 5: Contains the date and time the report was generated. (YYYY-MM-DD TIME)

Row 7: Contains the color coding legend.

Row 9 onward: Contains the Passing Cutoffs for the course and all Question Categories.

All calculations will be displayed in percentages.

The Calculations tab of the Gradebook report workbook will show the following:

Mean Example Calculation

Student 1: 60 / 110 points

Student 2: 75 / 100 points

Student 3: 90 / 120 points

Total possible points within the course is 120  but each student will be graded as a percentage of their total possible points.

Student 1: 55%

Student 2: 75%

Student 3: 81.82%

Mean Calculation = (54.55+75+81.82) / 3 = 70.46%

Standard Deviation Example Calculation

Mean = 70.46%

Find each participants score deviation from the mean

Student 1 : 54.55% - 70.46% = 15.91%

Student 2 : 75% - 70.46% = 4.54%

Student 3 : 81.82% - 70.46% = 11.36%

Square each deviation from the mean

Student 1 : 15.91*15.91 = 253.1281

Student 2 : 4.54*4.54 = 20.6116

Student 3 : 11.36*11.36 = 129.0496

Find the the sum of the squares

253.1281 + 20.6116 + 129.0496 = 402.7893

Find the variance

402.7893/3 = 134.2631

Find the square root of the variance

11.59