The Question Analysis Report provides a detailed breakdown of how participants performed on each question within an evaluation. This tool helps identify which questions may need review or remediation and offers insights into question quality using statistical analysis.

What the Report Shows

• No Credit, Partial Credit, Full Credit counts for each question
• Mean Score per question
• Point-Biserial Correlation to assess question quality
• Color-coded performance indicators
• Downloadable Reports in Excel or PDF format

Accessing the Question Analysis Report

You can access the report in two ways:

Option 1: From the Reports Menu

1. Select Reports in the global navigation bar.
2. Under QUICKLINK, select Course Results.
3. Select Question Analysis from the Report dropdown.

Option 2: From a Course

1. Select Courses in the global navigation bar.
2. Select the course you want to view.
3. In the Results pod, select View Reports.
4. Choose Question Analysis from the Report dropdown.

Report Fields Explained

• Evaluation: Choose the evaluation you want to analyze. If a scenario filter is applied, only evaluations from that scenario will appear.
• Question Instruction & Question: Displays the full text of each question.
• Question Statistics:
  • No Credit / Partial Credit / Full Credit counts
  • Mean Score
  • Point-Biserial Correlation (indicates how well a question differentiates between high- and low-performing learners)
  • A visual indicator helps quickly identify questions needing review

Color Coding

• Red - No credit given
• Light Green - Partial credit
• Green - Full credit

Understanding Point-Biserial Correlation

This metric shows how well a question correlates with overall learner performance:

• Green: High correlation (good question)
• Yellow: Low correlation (may need review)
• N/A: Not enough data to calculate

You can also check "Count no answers as no credit" to include unanswered questions in the correlation calculation.

Answer Analysis

This section displays each question and its answer choices-ideal for Likert-style or multiple-choice evaluations.

• Evaluation: Select the evaluation to analyze.
• Answer Analysis Field: Shows:
  • Question text
  • Points available
  • Percent of users who chose each answer (with a visual bar)
  • Total count of responses

Filtering Options

• Scenario Filters: Narrow results by specific course scenarios.
• Evaluator/Evaluatee Filters: Search by evaluator or learner name.

Report Metadata

Each generated report includes:

• Report type (Question or Answer Analysis)
• Date generated
• Any filters applied (Scenario, Evaluator, Evaluatee)