The Question Analysis Report and Answer Analysis Report provide detailed insights into learner performance at the question level. These reports help administrators evaluate question quality, identify knowledge gaps, analyze response trends, and improve evaluations over time.

What the Reports Show

Question Analysis

The Question Analysis Report provides a statistical breakdown of learner performance for each question in an evaluation.

For each question, the report includes:

• Scoring distribution:
  • No Credit
  • Partial Credit
  • Full Credit
• Mean score
• Point-Biserial Correlation
• Color-coded performance indicators
• Downloadable Excel and PDF reports

Answer Analysis

The Answer Analysis Report focuses on how learners answered individual questions.

This report displays:

• Question text
• Available points
• Percentage of learners selecting each answer
• Visual response distributions
• Total response counts

This view is particularly useful for Likert-scale and multiple-choice questions, helping identify confusing answer choices or unexpected response patterns.

Accessing the Reports

You can access the Question Analysis and Answer Analysis reports in two ways.

Option 1: From the Reports Menu

1. Select Reports from the global navigation.
2. Under QuickLink , select Course Results .
3. Choose Question Analysis or Answer Analysis from the Report dropdown.

Option 2: From a Course

1. Select Courses from the global navigation.
2. Open the course you want to review.
3. Select View Results .
4. Choose Question Analysis or Answer Analysis from the Report dropdown.

Report Filters

Use filters to focus on specific evaluations, evaluators, or learners.

Evaluation Filter

• Select the evaluation you want to analyze.
• If a Scenario filter is applied, only evaluations associated with that scenario are available.

Evaluator Filter

Use the Evaluator filter to view results from evaluations completed by a specific evaluator.

• Searchable single-select dropdown
• Users are listed alphabetically by first name
• Includes all users who have completed evaluations within the current course
  • Participants
  • Administrators
• Selecting an evaluator displays only results from evaluations that user completed

Example

If an instructor completed evaluations for multiple learners, selecting that instructor in the Evaluator filter displays only responses submitted by that instructor.

Evaluatee Filter

Use the Evaluatee filter to view results for a specific learner who was evaluated.

• Searchable single-select dropdown
• Users are listed alphabetically by first name
• Includes course participants within the current course
• Selecting an evaluatee displays only evaluations associated with that learner

Example

If several instructors evaluated the same learner, selecting that learner displays all evaluation results associated with that learner.

Report Fields Explained

Question Content

Question Instruction & Question

Displays the full question text exactly as it appears within the evaluation.

Question Statistics

For each question, you'll see:

• No Credit count
• Partial Credit count
• Full Credit count
• Mean Score
• Point-Biserial Correlation

These metrics help determine how learners performed and whether a question effectively differentiates stronger performers from weaker performers.

Color-Coded Scoring Indicators

Question performance is displayed using color-coded indicators.

These visual indicators help identify questions that may require review.

Understanding Point-Biserial Correlation

The Point-Biserial Correlation measures how well a question distinguishes between high-performing and low-performing learners.

Optional Setting

Count no answers as no credit

When enabled, unanswered questions are treated as No Credit when calculating Point-Biserial Correlation. This can affect results for optional or skipped questions.

Answer Analysis

The Answer Analysis report helps you understand how learners responded to individual questions.

For each answer option, the report displays:

• Response percentage
• Visual response bar
• Response count
• Available points

Use this data to:

• Identify confusing answer choices
• Evaluate distractor effectiveness
• Detect unexpected response patterns
• Improve future evaluations

Report Metadata

Downloaded reports include:

• Report type (Question Analysis or Answer Analysis)
• Date generated
• Selected evaluation
• Applied filters:
  • Scenario
  • Evaluator
  • Evaluatee

When to Use Each Report

Use Question Analysis when you want to:

• Evaluate question quality
• Identify difficult questions
• Review learner performance trends
• Analyze Point-Biserial statistics

Use Answer Analysis when you want to:

• Analyze answer selection patterns
• Review Likert-scale responses
• Validate answer choices
• Understand how learners responded to individual questions