You are using an unsupported browser. Please update your browser to the latest version on or before July 31, 2020.
close
You are viewing the article in preview mode. It is not live at the moment.
Home > Manage Users & Settings > Console > Console Reporting > 8. BenchPrep Analytics in Console
8. BenchPrep Analytics in Console
print icon

We are actively making updates and improvements, and functionality or data may change as we continue development.

 

BenchPrep Analytics delivers faster, more customizable insights that help key stakeholders track learner progress, measure performance, and act with confidence.

 

By surfacing analytics at all levels—from individual learners to groups, courses, and branches—our dashboards give administrators, program managers, and instructors stronger visibility to make data-driven decisions that improve learning outcomes. 

 

The analytics experience is organized into several key sections, each designed to present data at a different level of granularity.

 

When reviewing Analytics Data keep in mind:
 

  • Access to analytics requires the Read Reports permission. You can only view data for programs and courses within your assigned scope.
  • All analytics data is displayed in UTC time and may differ from your local time zone.
  • The data is refreshed on hourly basis.
  • Analytics includes only users without administrative or custom roles. Users with these roles are excluded from reporting.

Analytics data is available across multiple areas in Console. The sections below outline where key data points can be found

 

Within the Manage Users section in Console: 

  • The Course Overview section of the User Detail page shows progress and performance data at the user level for any learners you have permission to view. The dashboard includes metrics such as total enrollments, average test scores, course progress, and more.
  • The Branch Dashboard Overview section of the Branch Detail page displays branch level data for customers who utilize our Enterprise Engine offering. The dashboard offers a comprehensive overview of progress and performance data specific to groups and learners within the selected branch.
  • The Group Overview section of the Group Detail page gives an overview of enrollment and performance data scoped to the selected group. The section offers a comprehensive overview of progress and performance data specific to the group in your access context.

 

Under the Analytics section in Console:

  • The Course Report dashboard gives a comprehensive view of course activity and performance. It provides detailed insights into exams, quizzes, and all learning modalities, along with learner engagement and outcomes.
  • The Sessions Detail Report dashboard houses the Session Report Table.  When the Sessions Report Table is enable it displays every time a learner accesses the platform, which course they open, and for how long the learner was in the course. 

 

Viewing User Insights

Users with a custom role with the “Read Users” and "Read Reports'' permissions will have access to the User Detail page and the Course Overview section, scoped to the level the role is assigned at.  Users with a Console Admin role will see all users in the tenant.

 

If you’re a Group Manager, Instructor, or have a custom role with group-level permissions, you’ll see learner data only for the group scope you have selected. To view learners in another group, simply switch your access context. To learn how to switch context between roles please click here.

 

To view data for learners under your purview, follow these steps:
 
Open Console and select Users under Manage Users, then select the learner you want to view.
 

Once selected the User’s Detail page will display an overview of the learner's licenses and the number of their enrollments, Exam Results and other data. To view additional details about the User Detail page click here.

 

 

When enabled the Course Overview section displays the following fields when the Course Table is enabled:

 

  • Course Name - Name of the course.
  • Course Progress - This data point displays course progress for each learner’s enrollment.  Course progress is determined by the Study Plan progress within the course. If a Study Plan is not used it is determined by the number of content items completed with the course divided by available content items.
  • Course Status - Not Started, In Progress, Completed, Expired.
  • Last Time Active - Displays the last time a learner completed an activity in the selected course.  An activity consists of taking action (i.e. completing, creating, editing, or deleting) for one of the following:
    • Confidence levels (lessons, flashcards, or questions)
    • Practice questions
    • Exams
    • Essays
    • Bookmarks
    • Highlights
    • Notes
    • Resets (practice questions or exams)
    • Continuous learning cycle (if applicable

 

The Course Overview Table is a sub-feature of the Course Overview Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export all data from this table.  Simply click on the Export button above the Name column and the CSV will be sent to you via email.

 

To view more data about a learner’s specific course click on any course.

 

Once you select a course you will be presented with additional course level information.

 

The Lessons tab when enabled displays the following fields when the Lessons Table is enabled: 

 

  • Lesson Name - Name of lesson.
  • Sub-Category name will display when drilling into the Lesson Name.
  • Course Progress - Displays Not Started if the learner has yet to make progress in the course.  Displays the percentage of the course the learner has completed once started and the number of lessons completed.  Course progress is determined by the Study Plan progress within the course. If a Study Plan is not used it is determined by the number of content items completed with the course divided by available content items.
  • Confidence Level - Displays the confidence level of the lesson i.e. high, medium, and low.
  • Last Completed At - Can be calculated at category level, sub-category level, and at the lesson level.  At the category level, it displays the last time a lesson was completed within that category. At the sub-category level, it displays the last time a lesson within that specific sub-category was last completed. At the lesson level, it displays the most recent completion date of the lesson.

 

The Lessons Table is a sub-feature of the Lessons Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export the data from this page.  Simply click on the Export button above the Name column and the CSV will be generated and sent to you via email.

 

When the Exam tab is enabled it displays the following fields when the Exam Table Report is enabled:

 

  • Name - Name of exam.
  • Exam Section - If applicable will display the name of the sections in the exam.
  • Category - List the question categories when expanding the table.
  • Exam Progress - Displays the state of the exam, i.e. Not Started, Paused, and Completed.
  • Last Score - The most recent score from the learner’s most recent exam attempt.
  • Attempts - Total number of attempts the learner has attempted, including exam resets.
  • Last Attempt - The last date the learner attempted the exam.

 

The Exam Reports Table is a sub-feature of the Exam Report Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export data from the Exam Report Table.  Simply click on the Export button above the Name column and the CSV will automatically download.

 

The Exam Tab also displays a listing widget that displays the Categories with the most incorrect questions for a quick overview of the top 5 questions categories with the most incorrect corrections.  The widget will display the name of the categories and how many questions were missed in the category.  This provides a quick overview of question category performances.

 

 

 

When the Exam Report User Attempts Chart is enabled it will display in the Exam Tab.  The Exam Report User Attempt Chart displays the number of attempts the user had on their exams and their score for that attempt.  Only completed attempts are included.  If an exam is paused, then was reset the attempt will not be included in the count or in the calculation.

 

The Exam Report User Attempt Chart is a sub-feature of the Exam Report Tab, to learn more about how to manage this feature please click here.

 

 

You also have the ability to Export data from this page.  Simply click on the Export button above the Name column and the CSV will automatically download.

 

The Exam Tab can also display the Exam Attempts Table when enabled.  Only completed attempts are included.  If an exam is paused, then was reset the attempt will not be included in the count or in the calculation.  The Exam Attempts table will display the following fields:

  • Name - Name of the exam.
  • % Correct - The percentage of questions the learner correctly answered.
  • Attempted At - Displays the time the exam was attempted.
  • Attempted # - Displays the number of attempts

 

The Exam Report Attempts Table is a sub-feature of the Exam Report Tab, to learn more about how to manage this feature please click here.

 

The Practice tab displays the following fields when the Practice Table is enabled:

 

  • Name - The question category name.
  • Questions Taken - The number of questions taken in the category or sub category.
  • Percentage Correct - Percentage of questions answered correctly.
  • Last Attempt - The date the user last attempted Practice questions in the Question Category or Sub Category.

 

The Practice Table is a sub-feature of the Practice Report Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export the data from the Practice Table.  Simply click on the Export button above the Name column and the CSV will be generated and sent to you via email.

 

The Practice Tab also displays a listing widget that displays the Categories with the most incorrect questions for a quick overview of the top 5 questions categories with the most incorrect corrections.  The widget will display the name of the categories and how many questions were missed in that category.  This provides a quick overview of question category performances.

 

 

The Practice Tab can also display a listing widget that displays the Most Incorrect Tags List. Which is similar to the Categories with the 5 most incorrect questions but it displays the top lowest performing questions based on tags.  The widget will display the name of the tags and how many questions were missed that were associated to the tag.

 

 

The Most Incorrect Tags List is a sub-feature of the Practice Tab, to learn more about how to manage this feature please click here.

 

When the Curriculum tab is enabled it displays multiple sub-features.  When the Curriculum Report Table is enabled the following fields will display in the Curriculum Report Table:
 

  • Name - Name of the Curriculum.  When drilling down into the curriculum it will display the name of the tasks within the curriculum.
  • Task Type - Displays the type of task the learner completed like lessons, Exams, and Practice Questions.
  • Score - Displays the learner's score on the curriculum or task.
  • Total Time Spent - Is the total time the learner spent in the curriculum.
  • Last Completed At - Displays the date a learner last completed a task.

The Curriculum Table is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab can also display the Total Task Completed in the curriculum.  Any task the learner has completed will display in the count for Total Task Completed.  Incomplete task will not display in the data point.

 

The Total Task Completed is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab will also display the Average Test Score of the learner.  The percentage shown is the average score the leaner received after completing any tests within the curriculum.  Paused tests are not factored into the average test score.  

 

 

The Avg. Test Score is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab will also display the Average Practice Score of the learner.  The percentage shown is the average score the leaner received after completing any practice questions within the curriculum.

 

The Avg. Practice Score is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab will also display the External Packages of the learner.  The percentage shown is the average progress across all external packages. 

 

The External Packages is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

To navigate back to the learner’s courses click on the Course Overview link above the Lesson, Exam, and Practice tab.

 

 

Viewing Branch Insights

Users with a custom role with the “Read Branches” and "Read Reports'' permissions will have access to the Branch Detail page and the Groups Overview and User Detail Breakdown tabs, scoped to the level the role is assigned at. Users with a Console Admin role will see all users in the tenant.

 

If you’re a Group Manager, an Instructor of multiple groups, or have custom roles with group-level permissions, you’ll see learner data only for the group scope you have selected. To view learners in another group, simply switch your access context. To learn how to switch context between roles please click here.

 

To view data for a Branch under your purview, follow these steps:

 

Open Console and select Branches under Manage Users, then use the filter to select the Branch you want to view.

 

 

 

The Branch Detail page will display an overview of the branch's details.  To learn more the branch details and managing branches click here.

 

The Group Overview section will display following fields when the Group Table is enabled:

 

  • Name - Name of the group. 
  • Enrolled Users - Number of enrolled learners in a group.
  • Avg. Course Progress - Average course progress by all learners in each group.   Course progress is determined by the Study Plan progress within the course. If a Study Plan is not used it is determined by the number of content items completed with the course divided by available content items.
  • Avg. Exam Score - Displays the average exam scores (factoring “percent correct” score from exams in started, paused and completed states, including reset exams), averaged across all enrollments for each group. 
  • Avg. Practice Score -  Averages out the practice scores across all learners in the group. The calculation involves taking the sum of practice scores, which includes correct, incomplete, and total answers recorded in practice sessions, and dividing it by the total number of practice sessions. This average is calculated across all enrollments within the group.
  • Last Time Active - Displays the last time a learner completed an activity in the selected group.  An activity consists of taking action (i.e. completing, creating, editing, or deleting) for one of the following:
    • Confidence levels (lessons, flashcards, or questions)
    • Practice questions
    • Exams
    • Essays
    • Bookmarks
    • Highlights
    • Notes
    • Resets (practice questions or exams)
    • Continuous learning cycle (if applicable 

 

The Group Table is a sub-feature of the Group Overview Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export the data from this page.  Simply click on the Export button above the Name column and the CSV will be generated and sent to you via email.

 

To view more data about the learners in a Branch click on the User Detail Breakdown.  The User Detail Breakdown displays data for all learners within the branch when the User Table is enabled.

 

The User Detail Breakdown page displays the following fields:

 

  • Name - Name of the learner.
  • Avg. Course Progress - Average of all course progress completed by the learner.  Course progress is determined by the Study Plan progress within the course. If a Study Plan is not used it is determined by the number of content items completed with the course divided by available content items.
  • Avg. Exam Score - Displays the average exam scores (factoring “percent correct” score from exams in started, paused and completed states, including reset exams) for all exams taken by the learner.
  • Avg. Practice Score - Averages out the practice scores for a learner in the Branch. The calculation involves taking the sum of practice scores, which includes correct, incomplete, and total answers recorded in practice sessions, and dividing it by the total number of all practice sessions completed by the learner.
  • Avg. External Asset Score - Reports an average score from all learner attempts on all SCORM, xAPI, AICC, PDF external assets, including re-attempts/re-launches.
  • Last Time Active - Displays the last time a learner completed an activity in the selected group.  An activity consists of taking action (i.e. completing, creating, editing, or deleting) for one of the following:
    • Confidence levels (lessons, flashcards, or questions)
    • Practice questions
    • Exams
    • Essays
    • Bookmarks
    • Highlights
    • Notes
    • Resets (practice questions or exams)
    • Continuous learning cycle (if applicable)

 

The Users Table is a sub-feature of the User Detail Breakdown Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export the data from this page.  Simply click on the Export button above the Name column and the CSV will be generated and sent to you via email.

 

Viewing Group Insights

Users with a custom role with the “Read Groups” and "Read Reports'' permissions will have access to the Group Detail page and the User Detail Breakdown section, scoped to the level the role is assigned at. Users with a Console Admin role will see all users in the tenant.

 

If you’re a Group Manager, an Instructor of multiple groups, or have custom roles with group-level permissions, you’ll see learner data only for the group scope you have selected. To view learners in another group, simply switch your access context. To learn how to switch context between roles please click here.

 

To view data for Groups under your purview, follow these steps:

 

Open Console and select Groups under Manage Users, then select the Group you want to view.

 

 

The Group Details page will display information about the selected group.  To learn more about the Group Details page click here.

 

Below the Branch membership the group’s user data will display in the User Details Breakdown section when the Users Table is enabled.

 

The User Detail Breakdown tab displays the following fields:

 

  • Name - Displays learners name.
  • Avg. Course Progress - This column displays average course progress, calculated by averaging progress across all learner’s enrollments within the group.  Course progress is determined by the Study Plan progress within the course. If a Study Plan is not used it is determined by the number of content items completed with the course divided by available content items. 
  • Avg. Exam Score - Displays the average exam scores (factoring “percent correct” score from exams in started, paused and completed states, including reset exams), averaged across all enrollments within the group. 
  • Avg. Practice Score - Averages the practice scores across all learners in the group. The calculation involves taking the sum of practice scores, which includes correct, incomplete, and total answers recorded in practice sessions, and dividing it by the total number of practice sessions. This average is calculated across all enrollments within the group.
  • Avg. External Asset Score -  Reports an average score from all learner attempts on SCORM, xAPI, AICC, PDF external assets, including re-attempts/re-launches.
  • Last Time Active - Displays the last time a learner completed an activity in the selected Branch.  An activity consists of taking action (i.e. completing, creating, editing, or deleting) for one of the following:
    • Confidence levels (lessons, flashcards, or questions)
    • Practice questions
    • Exams
    • Essays
    • Bookmarks
    • Highlights
    • Notes
    • Resets (practice questions or exams)
    • Continuous learning cycle (if applicable)

 

The Users Table is a sub-feature of the User Detail Breakdown Tab, to learn more about how to manage this feature please click here.

 

Viewing Course Report Insights

This Course Report delivers a complete picture of course performance, including exam and quiz results, learner engagement, and progress across all learning formats — providing instructors with the insights they need to guide success.


In order to view the Course Reports tab you must have a custom role with “Read Reports” and Read Content Package” permissions.  Users with a Console Admin role will see all courses in a tenant. 


If you manage multiple branches and groups (users with Branch Manager, Group Manager role or any other custom role with applicable permissions assigned at Branch and Group access context) the Course Report Dashboard will automatically display the courses associated with the branches and groups you oversee, eliminating the need to switch access contexts to view data for each group individually.
 

To view the Course Report please click on Analytics and then select Course Reports.

 

 

The Course Report section displays the following fields when the Course Report Table is enabled:

 

  • Course Name - Name of the course.
  • Average Course Completion - The average course completion % for all active learners with active course enrollment.
  • Branches - Number of branches with access to the course.
  • Groups - Number of groups with access to the course.
  • Total Enrolled Users - Total number of active learners with active course enrollment learners enrolled in the course.

 

The Course Report Table is a sub-feature of the Course Overview Tab, to learn more about how to manage this feature please click here.

 

You also have the ability to Export all data from this page.  Simply click on the Export button above the Name column and the CSV will automatically download.

 

Select any course to view more data about learners associated with the course.   Once you have selected a course the User Report Tab, Exam Report Tab, and the Practice Report Tab will display when enabled.   To learn more about managing these features click here.

 

 

You also have the ability to filter each tab by groups.  To filter the tabs by groups click on the filter and then select the group you want to view.

 

 

The User Report Tab displays the following fields when the User Report Table is enabled:

 

  • Name - Name of the learner.
  • Course Progress - Displays the avg. course progress for the learner in the selected course.   Course progress is determined by the Study Plan progress within the course. If a Study Plan is not used it is determined by the number of content items completed with the course divided by available content items.
  • Avg. Exam Score -Displays the average exam scores (factoring “percent correct” score from exams in started, paused and completed states, including reset exams) for all exams taken by the learner.
  • Avg. Practice Score - Averages out the practice scores for the learner in the course. The calculation involves taking the sum of practice scores, which includes correct, incomplete, and total answers recorded in practice sessions, and dividing it by the total number of practice sessions.
  • Time Spent - Based on the learner’s active sessions.
  • Last Time Active - Displays the last time a learner completed an activity in the selected Branch.  An activity consists of taking action (i.e. completing, creating, editing, or deleting) for one of the following:
    • Confidence levels (lessons, flashcards, or questions)
    • Practice questions
    • Exams
    • Essays
    • Bookmarks
    • Highlights
    • Notes
    • Resets (practice questions or exams)
    • Continuous learning cycle (if applicable)

 

The User Report Tab is a sub-feature of the Course Overview Tab, and the User Report Table is a sub-feature of the User Report Tab to learn more about how to manage these features please click here.

 

The Exam Report Tab displays the following fields when the Exam Report Table is enabled:

 

  • Name - Name of the exam.
  • Avg. Score - Displays the average exam scores (factoring “percent correct” score from exams in started, paused and completed states, inclusive of reset exams) for all learners in this course. 
  • # of learners taken - The number of learners that have taken the exam.
  • Last Attempt - Displays the date a learner within your scope context last attempted the exam. 

When you expand the Exams it will display questions the users have taken when expanded.  These questions display the same columns as the Exam Report Table.

 

The Exam Tab also displays a listing widget that displays the Categories with the most incorrect questions for a quick overview of the top 5 questions categories with the most incorrect corrections.  The widget will display the name of the categories and how many questions were missed in the category.  This provides a quick overview of question category performances.

 

The Exam Report Tab will also display a date range filter allowing a user to customize the data they are viewing.  The Exam Report date filter is set to display the last 30 days by default.

 

The Exam Report Tab is a sub-feature of the Course Overview Tab, and the Exam Report Table is a sub-feature of the Exam Report Tab to learn more about how to manage these features please click here.

 

The Practice Report Tab displays the following fields when the Practice Report Table is enabled:

 

  • Name - The question category name. Including Parent and child categories.
  • Questions Taken - The number of questions taken in the category or sub category.
  • Percentage Correct - Percentage of questions answered correctly.
  • Last Attempt - The date the user last attempted Practice questions in the Question Category or Sub Category.

 

The Practice Report Tab also displays a listing widget that displays the Categories with the most incorrect questions for a quick overview of the top 5 questions categories with the most incorrect corrections.  The widget will display the name of the categories and how many questions were missed in the category.  This provides a quick overview of question category performances.

The Practice Report Tab is a sub-feature of the Course Overview Tab, and the Practice Report Table is a sub-feature of the Exam Report Tab to learn more about how to manage these features please click here.

 

The Curriculums Report Tab displays the following fields when the Curriculum Report Table is enabled:

 

  • Name - Name of the Curriculum.  When drilling down into the curriculum it will display the name of the tasks within the curriculum.
  • # of Students Completed - displays the total number of learners who have completed the curriculum.
  • Task Type - Displays the type of task the user completed like lesson, Exam, and Practice.
  • Avg. Score - Displays the average score of all learners who completed the task.
  • Total Time Spent - Is the total time spent for all learners on the curriculum.
  • Assigned At - Displays the date the task was assigned.
  • Last Completed At - Displays the date a learner last completed the task
  • When viewing the Curriculum Report Table you have the ability to expand the Curriculum and view individual task within the curriculum.

 

The Total Task Completed is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab will also display the Average Test Score of the learner.  The percentage shown is the average score the leaner received after completing any tests within the curriculum.  Paused tests are not factored into the average test score.  

 

 

The Avg. Test Score is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab will also display the Average Practice Score of the learner.  The percentage shown is the average score the leaner received after completing any practice questions within the curriculum.

 

The Avg. Practice Score is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

The Curriculum Tab will also display the External Packages of the learner.  The percentage shown is the average progress across all external packages. 

 

The External Packages is a sub-feature of the Curriculum Tab, to learn more about how to manage this feature please click here.

 

Viewing Session Details Report

To view the Session Details Report please click on Analytics and then select Session Detail Reports.

 

The Session Details Report is a feature access of the Analytics tab in Console.  The Session Details Report section reports every time a student accesses the platform, which course they open, and for how long.

 

To learn more about the Session Details Report and how to manage the feature click here.

 

In order to view the Session Details Report tab you must have a custom role with “Read Reports”  permission.  Users with a Console Admin role will see all reports within the Analytics section.

 

The Session Detail Reports displays the Session Details Table when enabled.  The table can be filtered by the following:

  • Content Packages
  • Branches
  • Groups
  • User
  • Start Date and End Date (by default the filter will display the last 30 days).

When enabled the Sessions Detail Table will display in the Session Detail Report tab.  The Sessions Detail Table is a sub-feature of the Session Detail Report tab.  To learn more about how to manage this sub-feature click here.

 

The Session Details Report displays the following data points in the Session Detail Table:

  • Name - Name of user for recorded session.
  • Course - Name of course session took place in.
  • Start Time - Time the session begins. (displays in UTC)
  • End Time - Time the session ends. (displays in UTC)
  • Total Duration - Total time user spent in the session. The Total Duration displays in minutes.

You also have the ability to Export all data from this table.  Simply click on the Export button above the Name column and the CSV will be sent to you via email.

 

The Session Details Report also has 2 additional sub-features that will be displayed when enabled.  These sub-features are Sessions Report - Total Number of Sessions Data Point and Sessions Report - Total Time Spent Data Point.

 

The Total Number of Session Data Point displays the total number of combined sessions for all users and will display above the Sessions Detail Table.

 

The Total Time Spent will display the total duration for all sessions for all users.  This time is displayed in hours and minutes and will display above the Sessions Details Table.

 

 

 

 

 

 

 

 

 

Feedback
0 out of 0 found this helpful

scroll to top icon