The Utilization Dashboard presents timely data around end user usage at the tenant level, in aggregate, and in relation to specific learning activities, locations, and more. This dashboard is scoped to the level of permissions your account has.

 

The dashboard is accessible via Console to admin users and users with the following permissions assigned: 

• read:usage_dashboard permission
• access console permission (checked by default)
• read:roles permission (checked by default)
• read:permissions permission (checked by default)
   

All four permissions must be assigned to the user's role to access the Utilization Dashboard. 

 

Click here to learn how to create a custom Console role. 

 

The data automatically refreshes daily at midnight Central Standard Time (CST).

Filtering options

Left-hand side dashboard filters allow you to skope your data accordingly.

At the widget level, you can select:

The Full Screen icon to display a specific report in full screen mode. NOTE: You can utilize respective widget-level filters applicable to a specific report within this mode.

The Download - three dot icon allows you to download your data point. Download instructions can be found here.

Viewing Utilization Dashboard Data

To view the Utilization Dashboard, follow these steps:

1. Open Console and select Analytics, then select Utilization Dashboard.
2. The page will show all of the available reports within the specific dashboard. Beneath a report title is a brief description of each report to provide additional information on the specific report. 

Program Usage Overview
The Program Usage - Overview section presents a complete set of aggregated data, tailored to your account's permission level. The graphs below this section do not adjust according to the By Course filter on the left-hand side. 
 

 

The Users with Activities This Month datapoint displays the number total users that completed at least one activity in the current month. An activity consists of taking action (i.e. completing, creating, editing, or deleting) on one of the following: Confidence levels (lessons, flashcards, or questions), practice questions, exams, assignments, bookmarks, highlights, notes, resets (practice questions or exams), continuous learning cycle (if applicable).

 

The New Enrollments datapoint displays total new enrollments in the current month.  

The How many users have logged in? chart displays the total number of user logins by month and averages logins per user per month. Slide the horizontal bar to modify your data range. 

 

The How many learners use the platform (in aggregate)? chart displays total unique Active Users per month, across all courses. An active user is a user with at least one activity in a course. An activity consists of taking action (i.e. completing, creating, editing, or deleting) on one of the following: Confidence levels (lessons, flashcards, or questions), practice questions, exams, assignments, bookmarks, highlights, notes, resets (practice questions or exams), continuous learning cycle (if applicable).

The chart also displays total New Enrollments, per month, across all courses. An enrollment refers to having access to a course, without factoring in whether the user interacts with or takes any action within the course.

 

 

Program Usage - (Filter by Course) 
The Program Usage - (Filter by Course) section provides further insight into aggregated data, tailored to your account's permission level. The graphs below this section can be adjusted according to all filters on the left-hand side. 

 

The How many learners use the platform per course per month? chart displays the following:

• Course ID:
• Course Name
• Date
• Active Learners - An active user is a user with at least one activity in a course. An activity consists of taking action (i.e. completing, creating, editing, or deleting) on one of the following: Confidence levels (lessons, flashcards, or questions), practice questions, exams, assignments, bookmarks, highlights, notes, resets (practice questions or exams), continuous learning cycle (if applicable).
• New Enrollments - A new enrollment refers to having access to a course, without factoring in whether the user interacts with or takes any action within the course.

 

The How many learners use the platform on average? chart displays Avg. Active Users in a current month. An active user is a user with at least one activity in a course. An activity consists of taking action (i.e. completing, creating, editing, or deleting) on one of the following: Confidence levels (lessons, flashcards, or questions), practice questions, exams, assignments, bookmarks, highlights, notes, resets (practice questions or exams), continuous learning cycle (if applicable). The average is calculated by counting the number of Active Users in a course and dividing the sum by the number of courses users accessed. For example, if there were 500 active users across 20 courses in a month, the average would be 25 active users that month. 

The chart also displays Avg. New Enrollments, perm month across all courses. An enrollment refers to having access to a course, without factoring in whether the user interacts with or takes any action within the course.  The average is calculated by counting the number of New Enrollments and dividing the sum by the number of courses. 

 

The Are learners happy with the platform? chart displays the total number of course reviews by score and average score. Review score is collected by users who opt to click on the ‘Rate & review this course!” link listed on the Home page within a course. 

 

The How long do users spend studying? chart shows the average time each user spent in study sessions. It's calculated by dividing the total study session time by the number of unique users who participated in a session. The data only includes active session time and excludes any sessions with unusually long durations.

 

The How often do learners study? chart shows how many average study sessions were started and the average duration of those sessions. 

The "Are learners likely to recommend the course to others?" chart shows the results of the NPS survey. The Net Promoter Score (NPS) gauges learner engagement by classifying them as detractors, passives, or promoters based on their response to the question, "How likely are you to recommend this course to a friend?"

The Are learners retained over time? chart represents the percentage of users who completed an activity during the month (shown on the y-axis) and the activity range, months retained (shown on the x-axis). 

 

 

The With which exam questions do learners struggle? graph displays the average percent correct for test question categories against the average time taken to answer questions within the categories.  Each question category is indicated by a different color. 

 

The How many exams do learners take? graph displays exam specific data.  Exams completed represents completed exam attempts including reset attempts. 

The How do learners score on exams? chart represents the number of exam attempts (completed exams, excluding resets) and average exam score (including scores on reset exam attempts and on incomplete exam attempts). 

 

The Which Exam topics take learners the longest? boxplot displays the distribution of time taken on exam questions by topic. 

 

The Which lesson topics do learners study the most? chart shows total confidence level ratings marked by lesson category and by confidence rating (Low, Medium, High).

 

The Which question topics do learners study the most? chart displays correct and incorrect answers for practice questions and exams, grouped by question category. Reset questions are included. 

 

The How much do learners interact with questions? chart shows the total number of questions answered and the average number of questions answered per user for both practice and exam questions (including resets) by month. Every attempt is counted, so if a user answers the same question 5 times, it will count as 5 answers.

 

The How are learners spending their time? pie chart displays the time a user spends in different areas of the platform during a study session, such as discussions, exams, flashcards, games, quizzes, readings, and study plans. Study sessions end after 15 minutes of inactivity -if a user is inactive for 15 minutes or longer, that study session will not count in the calculation.  

In the pie chart, "Others" groups less common activities that take up smaller amounts of study time (i.e. discussions, messages, study plan review). You can click on the "Others" section to see a detailed breakdown of these activities.

 

 

The Does device type affect learner engagement? graph shows where users spend their time on the platform, based on the modality they visit (i.e Flashcards, Practice, Discussions, etc.) and the device they use. This is displayed as a percentage of all study sessions started on each device type.

 

 

The Does learner performance align with perceived confidence? chart compares the average percentage of correct answers on exam and practice questions with a learner's confidence level. The "Percent Correct" is calculated by dividing the number of correct answers by the total number of answers.

The "Confidence Coefficient" measures how confident a learner feels about the content, based on ratings they give (Low, Medium, or High) for lessons, questions, and flashcards. Each rating is weighted: Low = 0%, Medium = 50%, and High = 100%.  The calculation combines the percentage of correct practice and exam answers with the average confidence score from flashcards and lessons for each topic.