Dynamic Exam Functionality

Is Dynamic Exams configuration compatible with other exam features?

• Yes - applying dynamic exams configuration will not affect any other feature. Review the features here.

 

Isn’t this the same functionality as randomization?

• Randomization allows for unique experiences per learner/attempt by presenting all of a test's questions in different orders. The Dynamic Exam experience makes it possible to include different questions in each attempt, enhancing the uniqueness further.

 

Does the order of the question family change?

• The question families will be presented in the order you specify, pulling randomly from their respective pools until reaching the number given under "slot_count".

 

How does the system pull questions from a question family? Is it random? 

• Questions are pulled at random each time. The system does not consider previous attempts or other data.

 

Will learners see any difference in their exam experience?

• No; if you would like to indicate/notify learners that their exam experience will be dynamic, we recommend including using BluePrint to include that detail in the Test Introduction field or in the Exam name.

 

Configuring Dynamic Exams

Can I make an existing exam dynamic?

• To preserve data integrity and not disrupt user experience for learners, we suggest implementing dynamic exams within a new test (within a new or existing course). Making an existing exam with live learners is not recommended.

 

Is it possible for only a portion of the questions to be set as Dynamic, or does the whole exam need to be Dynamic?

• The exam must be a full length exam and have sections in order for a portion of questions to be set as dynamic.  For example if the exam has a total of 4 sections you may only want 2 sections to be set as dynamic.  To do this, configure a spreadsheet that only has the desired sections and associated questions listed on it that you want to set as dynamic.  This way, only the desired sections and questions will be dynamic.  The remaining 2 sections will not be dynamic.

 

Before submitting a request to implement a Dynamic Exam, do my questions need to be associated to my exam?

• No, your questions do not need to be associated to the exam, as our script will take care of this. However, if they've already been associated, that won't be an issue, and we'll still be able to setup the Dynamic Exam for you.

 

What if I want to modify the question families, or add questions to the test?

• Questions can be added without impacting the dynamic experience, but such questions will be displayed on every attempt. Questions can also be deleted, as long as doing so does not reduce the number of questions in the family below the numeric value given under "slot_count" for that family. Any change to question-family membership must be submitted as a new request using an updated CSV covering the final desired state of all questions in the exam.

 

What happens to a dynamic exam once a question has been deleted?

• If a learner was presented with a question that has subsequently been deleted, the exam will return to the paused state. The learner will need to resume the exam and will be presented with another question in place of the deleted one.

 

Can Dynamic Exams be replicated?

• No, dynamic exams cannot be replicated since the set up process relies on question families IDs which are unique within each course.  Please submit a request with a formatted CSV if you would like to set up a dynamic exam within a replicated course. To learn more about the CSV and how to set it up, please click here.