Knowledgebase: Online Assessment
Delivering Remote Exams

Article Last Updated April 2021

This article outlines best practices and suggestions for delivering fully remote exams using the eClass quiz activity.

Fully remote online exam delivery poses several challenges both from the academic honesty side and from the practical side as students are new to this style of exam. These challenges are discussed in detail in Assessment of Remote Learning under Exceptional Circumstances which recommends that alternative assessments or open-book, flexible eClass quizzes are used. Instructors should consult CTL to restructure assessments for this format while ensuring learning outcomes are being met. CTL has posted 2 great videos on this topic: 1) discussing alternatives to closed-book final exams; and 2) a guide to creating Open Book Exams (OBEs).

The following guidelines apply to setting up quizzes for these and other scenarios.

 

Constructing Quizzes for Remote Exam Delivery

  • One question per page where possible

    Switching between pages in a quiz forces data to be saved to eClass every time a student navigates between pages, minimizing data loss in the event a student's internet connection drops. Whenever possible, construct quizzes so that there is only question per page. If several questions refer to the same material (for example a diagram, case study, or written problem), these can be constructed as a single page but these should be limited to 3 or 4 questions with a repeated copy of the information provided on a second page for further questions. If long form answers (essay questions) are required for the same material, these should be split onto single pages with the preparatory material repeated on each page.

  • Avoid sequential navigation

Under a quiz 'Layout' settings, it is possible to set Navigation to Sequential. This should be avoided as it only allows the students 1 view of a question and they can never navigate back to it. The default (and by far the most commonly used) Navigation selection is Free which allows students to flag questions and return to them if necessary just as they would in a paper exam. Changing this setting to sequential may cause student confusion as they are used to the ability to navigate.

  • Add security features  

    There are a wide range of available security features including honesty checks, question and answer order randomization, password protection, and more.

 

Practical Considerations for Delivering Remotely

  • Set flexible timing

    Ensure that the quiz time limit and open/close dates and times provide a buffer to account for technical challenges. Specifying a longer exam time window provides students flexibility for their specific start time, spreads out performance and support load, and generally reduces anxiety. For example, if a quiz time limit is 120 minutes and scheduled for 2PM - 4PM, open the quiz at 1:30PM and close it at 4:30PM. Longer windows, for example providing students with 3 days to complete their exam are also recommended.

  • Communicate early with students

    Instructors should communicate the exam details such as format and timing, how and when students will access the exam link, and any other special requirements students need to be aware of as soon as they can to head off any potential issues. For example, if the link to a quiz will appear in eclass only at the assigned start time, students may panic if they do not know that in advance. It is also imperative to set the expectations for student behaviour during exams and to outline the consequences for not meeting the requirements. Instructors are encouraged to emphasize to their students that the correct, complete monitoring record of an exam is considered a required component of successful exam submission and it is the student's onus to provide this. Instructors should also ensure that students review the available tools and tips for taking quizzes on eClass.  

  • Run a practice quiz

    Running a practice quiz with students accessing from wherever they will complete their final exam is essential. Whether students are already familiar with taking quizzes on eClass or not, attempting a quiz from the actual exam-taking locations where bandwidth or firewall issues may occur can prevent these from occurring during the actual exam. Whenever possible, running a practice with 'for marks' quizzes (eg. existing formative assessments in your course) will ensure a higher rate of student participation.

  • Prepare for problems

    - Establish a communication process for the different kinds of issues that may arise during an exam - eg. for subject matter questions, contact the TAs; for internet outages phone your internet provider (or switch to cellular internet service); for technical issues with your computer contact the IST helpdesk (780-492-9400); for eClass issues contact eClass support (780-492-9372). These tips are also suggested for students herePlease note, eClass support is open during university business hours only (M-F, 8:00AM-4:00PM) so if exams are scheduled outside this time range prepare an alternative mechanism for support.

    - Some available communication options include phone, email, google chat, a 'live' shared google doc, or eClass messaging. Instructors may also want to create an online meeting, for example a zoom session with the waiting room enabled for 1-to-1 interactions that students can log into during an exam to pose questions.

    - Be familiar with the process to extend the attempt deadline for particular students who might be encountering issues. 

    - Plan a backup solution - for example offering an alternative variation of the exam to be emailed to a student, completed, and returned or shifting students to a deferred exam.

 

Employing Remote Monitoring Tools

As mentioned above, remotely delivered exams pose a range of challenges to be overcome. Some of the technical/practical challenges can be addressed by communicating early with students, clearly outlining expectations, and running practice exams to identify issues before exams. From an academic honesty perspective there 4 main challenges:

  • Ensuring the exam taker is the correctly enrolled student (identity validation).
  • Monitoring the student and the physical space where they complete the exam to ensure no disallowed materials are used (physical integrity validation).
  • Monitoring the students online activities to ensure they are not accessing any disallowed electronic resources (online integrity validation).
  • Making sure that exams and questions aren't copied by exam takers (question security)

The available options for exam delivery are listed below in order of increasing ability to meet these challenges but also in increasing order of potential for technical challenges. No academic honesty measures are going to be 100% effective. It is up to instructors to decide which challenges to address are most important to them and which of the options below they feel comfortable with having their students use. There is also the cost of the service to consider. 

Option 1: No remote monitoring - Alternative assessment or open-book eClass exam staged over a flexible time block.

- Method: CTL has provided suggestions for this type of assessment and they are available for consultations on how to convert existing assessments.

- Support: Assessments of this type create the fewest barriers to student access and have the fewest technological limitations and are - often carried out in eClass which is fully supported.

- Costs: Charges may apply depending on the delivery method chosen by the instructor, but use of eClass is free.

- Monitoring: This style of exam does not provide any of the four types of monitoring noted above. Instructors should be aware that exam questions may be copied.

 

Option 2: Smart Exam Monitor (SEM) - a chrome-only web application that records student webcam video, audio, and screen activity.

- Method: Instructors use eClass or another exam delivery method and use SEM to monitor the exam session. New in September 2020, SEM now features an option to deliver eClass quizzes in a forced-full screen mode. Any students navigating away from the exam-taking window are automatically flagged. For more information, please view this webinar demonstrating this SEM closed book set up for eClass quizzes. 

- Support: eClass exams and SEM are supported by the eClass team; instructors can engage the team and sign up to have their exam validated. Other exam delivery methods are up to the instructor to support; SEM may be able to be used in these scenarios.

-Costs: Charges may apply depending on the delivery method chosen by the instructor, but eClass and SEM are free.

- Monitoring: Provides identity validation, monitoring/recording of the student’s physical environment, and lightweight monitoring/recording of the student's onscreen activity. Does not provide question security or full monitoring of the student’s computer activity.

 

Option 3: eClass exam combined with Examlock - custom exam security application run on student's devices.

- Method: Instructors use eClass and Examlock to deliver their exam. 

- Support: eClass and Examlock are both supported by the eClass team.

- Costs: eClass and Examlock are free to use.

- Monitoring: Provides some identity validation through CCID access; reports on the student’s online and computer activities; provides some question security, although students could take pictures on their phones. The physical environment is not monitored.

 

Option 4: eClass exam using both Examlock and combined with Smart Exam Monitor  - combine both eClass-supported tools. 

- Method: Instructors use eClass and Examlock to deliver their exam and combine it with Smart Exam Monitor to monitor the session.

- Support: eClass, Examlock and SEM are all supported by the eClass team. This article describes this scenario in detail and instructors can also view this webinar demonstrating how to set up SEM and ExamLock together.

- Costs: eClass, Examlock, and SEM are free

- Monitoring: Provides identity validation, monitors and reports on the student’s computer activities, monitors the student’s physical environment, and provides some question security (screenshots are prevented).

 

Option 5: eClass exam or another exam delivery platform, combined with paid remote proctoring service RPNow

- Method: Instructors use eClass or their own delivery method and combine it with the remote proctoring service, RPNow.

- Support: Access to the remote proctor is set up through eClass, and technical support is provided through the RPNow vendor. Not recommended for exams that require the use of paper to facilitate the exam, Please see option 2. 

- Costs: RPNow charges $3.50 US per exam per student. Fees will be charged back to Individual Faculties, so Dean’s approval is required. Other charges may apply depending on the delivery method chosen by the instructor.

- Monitoring: All four types of monitoring are supplied, and an audit report is produced by the vendor. All session videos are available for instructors to review.

 

(11 vote(s))
Helpful
Not helpful

Comments (0)