Friday, December 7, 2018

Digital Testing Safeguards

In 2013 I wrote my first blog post on managing technology usage in the classroom. The fear of off task behavior still seems to be one of the main reasons teachers are hesitant to use technology five years later. While the devices may vary, the concepts on how to teach students good internal management of appropriate use has not changed. It starts with intentional boundaries being placed on students anytime technology is in their hands from pre-K forward.

I believe wholeheartedly that classroom management of students on devices is a digital citizenship issue. We are teaching students how to manage their impulses by setting expectations of appropriate usage. I also believe that if we are requiring students to use technology in our classrooms, we also need to be teaching students how to use it wisely and timely. Expectations are important for appropriate usage.

As our high school is moving forward to prepare for exams using Canvas for objective assessments my mind has been thinking on various ways to prepare the testing environment and test itself for integrity purposes. Below are my thoughts on this subject:

  • Classroom seating setup- make cheating hard but make monitoring easy for you. Exams don't take forever, move your desks or your students to help you monitor better. I work with a teacher in the elementary school that has her students sit on one side of their desk when she is giving instructions and then when it's time for them to work on the computers she has them move their chairs to the other side of their desks so she can quickly see their screens when she is working with small groups in the back of the classroom. Another option might be setting up your room for the task at hand by setting up desks in the following ways that allow you to quickly move around your room as you proctor an exam:
  • Question banks/groups -By creating Question Banks in your learning management system you can very easily differentiate a quiz to students by allowing the system to choose questions out of a question bank. Basically you are telling the Question Group how many questions you want on the quiz and it will randomly select questions from your pre-created banks. When creating question banks for randomization purposes it is important to create banks that have the same level of critical thinking within the groupings so that the quizzes will be equitable in rigor. Use Canvas LMS? Check out these links to help you:

  • 1. Access Codes- Codes serve as a safeguard that students cannot access exams when you are not ready for them to access it. Giving students the code right at exam time and then changing the code once everyone is in is a way to make sure different sections you teach are not accessing the exam when they are not in your presence. This can be set on the detail page of any quiz/exam you make in Canvas. 
  • 2. Filter IP Addresses- Many learning management systems have the ability to only allow a quiz/exam to be taken on campus. By choosing to filter the IP address you can prevent students from possibly accessing or finishing an exam at home without a proctor. This can also be set on the detail page in Canvas. Be aware that sometimes if a device is being managed by a VPN students will not be able to take the exam due to this setting. 
  • 3. Change feedback setting - One of the beautiful things about accessing digitally is that exams are graded immediately and teachers can spend more time on other things. In Canvas there is a setting for students to see question feedback right after taking an exam (in fact, it defaults to this setting). For testing integrity purposes, I would suggest changing this setting to a time after all of your students have taken the test so that you can be more assured that students aren't sharing their results with each other. 
  • 4. Shuffle answers - In most robust LMS options there is an option to shuffle the answers inside a quiz/exam with one click. When this is utilized to automatically it is important not to have answer choices like "both a & c" because it will randomize the answers and this answer will not be correct. 
  • 5. One question at a time - By choosing the option for students to see one question on a page it keeps wandering eyes from looking over and seeing another student's page of answers. The downside to this is that many students find it cumbersome when taking a test. Think of it like a hand covering the last question as the quiz taker moves along the test. Easy access is eliminated.
  • Lockdown Browser.  Using a lockdown browser so students cannot take screenshots or navigate off the tab they have open is another option. This is not a built-in option for most LMS options. Any time add-ons are used there is sometimes an added level of opportunity for things to go wrong. Keep in mind that you may have to troubleshoot this in your classroom as well. This document gives our teachers an overview on how to use Canvas with the Respondus lockdown browser as well as showing them how students will use the software depending on which device they are using. 

    The above list give teachers various ways to create quizzes/exams that ensure testing integrity. Teachers can pick and choose things that seem most beneficial to them but the value of test proctor movement is invaluable in both digital and non-digital assessment. It is also the easiest management tool. 

    The last thing I want to share are ways to overcome students getting kicked out of a Canvas exam  and not being able to continue taking it after accessing it again. This could happen due to a connectivity anomaly or due to a student just needing extended time for testing purposes. The easiest way to handle this is to not assign a "available until" time when creating a quiz/exam. This allows the test to remain open until the student submits the exam. To monitor this well we suggest these steps:
    • Use an access code (as soon as all students have accessed the test change the code).
    • At the end of the class period have any students who have not completed the exam come to you and physically watch them exit the exam. This way they cannot continue the exam except when you give them the new code. This prevents students from finishing up a quiz/exam in study hall with access to information to help them.