Distance Ed Math Class Exams and Proctoring

[Fred Feldon]

Deat ITLC Colleagues  --  I'd like to add my name to serve on the subcommittee to revise the Position Statement on Proctored Testing for Courses Taught at a Distance. Here's the reason.

Coastline offered its first online math class in 1999. We've been a "pioneer" of this modality. As such, with hundreds of course offerings and thousands of students served, we have come to the realization of how easy it is to cheat with electronic proctoring. Frankly, it's a breeze. One of our faculty recently documented (on video) four ways to cheat using trickery and sleight of hand to access cell phone, cheat sheet, additional browsers, laptops and tablets using electronic proctoring on the highest possible settings. Our administration is trying to end human proctoring., Our department unanimously agreed to the following policy.

Coastline College is committed to authentic assessment of students in mathematics classes with heavily weighted midterms and final exams. These exams are paper and pencil, proctored by a human. Students are required to explain their thinking, justify their answers, show their work using proper mathematical notation with the majority of the questions being open-ended and free response which allows for partial credit. The Coastline math department requires these exams to have human proctors with line-of-sight to ensure authorship of work and to maintain integrity and the College's academic honesty policy.

Feel free to comment or perhaps reply with your own experience in this matter, and what your department policy is. Thanks!  --  Fred

[Foth, Robert]

Could you expand on this " using electronic proctoring on the highest possible settings." What proctoring was being used?

--
You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.
To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/c94f44d2-6932-47ce-b1ba-4a9c13541c9b%40googlegroups.com.

--

Robert Foth

PimaOnline Department Head Mathematics

Discipline Coordinator MAT 092S, 142, 146, and 147

Pima Community College

Northwest Campus G202

Phone: (520) 206-2378

rf...@pima.edu

[Feldon, Fred]

Proctorio

Fred Feldon

Professor of Mathematics
Co-Chair Department of Mathematics
Coastline Community College
Fountain Valley, CA 92708
ffe...@coastline.edu

"It doesn't matter if my classroom is a little rectangle in a building or a little rectangle above my keyboard. Doors are rectangles. Rectangles are portals. We walk through." Kathi Inman Berens

---

From: amaty...@googlegroups.com [amaty...@googlegroups.com] on behalf of Foth, Robert [rf...@pima.edu]
Sent: Sunday, October 13, 2019 3:45 PM
To: Feldon, Fred
Cc: AMATYC-ITLC
Subject: [External] Re: [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/CAGEvZBF6J3D-t2mGnR%3DVkZ2dOwQ3gELhx%3D8RDcJA%2BsriZpHVPg%40mail.gmail.com.

-------------------------------------------------------------------------------------
*** NOTICE *** This message was sent from an external sender and did not originate from Coast Community College District. If you are unsure of the authenticity of the sender, DO NOT click any links or download any attachments. Instead, click on FORWARD and address to phishing

[Moss, Cindy]

Hi Fred,

 

Can you share the video? Here is one of many websites that give instructions on how to cheat with electronic proctoring systems. https://www.executiveacademics.com/single-post/2016/1/5/Beating-Cheating-and-Defeating-Online-Proctoring

Not to mention all the sites that advertise they will take an online class for students.

 

Thanks,

Cindy

 

Professor Moss

Skyline College

San Bruno, CA

http://accounts.smccd.edu/moss/

--

You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.
To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/c94f44d2-6932-47ce-b1ba-4a9c13541c9b%40googlegroups.com.

[SMCCCD-EXTERNAL-STAMP-ADDED]

[Foth, Robert]

So you were using the record only version then? Not a live proctor? Reason I ask is I know the record only is not a great solution as it puts a huge burden on the faculty member to review the video even though they try to flag videos with suspicious behavior - a live proctor typically interrupts students with suspicious behavior to sweep a room.

[Feldon, Fred]

Correct. Proctorio records only. You must be thinking of ProctorU. One of the services they offer versions called live and pro where "live proctors are augmented by AI." I was told it's quite expensive and that the live proctors are looking at multiple students. I believe the ways to cheat at Proctorio also apply to Proctor U.

Fred Feldon

Professor of Mathematics
Co-Chair Department of Mathematics
Coastline Community College
Fountain Valley, CA 92708
ffe...@coastline.edu

"It doesn't matter if my classroom is a little rectangle in a building or a little rectangle above my keyboard. Doors are rectangles. Rectangles are portals. We walk through." Kathi Inman Berens

From: amaty...@googlegroups.com [amaty...@googlegroups.com] on behalf of Foth, Robert [rf...@pima.edu]

Sent: Monday, October 14, 2019 10:09 AM

To: Feldon, Fred
Cc: AMATYC-ITLC

Subject: [External] Re: [External] Re: [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/CAGEvZBH1f8JoRD%2Bn8Euek-5uXXje8%2Bcq0Hoa%3DJaMOAY2-kQd%3DQ%40mail.gmail.com.

[Foth, Robert]

The cost is around 25 per 2 hour exam which is typically much higher compared to the record and go type proctoring where there is not interactions. I think overall that one is harder to cheat - there are lots of ways to cheat in the ftf proctoring environment as well so your department just needs to feel comfortable with the choice that is made. I have advocated we do not go the direction of record and go as it is more problematic and puts a huge burden of time on the faculty member to review for incidents.

I think we would want to make sure our position statement does not pigeon hole proctoring to be done solely in a physical location and that we support some sort of electronic proctoring. I think with ProctorU we get in general the same level of security as our physical testing centers - the one thing to be aware of is that we can see the whole proctoring event when it it is done that way and we over analyze any gaps. When we look at physical site proctoring other issues pop up as well, but we don't have the same type of data to analyze (we have had faculty watch the proctoring and saw proctors not doing their job there as well and students doing things they should not do when testing).

[Graser, David]

When our local universities started talking about the transferability of online classes that do not have at least human proctoring in at least 50% of assessments, I took notice and began requiring students to take their midterm and final (50% of the final grade) in a human proctored environment. Ten years ago this was a bit of a pain since finding proctored testing locations was tough. In the last few years, it has been a management issue but not a barrier to students taking exams. For my classes, online students have several choices.

1. They can take the midterm and final in a class room setting with my face to face students at a time when the face to face class is scheduled.
2. They can take the midterm and final in a Yavapai College Proctored Testing Center in Prescott, Clarkdale, or Prescott Valley during a three day window. These centers are open from 8-5pm generally, but do have extended hours on some days.
3. They can take the midterm and final at another proctored testing location where the exam is proctored by a person at that location.

 

About 75% of my online students are located in the district and take advantage of Option 2. Managing this requires me to contact each student and to get them to fill out a Google Form  with the location of the testing center they wish to use…then I have to get exams to those centers.

 

Another 25% of my online students take advantage of Option 3. I was concerned that this would be a real burden, but over the past five years I have only had one student that made it into a nightmare. Some of the locations students have used are testing centers at community colleges in the Phoenix and Tucson area, testing centers located at university extension sites, public libraries, air force bases…you name it. There is also a burgeoning test proctoring business associated with various businesses that offer tutoring for junior and high school students. Managing this is a task. I send them a Google Form to fill out requesting the name of the testing center, a phone contact, and an email contact. The only obstacle I have run into is that some university or community college testing centers will restrict testing to their students during the eight and final weeks of the semester. I try to take this into account when scheduling the exams.

 

In short, finding proctors that are physically present is not the burden I once anticipated. If you college is going to go deep into online learning, they need to offer testing services to other colleges as well as their own students. By providing reciprocal services, all of the colleges can survive and thrive. There are plenty of students out there for everyone.

 

Dave

 

Dr David Graser

Professor of Mathematics

Yavapai College

928-776-2108

Office Hours: TTh 9:15-11am in 4-105 or Zoom

Zoom: MAT 142 M 7-7:45pm, MAT 172 T 7-7:45pm, MAT 212 M 7:45-8:30pm

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/7EBBD28C750B9C4B8E331932D5D9112A0239C4398F%40dit-mbx01v.

[Anne S. Magnuson]

Hello,

At Wake Tech, our department has always required testing at our e-learning testing center if a student lives less than 50 miles from the closest Wake Tech location.  If they are farther away, they must secure an alternate proctor in a college setting to administer their tests in a proctored environment.  This holds for unit tests (usually 3 to 4) and final exams.  We use online homework systems, Blackboard assignments, etc. for other assessments.

Our testing center currently uses Smarterproctoring, which is a web site that acts as a hub for testing centers so that remote proctors can share testing materials. They are piloting another system called Registerblast.

Smarterproctoring has a list of member testing centers that are not necessarily vetted so unless they are well-known to us (used frequently or at another NC community college), we have the student supply the instructor with contact information for their alternate proctor and the instructor must be satisfied that their choice is a legitimate testing center in a college setting (no elementary school librarian or mother's best friend, etc.).    In the early days of using Smarterproctoring, we have had instances where a nefarious person(s) signed up as a testing center with Smarterproctoring and either allowed students to cheat or provided the answers, so we stress that the instructors must check out new alternate proctors.  We ask the alternate proctor to sign a contract agreeing they will give the tests under the conditions requested and return the scanned test to our testing center, similar to David's process.

Also, there is an organization of testing centers, NCTA, that certifies testing centers.

Our biggest problem with this process is with students who do not read the important information when they sign up for the class that unit tests and final exams are proctored.  This has caused problems with students in remote locations or foreign countries or those who just don't want to come to campus at all, but we hold fast to the policy as the importance of maintaining the integrity of the course is paramount.

Regards,

Anne Magnuson

Associate Department Head, Math & Physics

Wake Tech Community College

6600 Louisburg Rd, ND477

Raleigh, NC 27616

919-532-5637

---

From: amaty...@googlegroups.com <amaty...@googlegroups.com> on behalf of Graser, David <David....@yc.edu>
Sent: Monday, October 14, 2019 3:50 PM
To: Feldon, Fred <ffe...@coastline.edu>; AMATYC-ITLC <amaty...@googlegroups.com>

Subject: RE: [External] Re: [External] Re: [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

 

[CAUTION]: This email originated from outside of Wake Technical Community College. Do not click links, or open attachments unless you verify that the attachment and content are safe.

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/BYAPR15MB272541AC5C66878D0F985FDDFA900%40BYAPR15MB2725.namprd15.prod.outlook.com.

Email correspondence to and from this address may be subject to the North Carolina Public Records law and may be disclosed to third parties by an authorized state official (NCGS. ch. 132). Student educational records are subject to FERPA.

[Feldon, Fred]

Wow. And it's from 2016. I can only imagine the advances made in the last 3-4 years since this article was published!

Regarding the Coastline College videos, I've already had three requests for them. I will ask my colleague for the links. I will get right back to you all.  --  Fred

Fred Feldon

Professor of Mathematics
Co-Chair Department of Mathematics
Coastline Community College
Fountain Valley, CA 92708
ffe...@coastline.edu

"It doesn't matter if my classroom is a little rectangle in a building or a little rectangle above my keyboard. Doors are rectangles. Rectangles are portals. We walk through." Kathi Inman Berens

---

From: Moss, Cindy [mo...@smccd.edu]
Sent: Sunday, October 13, 2019 4:36 PM
To: Feldon, Fred; AMATYC-ITLC
Subject: [External] RE: [] [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

Hi Fred,

 

Can you share the video? Here is one of many websites that give instructions on how to cheat with electronic proctoring systems. https://www.executiveacademics.com/single-post/2016/1/5/Beating-Cheating-and-Defeating-Online-Proctoring

Not to mention all the sites that advertise they will take an online class for students.

 

Thanks,

Cindy

 

Professor Moss

Skyline College

San Bruno, CA

http://accounts.smccd.edu/moss/

 

From: amaty...@googlegroups.com [mailto:amaty...@googlegroups.com] On Behalf Of Fred Feldon
Sent: Sunday, October 13, 2019 1:02 PM
To: AMATYC-ITLC
Subject: [EXTERNAL] [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

 

Dear ITLC Colleagues  --  I'd like to add my name to serve on the subcommittee to revise the Position Statement on Proctored Testing for Courses Taught at a Distance. Here's the reason.

 

Coastline offered its first online math class in 1999. We've been a "pioneer" of this modality. As such, with hundreds of course offerings and thousands of students served, we have come to the realization how easy it is to cheat with electronic proctoring. Frankly, it's a breeze. One of our faculty recently documented (on video) four ways to cheat using trickery and sleight of hand to access cell phone, cheat sheet, additional browsers, laptops and tablets using electronic proctoring on the highest possible settings. Our administration is trying to end human proctoring., Our department unanimously agreed to the following policy.

 

Coastline College is committed to authentic assessment of students in mathematics classes with heavily weighted midterms and final exams. These exams are paper and pencil, proctored by a human. Students are required to explain their thinking, justify their answers, show their work using proper mathematical notation with the majority of the questions being open-ended and free response which allows for partial credit. The Coastline math department requires these exams to have human proctors with line-of-sight to ensure authorship of work and to maintain integrity and the College's academic honesty policy.

 

Feel free to comment or perhaps reply with your own experience in this matter, and what your department policy is. Thanks!  --  Fred

--
You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.
To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/c94f44d2-6932-47ce-b1ba-4a9c13541c9b%40googlegroups.com.

[SMCCCD-EXTERNAL-STAMP-ADDED]

-------------------------------------------------------------------------------------

[Eric York]

We too are wrestling with proctoring exams for online courses, so I'm flol owing this discussion with interest.

Eric 

To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/c94f44d2-6932-47ce-b1ba-4a9c13541c9b%40googlegroups.com.

[SMCCCD-EXTERNAL-STAMP-ADDED]

-------------------------------------------------------------------------------------
*** NOTICE *** This message was sent from an external sender and did not originate from Coast Community College District. If you are unsure of the authenticity of the sender, DO NOT click any links or download any attachments. Instead, click on FORWARD and address to phishing

--

You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.

To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/7EBBD28C750B9C4B8E331932D5D9112A0239C43820%40dit-mbx01v.

[Mary Beth Orrange]

I am retired from teaching but I love this discussion anyway!!! 

Thanks to everyone for their contributions!  

Mary Beth

Sent from my iPhone

On Oct 15, 2019, at 10:21 AM, Eric York <eric...@wnc.edu> wrote:



To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/CABT7bWyMOXgHz3u4xKj4VhvbQWAz0QnJTh8LRxscN3ddNbJ9vQ%40mail.gmail.com.

[George Hurlburt]

I’ve always required proctored testing.  A long time ago, I experimented with having some exams proctored and some unproctored, but found the grade discrepancy between proctored and unproctored was very unacceptable.

 

For the past 3 years I used an online proctoring service.  I stopped using it this semester because I didn’t like that I had to run my test through my course site.  I wanted to use paper/pencil.  Running through the course site limited the types of questions I could ask.  Also, students need to graph by hand.  Graphing on the computer just isn’t the same.

 

Recently our Provost asked why the Math Department required proctored testing for our online classes.  My response was “The question you should be asking is how do faculty members who don’t require anything to be proctored ensure academic standards and integrity.” 

 

George

 

George Hurlburt

Professor of Mathematics

SUNY Corning Community College

1 Academic Drive

Corning, NY  14830

607-962-9324

To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/c94f44d2-6932-47ce-b1ba-4a9c13541c9b%40googlegroups.com.

[SMCCCD-EXTERNAL-STAMP-ADDED]

-------------------------------------------------------------------------------------
*** NOTICE *** This message was sent from an external sender and did not originate from Coast Community College District. If you are unsure of the authenticity of the sender, DO NOT click any links or download any attachments. Instead, click on FORWARD and address to phishing

--
You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.

To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/7EBBD28C750B9C4B8E331932D5D9112A0239C43820%40dit-mbx01v.

--
You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.
To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/CABT7bWyMOXgHz3u4xKj4VhvbQWAz0QnJTh8LRxscN3ddNbJ9vQ%40mail.gmail.com.

--
You received this message because you are subscribed to the Google Groups "AMATYC-ITLC" group.
To unsubscribe from this group and stop receiving emails from it, send an email to amatyc-itlc...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/AA4FE3F9-DA98-4B8F-A652-0582FF5949D7%40gmail.com.

[Jon Oaks]

I like the statement that Coastline has put out. For online classes at my college, we require an on campus final exam or a proctored exam in person at a college close to the student. The student has to make the arrangements on their own and it is at their own expense. A few years ago we were able to get the registrar to put the on campus final exam requirement in the online schedule, but I think a statement along with it as to why we are requiring the on campus final exam would prove helpful for the students to know up front before they even register to take the class.

Thanks,

Jon

Jon Oaks (백승찬)

Professor of Mathematics

AMATYC Midwest Regional Vice President

https://www.facebook.com/groups/amatycmidwest

Email: jonn...@gmail.com
Website: bit.ly/algebragames

--

[Feldon, Fred]

Thanks for sharing, Johanna! Another professor mentioned earlier ProctorU is about $25 per two-hour exam. So that would add $50 to the cost of a class with a proctored Midterm and Final. Not sure how well that would go over with students. Even it were an effective way to maintain integrity...

Fred Feldon

Professor of Mathematics
Co-Chair Department of Mathematics
Coastline Community College
Fountain Valley, CA 92708
ffe...@coastline.edu

"It doesn't matter if my classroom is a little rectangle in a building or a little rectangle above my keyboard. Doors are rectangles. Rectangles are portals. We walk through." Kathi Inman Berens

---

From: Debrecht, Johanna M. [jdeb...@nvcc.edu]
Sent: Thursday, October 17, 2019 9:58 AM
To: George Hurlburt; Mary Beth Orrange; Eric York
Cc: Feldon, Fred; AMATYC-ITLC; Moss, Cindy
Subject: [External] Re: [] [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

I have taught, and designed, the online calculus courses for Northern Virginia Community College, which has a very, very large number of students taking such courses (over 10,000 FTE). We have found the same thing Fred did: It is super easy to cheat on the electronic monitoring systems. We also found what George did: Students who take the online exams can't have the same depth and breadth of questions as the paper and pencil exams. They were much less successful in their future math courses. We used this data to convince the administration to allow the math department to continue using paper and pencil exams.

In Colorado, I have experimented with using ProctorU, which is an online proctoring system. It works okay, but it takes a lot of time to verify whether or not a student was cheating, and again, it can be difficult to avoid all cheating. It basically videos the student while taking the exam. It uses an algorithm to detect changes such as someone else in the room, a phone, etc. It can also lock the browser down so they can't access other websites. You can usually see enough to tell if the student is looking at another device.

However, every time the student coughs, wiggles the chair too much, etc., it raises a flag. So, it takes a lot of the instructor's time to detect true cheating. For that reason, I wouldn't want to use it as the standard. I still think in-person proctoring is the way to go.

Johanna

Johanna M Debrecht

Math Faculty

Red Rocks Community College

Assistant Professor, Adjunct
Loudoun Campus
Northern Virginia Community College

Editor

MathAMATYC Educator Journal

American Mathematical Association

  of Two-Year Colleges

---

From: amaty...@googlegroups.com <amaty...@googlegroups.com> on behalf of George Hurlburt <hurl...@corning-cc.edu>
Sent: Tuesday, October 15, 2019 09:32
To: Mary Beth Orrange <orran...@gmail.com>; Eric York <eric...@wnc.edu>

Cc: Feldon, Fred <ffe...@coastline.edu>; AMATYC-ITLC <amaty...@googlegroups.com>; Moss, Cindy <mo...@smccd.edu>

Subject: RE: [] [amatyc-itlc] Distance Ed Math Class Exams and Proctoring

 

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/b3403840ad4ea08b31efb8451c91d875%40mail.gmail.com.

[Foth, Robert]

The students who are local typically go to the community college testing center. Some local students like the ProctorU option if they have a demanding work schedule (this way they can schedule when to take the exam and that may be outside of our regular testing windows). The distance students like it since they get some flexibility and don't have to figure out where they can test and drive to that location (which may end up costing more than $25 when you factor in the time to do the leg work up front and then the possible drive to a physical location). Students still have the option to seek out a physical center, but that is extremely rare now unless they are already a student at the other institutions since most places seem to charge to proctor the exams (from my experience).

To view this discussion on the web visit https://groups.google.com/d/msgid/amatyc-itlc/7EBBD28C750B9C4B8E331932D5D9112A0239C44591%40dit-mbx01v.