Online Proctoring Systems Evaluation
A comprehensive analysis of proctoring alternatives to help our institution make an informed decision on academic integrity solutions.
1 Executive Summary
Key findings from our comprehensive evaluation of online proctoring systems.
Current Annual Cost
Honorlock at $8.24/exam with 20,000 proctored exams/year
Potential Savings
Switching to alternatives like Respondus or Proctorio
Vendors Evaluated
Major commercial and open-source solutions analyzed
Critical Factor
Accessibility compliance varies significantly across vendors
Key Findings
- Honorlock pricing ($8-15/exam) is among the highest in the market. Per-exam pricing may be costing more than necessary for high-volume institutions.
- Respondus LockDown Browser + Monitor offers the best value for institutions already using compatible LMS platforms, with site licensing that eliminates per-exam fees.
- All AI-based proctoring systems show documented bias against students with darker skin tones, disabilities, and non-standard testing environments.
- Accessibility compliance varies widely - many vendor VPATs are outdated (2+ years old) and should be independently verified.
- Student anxiety and complaints are significant with all proctoring systems, but vary in severity based on surveillance intensity.
- Safe Exam Browser offers an open-source alternative for basic lockdown functionality without privacy concerns, but lacks robust proctoring features.
2 Quick Comparison Matrix
At-a-glance comparison of all evaluated proctoring systems.
| Vendor | Pricing Model | Est. Cost/Exam | AI Proctoring | Live Proctors | LMS Integration | VPAT Available | Status |
|---|---|---|---|---|---|---|---|
| Honorlock | Per exam/student | $8-15 | Yes | Hybrid (on-demand) | Canvas, BB, D2L | Yes (2022) | Current |
| Proctorio | Per exam/custom | $3-5 | Yes | No | Canvas, BB, Moodle, D2L | Yes | Consider |
| Respondus | Site license | ~$0* | Yes (Monitor) | No | Canvas, BB, Moodle, D2L | Yes | Recommended |
| ProctorU/Meazure | Per exam (tiered) | $15-35 | Yes | Yes (Live+) | Canvas, BB, Moodle, D2L | Yes | Consider |
| ExamSoft | Subscription | Custom | Yes (ExamMonitor) | No | Limited | Yes | Niche Use |
| Examity | Per exam (tiered) | $10-25 | Yes | Yes | Canvas, BB, Moodle, D2L | Yes | Consider |
| Safe Exam Browser | Free (Open Source) | $0 | Limited | Optional (Jitsi) | Moodle (native) | N/A | Supplement |
* Respondus site license means no per-exam fees after initial license purchase. Annual license costs vary by institution size.
3 Detailed Vendor Profiles
In-depth analysis of each proctoring solution including features, pricing, and considerations.
Honorlock
Current System - AI + Live HybridProctorio
Fully Automated AI ProctoringRespondus
LockDown Browser + MonitorProctorU / Meazure
Live + AI Proctoring OptionsExamSoft
Assessment Platform with ProctoringSafe Exam Browser
Open Source Lockdown Browser4 Accessibility Compliance
Critical analysis of accessibility standards compliance across all evaluated systems.
Critical Research Finding: Bias in AI Proctoring
A 2022 Frontiers in Education study found significant disparities in automated proctoring software:
- Students with darker skin tones were significantly more likely to be flagged for review
- Black students showed increased likelihood of being marked for potential cheating
- Women with darkest skin tones were far more likely to be flagged than any other group
- Root cause: Training datasets predominantly composed of white males aged 18-35
Source: Frontiers in Education - Racial, skin tone, and sex disparities in automated proctoring software
WCAG 2.1 AA Compliance
Minimum standard required for higher education
Section 508 Compliance
Required for federal funding recipients
Screen Reader Compatibility
JAWS, NVDA, VoiceOver support
VPAT Currency
VPATs older than 2 years are considered outdated
Key Accessibility Considerations
-
!
Extended Time Accommodations
All vendors support extended time, but implementation varies. Verify accommodation workflows with your Disability Services office.
-
!
Assistive Technology Compatibility
Browser lockdown features may conflict with screen readers, magnification software, and other assistive technologies. Test thoroughly before deployment.
-
!
AI Flagging and Disabilities
Students with movement disorders, tics, or visual impairments may be disproportionately flagged by AI algorithms that detect "suspicious" behavior.
5 User Feedback & Research
Aggregated feedback from students, faculty, and administrators across multiple institutions.
Student Perspectives
Key Student Concerns
- Privacy invasion from home environment monitoring
- Test anxiety amplified by surveillance
- Technical failures causing exam disruptions
- Racial bias in facial recognition
- Unfair flagging for normal behaviors (looking away, fidgeting)
Faculty Perspectives
Key Faculty Preferences
- Configurable settings to reduce false positives
- Efficient video review interfaces
- Strong LMS integration for easy setup
- Clear accommodation workflows
- Reliable technical support
Administrator Perspectives
Key Admin Priorities
- Predictable, scalable pricing
- FERPA and data privacy compliance
- Accessibility compliance documentation
- Strong vendor support and SLAs
- Implementation and training resources
6 Cost Comparison Calculator
Estimate your institution's costs with different proctoring providers.
Calculate Your Estimated Annual Costs
7 Recommendations
Based on our comprehensive analysis, here are our recommendations for the Ed Tech Committee.
Primary Recommendation: Respondus LockDown Browser + Monitor
For institutions seeking the best balance of cost, functionality, and reliability, Respondus offers the strongest value proposition. The site licensing model eliminates per-exam cost anxiety and provides predictable budgeting. With 2,000+ institutions already using the platform, it represents a proven, stable solution.
Alternative Considerations
Proctorio - Best for Maximum Flexibility
If instructor control and configuration options are paramount, Proctorio offers the most granular settings. However, weigh this against documented privacy controversies and student concerns.
ProctorU - Best for High-Stakes Exams
For certification programs or high-stakes assessments where live proctoring is required, ProctorU's Live+ tier provides the strongest integrity guarantee, albeit at premium pricing.
Safe Exam Browser - Best for Privacy-Conscious
For institutions prioritizing student privacy or seeking a supplementary lockdown tool, SEB offers a free, open-source option. Best used alongside other assessment integrity measures.
Recommended Next Steps
- Request current VPATs from top vendor candidates (ensure they're less than 2 years old)
- Schedule demos with Respondus and one alternative (Proctorio or Examity)
- Conduct pilot testing with Disability Services to verify accessibility workflows
- Survey faculty about current Honorlock pain points and feature priorities
- Negotiate pricing based on actual exam volume and multi-year commitments
- Review contracts for FERPA compliance, data retention policies, and exit clauses
8 Sources & References
Research & Studies
- Frontiers in Education - Racial, skin tone, and sex disparities in automated proctoring software
- MIT Technology Review - Software that monitors students during tests perpetuates inequality
- CSUN - ProctorU, Respondus Monitor and Proctorio Comparison