Proctoring Using AI

Abstract

This paper presents a comprehensive AI-based online examination proctoring system designed to maintain academic integrity in remote assessment environments. The system employs multiple machine learning techniques including facial recognition, head pose estimation, voice detection, electronic device identification, and behavioral analysis to monitor students during online examinations. The proposed system integrates computer vision algorithms, deep learning models, and real-time monitoring capabilities to detect potential cheating behaviors with high accuracy. Experimental results demonstrate the system\'s effectiveness in identifying various forms of academic misconduct while maintaining user privacy and system reliability. The system achieved a detection accuracy of 94.2% for facial verification, 89.7% for head movement detection, and 91.3% for electronic device identification across diverse testing scenarios.

Introduction

With the rise of online education and remote exams, maintaining exam integrity has become a major challenge. Traditional proctoring methods, reliant on human supervisors, are limited in scalability and effectiveness, especially when one proctor oversees many test-takers. Students often find ways to cheat using unauthorized devices, outside help, or other methods.

This paper proposes an AI-based proctoring system designed to autonomously detect suspicious behaviors such as multiple people in view, unusual head movements, use of unauthorized devices, and attempts to cheat, thus creating a secure and fair online exam environment. Leveraging AI technologies like computer vision, machine learning, and facial recognition, the system offers real-time, scalable, and more accurate monitoring without the need for physical proctors.

The system integrates five key modules:

1. Facial Recognition for continuous identity verification.

2. Head Pose Estimation to monitor attention and detect looking away.

3. Multi-Person Detection to identify unauthorized individuals.

4. Electronic Device Detection to spot unauthorized gadgets.

5. Voice Activity Detection to monitor for unauthorized communication.

Additionally, the system monitors screen activity and keyboard inputs to detect prohibited actions like tab-switching or copy-pasting.

This multi-modal approach addresses shortcomings in earlier systems by combining diverse detection techniques, optimizing real-time performance, and focusing on user privacy and scalability. The system includes a trust scoring mechanism and user-friendly interface for both students and administrators.

The paper also reviews prior work, noting limitations in earlier automated proctoring systems, and presents the architecture, algorithms, and ethical considerations involved in deploying this AI-driven proctoring solution.

Conclusion

This paper presented a comprehensive AI-based online examination proctoring system that addresses the critical need for maintaining academic integrity in remote learning environments. The system successfully integrates multiple monitoring modalities including facial recognition, head pose estimation, multi-person detection, electronic device identification, voice activity detection, and screen monitoring to provide thorough examination oversight. Experimental results demonstrate the system\'s effectiveness, with detection accuracies ranging from 89.7% to 97.4% across different violation types. The implementation of a trust scoring algorithm provides objective assessment of student behavior, while comprehensive violation documentation ensures transparency and accountability in the evaluation process. The system\'s modular architecture, scalable design, and user-friendly interface make it suitable for deployment across various educational institutions and examination scenarios. Privacy and security considerations have been thoroughly addressed to ensure compliance with educational data protection regulations. Future work will focus on enhancing the system\'s AI capabilities, improving accessibility features, and exploring advanced behavioral analysis techniques. The continued evolution of this system will contribute to the advancement of trustworthy and effective online education assessment methods. The successful implementation and validation of this AI-based proctoring system represents a significant contribution to the field of educational technology, providing a practical solution for maintaining academic integrity in the digital age while respecting student privacy and promoting fair assessment practices.

References

[1] Neelesh Chandra M, Piyush Sharma, Utkarsh Tripathi, Ujwal Kumar and Dr. G.C. Bhanu Prakash, ‘Automating Online Proctoring Through Artificial Intelligence’ IRJET, Volume: 08 Issue: 01, Jan 2021. [2] Weiqing Wang, Kunliang Xu, Hongli Niu, Xiangrong Miao,” Emotion Recognition of Students Based on Facial Expressions in Online Education Based on the Perspective of Computer Simulation”, Complexity, vol. 2020, Article ID 4065207, 9 pages, 2020. https://doi.org/10.1155/2020/4065207 [3] S. Prathish, A. N. S. and K. Bijlani, “An intelligent system for online exam monitoring,” 2016 International Conference on Information Science (ICIS), 2016, pp. 138-143, doi: 10.1109/INFOSCI.2016.7845315. [4] T. Guo, X. Bai, X. Tian, S. Firmin, and F. Xia, “Educational anomaly analytics: Features, methods, and challenges,” Front. Big Data, vol. 4, pp. 811–840, 2022. [5] W. Liu, W. Luo, D. Lian, and S. Gao, “Future frame prediction for anomaly detection— A new baseline,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2018, pp. 6536–6545. [6] R. T. Ionescu, F. S. Khan, M.-I. Georgescu, and L. Shao, “Object-centric auto-encoders and dummy anomalies for abnormal event detection in video,” in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2019, pp. 7842–7851. [7] R. Tudor Ionescu, S. Smeureanu, B. Alexe, and M. Popescu, “Unmask ing the abnormal events in video,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), 2017, pp. 2895–2903. [8] T.-N. Nguyen and J. Meunier, “Anomaly detection in video sequence with appearancemotion correspondence,” in Proc. IEEE/CVF Int. Conf. Comput. Vis. (ICCV), 2019, pp. 1273–1283. [9] Abisado, M., Gerardo, B., Vea, L., Medina, R.: Experimental facial expres sion and gesture training towards academic a ect modeling. In: 2018 IEEE 10th International Conference on Humanoid, Nanotechnology, Information Tech nology,Communication and Control, Environment and Management (HNICEM). pp. 14 (2018). [10] Agarwal, V.: Real-time head pose estimation in python. Available at https://towardsdatascience.com/retime-head-pose-estimation-in-python e52db1bc606a (2021.07.14) [11] Atoum, Y., Chen, L., Liu, A.X., Hsu, S.D.H., Liu, X.: Automated online exam proctoring. IEEE Transactions on Multimedia 19(7), 16091624 (2017). https://doi.org/10.1109/TMM.2017.2656064 [12] Althubaiti, A. (2016). Information bias in health research: Definition, pitfalls, and adjustment methods. Journal of Multidisciplinary Healthcare [13] González-González, C. S., Infante-Moro, A., Infante-Moro, J. C. (2020). Implementation of E-proctoring in online teaching: A study about motivational factors. Sustainability, 12, 3488. https://doi.org/10.3390/ su12083488. [14] Hollister, K. K., Berenson, M. L. (2009). Proctored versus Unproctored online exams: Studying the impact of exam environment on student performance. Decision Sciences Journal of Innovative Education, 7, 271–294. [15] Tweed M, Desrosiers J, Wilkinson TJ. Randomised controlled trial of students access to resources in an examination. Med Educ. 2021?55(8):951–60. [16] Neumann J, Simmrodt S, Teichert H, Gergs U. Comparison of online tests of very short answer versus single best answers for medical students in a pharmacology course over one year. Educ Res Int. 2021?2021:1–10 [17] Jaap A, Dewar A, Duncan C, Fairhurst K, Hope D, Kluth D. Effect of remote online exam delivery on student experience and performance in applied knowledge tests. BMC Med Educ. 2021?21(1):1–7. [18] Michael K, Lyden E, Custer T. Open-book examinations (OBEs) in an ultra sound physics course: a good idea or a bad experiment? J Diagn Med Sonography. 2019?35(3):174– 80. [19] T. Guo, X. Bai, X. Tian, S. Firmin, and F. Xia, “Educational anomaly analytics: Features, methods, and challenges,” Front. Big Data, vol. 4, pp. 811–840, 2022.

Copyright

Copyright © 2025 Dr. Jayshree R. Pansare, Aditya Pawar, Abhishek Chorghade, Sahil Barge, Ansh Agarwal. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.