AAA

Challenges of administering university examinations remotely during the COVID-19 pandemic

Miłosz Wawrzyniec Romaniuk, Joanna Łukasiewicz-Wieleba

Abstract

The article presents the results of a research questionnaire conducted among students and lecturers after the first, and repeated after the second, exam session during the pandemic crisis as this was the first time the examinations were conducted by distance education at The Maria Grzegorzewska University (Warsaw, Poland). Lecturers see the advantages of remote examination in the technological possibilities of conducting examinations (automation in checking and assessing the tests and archiving the results), time savings (immediate availability of results, flexibility of examination dates), and organizational improvements. Students indicate the comfort of writing the exam in a friendly environment, which reduces stress, and appreciate the possibility of obtaining results quickly and the need to spend less time on the exam itself. In the case of disadvantages of remote exams, lecturers indicate a lack of control over the independence and integrity of students, and students complain about the stringent time constraints, distractors and stress, as well as the level of the exam (both higher and lower compared to the level of traditional exams) and the adequacy of the grades obtained. Both groups consider technical problems that arise during the exam to be severe. Twenty percent of students admit to using unauthorized assistance during tests and exams. Academic teachers try to reduce the dependence of students by choosing an appropriate form of the exam (problem tasks, oral exams, open-ended questions, test variants), using special strategies (comparing students' work, control questions, looking for parts of final papers on the Internet), and using technical solutions (requirement of turning on the camera, checking the metadata of files, the need to document work). The search for an effective and appropriate method of verification of learning outcomes is ongoing.

Keywords: crisis remote education, remote examinations, COVID-19, e-learning, higher education

References

  • Balderas, A., & Caballero-Hernández, J. A. (2020). Analysis of learning records to detect student cheating on online exams: Case study during COVID-19 pandemic. Eighth International Conference on Technological Ecosystems for Enhancing Multiculturality, 752-757. https://doi.org/10.1145/3434780.3436662
  • Bawarith, R., Basuhail, A., Fattouh, A., & Gamalel-Din, S. (2017). E-exam cheating detection system. International Journal of Advanced Computer Science and Applications, 8(4), 176-181. https://doi.org/10.14569/IJACSA.2017.080425
  • Bilen, E., & Matros, A. (2021). Online cheating amid COVID-19. Journal of Economic Behavior & Organization, 182, 196-211. https://doi.org/10.1016/j.jebo.2020.12.004
  • Brightwell, R., Daniel, J.-H., & Stewart, A. (2004). Evaluation: is an open book examination easier? Bioscience Education, 3(1), 1-10. https://doi.org/10.3108/beej.2004.03000004
  • Carstairs, J., & Myors, B. (2009). Internet testing: A natural experiment reveals test score inflation on a high-stakes, unproctored cognitive test. Computers in Human Behavior, 3(25), 738-742. https://doi.org/10.1016/j.chb.2009.01.011
  • Cluskey Jr., G. R., Ehlen, C. R., & Raiborn, M. H. (2011). Thwarting online exam cheating without proctor supervision. Journal of Academic and Business Ethics, 4(1), 1-7.
  • Cramp, J., Medlin, J. F., Lake, P., & Sharp, C. (2019). Lessons learned from implementing remotely invigilated online exams. ,i>Journal of University Teaching & Learning Practice, 16(1). https://ro.uow.edu.au/jutlp/vol16/iss1/10/
  • Czerski, T. (2020). Nowoczesny nauczyciel akademicki w dobie COVID-19 [A modern academic teacher in the COVID-19 era]. Dydaktyka Informatyki, 15, 104-119. https://doi.org/10.15584/di.2020.15.7
  • Dobińska, G., & Okólska, K. (2020). Kształcenie akademickie w formie zdalnej - refleksja nad prakseologicznym wymiarem e-learningu [Academic education in a distance form - reflection on the praxeological dimension of e-learning]. Studia z Teorii Wychowania, 4(33), 41-58. https://doi.org/10.5604/01.3001.0014.6558
  • Dougherty, P., & Shinozaki Dougherty, A. (2020). Building a sense of community in online courses. e-mentor, 4(86), 72-78. https://doi.org/10.15219/em86.1484
  • Durning, S. J., Dong, T., Ratcliffe, T., Schuwirth, L., Artino, A. R., Boulet, J. R., & Eva, K. (2016). Comparing open-book and closed-book examinations. A systematic review. Academic Medicine, 91(4), 583-599. https://doi.org/10.1097/ACM.0000000000000977
  • Elsalem, L., Al-Azzam, N., Jum'ah, A. A., Obeidat, N., Sindiani, A. M., & Kheirallah, K. A. (2020). Stress and behavioral changes with remote E-exams during the Covid-19 pandemic: A cross-sectional study among undergraduates of medical sciences. Annals of Medicine and Surgery, 60, 271-279. https://doi.org/10.1016/j.amsu.2020.10.058
  • Eltayeb, L. B., Alharthi, N. S., Elmosaad, Y. M., & Waggiallah, H. A. (2020). Students' perception on E. Learning and Remote Exams during COVID 19 Outbreak 2020. International Journal of Pharmaceutical and Phytopharmacological Research (eIJPPR), 10(5), 142-148.
  • Friedman, A., Blau, I., & Eshet-Alkalai, Y. (2016). Cheating and feeling honest: Committing and punishing analog versus digital academic dishonesty behaviors in higher education. Interdisciplinary Journal of e-Skills and Lifelong Learning, 12, 193-205. https://doi.org/10.28945/3629
  • García-Penalvo, F. J., Corell, A., Abella-García, V., & Grande-de-Prado, M. (2021). Recommendations for mandatory online assessment in higher education during the COVID-19 pandemic. In D. Burgos, A. Tlili, & A. Tabacco (Eds.), Radical solutions for education in a crisis context. COVID-19 as an opportunity for global learning (pp. 85-98). Springer. https://doi.org/10.1007/978-981-15-7869-4_6
  • Instrukcja postępowania dla studentów w sytuacji egzaminacyjnej realizowanej zdalnie w Akademii Pedagogiki Specjalnej im. Marii Grzegorzewskiej. [Procedure for students during remotely administered exams at The Maria Grzegorzewska University] (2020, May 25). http://www.aps.edu.pl/media/2392237/28052020studenci-instrukcja-egzaminowania-tp-i-kk-20200521.pdf
  • Jervis, C. G., & Brown, L. R. (2020). The prospects of sitting 'end of year' open book exams in the light of COVID-19: A medical student's perspective. Medical Teacher, 42(7), 830-831, https://doi.org/10.1080/0142159X.2020.1766668
  • Johanns, B., Dinkens, A., & Moore, J. (2017). A systematic review comparing open-book and closed-book examinations: Evaluating effects on development of critical thinking skills. Nurse Education in Practice, 27, 89-94. https://doi.org/10.1016/j.nepr.2017.08.018
  • Johnston, J., & O'Farrell, C. (2020). Rewriting the (exam) script? Assessing student learning in an unusual end-of-year context. All Ireland Journal of Higher Education, 12(2), 1-13. https://ojs.aishe.org/index.php/aishe-j/article/view/457/787
  • Kobylarek, A. (2020). Edukacja w czasach zarazy. Przypadek uniwersytetu [Education in times of plague. The university case]. Ogrody Nauk i Sztuk, 10, 7-13. https://doi.org/10.15503/onis2020.7.13
  • Kraśniewski, A. (2020). O jakości kształcenia w czasach COVID-19: stare odpowiedzi na nowe pytania? In J. Lubacz, Nauczanie po pandemii. Nowe pytania czy nowe odpowiedzi na stare pytania? [Post-pandemic teaching. New questions or new answers to old questions?] (pp. 39-50). Wydawnictwo SGGW. http://www.ipwc.pw.edu.pl/pliki/Nauczanie-po-pandemii-2020.pdf
  • Mohanna, K., & Patel, A. (2016). Overview of Open Book-Open Web Exam over Blackboard under E-Learning System. 2015 Fifth International Conference on e-Learning (econf) (pp. 396-402). Bahrain: Manama. https://doi.org/10.1109/ECONF.2015.81
  • Para, A. (2021). Możliwości wykorzystania grywalizacji w zdalnej edukacji [The use of gamification in distance education]. e-mentor, 1(88), 21-29. https://doi.org/10.15219/em88.1499
  • Pokrzycka, L. (2021). Rola aplikacji dydaktycznych w nauczaniu zdalnym [The role of educational applications in distance learning]. e-mentor, 1(88), 30-36. https://doi.org/10.15219/em88.1500
  • Puchkov, E., Knyaginina, N., Novoselov, I., & Jankiewicz, S. (2020). COVID-19 and final (state) examination: Strategies of international and Russian universities. Białostockie Studia Prawnicze, 25(4), 257-271. https://doi.org/10.15290/bsp.2020.25.04.17
  • Romaniuk, M. W. (2015a). Digital competences of Maria Grzegorzewska Academy of Special Education students - Method and results of a survey. International Journal of Electronics and Telecommunications, 61(3), 267-272. https://doi.org/10.1515/eletel-2015-0035
  • Romaniuk, M. W. (2015b). E-learning in College on the example of Academy of Special Education. International Journal of Electronics and Telecommunications, 61(1), 25-29. https://doi.org/10.1515/eletel-2015-0003
  • Romaniuk, M. W., & Łukasiewicz-Wieleba, J. (2020a). Crisis remote education at The Maria Grzegorzewska University during social isolation in the opinions of academic teachers. International Journal of Electronics and Telecommunications, 66(4), 801-806. https://doi.org/10.24425/ijet.2020.135673
  • Romaniuk, M. W., & Łukasiewicz-Wieleba, J. (2020b). Crisis remote education at The Maria Grzegorzewska University during social isolation in the opinions of students. International Journal of Electronics and Telecommunications, 66(4), 807-812. https://doi.org/10.24425/ijet.2020.135675
  • Romaniuk, M. W., & Łukasiewicz-Wieleba, J. (2020c). Zdalna edukacja kryzysowa w APS w okresie pandemii COVID-19 [Remote crisis education at The Maria Grzegorzewska University during the COVID-19 pandemic]. https://doi.org/10.13140/RG.2.2.18059.52006
  • Romaniuk, M. W., & Łukasiewicz-Wieleba, J. (2021a). Crisis remote education from the perspective of one-year experience of academic teachers. International Journal of Electronics and Telecommunications, 67(2), 213-219. https://doi.org/10.24425/ijet.2021.135967
  • Romaniuk, M. W., & Łukasiewicz-Wieleba, J. (2021b). Crisis remote education from the perspective of one-year experience of students. International Journal of Electronics and Telecommunications, 67(2), 221-227. https://doi.org/10.24425/ijet.2021.135968
  • Romaniuk, M. W., Łukasiewicz-Wieleba, J., & Kohut, S. (2020). Nauczyciele akademiccy wobec kryzysowej edukacji zdalnej [Academic teachers in the face of crisis remote education]. e-mentor, 5(87), 15-26. https://doi.org/10.15219/em87.1489
  • Rybalko, I., Bukrieieva, O., & Skrypnyk, N. (2020). The use of active learning methods to stimulate student activity in the online course. e-mentor, 4(86), 47-53. https://doi.org/10.15219/em86.1481
  • Rzecznik Praw Obywatelskich. (2020, June 10). Koronawirus. Zdalne egzaminy na uczelniach pod lupą Rzecznika. https://www.rpo.gov.pl/pl/content/koronawirus-zdalne-egzaminy-na-uczelniach-pod-lupa-rpo
  • Sam, A. H., Reid, M. D., & Amin, A. (2020). High-stakes, remote-access, open-book examinations. Medical Education, 54(8), 767-768. https://doi.org/10.1111/medu.14247
  • Tilak, P., Deshmukh, M., Phadke, S., & Hakim, S. S. (2020). A survey on online examination during COVID 19 pandemic: Perception of management students. Mukt Shabd Journal, 9(8), 285-290.
  • Tuah, N. A., & Naing, L. (2021). Is online assessment in higher education institutions during COVID-19 pandemic reliable? Siriraj Medical Journal, 73(1), 61-68. https://doi.org/10.33192/Smj.2021.09
  • Vazquez, J. J., Chiang, E. P., & Sarmiento-Barbieri, I. (2021). Can we stay one step ahead of cheaters? A field experiment in proctoring online open book exams. Journal of Behavioral and Experimental Economics, 90, 101653. https://doi.org/10.1016/j.socec.2020.101653
  • Wahid, R., & Farooq, O. (2020). Online exams in the time of COVID-19: quality parameters. International Journal of Social Sciences and Educational Studies, 7(4), 13-21. https://ijsses.tiu.edu.iq/index.php/volume-7-issue-4-article-2/
  • Wskazówki dla nauczycieli akademickich w sprawie egzaminów realizowanych zdalnie w Akademii Pedagogiki Specjalnej im. Marii Grzegorzewskiej. [Guidelines for academic teachers on remotely administered exams at The Maria Grzegorzewska University] (2020, May 25) http://www.aps.edu.pl/media/2392236/28052020nauczyciele-instrukcja-egzaminowania-tp-i-kk-20200521.pdf
  • Wyrwa, F., Wyrwa, M., & Wilkus-Wyrwa, A. (2020). Wyzwania nauczania zdalnego. Perspektywa nauczyciela i ucznia [Distance learning challenges. Teacher and student perspective]. In XXVI Konferencja Diagnostyki Edukacyjnej - Rola społeczna diagnostyki edukacyjnej (pp. 363-381). PTDE. http://www.ptde.org/pluginfile.php/1457/mod_page/content/19/XXVI_363_381_wyrwa.pdf
AUTHORS

Miłosz Wawrzyniec Romaniuk

The author is a doctor of pedagogical sciences, assistant professor at the Department of Methodology and Pedagogy of Creativity at The Maria Grzegorzewska University. He is interested in sail training in theory and in practice. He conducts scientific research and takes part in seagoing voyages of the School under Sails with young people as the head of the school and the watch officer. He is interested in new technologies and their use in teaching and learning.

Joanna Łukasiewicz-Wieleba

The author is a post-doc, professor at The Maria Grzegorzewska University. For years, she has been dealing with the issues of gifted education and the development of predispositions with the use of IT tools. She is an external expert of the Education Office of the City of Warsaw for gifted students, and carries out educational and research projects, including those related to modern technologies in education.

About the article

DOI: https://doi.org/10.15219/em90.1519

The article is in the printed version on pages 22-31.

pdf read the article (English)

How to cite

Romaniuk, M. W. & Łukasiewicz-Wieleba, J. (2021). Challenges of administering university examinations remotely during the COVID-19 pandemic. e-mentor, 3(90), 22-31. https://doi.org/10.15219/em90.1519