Abstract

Open Badges have become a metadata standard that has been used to transform digital credentialing practices in learning contexts including Massive Open Online Courses (MOOCs). Badges may be designed and used in diverse ways to enhance learner motivation in MOOCs. However, empirical research about the motivational effects of the badging process has been limited to anecdotal evidence. Objective: The goal of this study was to explore the motivational effects of open badges in MOOCs. The primary research question was whether and how open badges motivate participants to: a) learn in MOOCs, b) to complete MOOCs, and c) to use Open Badges outside of the MOOC environment. Method: An exploratory learner perception study was conducted in two platforms: OpenVM and MiriadaX. Both platforms issue Open Badges to recognize learning outcomes in MOOCs. The research sample included 1788 participants with diverse backgrounds, who participated in OpenVM (n = 1412) and in MiriadaX (n = 376) courses. Learner perceptions were self-reported via two online surveys, which included an aligned set of items in English (OpenVM) and Spanish (MiriadaX). Results: The findings show that regardless of the MOOC platform, the topic of the course and the language of instruction, MOOC participants were motivated by open badges, especially by an adequate description of the skills developed in the MOOCs. A regression analysis indicated that an adequate skill description in the open badges had the greatest predictive value for motivation to learn in MOOCs and to complete the course (r² = 56.3%). The instrument with five items showed high internal consistency (α = 0.92).

Keywords: MOOC, Open Badges, micro-credentials, motivation, competencies, skills

References

• Abramovich, S., Schunn, C., & Higashi, R. M. (2013). Are badges useful in education?: it depends upon the type of badge and expertise of learner. Education Technology Research and Development, 61, 217-232. https://doi.org/10.1007/s11423-013-9289-2
• Albelbisi, N., Yusop, F. D., & Salleh, U. K. M. (2018). Mapping the factors influencing success of massive open online courses (MOOC) in higher education. Eurasia Journal of Mathematics, Science and Technology Education, 14(7), 2995-3012. https://doi.org/10.29333/ejmste/91486
• Bakki, A., Oubahssi, L., Cherkaoui, C., & George, S. (2015). Motivation and engagement in MOOCs: How to increase learning motivation by adapting pedagogical scenarios? In G. Conole, T. Klobučar, C. Rensing, J. Konert, & E. Lavoué (Eds.), Design for teaching and learning in a networked world (pp. 556-559). Springer.
• Balakrishnan, G., & Coetzee D. (2013). Predicting student retention in massive open online courses using hidden Markov models. University of California at Berkeley. http://www2.eecs.berkeley.edu/Pubs/TechRpts/2013/EECS-2013-109.pdf
• Barak, M., Watted, A., & Haick, H. (2016). Motivation to learn in massive open online courses: Examining aspects of language and social engagement. Computer & Education, 94, 49-60. https://doi.org/10.1016/j.compedu.2015.11.010
• Borrás-Gené, O., Martínez-Núnez, M., & Martín-Fernández, L. (2019). Enhancing fun through gamification to improve engagement in MOOC. Informatics, 6(3), 28. https://doi.org/10.3390/informatics6030028
• Buchem, I. (2018). Design patterns for digital competency credentials based on open badges in the context of virtual mobility. Development of generative design patterns for competency credentials. In D. Schiffner (Ed.), Proceedings of DeLFI Workshops 2018, 2018 Lecture Notes in Informatics (LNI). Gesellschaft für Informatik.
• Buchem, I., & Hamelmann, H. (2010). Microlearning: a strategy for ongoing professional development. eLearning Papers, 21, 1-15.
• Buchem, I., & Carlino, C. (2018). Update of milestone 4: Implementation and user-testing of open credentials to recognise virtual mobility skills in the OpenVM Learning Hub. Open Virtual Mobility Erasmus+ (2017-2020). https://www.openvirtualmobility.eu/topics/outputs
• Buchem, I., Konert, J., Poce, A., Carlino, C., Tur, G., & Ubachs, G. (2018). Open Virtual Mobility Brochure. Erasmus+ OpenVM Project. https://www.openvirtualmobility.eu/wp-content/uploads/2020/04/OpenVM-Erasmus-brochure.pdf
• Buchem, I., Poce, A. & Tur, G. (2019). Microlearning in MOOCs. A case study on designing engaging micro-learning experiences in the Media and Digital Literacy MOOC. Comunicación y Pedagogía, 315-316, 7-12.
• Buchem, I., Amenduni, F., Poce, A., Andone, D. Mihaescu, V., Tur, G., Urbina Ramírez, S., & Smitek, B. (2020). Integrating mini-MOOCs into study programs in higher education during COVID-19. Five pilot case studies in context of the open virtual mobility project. In S. K. Softic, D., Andone, & A. Szucs (Eds.), Human and artificial intelligence for the society of the future (pp. 299-310). https://proceedings.eden-online.org/wp-content/uploads/2020/09/Annual_2020_Timisoara_Proceedings_ISSN.pdf
• Buchem, I., Carlino, C., Amenduni, F. & Poce, A. (2020). Meaningful gamification in MOOCs. Designing and examining learner engagement in the Open Virtual Mobility Learning Hub. In Proceedings of the 14th International Technology, Education and Development Conference (9529-9534). IATED. https://doi.org/10.21125/inted.2020.1661
• Challen, G., & Seltzer, M. (2014). Enabling MOOC collaborations through modularity. In Proceedings of the 2014 Learning with MOOCs Practitioner's Workshop.
• Chaw, L. Y., & Tang, C. M. (2019). Driving high inclination to complete massive open online courses (MOOCs): motivation and engagement factors for learners. The Electronic Journal of e-Learning, 17(2), 118-130. https://doi.org/10.34190/JEL.17.2.05
• Coffrin, C., Corrin, L., de Barba, P., & Kennedy, G. (2014, March). Visualizing patterns of student engagement and performance in MOOCs. In Proceedings of the Fourth International Conference on Learning Analytics and Knowledge (pp. 83-92). https://doi.org/10.1145/2567574.2567586
• Cross, S., Whitelock, D., & Galley, R. (2014). The use, role and reception of open badges as a method for formative and summative reward in two Massive Open Online Courses. International Journal of e-Assessment, 4(1). https://ijea.org.uk/index.php/journal/article/view/72
• Deshpande, A., & Chukhlomin, V. (2017). What Makes a Good MOOC: A Field Study of Factors Impacting Student Motivation to Learn. American Journal of Distance Education, 31, 275-293. https://doi.org/10.1080/08923647.2017.1377513
• Dillenbourg, P., Fox, A., Kirchner, C., Mitchell, J., & Wirsing, M. (2014). Massive open online courses: current state and perspectives (Dagstuhl perspectives workshop 14112). Dagstuhl Manifestos, 4(1), 1-27. https://doi.org/10.4230/DagMan.4.1.1
• Downes, S. (2019). Recognising achievement with badges and blockchain in a Connectivist MOOC. Journal of Learning for Development, 6(3), 273-286.
• Duru, I., Dogan G., & Diri, B. (2016). An overview of studies about students' performance analysis and learning analytics in MOOCs. In 2016 IEEE International Conference on Big Data (Big Data) (pp. 1719-1723). https://doi.org/10.1109/BigData.2016.7840786
• Fidalgo-Blanco, Á., Sein-Echaluce, M. L., & García-Penalvo, F. J. (2016). From massive access to cooperation: lessons learned and proven results of a hybrid xMOOC/cMOOC pedagogical approach to MOOCs. International Journal of Educational Technology in Higher Education, 13(1), 24. https://doi.org/10.1186/s41239-016-0024-z
• García-Penalvo, F. J., Cruz-Benito, J., Borrás-Gené, O., & Blanco, Á. F. (2015, August). Evolution of the conversation and knowledge acquisition in social networks related to a MOOC course. In P. Zaphiris, & A. Ioannou (Eds.), Learning and collaboration technologies (pp. 470-481). Springer. https://doi.org/10.1007/978-3-319-20609-7_44
• Grant, S. (2014). What counts as learning: Open digital badges for new opportunities. Digital Media and Learning Research Hub. https://dmlhub.net/publications/what-counts-learning/index.html
• Haug S., Wodzicki K., Cress U., & Moskaliuk J. (2014). Self-regulated learning in MOOCs: Do open badges and certificates of attendance motivate learners to invest more? In U. Cress, & C. D. Kloos (Eds.), EMOOCs 2014 - European MOOC stakeholder summit (pp. 66-72). P.A.U. Education.
• Hew, K. F. (2015). Towards a model of engaging online students: Lessons from MOOCs and four policy documents. International Journal of Information and Education Technology, 5(6), 425-431. https://doi.org/10.7763/IJIET.2015.V5.543
• Hew, K. F. (2016). Promoting engagement in online courses: What strategies can we learn from three highly rated MOOCs. British Journal of Educational Technology, 47(2), 320-341. https://doi.org/10.1111/bjet.12235
• Hickey, D. T., & Chartrand, G. T. (2019). Recognizing competencies vs. completion vs. participation: Ideal roles for web-enabled digital badges. Education and Information Technologies, 25(2), 943-956. https://doi.org/10.1007/s10639-019-10000-w
• Hickey, D. T., & Schenke, K. (2019). Open digital badges and reward structures. In K. A. Renninger, & S. E. Hidi (Eds.), The Cambridge handbook on motivation and learning (pp. 209-237). Cambridge University Press.
• Higashi, R., Abramovich, S., Shoop, R., & Schunn, C. (2012). The roles of badges in the computer science student network. In C. Martin, A. Ochsner, & K. Squire (Eds.), Conference Proceedings (pp. 423-429). Carnegie Mellon University: ETC Press.
• Hone, K. S., & El Said, G. R. (2016). Exploring the factors affecting MOOC retention: A survey study. Computers & Education, 98, 157-168. https://doi.org/10.1016/j.compedu.2016.03.016
• Jiang, S., Williams, A. E., Schenke, K., Warschauer, M., & O'Dowd, D. K. (2014). Predicting MOOC performance with Week 1 Behavior. EDM.
• Jovanovic, J., & Devedzic, V. (2015). Open badges: Novel means to motivate, scaffold and recognize learning. Technology, Knowledge and Learning, 20(1), 115-122. https://doi.org/10.1007/s10758-014-9232-6
• Kizilcec, R. F., Piech, C., & Schneider, E. (2013, April). Deconstructing disengagement: analyzing learner subpopulations in massive open online courses. In Proceedings of the third international conference on learning analytics and knowledge (pp. 170-179). https://doi.org/10.1145/2460296.2460330
• Konert, J., Buchem, I., & Stoye, J. (2019). Digitales Kompetenzverzeichnis mit Technologien des Semantic Web [Digital competency directory using semantic web technologies]. In S. Schulz (Ed.), Proceedings of DELFI Workshops 2019 (pp. 61-70). Gesellschaft für Informatik. https://doi.org/10.18420/delfi2019-ws-108
• Lemoine, P. A., & Richardson, M. D. (2015). Micro-credentials, nano degrees, and digital badges: New credentials for global higher education. International Journal of Technology and Educational Marketing (IJTEM), 5(1), 36-49. https://doi.org/10.4018/ijtem.2015010104
• Liyanagunawardena, T. R., & Williams, S. A. (2014). Massive open online courses on health and medicine: review. Journal of Medical Internet Research, 16(8):e191. https://doi.org/10.2196/jmir.3439
• Ma, X. (2015). Evaluating the implication of open badges in an open learning environment to higher education. In 2nd International Conference on Education Reform and Modern Management (pp. 105-108). Atlantis Press.
• Martin, F. G. (2012). Will massive open online courses change how we teach? Communications of the ACM, 55(8), 26-28. https://doi.org/10.1145/2240236.2240246
• McAuley, A., Stewart, B., Siemens, G., & Cormier, D. (2010). The MOOC model for digital practice. University of Prince Edward Island.
• MiriadaX. (n.d.). Our numbers. Retrieved June 2, 2020 from https://miriadax.net/en/nuestros-numeros
• Ortega-Arranz, A., Bote-Lorenzo, M. L., Asensio-Pérez, J. I., Martínez-Monés, A., Gómez-Sánchez, E., & Dimitriadis, Y. A. (2019). To reward and beyond: Analyzing the effect of reward-based strategies in a MOOC. Computers & Education, 142. https://doi.org/10.1016/j.compedu.2019.103639
• Peco, P. P., & Lujan-Mora, S. (2013). Architecture of a MOOC based on CourseBuilder. In 12th International Conference on Information Technology Based Higher Education and Training (ITHET) (pp. 1-8). IEEE. https://doi.org/10.1109/ITHET.2013.6671045
• Pickard, L., Shah, D., & Simone, J. J. (2018). Mapping microcredentials across MOOC platforms. In 2018 Learning with MOOCS (LWMOOCS) (pp. 17-21). https://doi.org/10.1109/LWMOOCS.2018.8534617
• Pilli, O., & Admiraal, W. (2016). A taxonomy of massive open online courses. Contemporary Educational Technology, 7(3), 223-240. https://doi.org/10.30935/cedtech/6174
• Rai, L., & Chunrao, D. (2016). Influencing factors of success and failure in MOOC and general analysis of learner behavior. International Journal of Information and Education Technology, 6(4), 262-268. https://doi.org/10.7763/IJIET.2016.V6.697
• Reich, J., & Ruipérez-Valiente, J. A. (2019). The MOOC pivot. Science, 363(6423), 130-131. https://doi.org/10.1126/science.aav7958
• Reparaz, C., Aznárez-Sanado, M., & Mendoza, G. (2020). Self-regulation of learning and MOOC retention. Computers in Human Behavior, 111. https://doi.org/10.1016/j.chb.2020.106423
• Rughiniş, R., & Matei, S. (2013). Digital badges: signposts and claims of achievement. In C. Stephanidis (Ed.), HCI International 2013 - Posters' Extended Abstracts (pp. 84-88). Springer. https://doi.org/10.1007/978-3-642-39476-8_18
• Shukor, N. A., & Abdullah, Z. (2019). Using learning analytics to improve MOOC instructional design. International Journal of Emerging Technologies in Learning, 14(24), 6-17. https://doi.org/10.3991/ijet.v14i24.12185
• Tovar, E., Dimovska, A., Piedra, N., & Chicaiza, J. (2013). OCW-S: Enablers for building sustainable open education evolving OCW and MOOC. In 2013 IEEE Global Engineering Education Conference (EDUCON) (pp. 1262-1271). https://doi.org/10.1109/EduCon.2013.6530269
• Witthaus, G., Inamorato dos Santos. A., Childs, M., Tannhäuser, A., Conole, G., Nkuyubwatsi, B., & Punie, Y. (2016). Validation of non-formal MOOC-based learning: An analysis of assessment and recognition practices in Europe (OpenCred). EUR 27660 EN. https://doi.org/10.2791/809371