Evaluation of User Experience in the Extraordinary Computer-Based Test Application for HTML Programming Course Material
##plugins.themes.academic_pro.article.sidebar##
##plugins.themes.academic_pro.article.main##
Abstract
This study aims to evaluate the use of the Extraordinary Computer-Based Test (CBT) application in assessing the HTML Programming course at the Politeknik Pelayaran Sumatera Barat. The method used is quantitative with a program evaluation design based on the CIPP model (Context, Input, Process, Product). The subjects of the study consisted of 62 third-semester students from the eighth batch of 2024, divided into three classes. Data were collected through learning achievement tests, questionnaires, and practical assessment rubrics, focusing on the cognitive, affective, and psychomotor domains. The results of the study indicate that the CBT application is effective in improving students' learning outcomes. The average score for the cognitive aspect reached 83, with the highest scores in the structure and development of HTML applications. The affective evaluation showed positive student responses to CBT, with an affective aspect score of 82, while the psychomotor evaluation showed adequate practical skills with a score of 80. This study reveals that CBT enhances the effectiveness of assessments and enriches students' learning experiences by providing real-time feedback and more personalized guidance. The findings contribute to the development of technology-based learning tools and offer practical solutions to improve the quality of education. Furthermore, this study concludes that CBT can improve the quality of evaluation and learning in HTML programming and recommends further development to integrate other technologies into the learning process.
##plugins.themes.academic_pro.article.details##
This work is licensed under a Creative Commons Attribution 4.0 International License.
PAKAR Pendidikan is licensed under a Creative Commons Attribution 4.0 International License
Free to:
- Share — copy and redistribute the material in any medium or format
- Adapt — remix, transform, and build upon the material for any purpose, even commercially.
PAKAR Pendidikan Journal is licensed under a Creative Commons Attribution 4.0 International License. This permits anyone to copy, redistribute, remix, transmit and adapt the work provided the original work and source are appropriately cited.
This means:
(1) Under the CC-BY license, authors retain ownership of the copyright for their article, but authors grant others permission to use the content of publications in INVOTEK Journal in whole or in part provided that the original work is properly cited. Users (redistributors) of PAKAR Pendidikan Journal are required to cite the original source, including the author's name, PAKAR Pendidikan Journal as the initial source of publication, year of publication, volume number, issue, and Digital Object Identifier (DOI);
(2) Authors grant PAKAR Pendidikan the right of first publication. Although authors remain the copyright owner.
Privacy Statement
The names, email addresses, and affiliations entered in this journal site will be used exclusively for the stated purpose of providing readers professional access to the authors whose articles are published by the journal. No other information is collected, and will not be made available for any other purpose or to any other party.
References
Ahnan, M., Wibawa, A., & Zaeni, I. (2021). Evaluasi User Experience pada Pengembangan Aplikasi Sistem ADI STETSA SMAN 4 Malang menggunakan User Experience Questionnaire. Jurnal Inovasi Teknologi Dan Edukasi Teknik, 1(7), 518–525. https://doi.org/10.17977/um068v1i72021p518-525
Alqahtani, A. Y., & Rajkhan, A. A. (2020). E-learning critical success factors during the covid-19 pandemic: A comprehensive analysis of e-learning managerial perspectives. Education Sciences, 10(9), 1–16. https://doi.org/10.3390/educsci10090216
Anchors, Z. G., Moore, L. J., Burnard, S. D., Bressington, C. A., Moreton, A. E., & Arnold, R. (2024). A mixed-methods stress audit with midwives in the United Kingdom. Women and Birth, 37(5), 101639. https://doi.org/10.1016/j.wombi.2024.101639
Austin, S. F., Jansen, J. E., Petersen, C. J., Jensen, R., & Simonsen, E. (2020). Mobile app integration into dialectical behavior therapy for persons with borderline personality disorder: Qualitative and quantitative study. JMIR Mental Health, 7(6), 1–11. https://doi.org/10.2196/14913
Babadi, F., Esfandiari, M., & Cheraghi, M. (2024). Evaluating the dentistry program in Iran using the context, input, process, and product (CIPP) model: a comprehensive analysis. Frontiers in Medicine, 11(July), 1–6. https://doi.org/10.3389/fmed.2024.1394395
Basar, A. R., Jalil, S. ’Afiat, Adi, N. H., & Gunawan, R. H. (2023). Computer Network Design Using the Simple Queue Method in Maximising Network Performance in Companies. Journal of Computer-Based Instructional Media, 1(2), 68–81. https://doi.org/10.58712/jcim.v1i2.108
Basaran, M., Dursun, B., Gur Dortok, H. D., & Yilmaz, G. (2021). Evaluation of Preschool Education Program According to CIPP Model. Pedagogical Research, 6(2), em0091. https://doi.org/10.29333/pr/9701
Cahyaningsih, E., Fitriyanti, A., Islam, U., Sunan, N., & Yogyakarta, K. (2024). Utilization of Computer-Based Testing Technology to Optimize Cognitive-Based Assessment Literacy in the Learning of Islamic Elementary School Students. Journal of Integrated Elementary Education, 4(2), 151–172. https://doi.org/10.21580/jieed.v4i2.21943
Efendi, R., Lesmana, L. S., Putra, F., Yandani, E., & Wulandari, R. A. (2021). Design and Implementation of Computer Based Test (CBT) in vocational education. Journal of Physics: Conference Series, 1764(1), 1–12. https://doi.org/10.1088/1742-6596/1764/1/012068
Ghaffar, M. A., Khairallah, M., & Salloum, S. (2020). Co-constructed rubrics and assessment for learning: The impact on middle school students’ attitudes and writing skills. Assessing Writing, 45, 100468. https://doi.org/10.1016/j.asw.2020.100468
Hamilton, D., McKechnie, J., Edgerton, E., & Wilson, C. (2021). Immersive virtual reality as a pedagogical tool in education: a systematic literature review of quantitative learning outcomes and experimental design. In Journal of Computers in Education (Vol. 8, Issue 1). Springer Berlin Heidelberg. https://doi.org/10.1007/s40692-020-00169-2
Hanafi, Adi, N. H., Kusuma, A. B., & Le, S. K. (2023). Development of Web-Based Computer Laboratory Management Information System at SMKS Pertiwi Batam. Journal of Computer-Based Instructional Media, 1(2), 54–67. https://doi.org/10.58712/jcim.v1i2.107
Jebb, A. T., Ng, V., & Tay, L. (2021). A Review of Key Likert Scale Development Advances: 1995–2019. Frontiers in Psychology, 12(May), 1–14. https://doi.org/10.3389/fpsyg.2021.637547
Maricar, M. A., Edwar, Anisa, A. P. N., & Simangunsong, B. F. (2023). Evaluasi User Experience Terhadap Website Maidekost Menggunakan Use Questionnaire. Tematik, 10(1), 67–73. https://doi.org/10.38204/tematik.v10i1.1298
Mohebi, S., Parham, M., Sharifirad, G., & Gharlipour, Z. (2018). Social Support and Self ‑ Care Behavior Study. January, 1–6. https://doi.org/10.4103/jehp.jehp
Owan, V. J., Abang, K. B., Idika, D. O., Etta, E. O., & Bassey, B. A. (2023). Exploring the potential of artificial intelligence tools in educational measurement and assessment. Eurasia Journal of Mathematics, Science and Technology Education, 19(8), 1–15. https://doi.org/10.29333/ejmste/13428
Park, Y. S., Konge, L., & Artino, A. R. (2020). The Positivism Paradigm of Research. Academic Medicine, 95(5), 690–694. https://doi.org/10.1097/ACM.0000000000003093
Prasetya, F., Fortuna, A., Samala, A. D., Fajri, B. R., Efendi, F., & Nyamapfene, A. (2023). Effectiveness of Distance Learning Computer Numerical Control Based on Virtual Laboratory Using a Metaverse Platform to Improve Students’ Cognitive Ability and Practice Skills. International Journal of Interactive Mobile Technologies (IJIM), 17(24), 4–21. https://doi.org/10.3991/ijim.v17i24.45019
Prasetya, F., Fortuna, A., Samala, A. D., Rawas, S., Mystakidis, S., Syahril, S., Waskito, W., Primawati, P., Wulansari, R. E., & Kassymova, G. K. (2024). The impact of augmented reality learning experiences based on the motivational design model: A meta-analysis. Social Sciences & Humanities Open, 10(May), 100926. https://doi.org/10.1016/j.ssaho.2024.100926
Rachman, A. Z., & Nugrahawan, A. R. (2024). Evaluation of Arabic Language Learning Assessment Using the CBT Application at SMA Muhammadiyah 4 Jakarta with the CIPP Model. Tarbiyah Wa Ta’lim: Jurnal Penelitian Pendidikan Dan Pembelajaran, 11(1), 39–51. https://doi.org/10.21093/twt.v11i2.8745
Rahim, B., Ambiyar, A., Waskito, W., Fortuna, A., Prasetya, F., Andriani, C., Andriani, W., Sulaimon, J., Abbasinia, S., Luthfi, A., & Salman, A. (2024). Effectiveness of Project-Based Learning in Metal Welding Technology Course with STEAM Approach in Vocational Education. TEM Journal, 13(2), 1481–1492. https://doi.org/10.18421/TEM132-62
Sansi, A. S., Rini, F., Mary, T., & Kiong, T. T. (2023). The development of android-based computer and basic network learning media. Journal of Computer-Based Instructional Media, 1(2), 44–53. https://doi.org/10.58712/jcim.v1i2.19
Sharma, L. R., Bidari, S., Bidari, D., Neupane, S., & Sapkota, R. (2023). Exploring the Mixed Methods Research Design : Types , Purposes , Strengths , Challenges , and Criticisms. Global Academic Journal of Linguistics and Literature, 5(1), 1–12. https://doi.org/10.36348/gajll.2023.v05i01.002
Siallagan, L., & Hanafi. (2024). Optimizing spare part monitoring: Innovative dashboard system design for commanditaire vennotschaap using rapid application development. Journal of Computer-Based Instructional Media, 2(1), 31–41. https://doi.org/10.58712/jcim.v2i1.129
Ulaş, S., & Seçer, İ. (2022). Developing a CBT-Based Intervention Program for Reducing School Burnout and Investigating Its Effectiveness With Mixed Methods Research. Frontiers in Psychology, 13(July), 1–15. https://doi.org/10.3389/fpsyg.2022.884912
Wulansari, R. E., Fortuna, A., Marta, R., Primawati, P., Masek, A., Kaya, D., Prasetya, F., Sakti, R. H., Luthfi, A., Rizki, I. A., Hasna, F. H., & Eshaghi, S. (2024). Revolutionizing Learning: Unleashing the Power of Technology Gamification-Augmented Reality in Vocational Education. TEM Journal, 13(3), 2384–2397. https://doi.org/10.18421/TEM133-65
Yılmaz, A. (2021). The effect of technology integration in education on prospective teachers’ critical and creative thinking, multidimensional 21st century skills and academic achievements. Participatory Educational Research, 8(2), 163–199. https://doi.org/10.17275/per.21.35.8.2