UJIAN MELALUI GFORM, MUDAHKAH DITEBAK? ANALISIS ITEM RESPONSE THEORY 3 PARAMETER LOGISTIK
Abstract
Quality assessment is essential for measuring students' abilities, but challenges such as guessing in multiple-choice questions can reduce test validity. This study aims to evaluate the quality of test items using the 3 Parameter Logistic (IRT 3PL) Item Response Theory model. A total of 191 students answered 40 multiple-choice questions. The analysis included item-total correlation, point biserial correlation, and IRT 3PL parameters (discrimination, difficulty, guessing). Results showed that most items had good quality (A > 1; p > 0.05), although some items, such as item 6 and 31, required revision. Conclusion: The test instrument is adequate, but items with high guessing probabilities or low discrimination need improvement to enhance the test's validity and reliability.
Penilaian berkualitas penting untuk mengukur kemampuan peserta didik, tetapi tantangan seperti menebak dalam soal pilihan ganda dapat mengurangi validitas tes. Penelitian ini bertujuan mengevaluasi kualitas butir soal menggunakan Model Item Response Theory 3 Parameter Logistic (IRT 3PL). Sebanyak 191 mahasiswa mengerjakan 40 soal pilihan ganda. Analisis meliputi korelasi item-total, point biserial, dan parameter IRT 3PL (daya pembeda, tingkat kesulitan, peluang menebak). Hasilnya sebagian besar butir memiliki kualitas baik (A > 1; p > 0,05), meskipun beberapa butir seperti item 6 dan 31 memerlukan revisi. Kesimpulan: Instrumen tes memadai, tetapi butir dengan peluang menebak tinggi atau daya pembeda rendah perlu diperbaiki untuk meningkatkan validitas dan reliabilitas tes.
Keywords
Full Text:
PDFReferences
Almaleki, D. A., & Alomrany, A. G. (2021). The effect of methods of estimating the ability on the accuracy and items parameters according to 3PL model. International Journal of Computer Science & Network Security, 21(7), 93–102. https://koreascience.kr/article/JAKO202123563866608.page
Baker, F. B. (2001). The Basics of Item Response Theory. ERIC Clearinghouse.
Beerkens, M. (2020). Evidence-based policy and higher education quality assurance: progress, pitfalls and promise. In Impact Evaluation of Quality Management in Higher Education (pp. 38–53). Routledge. https://www.taylorfrancis.com/chapters/ edit/10.4324/9780429293276-4/evidence-based-policy-higher-education-quality-assurance-progress-pitfalls-promise-maarja-beerkens
Bulut, O. (2021). Beyond multiple-choice with digital assessments. ELearn, 2021(Special Issue), 1–10. https://dl.acm.org/doi/abs/10.1145/3472394
Çekiç, A., & Bakla, A. (2021). A review of digital formative assessment tools: Features and future directions. International Online Journal of Education and Teaching, 8(3), 1459–1485. https://eric.ed.gov/?id=EJ1308016
Cosi, A., Voltas, N., Lázaro-Cantabrana, J. L., Morales, P., Calvo, M., Molina, S., & Quiroga, M. Á. (2020). Formative assessment at university through digital technology tools. Profesorado, Revista de Currículum y Formación Del Profesorado, 24(1), 164–183. https://revistaseug.ugr.es/index.php/profesorado/article/view/9314
Ebel, R. L., & Frisbie, D. A. (1991). Essentials of Educational Measurement (5th ed.). Prentice Hall.
Hambleton, R. K., Swaminathan, H., & Rogers, H. J. (1991). Fundamentals of Item Response Theory. Sage Publications.
Hill, J., & West, H. (2020). Improving the student learning experience through dialogic feed-forward assessment. Assessment & Evaluation in Higher Education. https://www.tandfonline.com/doi/shareview/10.1080/02602938.2019.1608908
Irons, A., & Elkington, S. (2021). Enhancing learning through formative assessment and feedback. In taylorfrancis.com. Routledge. https://www.taylorfrancis.com/books/ mono/10.4324/9781138610514/enhancing-learning-formative-assessment-feed back-alastair-irons-sam-elkington
Kusairi, S. (2020). A web-based formative feedback system development by utilizing isomorphic multiple choice items to support physics teaching and learning. Journal of Technology and Science Education, 10(1), 117–126. https://eric.ed.gov/ ?id=EJ1247013
Mueller, D. J. (1986). Measuring Social Attitudes: A Handbook for Researchers and Practitioners. Teachers College Press.
Rios, J. A. (2022). Assessing the accuracy of parameter estimates in the presence of rapid guessing misclassifications. Educational and Psychological Measurement, 82(1), 122–150. https://journals.sagepub.com/doi/abs/10.1177/00131644211003640
Robitzsch, A. (2022). Four-parameter guessing model and related item response models. Mathematical and Computational Applications, 27(6), 95. https://www.mdpi.com/2297-8747/27/6/95
Ryan, A., Judd, T., Swanson, D., Larsen, D. P., Elliott, S., Tzanetos, K., & Kulasegaram, K. (2020). Beyond right or wrong: More effective feedback for formative multiple-choice tests. Perspectives on Medical Education, 9, 307–313. https://link.springer.com/article/10.1007/S40037-020-00606-Z
Say, R., Visentin, D., Cummings, E., Carr, A., & King, C. (2022). Formative online multiple-choice tests in nurse education: An integrative review. Nurse Education in Practice, 58, 103262. https://www.sciencedirect.com/science/article/pii/ S147159532 1002 985
Stevens, D. D., & Levi, A. J. (2023). Introduction to rubrics: An assessment tool to save grading time, convey effective feedback, and promote student learning. In taylorfrancis.com. Routledge. https://www.taylorfrancis.com/books/mono/10.432 4/97810034 45432/introduction-rubrics-dannelle-stevens-antonia-levi
Subramaniam, A. V. V., Gupta, R., Singh, N., & Ravishankar, M. (2019). Usefulness of Multiple Choice Question-Based Online Formative Assessments for Determination of Item Statistics. Journal of Research in Medical Education & Ethics, 9(2), 119–125. https://www.indianjournals.com/ijor.aspx?target=ijor:jrmee&volume=9&issue=2&article=007
Yılmaz, F. G. K., Ustun, A. B., & Yılmaz, R. (2020). Investigation of pre-service teachers’ opinions on advantages and disadvantages of online formative assessment: an example of online multiple-choice exam. Journal of Teacher Education and Lifelong Learning, 2(1), 1–8. https://dergipark.org.tr/en/pub/tell/issue/52517/718396
Alea, L. A., Fabrea, M. F., Roldan, R. D. A., & Farooqi, A. Z. (2020). Teachers’ Covid-19 awareness, distance learning education experiences and perceptions towards institutional readiness and challenges. International Journal of Learning, Teaching and Educational Research, 19(6), 127–144. http://ijlter.net/index.php/ijlter/ article/view/308
Elsalem, L., Al-Azzam, N., Jum’ah, A. A., & Obeidat, N. (2021). Remote E-exams during Covid-19 pandemic: A cross-sectional study of students’ preferences and academic dishonesty in faculties of medical sciences. Annals of Medicine and Surgery, 62, 326–333. https://journals.lww.com/annals-of-medicine-and-surgery/fulltext/2021/02 000/Remote_E_exams_during_Covid_19_pandemic__A.69.aspx
Elsalem, L., Al-Azzam, N., Jum’ah, A. A., Obeidat, N., Sindiani, A. M., & Kheirallah, K. A. (2020). Stress and behavioral changes with remote E-exams during the Covid-19 pandemic: A cross-sectional study among undergraduates of medical sciences. Annals of Medicine and Surgery, 60, 271–279. https://www.sciencedirect.com/ science/article/pii/S2049080120304131
Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: a case study of Middle East College. Educational Assessment, Evaluation and Accountability, 32, 519–535. https://link.springer.com/article/10.1007/s11092-020-09340-w
Mahyoob, M. (2020). Challenges of e-Learning during the COVID-19 Pandemic Experienced by EFL Learners. Arab World English Journal (AWEJ), 11(4). https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3652757
Selvaraj, A., Radhin, V., Nithin, K. A., Benson, N., & Mathew, A. J. (2021). Effect of pandemic based online education on teaching and learning system. International Journal of Educational Development, 85, 102444. https://www.sciencedirect.com/science/ article/pii/S0738059321000973
DOI: https://doi.org/10.17509/e.v24i1.77831
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 EDUTECH
Ciptaan disebarluaskan di bawah Lisensi Creative Commons Atribusi-BerbagiSerupa 4.0 Internasional.