Rasch Analysis of FOCUS for Simple Harmonic Motion: Assessing Students' Mental Model

Tresna Galih Sukma Suryana, Nurdini Nurdini, Dudung Abdurrahman, Yuvita Oktarisa, Achmad Samsudin

Abstract


This research investigates the development and validation of the Four-Tier Observation and Concept Understanding Scaffold (FOCUS) instrument to identify high school students' mental models of simple harmonic motion. Employing a mixed-methods approach, the research involves qualitative analysis for instrument construction and quantitative analysis using Rasch Model techniques for empirical analysis . Data were collected from 852 respondents across five Indonesian provinces using cluster random sampling. The FOCUS instrument consists of four tiers: concept question, confidence level in responses to concept question, rationale for choices, and confidence level in rationale. Expert validation results indicate that the FOCUS instrument is valid and the results of the analysis of limited and broad trials show that the instrument is reliable and effective in diagnosing students' mental models. The findings highlight significant gaps in students' mental model of simple harmonic motion concepts, such as restorative forces, amplitude, and energy relations. This study contributes to physics education by offering a robust diagnostic tool for educators to systematically enhance and address students’ mental model.


Keywords


Rasch Analysis, Four-Tier Observation and Concept Understanding Scaffold (FOCUS), Simple Harmonic Motion, Mental Model

Full Text:

PDF

References


Abdurrahman, D., Efendi, R., & Wijaya, A. F. C. (2013). Profil Tingkat Penalaran dan Peningkatan Penguasaan Konsep Siswa SMA dalam Pembelajaran Fisika Berbasis Ranking Task Exercice Peer Instruction. Jurnal Wahana Pendidikan Fisika, 1.

Ambrose, S. A., & Lovett, M. C. (2014). Prior knowledge is more than content: skills and beliefs also impact learning. Applying Science of Learning in Education: Infusing Psychological Science into the Curriculum, 1.

Arslan, H. O., Cigdemoglu, C., & Moseley, C. (2012). A Three-Tier Diagnostic Test to Assess Pre-Service Teachers’ Misconceptions about Global Warming, Greenhouse Effect, Ozone Layer Depletion, and Acid Rain. International Journal of Science Education. https://doi.org/10.1080/09500693.2012.680618

Başer, M. (2006). Fostering conceptual change by cognitive conflict based instruction on students’ understanding of heat and temperature concepts. Eurasia Journal of Mathematics, Science and Technology Education, 2(2), 96–114.

Bond, T. G., & Fox, C. M. (2013). Applying the Rasch model: Fundamental measurement in the human sciences. Psychology Press.

Boone, W. J. (2020). Rasch basics for the novice. In Rasch Measurement: Applications in Quantitative Educational Research. https://doi.org/10.1007/978-981-15-1800-3_2

Boone, W. J., & Noltemeyer, A. (2017). Rasch analysis: A primer for school psychology researchers and practitioners. Cogent Education, 4(1). https://doi.org/10.1080/2331186X.2017.1416898

Boone, W. J., Yale, M. S., & Staver, J. R. (2014). Rasch analysis in the human sciences. In Rasch Analysis in the Human Sciences. https://doi.org/10.1007/978-94-007-6857-4

Caleon, I. S., & Subramaniam, R. (2010a). Do students know What they know and what they don’t know? Using a four-tier diagnostic test to assess the nature of students’ alternative conceptions. Research in Science Education. https://doi.org/10.1007/s11165-009-9122-4

Caleon, I. S., & Subramaniam, R. (2010b). Do students know What they know and what they don’t know? Using a four-tier diagnostic test to assess the nature of students’ alternative conceptions. Research in Science Education, 40(3), 313–337. https://doi.org/10.1007/s11165-009-9122-4

Caleon, I., & Subramaniam, R. (2013). Addressing students’ alternative conceptions on the propagation of periodic waves using a refutational text. Physics Education, 48(5). https://doi.org/10.1088/0031-9120/48/5/657

Creswell, J. W. (2014). Research design : qualitative, quantitative, and mixed methods approaches. SAGE Publications.

Delgado-Rico, E., Carretero-Dios, H., & Ruch, W. (2012). Content validity evidences in test development: An applied perspective. International Journal of Clinical and Health Psychology, 12(3), 449–460.

Eisner, E. W. (2017). The enlightened eye: Qualitative inquiry and the enhancement of educational practice. Teachers College Press.

Hill, B., Hall, J., Skouteris, H., & Currie, S. (2020). Defining preconception: Exploring the concept of a preconception population. BMC Pregnancy and Childbirth, 20(1). https://doi.org/10.1186/s12884-020-02973-1

Kaltakci-Gurel, D., Eryilmaz, A., & McDermott, L. C. (2017). Development and application of a four-tier test to assess pre-service physics teachers’ misconceptions about geometrical optics. Research in Science and Technological Education. https://doi.org/10.1080/02635143.2017.1310094

Kanli, U. (2014). A study on identifying the misconceptions of pre-service and in-service teachers about basic astronomy concepts. Eurasia Journal of Mathematics, Science and Technology Education. https://doi.org/10.12973/eurasia.2014.1120a

Liampa, V., Malandrakis, G. N., Papadopoulou, P., & Pnevmatikos, D. (2019). Development and Evaluation of a Three-Tier Diagnostic Test to Assess Undergraduate Primary Teachers’ Understanding of Ecological Footprint. Research in Science Education. https://doi.org/10.1007/s11165-017-9643-1

McDermott, L. C. (2013). Improving the teaching of science through discipline-based education research: An example from physics. European Journal of Science and Mathematics Education, 1(1), 1–12.

Nurdini, N., Ramalis, T. R., & Samsudin, A. (2019). Exploring K-11 Students ’ Conception using a Four-Tier Diagnostic Test on Static Fluid : a Case Study. April, 672–681.

Nurdini, N., Suhandi, A., Ramalis, T., Samsudin, A., Fratiwi, N. J., & Costu, B. (2020). Developing Multitier Instrument of Fluids Concepts (MIFO) to Measure Student’s Conception: A Rasch Analysis Approach. Journal of Advanced Research in Dynamical and Control Systems, 12(6).

Peşman, H., & Eryilmaz, A. (2010). Development of a three-tier test to assess misconceptions about simple electric circuits. Journal of Educational Research. https://doi.org/10.1080/00220670903383002

Rasch, G. (1966). An Item Analysis Which Takes Individual Differences Into Account. British Journal of Mathematical and Statistical Psychology, 19(1), 49–57.

Samsudin, A., Fratiwi, N. J., Ramalis, T. R., Aminudin, A. H., Costu, B., & Nurtanto, M. (2020). Using rasch analysis to develop multi-representation of tier instrument on newton’s law (motion). International Journal of Psychosocial Rehabilitation. https://doi.org/10.37200/IJPR/V24I6/PR260865

Samsudin, A., Indonesia, U. P., Nugraha, M. G., & Indonesia, U. P. (2019). An investigation of students ’ conceptual understanding levels on fluid dynamics using four-tier test An investigation of students ’ conceptual understanding levels on fluid dynamics using four-tier test. November. https://doi.org/10.1088/1742-6596/1280/5/052037

Sandoval, M. T. R., Oviedo, G. M. B., & Rodriguez-Torres, M. I. (2022). From preconceptions to concept: The basis of a didactic model designed to promote the development of critical thinking. International Journal of Educational Research Open, 3, 100207.

Somroob, S., & Wattanakasiwich, P. (2017). Investigating student understanding of simple harmonic motion. Journal of Physics: Conference Series, 901(1). https://doi.org/10.1088/1742-6596/901/1/012123

Sumintono, B. (2018). Rasch Model Measurements as Tools in Assesment for Learning. October 2017. https://doi.org/10.2991/icei-17.2018.11

Suryana, T. G. S., Setyadin, A. H., Samsudin, A., & Kaniawati, I. (2020). Assessing Multidimensional Energy Literacy of High School Students: An Analysis of Rasch Model. Journal of Physics: Conference Series, 1467(1). https://doi.org/10.1088/1742-6596/1467/1/012034

Treagust, D. F. (1988). Development and use of diagnostic tests to evaluate students’ misconceptions in science. International Journal of Science Education. https://doi.org/10.1080/0950069880100204

Tumanggor, A. M. R., Supahar, S., Ringo, E. S., & Harliadi, M. D. (2020). Detecting Students’ Misconception in Simple Harmonic Motion Concepts Using Four-Tier Diagnostic Test Instruments. Jurnal Ilmiah Pendidikan Fisika Al-Biruni, 9(1). https://doi.org/10.24042/jipfalbiruni.v9i1.4571

Varela, B., Sesto, V., & García-Rodeja, I. (2020). An Investigation of Secondary Students’ Mental Models of Climate Change and the Greenhouse Effect. Research in Science Education, 50(2). https://doi.org/10.1007/s11165-018-9703-1




DOI: https://doi.org/10.17509/wapfi.v9i2.76603

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 WaPFi (Wahana Pendidikan Fisika)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

The Journal Wahana Pendidikan Fisika http://ejournal.upi.edu/index.php/WapFi/ is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License

The Journal WaPFi (Wahana Pendidikan Fisika).

All rights reserverd. pISSN 2338-1027 eISSN 2685-4414

Copyright © Faculty of Mathematics and Science Education (FPMIPA) Universitas Pendidikan Indonesia (UPI)