Robust statistical techniques for educational evaluation in university technical studies: median and wilcoxon-mann-whitney (WMW) test

Authors

  • Raúl Montes-Pajuelo University of Huelva
  • Ángel Mariano Rodríguez-Pérez University of Huelva
  • Julio José Caparros-Mancera University of Huelva
  • Cesar Antonio Rodríguez-González University of Huelva

DOI:

https://doi.org/10.20868/abe.2024.2.5273

Keywords:

Técnicas estadísticas sólidas, metodologías didácticas activas, aprendizaje basado en problemas, aprendizaje basado en proyectos, Robust statistical techniques, active didactic methodologies, problem-based learning, project-based learning

Abstract

Problem Based Learning (PBL) is a teaching method that is increasingly being used in technical education. In both engineering and architecture education, PBL has been evaluated and shown to be effective in improving students' academic performance. The need to work in groups and the limitation of the number of students per PBL session require the use of robust statistical techniques in the corresponding statistical evaluation. In the present work, two robust statistical tests were applied: the median test and the Wilcoxon-Mann-Whitney (WMW) test. Using a sample of 35 students of the Master in Industrial Engineering at the University of Huelva, distributed over three academic years (2021-22, 2022-23 and 2023-24), the said tests were applied in relation to academic performance. There was an experimental group (19 students) and a control group (16 students). The details of the application of each test have been clarified, including the null and alternative hypotheses, the respective statistics of each test, and the case has been solved using R. It is shown that there is a significant difference in learning between the experimental group and the control group, based on median and Wilcoxon-Mann-Whitney (WMW) tests.

Downloads

Download data is not yet available.

References

Liu, Y., & Pásztor, A. (2022). Effects of problem-based learning instructional intervention on critical thinking in higher education: A meta-analysis. Thinking Skills and Creativity, 45, 101069. https://doi.org/10.1016/j.tsc.2022.101069

Rodríguez González, C. A., Rodríguez-Pérez, Á. M., Caparrós Mancera, J. J., & Hernández Torres, J. A. (2022). Didactic methodologies in technical education. Didactic methodologies in technical education, 349-357. https://dialnet.unirioja.es/servlet/articulo?codigo=8947390

García Llamas, J.L. (2003). Métodos de Investigación en Educación. Investigación cualitativa y evaluativa. Madrid: UNED.

Rodríguez, C. A., & Fernández-Batanero, J. M. (2017). Evaluación del aprendizaje basado en problemas en estudiantes universitarios de construcciones agrarias. Formación universitaria, 61-70. http://dx.doi.org/10.4067/S0718-50062017000100007

Johnson, M. y Hayes, M. J. (2016). A comparison of problem-based and didactic learning pedagogies on an electronics engineering course. International Journal of Electrical Engineering Education, 53(1), 3-22. https://doi.org/10.1177/0020720915592012

Trullàs, J. C., Blay, C., Sarri, E., & Pujol, R. (2022). Effectiveness of problem-based learning methodology in undergraduate medical education: a scoping review. BMC medical education, 22(1), 104. https://doi.org/10.1186/s12909-022-03154-8

García Pérez, A. (2005). Métodos Avanzados de Estadística Aplicada. Métodos Robustos y de Remuestreo. Editorial UNED.

García Llamas, J.L.; Pérez Juste, R. y Río Sadornil, D.del (2006). Problemas y diseños de investigación resueltos (3ª edición revisada y ampliada). Madrid: Dykinson.

Rodríguez, C. A., & Fernández Batanero, J. M. (2017). Aplicación de un aprendizaje basado en problemas en estudiantes universitarios de ingeniería del riego. Journal of Science Education, 18 (2), 90-96. http://hdl.handle.net/11441/61667

Pavlov, G., Shi, D., & Maydeu-Olivares, A. Chi-square difference tests for comparing nested models: An evaluation with non-normal data. Structural Equation Modeling: A Multidisciplinary Journal, 27(6), (2020) 908-917. https://doi.org/10.1080/10705511.2020.1717957

de Winter, J. F., & Dodou, D. Five-point likert items: t test versus Mann-Whitney-Wilcoxon (Addendum added October 2012). Practical Assessment, Research, and Evaluation, (2019) 15(1), 11. https://doi.org/10.7275/bj1p-ts64

Oliphant, H. (1928). A return to stare decisis. ABAJ, 14, 71. Available in: https://heinonline.org/HOL/Page?handle=hein.journals/abaj14&div=24&g_sent=1&casa_token=&collection=journals. Accessed: 24-04-2024

Gluck, Abbe R. (2013). The Federal Common Law of Statutory Interpretation: Erie for the Age of Statutes. Faculty Scholarship Series. Paper 4700. Available in: http://digitalcommons.law.yale.edu/fss_papers/4700. Accessed: 24-04-2024.

Barrows, H. S., (1971). Simulated patients (programmed patients); the development and use of a new technique in medical education, Springfield, Ill.: Thomas.

Barrows, H. S. (1985). How to design a problem-based curriculum for the preclinical years, New York: Springer Publishing Company.

Barrows, H. S. (1986). A taxonomy of problem‐based learning methods. Medical education, 20(6), 481-486. https://doi.org/10.1111/j.1365-2923.1986.tb01386.x

Barrows, H. S. (1996). Problem‐based learning in medicine and beyond: A brief overview. New directions for teaching and learning, 1996(68), 3-12. https://doi.org/10.1002/tl.37219966804

Barrows, H. S. y Pickell, G. C. (1991). Developing clinical problem-solving skills: a guide to more effective diagnosis and treatment (1st ed.). New York: W.W. Norton.

Barrows, H. S. y Tamblyn, R. M. (1980). Problem-based learning: an approach to medical education, New York: Springer Publishing Company.

Barrows, H. S., Peters, M. J., Josiah Macy Jr. Foundation y Southern Illinois University School of Medicine. (1984). How to begin reforming the medical curriculum: an invitational conference. Springfield, III: The School.

Striegel, A., y Rover, D. T. (2002, November). Problem-based learning in an introductory computer engineering course. In Frontiers in Education, 2002. FIE 2002. 32nd Annual (Vol. 2, pp. F1G-7). IEEE. https://doi.org/10.1109/FIE.2002.1158138

Steinemann, A. (2003). Implementing sustainable development through problem-based learning: Pedagogy and practice. Journal of Professional Issues in Engineering Education and Practice, 129(4), 216-224. https://doi.org/10.1061/(ASCE)1052-3928(2003)129:4(216)

Vardi, I., y Ciccarelli, M. (2008). Overcoming problems in problem‐based learning: a trial of strategies in an undergraduate unit. Innovations in Education and Teaching International, 45(4), 345-354. https://doi.org/10.1080/14703290802377190

Regalado-Méndez, A., M.R.P. Cid-Rodríguez y J.G. Báez-González, (2010a). Problem Based Learning (PBL): Analysis of Continuous Stirred Tank Chemical Reactors with a Process Control Approach, International Journal of Software Engineering & Applications (IJSEA): 1(4), 54-73. https://doi.org/10.5121/ijsea.2010.1404

Regalado-Méndez, A. et al. (2010b). Problem Based Learning: Obtaining Enzyme Kinetics Parameters Integrating Linear Algebra, Computer Programming and Biochemistry Curriculum, Technological Developments in Networking, Education and Automation, pp 13-18, Springer Netherlands. https://doi.org/10.1007/978-90-481-9151-2_3

Sahin, M. (2010). Effects of problem-based learning on university students’ epistemological beliefs about physics and physics learning and conceptual understanding of Newtonian mechanics. Journal of Science Education and Technology, 19(3), 266-275. https://doi.org/10.1007/s10956-009-9198-7

Yadav, A., Subedi, D., Lundeberg, M. A. y Bunting, C. F. (2011). Problem-based learning: Influence on students' learning in an electrical engineering course. Journal of EngineeringEducation, 100(2), 253. https://doi.org/10.1002/j.2168-9830.2011.tb00013.x

Woods, D. R. (2012). PBL: An Evaluation of the Effectiveness of Authentic Problem-Based Learning (aPBL), Chemical Engineering Education: 46(2), 135-144. Available in: https://journals.flvc.org/cee/article/view/122113 . Accesed: 24-04-2024

Vega, F., E. Portillo, M. Cano y Navarrete, B. (2014). Experiencias de aprendizaje en ingeniería química: diseño, montaje y puesta en marcha de una unidad de destilación a escala laboratorio mediante el aprendizaje basado en problemas, Formación Universitaria, 7(1), 13-22. http://dx.doi.org/10.4067/S0718-50062014000100003

Rodríguez González, C. A. (2017). Aplicación de un aprendizaje basado en problemas en estudiantes universitarios de ingeniería del riego y de la construcción. Tesis doctoral. Universidad de Sevilla. https://dialnet.unirioja.es/servlet/tesis?codigo=115646

R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2023. Available in: https://www.R-project.org

Smida, Z., Cucala, L., Gannoun, A., & Durif, G. (2022). A median test for functional data. Journal of Nonparametric Statistics, 34(2), 520–553. https://doi.org/10.1080/10485252.2022.2064997

Kishore, K., & Jaswal, V. (2022). Statistics Corner: Wilcoxon-Mann-Whitney Test. Journal of Postgraduate Medicine, Education and Research, 56(4), 199-201. Available in: https://web.archive.org/web/20230104015618id_/https://www.jpmer.com/doi/pdf/10.5005/jp-journals-10028-1613

Downloads

Published

2024-08-31

How to Cite

Montes-Pajuelo, R., Rodríguez-Pérez, Ángel M., Caparros-Mancera, J. J., & Rodríguez-González, C. A. (2024). Robust statistical techniques for educational evaluation in university technical studies: median and wilcoxon-mann-whitney (WMW) test. Advances in Building Education Innovación Educativa En Edificación, 8(2), 42-51. https://doi.org/10.20868/abe.2024.2.5273

Most read articles by the same author(s)